The "Late Show" host won't let the billionaire wiggle out of this one.