Its not the hot or the cold that really matters (to an extent obviously, extreme heat melts, extreme cold makes even metal brittle), its a large rapid change thats really bad. I doubt you will get those kinds of temperatures if you drill properly with cooling even if its a little chilly outside.
Drilling dry till its good and hot then throwing ice water on it would probably be pretty spectacular though...