Definition of "Extemporaneously" :

adverb: without prior preparation

"He spoke extemporaneously."