Definition of "Impulsively" :

adverb: in an impulsive or impetuous way; without taking cautions

"He often acts impulsively and later regrets it."