Definition of "Regretfully" :

adverb: with regret (used in polite formulas)

"I must regretfully decline your kind invitation."