Heatpumps are great.
Have one at home and my bill is tiny compared to how cozy my place is (warm in winter, cool in summer).
Though remember, insulation is key.
Insulation should always be the key regardless of what method you use to warm or cool a place - I also have a heat pump on old 100 year old house works great