Does Green Energy cost alot of money? But in the end, isn't it better than oil?

I had a conversation with someone who is against green energy. They told me that it costs way too much money to put solar in your homes for example. But in the long run isn't green cheaper? For example you go out and buy a house. Spend a good investment. The house comes with solar power. Wouldn't it save you money in the long run using this instead of paying for gas and heating bills?