I just went through this process, currently have gas hot water tank. Decided to get two quotes, one to replace existing tank with another and one for a tankless uni.
The problem I have, I live in a 2nd floor condo, my mechanical "room" (more like a closet) is so tight reason wanting to switch to a tankless unit was to free up some space in this "closet". Dealing with condo association in itself is another matter to get approval due to the wall penetration for exhaust vent.
I went through a plumbing and heating contractor for quotes because I also wanted to update main water shut-off valve and washer connections to 1/4 turn shut-off valves as well.
Talking to plumber he mentioned in CT currently there are no rebates for the tankless unit, also required an electrician and a permit for this work as
@CL82 already stated above. The quotes ended up $2,000.00 to $4,500.00 ( without electrician and permit cost). In the end also concluded to just swap out old hot tank with new one and call it a day without dealing with the condo association, additional electrical work and permit that would have been required.
Note: above quotes only for the tank or tankless, no valves upgrading in the two quotes.
...but probably the biggest difference maker for me was in the event of power failures (and we have had in this area) you would not have any hot water...unlike with tank at least there is residual hot water in tank to take showers until power comes back on.