Hiring Managers criticizing you because of where you live (remote work)

A few years ago, my parents bought property in South Florida, and then my dad died during the pandemic so I moved here since I could work remotely. Been loving life here and tbh, outside of NYC and South Florida, I cannot even think of living anywhere else in the US.

My years spent in Raleigh, NC and Atlanta, GA were some of the most miserable years of my life for many reasons.

However, I notice that when I get on calls with hiring managers, some make a lot of back-handed comments about where I live and it annoys me. For example, here are some I have heard:

"Well, at some point you will have to grow up and end the life of nightclubs and partying so do consider relocation"

^ Company brings up at the last stage that I would need to move to NC for this role, it was a six-figure base but I said no.

"Why Miami though? It's can't just be for the nightclubs and sports cars huh?"

^ First interview with hiring manager, I said no on the interview

"I do wonder how seriously someone would take this role with all the distractions that come with Miami"

^ First interview with hiring manager

I am not going to move but I do find this behavior offputting, especially since tons of people who live in Miami do not party or go to nightclubs.

FWIW, the hiring managers saying this are always older men. I wonder if anyone else sees this as much of a red flag as I do.