i've used more hosts than i can remember anymore, and they've all felt remarkably similar. most hosting providers now generally have the same bare minimum toolset (cough except neocities cough, which is it's own beast) the biggest distinction i've noticed is definitely support - some places i've used were super dead, had a bunch of broken or outdated links on their website, and super slow response times. for me, that's the biggest consideration after cost/storage/bandwidth.
i actually used the same host for 10 years until recently, lol. there was a moment in the early 2010s where hosting was insanely cheap, and i found a plan that was $10/year for 2GB storage and unlimited bandwidth (the same place costs $9/mo for something equivalent now

unfortunately, that host has been pretty dead for awhile now, and i wanted something that would support some more advanced projects i'm planning, so i switched to scalahosting a few months ago (after a lot of research) the cost kind of makes me want to cry, but they've been really fantastic so far. i can also host my boyfriend's domain now, which helps justify the cost a bit lol.
i do use neocities for one website, and i really love their social functionality! it's such a perfect bridge between modern social media standards & freeform web design projects, i wish i could use them just for that. the fact that they don't support ftp or .htaccess drives me a little crazy