Swimmer was the switch for me. I have a good friend who's been encouraging me to give them more time for years, but it never clicked. After Swimmer clicked, the whole discography did (but Swimmer especially).
Ha I went through this same thought process when I was listening to their last album and realizing that it was gonna end up making it on my top 25. That damn Urban Outfitters boat trip just really wasn't a great way for them to make a first impression with me