My thoughts on this, although in my eyes we should defer to whatever rules and structure the kind N&Ger(s) doing the heavy lifting of compilation prefers.
(1) Submittals should be blind. Anyone choosing to participate should submit their list to whoever’s compiling the results before posting it publicly. Otherwise too much groupthink and confirmation bias will be introduced. Groupthink is a tyranny of boredom. No edits. I know this process would make the poll more logistically challenging but still putting it out there.
(2) We should submit unapologetic, idiosyncratic, arbitrary, passionate, personally-biased lists of favorites, not “best of” or “greatest” lists. Seriously, who needs another “greatest” list? Not me. Zzzzzz. We’re not the Library of Congress, we’re a dang vinyl/music board. Let the freak flags fly loud and proud.
(3) Everyone submits the same number of titles, whatever that number may be. I would prefer 100. I think once we start writing them out, 50 will fill up very quickly. If someone can’t make a full list, they probably shouldn’t be participating.
(4) Consider making the final compiled list 100, not 500. Five hundred sounds utterly overwhelming and I’m not even sure we’d have enough contributors to make a list of 500 meaningful. And I may be in the minority but I get no enjoyment slogging through Top 500 lists.