That still doesn't get rid of the popularity contest aspect. You are making an assumption that humans can make perfectly rational decisions most of the time, much less all of the time. The unfortunate reality is that we all influenced by non rational factors as a result of how our brains evolved
Yes, you can't escape that unless you use some AI agent. I don't say I have solution for that.
Once again, using it to "rate coders" is just one of use cases, but I'll stick to it for the sake of this argument.
So you need a DBA. There's one here that could work for you. You can check data online about him, but you don't know who wrote it. You ask your friends around. Some guy you barely knows says he's a fraud. One of your friends says he worked with him and he's good. You're best friend doesn't know him, but his friend, who he trusts, says he's great.
This is how you build your opinion about people (I'm aware it's a simplification but it's not relevant here). The mechanics doesn't change. Just the technology. But it's a leap as big as switching from snail mail to e-mail.
How much you trust some information depends on where it comes from. But it doesn't always come directly from the trusted source. So you use your trusted sources to learn about this information source.
You also learn to lessen your trust in sources that turned out to lead you to some bad information. It's not always easy to keep it all in your head. Business people learn to master that skill because that's the algorithm that works for acquiring trustworthy information and information is money. However not everybody's live revolves about building network of great contacts and staying in touch with them polling for some useful data.
reply