Well, you're just wrong because you aren't describing the current system.

Not rated texts will be placed below texts rated very low. And a text rated high by only one person will be rated lower than a text rated crap by hundreds of people.

A bad rating do lower the score for well rated texts, but adds score for the non-rated ones.