I kinda agree with you. The way I get around this is by playing with at least one or two of my friends (I personally know). This means less room for "annoying" people on your team and a higher chance you'll be paired with another group of friends also looking for a decent match. Most of my friends have higher elo, and I feel that higher elo normals have less "awful/trolls in the game. I find playing against higher skilled people, who are also in groups with their friends, a great practice for ranked matches.