Refs have been getting jabbed by fans, players, coaches, etc since the first ref got his whistle...Bad calls happen but with very very few exceptions, the outcome of games are not impacted by those calls. The vast majority of calls are correct. If they weren't EVERYONE would know it.
It's part of the game and always will be. When I listen to the back and forth on this I think about the little league baseball, soccer or basketball games where some parents are so loud, vocal and obnoxious to the point that the game is ruined for the coaches and the kids.
I coached kids basketball and some soccer and I can tell you first hand that I gave it up because I got sick and tired of trying to keep parents from ruining the experience for the kids and their coaches. The only difference at this level is that the "parents" are supposedly mature adults who've outgrown this behavior.