They can decide a game, and they can produce monumentally bad decisions. Duke wasn't happy with a 7-2 imbalance in calls in the first half. UW wasn't happy with the objectively wrong calls and 10-2 imbalance in the second half.
Its not rigged. You have to overcome it. Refs are like rebounds, they don't just fall into the team's lap by chance, evenly split. You have to work hard to make it break even.
You need to shoot well from 3. You need to touch the post. You need to shoot from the wide open wings (Gasser and Hayes). And you need to defend quick guards on ball screens better.