I think most of the frustration comes from the fact that TT doesn't fill defensive positions of need that he and the organization have proven to be completely inept at evaluating, drafting, and developing.
The problem with this team is, and always will be, defense. Signing some competent defenders that would fill holes would go a long way toward getting us to another SB, but Ted simply won't admit that he hasn't a clue how to build a defense.