I was lucky when I went through university. Not one of my classes was taught by a T.A, nobody would stand for it due to how much we were paying for tuition. I've heard it is a rampant practice in state colleges and the #1 complaint seems to be problems understanding the T.As. As a parent, I'd be pissed at spending that much money and having my kid tell me they can't get anything out of the class because of it.
I paid for school myself and I'd change schools before I let my education suffer because of the use of T.As and not full professors, or because I couldn't understand a damn thing I was being 'taught' in the lectures. That's just me, but I don't like to piss my money away.
If the professor is tenured, trying to get anything done about it is pretty much a waste of time, but those that aren't usually don't want to rock the boat too much with lots of complaints against them, so hopefully he is the latter and not the former.
Hopefully, you got your problem resolved.