ISSUE - Mics Getting Quieter with More People on Chat

Been having an issue lately with mics. Actually, I've always had the problem, but it's been bugging me as to whether it is by design or a problem with the game.

Basically the more people you have with a mic on a channel the harder it is to hear them. In a group with three or four people the mics gets much quieter than if I was in a group with one other person.

In clan chat the issue is more noticeable. The more people on clan chat with a mic the volume of everyone talking will get lower.

I have the voice chat coming through my headset. The same thing happens if my voice chat comes through my TV, might be easier to hear if I turned my game sound off, but I don't really want to do that.