Before going to buy splitters and trying to fix it through direct audio output jack's, I'm asking this here I want the TV to continue having sound while I have my headphones on and plugged into the controller.
I believe you can set your controller to "All audio" and then change your audio output in the system settings to Digital. Obviously, you would have to wire the audio seperate from the HDMI. I believe that would work without using a splitter. Haven't tried it, but it's work a shot if you have old school audio connector cable.