Crossfader Assign may not be set the way you want the crossfader to work.
Select a setting other than THRU with the CROSSFADER ASSIGN selector.
For details, see the Instruction Manual > [Audio output] > [Channel section/master section].
You can read the Instruction Manual [here].