Crossfader assignment may not be set the way you want the crossfader to work.
In the general setting, channels [1] and [3] should be set to the left side of the crossfader, and channels [2] and [4] should be set to the right.
*Crossfader assign sets the channel output to either the left or right side of the crossfader. If you don't want to use the crossfader, you can change the setting to disable it.
For details, refer to [Mixer panel] in the rekordbox Instruction Manual.
You can read the rekordbox Instruction Manual [here].