Okay, sorry, I misunderstood. Unfortunately, I'm a little sketchy when it comes to Ableton and MIDI. I haven't used MIDI much since I started using Ableton. And Ableton doesn't have a detailed MIDI event editor, so it would be hard to see what, exactly, is going on.
I'd start by disabling NRPM messages on the X4, and play back the track again, as NRPM is pretty much the only way to modify the X4's patch via MIDI with Ableton (AFAIK, Ableton actively filters away sysex messages).