I actually kind of got this to work by messing around with MIDI Settings (MIDI Control, Local Control, ...) but in the end what one want is to separate IN and OUT channels.
It is a bit disappointing that it is not possible on such a premium device, it really should be simple enough in software. Perhaps it could be made in an update. Is there a feature request page somewhere perhaps?