So - after a day with the Tom Oberheim SEM (MIDI-to-CV version, `NEWSEM9` PCB), I absolutely love the sound, but am convinced that one must embrace the rather limited modulation routings (even with all of the patch points on the MIDIed unit exposed*) as a necessary creative feature.
For those that are used to the wealth of Prophet '08 / Mopho / Tetra modulation routings, it may be a bit of a shock; in my own setup, I specifically chose a standalone SEM so that I might focus on its constraints. The DSI Pro-2 makes an excellent modulation source / controller for this, with a much wider variety of source / destination / multiplier options than the TVS Pro....
Also - in the case of the MIDI-to-CV variant - as with the TVS Pro, the MIDI controller-instantiated modulation options are sparse, though I have not heard any zipper-noise or stair-stepped artifacts when using the mod wheel, for example, as a pitch adjustment via EXTMOD.
After all of this, I might be inclined to go for the OB-6 desktop before I'd jump into the TVS Pro, though nothing beats stereo SEMs!
* - the `NEWSEM9` PCB is also used in the later SEM Pro and TVS Pro, providing a 30-pin breakout for the patch panel; in addition, there exists a pair of auxiliary VCAs which (I believe) is used for the panning control on the TVS Pro (not used or exposed on the SEM Pro or SEM Patch-Panel variants).
With a suitable breakout (and a clever way to route it), it might definitely be possible to LFO-modulate the output panning....