MPC Beats Plugin Latency in Logic + PT

Hi - my issue is latency when using the MPC plugin in Logic sessions (and PT when I still used it). Wanting to see if anyone has any ideas for a solution or a better way to route my MPC into Logic not using the MPC plugin. Not adverse to running audio & midi info out of the MPC and into my UAD Apollo, just hoping there might be a better way that doesn't take up physical inputs.

- I use MPC plugin (MPC Live 2 as controller) in Logic sessions for drums only mostly. No latency when I've just got 1-2 software instrument tracks in a session + the MPC midi software track.
- I use Arturia V collection 11 software instruments (these are probably too DPS heavy), and as soon I as have a few of these software instrument tracks in a session, plus maybe a VOX track, the MPC controller latency is nuts.
- Buffer settings for Logic are either 64 - 128 to try and help with MPC controller latency. But doesn't really do much. Can't seem to change any buffer settings in the MPC Beats plugin.
- Both Logic & MPC softwares are up to date.
- Running through a 2018 Mac mini / 64GB memory.

Thanks GG

It's a mfer to set up, but I use Jack Audio for all my audio routing. 32 outs from the desktop software into my song template in Reaper. You can also route your ins & outs multiple places at once. For instance, my guitar input on my interface goes both into audio tracks in MPC, or to a guitar track in Reaper, just arm the track. It works with any DAW. It adds no discernible latency at all and is lossless.