If you're going to swap slides and other parts, why not just buy a regular P320 Carry or just the fire control unit?
I bought a P329 Pro Carry with red dot and tall sights, I swapped in a small grip module and really like it.
Not sure I'd spend that kind of money to replace the slide.