If you leave the pot intact, you will also be leaving behind a fair amount of old potting medium. It will decompose, compress and cause the roots in the pot to die and rot.
In my opinion, if you extract the pot from the root mass and take the old medium away as well, the plant will be in much better shape to move on.