I wouldn't fight the older growths and focus on securing your plans so that it can establish roots in your choice of media/pot. Whenever your plant loosens and falls out, you might damage the roots that help maintain a healthy plant.
Whenever I pot up a rowdy plant, I stake each psuedobulb and tie it with a twist tie. You can try "correcting" the growth orientations but I generally stake it the way it keeps the plant most stable in the pot. You can use a rhizome clip too. It's not aesthetically pleasing but you really want the plant to root well and establish itself in the pot.
Orchids can be top heavy, and you can prevent it from toppling over by plopping the entire orchid+pot into a larger terracotta pot. Hanging your plant can accomplish the same thing.
I'd recommend:
1: secure the plant so it doesn't move in a pot. Let the roots establish.
2: secure the entire plant in a heavier pot or hang it so it doesn't topple over.
Some of what I've done:
This one was so top heavy, I had to triple pot it...
sometimes hanging is the way to go... a crochet pot hanger is nice if you have a really rowdy plant. It swings around in the wind every which way.
and sometimes it just does whatever it wants no matter how you pot it / stake it... This one was growing at a really weird angle and I decided to pot it horizontally... I like tightly potting things up with large bark. Shoving a piece one by one until the plant is secure. I think most people would consider that overkill... but it works for me