Dan, I wish i'd read this before starting
we tried doing it without removing too awful much
We finally just did as you did to get it out and the replacement back in.
Had to replace the UCA bushings anyway so we pulled it too.
Now I have idler arm bushing to get and replace.