Dan, I wish i'd read this before starting

we tried doing it without removing too awful much

We finally just did as you did to get it out and the replacement back in.
Had to replace the UCA bushings anyway so we pulled it too.
Now I have idler arm bushing to get and replace.