There shouldn't be any issues. I have personally used uppers of all the major manufacturers on my Bushy lowers without incident.
The only "odd" one of the bunch is Colt with their large pivot hole. Still, no big thing. There are companies that make offset pins that will mate a small hole lower with a Colt upper.