It's because the barrel and sights are fixed in place. With most semi-autos, the barrel and sights move with each shot. In order to make them lock back into place tightly and precisely enough to approach the consistency of a revolver, the gun would have to be fitted to such tight tolerances that reliability would be adversely affected. In most cases, the variance in lockup of the barrel and slide is more than enough to offset the tighter tolerances of the chamber.
Now, some semi-autos are better in these respects than others. A gun with a fixed barrel such as a Makarov, Walther PP, CZ-83 or the like can give surprisingly good accuracy because you've taken one variable, the movement of the barrel, out of the equation. Also, semi-autos with both barrels and slides fixed in place, such as a Ruger Mk. III, are capable of fantastic accuracy and it is not uncommon for them to outshoot even top-quality revolvers.
The problem, however, is that having a fixed barrel and/or sights in a semi-auto requires either a much more complex design or a blowback operation which limits the power of the cartridge. While blowbacks in larger calibers have been made, the Hi-Point pistols and the Astra 400 come to mind, they all require either an overly large and heavy slide or an excessively heavy recoil spring. The best and most practical way to make a semi-auto in a service-class or above caliber is to have some sort of locked breech and the most effective and practical way to do that is with a reciprocating slide and moving barrel of some sort. Additionally, for the purposes that a semi-auto is commonly used, their accuracy is typically considered to be good enough and thus few manufacturers see the need to go to the time, complexity, and expense of attempting to create a design that is significantly more accurate. Simply put, a 3 inch group at 25 yards is more than accurate enough for a Military, Police, or self-defense handgun.
The design of a revolver, however, keeps the cylinder locked in place until the user manually unlocks it by pulling the trigger, cocking the hammer, or actuating the cylinder release latch. Because of this, there is very little, if any change needed to the basic design to scale a very small .22 Rimfire revolver up to shoot the largest Magnum cartridge.