Schmellba99,
That's not quite the case (so to speak.) Eyeball
this article, and even though it's not on topic for pistol shooting, it does show how different brass alloys can be from different makers. Not only can brass have different alloys, it can have different work hardening due to how often it has been reloaded. Both of these are factors in bullet pull, which affects start pressure which affects ignition time and velocity consistency and accuracy.
Some years ago, competitors at the National Matches observed that military match pistol ammo shot a little better than its commercial counterparts. This was tracked down to the pitch seal in the military cartridge increasing start pressure for more uniform ignition and muzzle velocity than commercial cartridges exhibited. Obviously, sorting by brand and by load history is not going to get you something the commercial match loads didn't already have, but not doing so can get you something less.
But most people aren't shooting conventional pistol matches these days. So, whether you get anything from doing it or not just depends what it is you are doing with the ammo and how.
All group size precision, whether in rifle or pistol, is part of a complex system, all the elements of which interact with one another. The late Michael Creighton pointed out that complex systems are not easily predictable. His example was the stock market. If someone claims they know what a stock is going to do three days from now, you are immediately aware that he is either a crook or a charlatan. Creighton's point was the same applies to how the environment, another complex system, will react to something we do to it, but for some reason we haven't learned to recognize those who claim to be able to say what it will do in the same light as we do stock market predictors. I'll add that same warning to elements of reloading, as interior ballistics is another complex system. We've all had our own personal experiences with it, but here's the bottom line: if you want an objective assessment of whether a particular reloading step matters to you or not, you have to test it in your own equipment to see what difference, if any, you can see it making.
Here's the reason the answer is not universal: each source of error adds some amount of random distribution or spread to the overall distribution of bullet holes on a target. They don't add linearly. That is, if you have a source of error that produces an average of a 1" group spread and another that produces an average of 2" group spread and put them together so the shooting system has both sources of error at once, you don't get a 3" group. You get just under a 2¼" average group size. This is because independent sources of error rarely both have their two worst case oppositely influenced shots (the two that wind up defining the group size) on the same two shots, and when they do, it's rarely the case that they just happen to have the same directions of influence away from the center for each of the two bullets. And those two coincidences are what it would take to get a 3" group result in my example. On average, they randomly assert their most extreme influence on randomly different shots in the string and in randomly different directions away from the group center.
In statistics you solve for the final group average by combining the standard deviations of the two, and standard deviations combine as the square root of the sum of their squares. In my example I gave a 1" average group error and a 2" average group error. So they will combine as:
Combined Average Group = √(1²+2²) = √5 = 2.24
Here's the thing: If you have a 2" source of random group error, then introduce the 1" source of error, you might not notice it made any difference, as a quarter inch one way or the other is well within normal group variance for pistol shooting. You might have to fire and measure twenty groups before you were certain you had accomplished anything at all (though there is a statistical test called a T test that will let you tell sooner). But if you have only the 1" source of error and introduced the 2" source of error on top of it, you'd notice right away, as the average group would slightly more than double.
The same thing works in reverse. If you have 2¼" groups and you do something that remedies the 1" source of error, you would have a hard time telling that you'd done anything to better your situation, even though your average score on targets would go up a little, scratching the next higher scoring ring a little more often. But if you removed the 2" source of error, you'd know right away, as group size would drop by just over half.
What happens to your 2¼" groups if you remove a ¼" source of error? Well you have:
Corrected Average Group = √5²-¼² = 2.22"
Not much, going from 2.24" to 2.22". Now you really have to shoot a lot to tell if you made any improvement. But if you had a gun shooting ¼" groups to start with, you'd instantly notice you had turned it into a one-holer. So, whether or not you see the effect of something you do to improve group size clearly depends on the cumulative effect of all the other error sources in your shooting system. In general, the more accurate the shooting system is to start with, the more easily you see the effect of an improvement.
So, this is going to come down to how accurate you and the system are. You can painstakingly go through all sorts of group shooting and measuring and statistical analysis after each attempted improvement to see if you've achieved a visible group reduction, as many people do. Or, you can do what I do, and take just one set of cases and sort them and treat them like a benchrest shooter would, load up maybe 25 to 50 and shoot just one big group. Then repeat with ammo loaded without all the special effort. If you see a clear difference between the performance of the two ammo sets, some thing or things you did with the careful loading mattered and it's probably worth taking time to find out which ones it was. If you don't see a clear difference, then other factors, like your gun, your sights, or yourself are dominating the group size, and the difference made by your careful loading work is not going to bear fruit until you address these other factors.