Yes and no... That is the short answer... But it needs context to be useful.
An in spec forged lower is usually pretty comparable to any other in spec forged lower.
Now... There can and will be some differences, some minor some less. Your personal needs and goals for the rifle you want to build will come into play as to what matters and what doesn't. If all you want is a lower that is in spec and hold the parts together, then there is not any difference that matters. If you have further concerns, then they may matter more.
Some cheap lowers do not get anodized as well as other lowers, but that is more supposition based on finish durability reports I have read over the past few years. Things like, "I got a cheap Anderson lower, and it wears and scratches easier than my Colt"... Stuff like that.
Another difference is finish machining. Some take to time to smooth out the flash from the forging process... Basically what would look like a seem from the two sides of the forging die.
For example... My BCM is smooth, clean, and nicely finished, but my Colt had the flashing trimmed off a bit, but no effort to smooth the area and make a nice uniform surface. I trust the Colt to be tough and handle anything I would throw at it, but it isn't as nice aesthetically.
Similar lack of finishing steps can be in cheap lowers. Not all of the lower cost ones though... Aero tends to make a nicely finished lower.
Another difference is in the QC... The cheap lowers may not get very thorough QC, and something that is out of spec may slip through more often. Usually it's minor and primary cosmetic, but on occasion, you will get a lower with a dimensional issue. Then parts don't fit right, and the rifle won't work correctly. Higher end and higher cost lowers tend to have this issue very rarely, as they spend more time on QC.
I have heard several stories of Anderson lowers that were out of spec in some way. I have heard a few about PSA as well... Not heard any about Aero that I can recall.
With current pricing, I think Aero is the best bet for a lower at a good low price point. Followed by PSA, then Anderson is my last choice.
Beyond those, until you start getting into brands like Daniel Defense, you won't see much different than the name on the side.
If you want a certain name brand, then go with what you want.
Once you deviate from the standard forged lower receiver... Either by using an alloy other than 7075, or getting into milled receiver options... Or some of the crazy designs like the skull magwell lower...
Then all bets are off... There are too many differences and potential pros and cons to go over.
I go with standard forged myself... They work well, they have a low cost generally, and they have the best parts compatibility with aftermarket parts and upgrades.