Practically: no. Most of us with more than one AR have built at least one from parts.
Technically: Yes. If you remove the barrel and do not put it back on properly, you can have headspace issues.
You may have a hard time getting things back together; but eventually you'll get it and it'll be easy next time.
