I pull the extractor every time I clean it but then again, that's the way the Marines taught us to do it years ago. I've talked to army vets of the more recent pepsi generation and they are saying that their modern doctrine is to not take it out since they kept on loosing small parts like springs and pins. YMMV.
As far as ejectors, I seldom ever take them out for cleaning unless it's having problems. Now when I was a GS employee at Camp Guernsey, Wyoming as a ground combat skills instructor, we used old GUU's and when it came to playing OPFOR, I would go through a case of blanks during the FTX our students would go through. Hey, I considered a level of success during the summer months by how many cook-offs I had in an iteration!
With that kind of abuse and with how filthy blanks are, part of my job being the CATM guy was to pull ejectors and clean them out when they started sticking. However, doing the old trick of putting a puddle of CLP on the bolt back and depressing the ejector with an expended case several times kept the fouling soft enough to keep working a while longer. I still do the same thing with my personal ARs and haven't had a need to pull and clean an ejector.