In my experience, MilSurp brass is far superior to commercial brass. Swaging the primer pocket is a small price to pay for the highest quality brass available.
BTW, A couple of years ago, I used my Dillon Swager to swage out the pockets on 5,000 rounds of WCC 9MM in one day. It was a PITA, but well worth it!