There is generally a lot more powder in a rifle cartridge, and it is generally in the form of sticks or small balls so you hear the impacts more easily. Pistol powder is generally flakes and there is much less powder used, so there isn't so much mass rattling around in the brass, but if you listen hard you may hear it.
Jimro