Some areas of the country get quite warm in the summer. I live about 50 miles from Death Valley, so wearing a sport jacket to hide a full size weapon would defiantly make me stand out from the crowd, (I would be the one covered in sweat).
Most SD gun battles usually end in less than 6 shots. Sure there are exceptions, but then do you really want to wear a bandolier to work?