Don't get us wrong talking at gigs is fine, gigs are a social activity and to stand there in complete silence would be a little odd...during a quiet song talking about what you saw on tv last night is not fine.
It's rude to the band to chat through the entire gig. If you're not interested in the band then don't go. If you're loud enough to have someone turn around and actually shush you then for God's sake keep it down!! People are there to listen to the band not your inane ramblings. If you find it hard to stand there and watch a band without talking throughout then maybe you should go outside, get it out of your system then come back in.