Historically that's true, but in today's polarized society that's the exception not the rule. Especially if someone suggests that YOU 'worship' something. There's a pretty strong connotation that you're into something that isn't worth caring about :)
But of course he's free to clear that up...