Agnostic is one who believes the question of a god's existence is unsettled.
Maybe, maybe not.
Atheist position is that there is no God and is an advocate for that position....... which makes him a member of a religious sect.
So in your mind you "believe" that if someone doesn't believe in your religion or any other religion that makes them religious. I don't see any logic in that thinking.
