Are all atheists also naturalists?

Here is what I think: people usually self-categorize without enough self-understanding and knowledge. For example, who create the terms "gay" & "lesbian", those labeled have not for sure but somehow they pick 'em up on the go. I used to call myself an atheist but no, never again because I don't want to limit my own potential and understanding.