Not necessarily - Dawkins' book The God Delusion has a whole chapter on Hitler and Stalin on the basis that its the most common criticism of atheism that he comes up against, ie the idea that the lack of a moral framework leads to monsters.
He makes two points, first that although Stalin was atheist its doubtful that Hitler was - he certainly had some belief system even if it wasn't 'pure' Christianity: in any case he thought he was accountable to some higher power.
His other argument is that while Stalin and Hitler were evil, what they did was not in the name of atheism but in a belief system (ie communism/Stalinism and fascism) that they were convinced was 'right' - much as previous religious leaders had done terrible things believing what they were doing was 'right' even if the means justifying the ends were messy. He points out that no wars have been fought in the name of atheism although as many as you like have been fought for religions.
Dawkins finishes with a nice quote from the Roman philosopher Seneca: 'religion is believed by common men to be true, by wise men to be false, and by rulers to be useful.'
Anyway, compared with what RC priests seem to have been up to, Goldman's sins appear almost saintly...