Is there a good part and a bad part of Harlem? ?

All I know is what I see on TV. And in the movies it all looks bad, but the other day when I was watching Man V. Food he went to Sylvia's in what looks like a nice part of Harlem. Have I just been brainwashed by TV. I'm from Oregon, so I have never even been near New York recently.