In some ways, yes. As another poster mentioned, shitty mechanics, absurd physics, and abysmal hit-detection made some of these games extremely frustrating. Why am I floating around? Why did I die from grazing a bird's wing? Why does game always slow down at this key moment, causing me to fall into a pit? How the fuck am I supposed to do this with three lives? When you discovered the patterns, learned to deal with the stupidity, or conditioned yourself to grind through multiple replays, some of the games became a lot easier, and were rather easy / short.
Some games, however, were just plain hard, no matter what. You have to figure that, back in the 80s, games were still somewhat novel. People would buy pretty much whatever came out. Developers didn't care if their games weren't accessible, too hard, or just plain fucked up. Someone would buy it, and some hardcore, obsessive gamer would probably play himself half-to-death to beat it. I think difficulty settings weren't necessarily thought of as a way to introduce easier play, but to give replay value for the masochists.
One thing that is certain is that old video games had awesome music. Games like Contra, Ninja Gaiden, Castlevania, and Gauntlet had some pretty cool music, especially considering the constraints of programming music with such limited capabilities.