I agree with OP. As an example of how difficulty options can remove enjoyment from a game, I find it pretty common for people to say that they found the Halo series to be average or mediocre after playing through on Normal... and I would agree with that, because that isn't playing the game as it was intended (Heroic). Playing on normal doesn't force you to strategize, choose and use weapons tactically, understand the mechanics of weapon types, shields vs armor, etc. which makes for a more shallow experience. The same would apply to From's games, even moreso.