We have to hand it to Atari for keeping it simple but functional early on. A lot of competing consoles around now tried to get crazy with controllers, adding things like number pads and spinning dials ...
Even with a mouse and keyboard, your PC gaming setup isn't complete until you've got a controller. Sure, there are plenty of games that can be played using a mouse (usually first-person shooters) but ...