But don't know where to look?
It's a serious problem -- many artists have careers so long and mystifying that you can't simply pick up any album and start there, because chances are usually as good that you'll get a shitty one as much as you'll get a good one. To make sure you know where to start and are no longer sneered at by the hipsters at the coffee shop who can't believe you've never heard this album before, there's Discographies, helpfully breaking down a band's output into 140 characters or less.
Here's a good sampling of some of their work:
Bob Dylan: 1 Woody; 2, 3 ambition; 4 pot; 5-7 speed; 8-9 pot; 10-11 AJ Weberman; 12-16 booze; 17-19 Jesus; 20-27 pot; 28 death; 29-32 pot.
The Beatles: 1st-4th) recorded in black & white; 5th-8th) the drugs kick in; 9th/10th/12th) entropy; 11th) invents ELO & Oasis by accident.