Bands who have great singles and who you generally like, but can't sit through whole albums by because the best songs are so many light years ahead of the filler.

For me:

The Cure
David Bowie
The Stranglers
The Cramps

On the other hand, bands you have to own every single thing by and don't seem to ever produce something that isn't worth listening to:

Tom Waits
Bjork
Final Fantasy
Portishead