Motorola Droid :: Contact List - Identifying Incoming Phone Calls

So I have something like 470 people in my Google Contacts under "All Contacts" and only about 60 under "My Contacts." I like it that way, because then my Droid contact list isn't full to the brim with people whose numbers I really don't need at the touch of my fingertips. That being said, however, it would be very cool if somehow the "All Contacts" section of my Google Contacts could be used to identify incoming phone calls.

For instance:
I want my Brother's phone number in My Contacts so I can call him.
I don't want my ex girlfriend's Stacey's number in My Contacts because I don't need to call her.
I still have my ex-girlfiend's contact info under "All Contacts" because there's no reason to delete it outright.
I would, however, like for my Droid's caller ID to tell me that the person calling me is "Stacey" instead of "unknown caller."

Am I asking too much? I know I could just add everyone to "My Contacts" and that would work, I just don't necessarily want 500 people in my Droid phone book. It's unnecessary. Or even apps that do this?