How to select a specific color in Photoshop CS2?

I'm trying to reduce colors from million to 7 exact colors. It's a fabric design, so I want to separate greens from the other colors. However, when I want to pick greens, other different colored pixels that belong to motifs are getting included in the selection area.