Look around you. No, really, look around you. There are arabs everywhere in this country and they like to eat. So no matter where you live there's a good possibility that you'll find an arabic store nearby.
If you're in San Francisco CA I can recommend Salama's Halal Meat Market.
It will have all the right spices, and very good fresh meat.
If you're from Ann Arbor MI then Jerusalem Market
is your safe bet.
A good way to find an arabic store is to do a keyword search using Google Maps
. Click on the find business tab and input your area code. For an example of how you can find an arabic store somewhere you wouldn't expect I did a search for one in Kansas City. Check picture 2 for results.
The store will most likely look like this one in SF in picture 1. Nuts, I know...