what takes a more detailed photo?

Its more than just a matter of choosing between an 8mp DSLR or a 10mp compact

Its the lens

how well you focus

the aperture you use

how steady you hold the camera

You need to consider resolution depending on what you are going to do with your fine detail photo. If youre only printing 4x6 you dont need 10mp. If youre not doing extreme cropping you dont need 10mp. The cameras resolution has no impact on detail captured.

An 8mp DSLR with a macro lens would be fine but so would a newer 10mp compact with close focus or macro ability. It depends on what you want to spend and how deep you want to get into photography. There is no advantage in one over the other.

I will likely get a ton of criticism for this answer from DSLR aficionados. "An 8mp DSLR will be far superior to a 12mp compact" etc etc. Ive heard it all before and its trash. Most of them couldnt tell a print from an expensive DSLR apart from a print out of any decent point n shoot.

Heres an article from Ken Rockwell. The Nikon DSLR users love to quote his articles to support their affection for Nikon DSLRs but they dont quote this article much. Its called "Your camera doesnt matter". Read it and look at some sample images from very "inferior" cameras. Far from 8mp DSLR and some of the photos are great.

I'll agree with KND. Lighting is more important. With enough light, a P&S camera will give acceptable images. I find it easier to use manual mode to shoot such items which means either a DSLR or an advanced P&S camera with manual mode.

Some interesting lighting links I have found on shooting coins:

http://www.washingtonpost.com/wp-srv/photo/essays/...

http://www.sigma-2.com/camerajim/cjgcoins.htm