A friend sent me this link today. Its a great tool to check how your site is being indexed by those creepy little spiders. Its free and gives you a score (my site didn't do so good, YET!) and recommendations for raising that score.