I am wondering how it is possible that slurp could see my links even though I have used mod_rewrite to make them very nice urls.
For example, I am using wordpress blog software. I have checked all the links on all of the pages, to make sure of course the mod_rewrite rules worked. Somehow Slurp (and google) have actually spotted a blog posting site.com/index.ph?p=9 when there is really no way they could have found them!
Obviously there is a way, or they wouldn't have found him. But what really sucks, is for some reason the post is now indexed under that URL!! The whole reason I have used to mod_rewrite rules is so that they wouldn't be - and my post title URLs would be instead! Arggggh...
And I have checked the logs - the referer is "-" ... which stinks. I am not sure how they are finding these.
Google is also finding the posts like this, but with a blank "-" referer also. However there is no leak, I promise! The blog is Here.
I am very frustrated because I have no links, and for some reason it defies logic. Also, for some reason my page "site.com/" displays adsense ads that are different (and a PSA) then "site.com/index.php" - which are properly targeted ads. I am uncertain how fast the mediapartner googlebot comes to update, but on my other site it seems to happen very often.
This is driving me nuts, because I don't want the wrong URLs indexed. The index.php?p=9.php one is on Google now too. Whacky...
Finally, my friend and I submitted a total of 3 sites to yahoo with the free submission at the same time the other day. Two of our sites our indexed and have been visited a lot by slurp. The third hasn't even been visited once. That is screwy too - is it just the URL or how is slurp determining whether or not to visit? Is the site possibly blacklisted? We have not submitted it before. However, I am wondering if the submission went thru. I don't want to submit again and get blacklisted, but it is the one we want indexed most! =)
Thanks in advance for any help!
For example, I am using wordpress blog software. I have checked all the links on all of the pages, to make sure of course the mod_rewrite rules worked. Somehow Slurp (and google) have actually spotted a blog posting site.com/index.ph?p=9 when there is really no way they could have found them!
Obviously there is a way, or they wouldn't have found him. But what really sucks, is for some reason the post is now indexed under that URL!! The whole reason I have used to mod_rewrite rules is so that they wouldn't be - and my post title URLs would be instead! Arggggh...
And I have checked the logs - the referer is "-" ... which stinks. I am not sure how they are finding these.
Google is also finding the posts like this, but with a blank "-" referer also. However there is no leak, I promise! The blog is Here.
I am very frustrated because I have no links, and for some reason it defies logic. Also, for some reason my page "site.com/" displays adsense ads that are different (and a PSA) then "site.com/index.php" - which are properly targeted ads. I am uncertain how fast the mediapartner googlebot comes to update, but on my other site it seems to happen very often.
This is driving me nuts, because I don't want the wrong URLs indexed. The index.php?p=9.php one is on Google now too. Whacky...
Finally, my friend and I submitted a total of 3 sites to yahoo with the free submission at the same time the other day. Two of our sites our indexed and have been visited a lot by slurp. The third hasn't even been visited once. That is screwy too - is it just the URL or how is slurp determining whether or not to visit? Is the site possibly blacklisted? We have not submitted it before. However, I am wondering if the submission went thru. I don't want to submit again and get blacklisted, but it is the one we want indexed most! =)
Thanks in advance for any help!
