Does MS have one?
I've done a brief search and sent a few crawlers around but I can't find any, but the site knows Google[Bot] and Bing[Bot] are watching. Where would I go to not be a dirty cracker and abide by good ethics here?
robots.txt
-
-
Tamuz Mafia Scum
- Mafia Scum
- Mafia Scum
- Posts: 2807
- Joined: March 20, 2005
- Location: Seattle, Washington State
robots.txt
Tamuz is the expression of the alienated, of the ambitious, of the dispossessed.-
-
Mr. Flay Metatron
- Metatron
- Metatron
- Posts: 24969
- Joined: March 12, 2004
- Location: Gormenghast
-
-
Tamuz Mafia Scum
- Mafia Scum
- Mafia Scum
- Posts: 2807
- Joined: March 20, 2005
- Location: Seattle, Washington State
-
-
Mr. Flay Metatron
- Metatron
- Metatron
- Posts: 24969
- Joined: March 12, 2004
- Location: Gormenghast
-
-
Tamuz Mafia Scum
- Mafia Scum
- Mafia Scum
- Posts: 2807
- Joined: March 20, 2005
- Location: Seattle, Washington State
I have the means to scrape. I was looking for the admin control flow. Your point re phpBB answers that, just means that if I want to scrape something from a non-guess forum I'll have to do so via my actual account, I also understand that there is a reason bots are locked out of things, so I probably shouldn't do so. Question answered as well as I need, thanks.Tamuz is the expression of the alienated, of the ambitious, of the dispossessed.-
-
Mr. Flay Metatron
- Metatron
- Metatron
- Posts: 24969
- Joined: March 12, 2004
- Location: Gormenghast
Copyright © MafiaScum. All rights reserved.