I don't see the file sitemap.axd anyplace but it's referenced in robots.txt

  • Thread starter Thread starter Cal Who
  • Start date Start date
C

Cal Who

I'm looking at someone elses code and they have the following in robots.txt.

But I don't see the file sitemap.axd anyplace.

What is going on here?


User-agent: *
Disallow: /login.aspx
Disallow: /search.aspx
Disallow: /error404.aspx
Disallow: /archive.aspx

#Remove the '#' character below and replace example.com with your own
website address.
#sitemap: http://example.com/sitemap.axd


Thanks
 
Cal said:
I'm looking at someone elses code and they have the following in
robots.txt.
But I don't see the file sitemap.axd anyplace.

What is going on here?

User-agent: *
Disallow: /login.aspx
Disallow: /search.aspx
Disallow: /error404.aspx
Disallow: /archive.aspx

#Remove the '#' character below and replace example.com with your own
website address.
#sitemap: http://example.com/sitemap.axd
Click to expand...

The # character indicates that that line is only a comment. Everything after
it is ignored. I bet that the web site isn't at example.com, too ;-)
 
Andrew Morton said:
The # character indicates that that line is only a comment. Everything
after it is ignored. I bet that the web site isn't at example.com, too ;-)
Click to expand...
I'm sorry, I should have said that I'm suppose to remove the # and insert my
address.
But what good will it do if the file is not present.

Thanks
 
Cal said:
I'm sorry, I should have said that I'm suppose to remove the # and
insert my address.
But what good will it do if the file is not present.
Click to expand...

It will do no good. That line is entirely optional. It is only an example;
probably the someone else grabbed an example robots.txt and left those lines
in.

Google's info on sitemaps is at
http://www.google.com/support/webmasters/bin/topic.py?topic=8476

and Yahoo!'s is out there somewhere too.
 
Andrew Morton said:
It will do no good. That line is entirely optional. It is only an example;
probably the someone else grabbed an example robots.txt and left those
lines in.

Google's info on sitemaps is at
http://www.google.com/support/webmasters/bin/topic.py?topic=8476

and Yahoo!'s is out there somewhere too.
Click to expand...

I believe that it will do no good with out the file, but it is not that
simple. There was a video that showed how to install the software and he
made a point of changing that line to insert the correct domain and remove
the #.

Is an .axd file something I could generate or better, have vs generate?


Thanks
 
Cal said:
I believe that it will do no good with out the file, but it is not
that simple. There was a video that showed how to install the
software and he made a point of changing that line to insert the
correct domain and remove the #.

Is an .axd file something I could generate or better, have vs
generate?
Click to expand...

There is no need for it to be a file ending in .axd; there are many examples
of generating sitemaps at
http://www.google.com/#hl=en&q=asp.net+generate+sitemap
 
Cal said:
I believe that it will do no good with out the file, but it is not that
simple. There was a video that showed how to install the software and he
made a point of changing that line to insert the correct domain and remove
the #.
Click to expand...

"There" where? Whose video? Made for what audience? The video was not a
commandment from The Lord Himself to every creature that creepeth and
maketh a robots.txt. The line with a file of that name only serves a
purpose if you have a file by that name. Since sitemap.axd pertains to
Google Sitemaps, it stands to reason that if you aren't using Google
Sitemaps, *you won't have one* and you don't need to follow Google's
instructions for implementing Google Sitemaps.
 
Harlan Messinger said:
"There" where? Whose video? Made for what audience? The video was not a
commandment from The Lord Himself to every creature that creepeth and
maketh a robots.txt. The line with a file of that name only serves a
purpose if you have a file by that name. Since sitemap.axd pertains to
Google Sitemaps, it stands to reason that if you aren't using Google
Sitemaps, *you won't have one* and you don't need to follow Google's
instructions for implementing Google Sitemaps.
Click to expand...

I think I understand now. The author expect that the user (me) would
understand about generating a site map and simply made a point of showing
that the robots file needed to be updated.

Thanks
 
Back
Top