about robots.txt

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • José
    Private First Class

    • Mar 2006
    • 6

    about robots.txt

    Hi!
    I'm José and my site is www.vaccontrol.com
    Looking at statistics on cPanel, and I saw frequently that "robots" made some visits...and "request" robots.txt. I don't have any file called robots.txt, and an error page 404 is the result.
    1- Is this a problem? or it's just the normal?
    2 - can (must) I do something t improve my site? . (anyway it is "listed" in importants searching sites)
    3 - What changes i need to do (tag's... metatags) when i change my pages, for exemple adding pages to my site?

    Thank you,
    José
  • racefan20
    Major General

    • Jul 2005
    • 2335

    #2
    Re: about robots.txt

    The robots look for robots.txt to find if you've set any "rules" for what they can and cannot access on your server. In most instances, you don't really need to worry about any of this, but you can read more here:

    My NASCAR Forum

    Comment

    • José
      Private First Class

      • Mar 2006
      • 6

      #3
      Re: about robots.txt

      Thank you for help.
      José

      Comment

      Working...
      X