What is robots.txt?

1. A file that lists all of your web pages along with details of how often they are updated
2. A file used to associate the Search console account with a domain
3. A text file that instructs robots how to crawl and index web pages
4. A file to give instructions to Google about how high to rank a certain site

Correct Answer:
A text file that instructs robots how to crawl and index web pages