The file name is always written with a lowercase letter

[rakibhasan]

optimization of the site, since it directly affects which pages will be indexed by search engines.
Basic rules of setup
First, let's make sure your robots.txt file meets the following requirements:
The file format must be txt only .
The file size must not exceed 32 KB .
The file name must be in all lowercase sms gateway brazil letters robots.txt . Bots will not accept any other variants, for example, with a capital letter.
The file must be accessible to robots and the server must return a 200 OK status .
There should be one common file for the entire site, including subdomains.
The file location is the root directory.
Common mistakes
When setting up your robots.txt file , it is important to avoid common mistakes that can prevent your site from being indexed correctly:
File location : The file must be located only in the root directive of the site.
Case sensitivity :
Open in browser page : The file must open in a browser page so that robots can read it correctly.
Disallow and Allow Errors : It is correct to use the Disallow directive to disallow and Allow to allow indexing.
Examples of directives
Here are examples of directives you can use in your robots.txt file :
User-agent: *
Disallow: /private/
Allow: /public/
User-agent: * refers to all robots, Disallow: /private/ prohibits indexing of the /private/ section, and Allow: /public/ permits indexing of the