The Robots.txt file is intended for robots, for example robots indexing pages for Google, Bing, Yandex. In this file, we define how robots visiting your pages should behave.
The Robots.txt file for your website is located at https://your-domain.com/robots.txt
In the free plan, Robots.txt is generated automatically and you don't have the option or need to change it.
The default Robots.txt file for your website looks like this:
These settings mean that all your pages are available to all robots on the Internet - they are visited without any problems and can be indexed by search engines.
In the BASIC or PRO plan, you have the option to edit the default Robots.
You don't need to change the default Robots.txt file! Its default content allows robots to visit and index your pages.
However, if you want to change it, go to the Website's settings, the Robots tab and enter the appropriate values in the text field.
Remember to be careful when making changes and do not block access to pages if you want them to be visible in Google, Bing, Yahoo etc.
