The Robots.txt file reports the information to indexing robots on which pages and files on your website they have to index. It is used mainly in order the website not to be overloaded by requests and helps manage the website's traffic. It is used to exclude webpage or file from Google indexing.

How to edit Robots.txt file

1. Go to the SEO Settings

2. Then go the "Robots.txt" tab.

3. Enter your code to the field "Content of the robots.txt file"

Exemplary commands

User-agent: *

The code that specifies the indexing robots and the content to be indexed. * Mark means that all the indexing robots will be blocked, but the very use of googlebot would mean that only the Google indexing robots will be blocked.

Disallow: /gallery

Exclusion of the gallery subpage from indexing.

Disallow: /lib/jieq5l/IMG_1898-k2z3myc6.jpeg

Exclusion from indexing of a file uploaded to media library. The exact file path one may find under the miniature in "My images and files" in "Settings".

Configuration of your mailbox in Gmail

Configuration of your mailbox in Outlook

Configuration of your mailbox in Thunderbird

Create a free mailbox

How to change the mailbox capacity

Import and export e-mails

Reset mailbox password

Server details needed to configure your email client

Sign in to your mailbox

Robots.txt file edition

18 June 2021

Didn't find a solution to your problem? Contact us on live online chat or ask on Facebook group.

Missing any feature? Share your ideas with us.

Webmaster's panel

Sign up

Log in

Knowledge base

WebWave drag and drop website builder lets you create unique websites. You can build your website from scratch by starting with a blank page, or choose various website templates from our free collection and modify them according to your needs. With WebWave website builder, you have a complete website design and hosting system at your fingertips.

Find us online

Website builder.

Offerings.

Help docs.

Company.

Back