404 error - Virtual robots.txt missing

on every WordPress installation there is a default virtual robots.txt file with the following

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

but on my 2 last project /robots.txt give me a 404 instead.

• I tried to disable all plugin
• I tried to switch theme with a blank one
• Tried to look on another older project which I updated last week and robots.txt is working

This not server related because it work on my local environment with older project

Any idea why ?

on every WordPress installation there is a default virtual robots.txt file with the following

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

but on my 2 last project /robots.txt give me a 404 instead.

• I tried to disable all plugin
• I tried to switch theme with a blank one
• Tried to look on another older project which I updated last week and robots.txt is working

This not server related because it work on my local environment with older project

Any idea why ?

• 404-error
• robots.txt

Share Improve this question edited Aug 1, 2017 at 8:31 Johansson 15.4k1111 gold badges4343 silver badges7979 bronze badges asked Aug 1, 2017 at 7:56 David HorizonefDavid Horizonef 3155 bronze badges 1

• I have no idea why it is missing but you could just upload a robots.txt via ftp. – Luckyfella Commented Aug 1, 2017 at 8:11

Add a comment  | 

1 Answer 1

Sorted by: Reset to default 0

Nevermind. It just doesn't work when wordpress is in a subfolder.

(robots.txt should be on website root so just create your own if wordpress is in a subfolder)