Watch Out, you use the robots.txt generator at your own possibility. It can be recommended to validate that your robots file doesn't exclude pages by slip-up. There are several tools to check this like the Google tool. To adequately protect against your URL from appearing in Google search effects, password-protect https://seotoolstube.com/