Configuration of the robots.txt file Search Engine Optimization (SEO) 2 USD Job 48 of 79 A robots.txt file is created that manages the indexation of the site based on the current structure of the site and its general state.
