Setting up XML Sitemap and Robots.txt for product indexing (WordPress)
Looking for a specialist for:
1) Work Objective
Ensure correct and fast indexing of the store pages in Google by:
automatic generation of XML Sitemap with products and categories;
correct Robots.txt (without blocking important pages and without indexing junk);
connecting Sitemap in Google Search Console.
2) Initial Data
CMS: WordPress (online store, ~100 products, more in the future)
Requirement: products must be indexed in bulk, without manual URL submission (since the limit for manual submission is restricted).
3) XML Sitemap — Requirements
3.1. Sitemap Generation
Set up the generation of sitemap_index.xml (index sitemap).
The sitemap must include:
product categories and subcategories;
product pages;
main site pages (contacts/delivery/payment, etc. — if they need to be in the index);
blog/articles (if available and an SEO blog is planned).
Exclude from the sitemap:
cart, checkout, personal account;
site search pages;
pages with sorting/filter parameters (if they generate multiple URLs);
service / duplicate pages.
3.2. Auto-update
The sitemap must automatically update when:
adding/deleting/editing a product;
changing a category;
changing the SEO data of a page.
For URLs in the sitemap, there must be a correct
<lastmod>.
3.3. Accessibility Check
Check that the sitemap is accessible at a URL like:
/sitemap_index.xmlor/sitemap.xml
The sitemap must open without errors (200 OK), not require authorization, and not be blocked by cache/protection.
4) Robots.txt — Requirements
4.1. Do Not Block Important Pages
Ensure that Robots.txt does not block:
product pages;
product categories;
product images (if used in search/images).
If WooCommerce filters/plugins are used on the site:
do not allow indexing of filter pages that create "junk" URLs;
priority: noindex for filters or canonical to the main category (see p.5).
4.2. Specify Sitemap in Robots
In robots.txt, it is mandatory to add the line:
Sitemap: https://YOUR_DOMAIN/sitemap_index.xml
5) Important for Stores (mandatory checks)
Check the correctness of canonical:
for products, the canonical should point to the "clean" product URL;
for filter/parameter pages, the canonical should lead to the main category (if such URLs exist).
Check that products have the status index, follow (not closed by the SEO plugin).
Check that products are accessible from categories and have internal links (Google crawls faster).
6) Google Search Console
Add the sitemap to GSC:
Indexing → Sitemaps → SubmitCheck:
that the sitemap is "successfully read";
there are no critical errors.
Provide the results of the work:
link to the sitemap;
screenshot from GSC (sitemap status);
final robots.txt (in text).
7) Acceptance Criteria (ready/not ready)
✅ The sitemap contains products and categories and updates automatically
✅ The robots.txt does not block products/categories and closes service pages
✅ The path to the sitemap is specified in robots.txt
✅ The sitemap is added to GSC and processed successfully
-
10 days89 USD
4623 109 0 10 days89 USD
Hello
I am interested in your project. I would like to discuss all the details of the collaboration in more depth.
-
1 day33 USD
3001 42 0 1 1 day33 USD
Good day.
I work with WordPress and am ready to set everything up on your site.
I will also add the sitemap to the Google Console.
-
6 days45 USD
3303 82 0 6 days45 USD
Hello, I have already worked with you, ready to complete the assigned task.
-
1 day45 USD
1986 27 0 1 day45 USD
Hello! 8+ years of experience in SEO, marketer by education. I will set up robots.txt and XML Sitemaps, add them to GSC. Contact me, I will be happy to help!
-
3 days30 USD
4429 80 1 4 3 days30 USD
Trust a professional with over 10 years of experience! The rates and deadlines are current! I will be happy to collaborate! Experience in commercial development of online stores on CMS, business portals, and corporate websites - 11 years! +CMS: WordPress (+Woocommerce), PrestaShop, Opencart, Joomla, Bitrix, MODX, DLE, Shopify php/html/css/js/Mysql, PhotoShop/Figma Examples of work (from scratch, turnkey): https://amari.net.ua/ https://heypretty.gr/ https://wildandorganic.com/ https://cryptosignals.org/ https://ecnbot.com https://locs-ua.com/ https://www.grower.com.ua/ https://www.alternativemedicine.com.ua/ https://silkkiss.ua/ https://v12coffee.com.ua/ https://smrtalgo.com/ https://sengero.no/ https://beautybysim.no/ https://sonatagalleri.com/ https://www.solmy-realestate.com/ https://www.emmanuel.com.ua/ https://www.onsitecomputersinc.com/ https://express-tehbud.com/ https://korostenporcelain.com.ua/ https://sladok.com.ua/ https://pricemds.com/ https://picupmedia.com/ https://www.serasar.com/
-
2 days22 USD
300 4 0 2 days22 USD
Good day
One or two days of work)
Your question will be solved by plugins and Google API
Nothing complicated, more routine
-
3 days33 USD
2803 15 0 1 3 days33 USD
Good day!
I am ready to complete the task.
_____________________________
-
5 days78 USD
1441 24 0 1 5 days78 USD
Hello!
I am ready to take on the project and set up a correct XML Sitemap + Robots.txt for quick and clean indexing of the online store on WordPress (WooCommerce).
🔧 What I will do:
I will set up sitemap_index.xml (products, categories, and if necessary — pages/blog);
I will exclude junk URLs (filters, sorting, search, service pages);
I will check and correct robots.txt (without blocking products and categories);
I will check canonical (especially for WooCommerce filters);
I will connect the sitemap in Google Search Console;
… I will check the indexing status and errors;
I will provide final links + screenshots from GSC.
I work with an SEO-oriented approach.
Additionally, indexing can be accelerated:
connecting Google Indexing API (through a service account);
mass submission of product URLs (up to Google limits);
relevant for new products / quick store launch.
❓ Clarifying questions (important before starting)
What SEO plugin is being used?
(Yoast / RankMath / All in One SEO / without a plugin)
Is there already a sitemap?
If yes — please send the link.
Are WooCommerce filters being used?
(by price, attributes, brands — important for noindex/canonical)
Are there access credentials?
WP admin
Google Search Console
Is it necessary to index:
the blog?
static pages (delivery, payment, etc.)?
Is it necessary to accelerate indexing through API or is standard submission sufficient?
-
1 day45 USD
764 3 0 1 day45 USD
Good day.
I am ready to set up the XML Sitemap, robots.txt, and connect the website to Google Search Console for proper mass indexing of products and categories in Google.
What I will do:
— set up sitemap_index.xml (products, categories, necessary pages, auto-update);
— exclude the cart, checkout, filters, and service URLs from the sitemap;
— check and adjust robots.txt (without blocking products, indicating sitemap);
— check canonical, index/follow for products and categories;
… — add the sitemap to Google Search Console and check the status.
Result:
— working sitemap;
— final robots.txt;
— confirmation from GSC.
-
3 days67 USD
1380 18 0 3 days67 USD
Hello. I will set up robots.txt and automatic sitemap generation and add it to GSC. For SEO, I often make the correct settings.
Write to me privately to discuss the details.
-
10 days267 USD
4873 107 0 10 days267 USD
Hello, Maxim.
I will quickly implement your tasks based on WORDPRESS. I have extensive experience confirmed by reviews.
If needed, I will provide a video instruction that explains how to work with the site:
☑ administer pages
☑ add images
☑ manage content in your admin panel
I am ready to discuss the details and start the execution. The final price/time after all clarifications.
…
Profile:
Freelancehunt
Reviews: Freelancehunt
-
2 days78 USD
95862 1272 1 10 2 days78 USD
Hello. I have extensive experience with WordPress. I am ready to collaborate. Please contact me.
-
2 days56 USD
12231 96 0 2 days56 USD
Good day!
I will set up the Sitemap and Robots.txt, and connect to Search Console.
Feel free to reach out, I will be happy to help.
-
2 days45 USD
85 1 1 2 days45 USD
Good day
I have been working with SEO audits and website promotion for over 10 years (with WP multiple times)
I have reviewed all the points of the task
I will complete these points and provide the results
Write to me, I will be glad to cooperate
-
12 days134 USD
8103 38 0 1 12 days134 USD
I will write a custom sitemap for the correct operation and full compatibility with your website, thank you, I will include the necessary canonical tags.
Current freelance projects in the category Web Programming
Approximately 5 microservices on FastAPI + edits and refactoring
350 USD
There is a project consisting of approximately ~11 microservices on FastAPI with integrations, which is more than half ready. The task is to complete the remaining ~5 microservices (more specifically - subscription/billing and integration with Revenuecat, abuse protection for… Python, Web Programming ∙ 1 hour 9 minutes back ∙ 14 proposals |
Responsive Portolio Website Design ( wordap - selling and buying website )I need a clean, modern portfolio site that follows my existing brand guide and adapts beautifully to desktop, tablet, and mobile. The site’s job is simple: highlight my work through high-impact photos, embedded videos, and detailed case studies so visitors immediately understand… Content Management Systems, Web Programming ∙ 15 hours 56 minutes back ∙ 32 proposals |
Moved the website from OpenCart to the Khoroshop platformHello. There is a website on OpenCart, an online store. It is necessary to transfer the structure of the site to the GoodShop platform, select a design for the new site, and make it fully functional. HTML & CSS, Web Programming ∙ 19 hours 36 minutes back ∙ 25 proposals |
Making edits to the website (WP, Elementor)Good day. We need to make 2 changes to the website: 1. The main menu "jumps" when hovering the cursor, plus in the Ukrainian version it is vertically centered (as it should be), while in the Russian version it is not centered, at the top. We need to center the Russian version… Web Programming ∙ 22 hours 13 minutes back ∙ 67 proposals |
It is necessary to modernize the admin panel in Open Cart for convenience.Technical assignment for configuring/improving OpenCart 1. Catalog → Products Task 1. Add a "Category" column to the product list Task 2. Add a "SKU" column to the product list Task 3. Add a "Creation date and time of the product" column Task 4. Quick edit of main product data… Web Programming ∙ 22 hours 29 minutes back ∙ 54 proposals |
Kyiv