Product parser for different websites, with daily updates on availability and price
Technical assignment for the development of a parser for collecting and updating product information
1. General project description
Goal: Development of a parser that will automatically collect product information from specified sources (websites, databases, etc.) and update this information daily.
2. Main requirements
Data collection about products: name, description, price, stock availability, images, and other parameters.
Daily verification of data relevance with updates in the database.
3. Additional wishes
Scalability for working with a large number of sources.
Protection against blocking
-
134 Hello.
I have experience in creating parsers for similar tasks. There are already several ready-made solutions that will positively affect the timeline for completing the work. I am waiting for your response for a more detailed discussion of the terms and price.
-
655 6 1 Good afternoon. I am ready to create an application for the automatic collection of product information from the specified sources with the ability to scale for working with a large number of sources.
-
698 16 0 Hello! I have extensive experience in developing various parsers. I can export data to Google Sheets, for example, or in any other format. I can also set up the script on hosting, and it will run every day (or even more often). Mobile proxies can be used to bypass blocks. Write to me, I will do it quickly and efficiently.
The price and deadlines are approximate; I need to see the websites and the complete technical specification.
-
1444 9 0 💬 Hello! I am ready to offer my services for developing a parser to collect and update product information daily.
✅ Technology stack:
Python (Requests, Aiohttp, BeautifulSoup) — fast and efficient parsing without Selenium.
Asyncio — for accelerated processing of multiple sources.
Databases (MySQL, PostgreSQL, SQLite) — flexible data storage.
Proxy servers — to bypass blocks.
💪 I guarantee:
… 📌 Reliable operation without blocks.
📌 Easy scaling for new sites.
📌 Full technical support.
❓ Please clarify:
How many sites need to be parsed at the start?
In what format should the data be saved, database, table, CSV?
Can you send examples of the sites?
I am ready to discuss all the details in private messages!
-
735 3 1 Good day!
I have extensive experience working with Telegram bots, web resource parsing, and creating full-fledged websites on Django, etc. Scrapy can be used for quick work or bs4 and requests.
I will gladly complete your order quickly and efficiently, waiting in private messages to discuss the details of the order.
-
8778 60 0 1 Good afternoon. I am ready to complete the task.
I have extensive experience in creating parsers.
I code in Python and hold 2nd place on the platform.
I will develop a parser to collect product information from the necessary sources. I will implement all the required functionality. I will connect the necessary integrations.
I will develop the logic for the constant updating of necessary data and ensure high speed. There will be an option to add the required number of sources.
I will provide reliable protection against blocks. I will create a user-friendly interface for managing the parser's operation. I will optimize it. I will provide documentation.
My portfolio:Freelancehunt
… Write to me, and we will discuss the details, and I will start working.
-
1770 20 0 I provide data on a regular basis in the required format.
I host parsers on my servers with support for their operation.
Contact me, and we will discuss the details and terms of cooperation.
-
каждый сайт - свои метки нужных свойств и т.п.
я понимаю в парсер 2-3 сайта забить, но если хотите больше + масштабирование - освойт любой виндовый парсер и настраивайте себе кампании..
-
У мене є готовий парсер-агрегатор для таких цілей. Які саме дані та з який джерел треба збирати?
-
Current freelance projects in the category Data Parsing
Parsing products, preparation for import to WPScrape the full catalog of these websites: https://svit-mebliv.ua/ https://kompanit.com.ua/ru https://amia.com.ua/ https://mebliromax.com.ua/ https://pehotin.com.ua/catalog/ https://www.sokme.ua/ru/ All products need to be combined into one general table for import into WP.… Web Programming, Data Parsing ∙ 2 hours 47 minutes back ∙ 26 proposals |
I am looking for a programmer for OpenCart.Good day 1) It is necessary to implement on the website dneprkomfort.dp.ua A module for Ukrainian banks has been purchased, and we have already integrated Mono Bank Here is an example from our competitor It is necessary to implement installment payments, purchase in parts… Web Programming, Data Parsing ∙ 1 day back ∙ 46 proposals |
A specialist in Telegram promotion is required.
28 USD
Tasks: invite real users from the username database to new chats and send messages to the target database. Only quality traffic and work with a live audience are of interest — performers using bots, fake engagement, or low-quality methods are requested NOT TO DISTURB. Work… Data Parsing, Social Media Marketing (SMM) ∙ 5 days 2 hours back ∙ 9 proposals |
Consultation on parsing Instagram account subscribersHello. It is necessary to conduct a preliminary assessment of the feasibility of the following task. I have a list of Instagram accounts. The goal is to obtain contact information (primarily email addresses) of users who follow these accounts. Previously, I encountered companies… Data Parsing ∙ 8 days 21 hours back ∙ 13 proposals |
A specialist is needed to find contacts of decision-makers in Ukraine.It is necessary to gather a database (or ready database) of contacts of decision-makers (DMs) in companies in Ukraine. Information Gathering, Data Parsing ∙ 9 days 1 hour back ∙ 21 proposals |