Parsing of supplier websites
There are about 30 supplier websites.
On each site, login is required with a username and password. (some without authorization)
The sites are on different platforms,
there are no XML exports from the suppliers.
Currently, a parsing system is in place, but we want to rewrite or improve it to be more modern.
A simple website with a search function has been implemented, and parsing occurs once a day at night.
The result provides: photo, name, price, availability, and supplier name.
If everything is to be rewritten from scratch, then here it is:
http://b2b.spartakelectronics.com/ru/login
http://www.golden-house.od.ua/
https://tec-star.com.ua/
http://masterberg.com.ua
https://elite-top.com.ua/
http://www.dtopelectronic.com.ua/
https://daikens.com.ua/
https://rainberg.in.ua/
https://lambix.prom.ua/g35022709-tovar
https://magnitopt.com.ua
https://shop-euromax.od.ua/
http://texnano.com.ua
https://hi-tech-odessa.com.ua/
https://b2b.delltalife.com/login/
http://www.andopt2.com.ua/
https://www.smartopt.com.ua/
https://matrix7km.com/
Melad.com.ua
https://venera7km.com.ua/
https://domte.com.ua/
http://hj-pheenecs.com.ua/
These need to be added:
https://bmaudio.com.ua/
https://atlanfa.com.ua/
http://www.gold-tor.com.ua/
http://asad.in.ua
These have stopped working:
https://jarviz-opt.com.ua/
jmaxtvshop.com.ua
https://211.in.ua
http://www.top-kitchen.com.ua/
The current version is written in Python with the libraries requests, bs4, lxml
In the video, the current version
Price and deadlines and how best to proceed
Applications 1
-
7 days445 USD
7 days445 USD
I will write everything qualitatively from scratch using a fast asynchronous library for parsing, and I will also write a search web page in a more modern way.
-
70 days601 USD
70 days601 USD
Good day. It is a long-term project, but I am ready to consider it. I will say right away that at the time of writing the bid, I have NOT looked at the websites. I am leaving a bid so that you can understand the approximate terms and budget - I am indicating the minimum amount for which I am ready to consider your proposal. If the approximate estimate suits you - write, we will agree on the exact one.
P.S. The maximum budget for a regular Safe is 27 thousand hryvnias. My bid is 30 thousand.
-
5 days367 USD
66 5 days367 USD
Hello, I have extensive experience in developing parsers and can work with websites. We can host the site, and if needed, on your custom domain, or on a free one, so that access is not only local to you. If you are interested, write to me privately, and we will discuss. I am ready to support the project in the future and improve it, for an additional fee.
-
7 days445 USD
986 12 1 7 days445 USD
I developed a similar parser for delivery services, as well as a parser with similar search parameters for the "Tavria V" website. I can offer a solution in the form of a program that will run on a schedule with flexible settings for intervals and the operating time of the parser.
-
4 days601 USD
172 1 1 4 days601 USD
Hello! I am ready to complete this project and have extensive experience in developing various applications.
-
1 day22 USD
1562 7 0 1 day22 USD
I am among the top 5 developers in the category of "Artificial Intelligence and Machine Learning" among ~2100 specialists on the platform. I guarantee:
- Fast and high-quality task execution
- Strict adherence to deadlines
- Regular communication throughout the entire process
I would be happy to discuss the details of your project in private messages.
-
5 days557 USD
1422 13 0 5 days557 USD
Hello!
I understand the task. I have experience in developing large parsing systems.
In my opinion, the best approach right now is not to "cosmetically patch" but to:
- have a unified result
- allow easy addition/removal of sites
- migrate some sites to Playwright (where JS/anti-bot is involved)
- keep requests where possible (speed)
… Cost estimation
- Rewrite everything from scratch:
Architecture + basic engine
Rewrite all sites with the addition of an anti-bot system
Connecting new sites
Logs, stability
Cost: ~25,000 UAH
Deadline: 4–5 weeks
- Adding or editing one site
Adapting to the new layout
Authorization (if applicable)
Integration into the existing system
1,000 UAH / site
Deadline: 1–2 days / site
Regarding the sites
Adding sites from the list - no problem
Sites that have stopped working - need to check what exactly is broken (JS, captcha, layout changes)
I am ready to discuss the best approach in private messages.
-
1 day89 USD
682 6 0 1 day89 USD
What you are showing with filters and pictures in the video is already the result of parsing and is displayed from the database. The parsers, apparently, have been developed and inserted into the scheduler so that they can be run independently, but I am more than sure that no one goes there unnecessarily, and if something breaks, you simply won't know about it. Most likely, everything is written in Python + Flask + Bootstrap. It is hard to say which database is used; you need to look at the code. It is done simply, but it probably worked and satisfied you. If the programmer were fixing what was broken, then no one would have looked further. To be able to view it from the outside, you can host it on an external server for $5 a month, and everything will work perfectly, and it will only be visible by password. It is necessary to understand ALL your complaints about what exists; after that, we can say what needs to be done and calculate the time-budget. Maybe you are fine with it as it is; it just needs to be fixed so that the broken parts work :) Let's discuss and come to an agreement.
-
3 days134 USD
1860 21 0 3 days134 USD
Hello. It is possible to create the ability to open remotely, it is also possible to rewrite everything from scratch, it is possible to come up with a more convenient form of use, and it is even possible to implement everything without a planner. In short, everything is possible; it all depends on your budget that you are willing to allocate for such a task. Within the budget, I will be able to offer the best implementation for you.
A few more words about the possibility of opening the site remotely. If this parsing is already happening on a separate rented server at the hosting, then there will be no problems with that. But if everything is happening on your computer, then a rented server will definitely be needed for this.
I will also need the source code of these Python scripts to assess the work already done and the scope of future work for rewriting from scratch if such a solution is decided upon.
-
7 days557 USD
1251 35 1 3 7 days557 USD
Hello, I am ready to complete it. I have a lot of experience. Write to me privately and we will discuss.
-
7 days45 USD
8753 60 0 1 7 days45 USD
Good day. I can offer to develop a tool that will never let you down.
I hold a top position in Python.
I will gladly complete this project.
-
5 days22 USD
4120 8 0 1 5 days22 USD
Good day.
Our team has many years of experience in developing ERP, CRM, CMS, and specialized software for businesses. We create effective digital solutions that help automate processes, increase productivity, and scale companies.
We work with modern technologies — from bots and scripts to AI agents and analytical systems. We develop websites of varying complexity. In our portfolio, we have implemented ERP solutions for the hotel business, as well as for companies engaged in the import and sale of goods, and our own product XFitness — an ERP system created specifically for fitness clubs.
We specialize in the following areas:
- Development of ERP Systems
- Development of CRM Systems
- Development of Websites of any complexity
… - Development of CMS Systems
- Support for Websites
- Development of OpenCart
- Support for OpenCart
- Modification of OpenCart
- Refinement of OpenCart
- Development of WordPress
- Support for WordPress
- Modification of WordPress
- Refinement of WordPress
- Development of ECommerce
- Support for ECommerce
- Modification of ECommerce
- Refinement of ECommerce
- Development of Web Applications
- Support for 1C Servers
- Support for Web Servers
- Development of mobile applications
- Data parsing
- Development of bots
- Development of AI agents
and on the following technologies:
- Python
- PHP
- Laravel
- Symfony
- Yii2
- JS
- NodeJS
- jQuery
- TypeScript
- MySQL
- HTML
- CSS
- Vue
- Nuxt.js
- React
- React Native
- C++
-
10 days356 USD
2263 25 1 10 days356 USD
Hello, Python developer with over 5 years of experience, I have been engaged in parsing for more than 4 years. The project is large as it requires creating modules for each website. Overall, your stack is suitable since there are many websites and this is the fastest option, but not the safest. I have reviewed several websites and parsing can be done without authorization and there is no strong protection, so the current stack can be used, but the entire list needs to be reviewed as for some it may be necessary to use anti-detect browsers for emulation. I specify the deadlines by which I am confident I can complete this and the price considering additional code for websites with better security systems. Overall, implementation is not a problem; it is just a matter of time to process all the websites. If you are satisfied with the conditions, please write to me personally, we can discuss and I will be happy to collaborate!
-
10 days89 USD
130 10 days89 USD
Good day. I have worked with many parsers, bypassing Cloudflare protection, using authorization, etc. I can take on your parser. I have experience with the libraries you mentioned, but I think they will need to be replaced, as the code will break with the slightest protection on the site. Please write to me privately, I would like to review the existing code, then I will be able to provide an exact price, but I think it will be around the indicated amount.
-
1 day16 USD
1048 7 1 1 day16 USD
Hello!
I have experience in web scraping with various authorization mechanisms, and I recently implemented a data collection system from several trading platforms using Python, BeautifulSoup, and Requests.
I will rewrite your scraping system from scratch, applying modern practices such as asynchronous programming with aiohttp, which will significantly speed up the data collection process. I will extract information (photos, names, prices, availability) according to your requirements.
This solution will provide flexibility for future upgrades and will be able to adapt to new websites without unnecessary effort. Let's discuss the details!
-
5 days67 USD
324 5 days67 USD
Hello! I have experience in web scraping and marketplace automation, specifically with Prom.ua, OLX. I think it is not necessary to rewrite the system from scratch — it is more reasonable to optimize the current code using requests/bs4 and integrate new suppliers into the existing architecture.
Please write to me in private messages for a detailed discussion of technical nuances and implementation timelines.
-
1 day22 USD
250 37 1 2 1 day22 USD
Good day,
I would like to ask you to review the files of the current implementation of the parsing system and provide feedback regarding a possible update or complete rewriting of the solution.
-
14 days67 USD
97 34 4 2 14 days67 USD
Good day.
The task is clear.
The parsers will be on a VPS, everything will work without your involvement.
There will be a website that can be accessed remotely, we can add filters or advanced search if needed.
Regarding the price - we need to look at a couple of examples of parsers that are already working, whether they can be adapted.
Write to me - we will discuss everything.
-
6 days223 USD
358 1 0 6 days223 USD
Good day!
I have experience in developing parsing and automation systems in Python. I see that you currently have a basic solution, but for a modern level, it is better to build a modular system where each site will have its own adapter. This will allow for easy addition of new sources and maintain stability during changes.
-
2 days33 USD
588 0 1 2 days33 USD
Hello, I can scrape data (~3000 products for 90 dollars) from different websites. Just describe in more detail what data is needed and where to put it. I will be happy to cooperate.
-
5 days33 USD
414 1 0 5 days33 USD
Hello, I am ready to do it, we need to discuss the project details in private messages and we can start working.
-
Здравствуйте.
Нужно все сайты смотреть... -
Можно поинтересоваться, почему отклоняете почти все ставки подряд?
От людей с опытом в разработке парсеров и не только.
-
Даний замовник виставляє не свої проекти а копіює їх з іншого сайту фрілансу на якому від імені фрілансера пише що готовий виконати все якісно. При цьому ставить там високу ціну а тут хоче знайти хто йому виконає дешево
-
Якщо є посилання то надішліть в підтримку
-
Вже це зробив на 3 проекти оригінали яких знайшов на іншому сайті
-
Current freelance projects in the category Data Parsing
A specialist in Telegram promotion is required.
29 USD
Tasks: invite real users from the username database to new chats and send messages to the target database. Only quality traffic and work with a live audience are of interest — performers using bots, fake engagement, or low-quality methods are requested NOT TO DISTURB. Work… Data Parsing, Social Media Marketing (SMM) ∙ 1 day 22 hours back ∙ 8 proposals |
Collection of B2B database of companies in Germany
40 USD
Goal: To obtain a list of potential employers (clients) for B2B mailing. Region: Munich (München) + radius of 50 km. Required niches: Construction companies (Bauunternehmen) Food enterprises (Lebensmittelhersteller, meat processing plants, bakeries) Logistics and… Data Parsing, Lead Generation & Sales ∙ 2 days 1 hour back ∙ 32 proposals |
Consultation on parsing Instagram account subscribersHello. It is necessary to conduct a preliminary assessment of the feasibility of the following task. I have a list of Instagram accounts. The goal is to obtain contact information (primarily email addresses) of users who follow these accounts. Previously, I encountered companies… Data Parsing ∙ 5 days 17 hours back ∙ 12 proposals |
A specialist is needed to find contacts of decision-makers in Ukraine.It is necessary to gather a database (or ready database) of contacts of decision-makers (DMs) in companies in Ukraine. Information Gathering, Data Parsing ∙ 5 days 22 hours back ∙ 18 proposals |
Need to scrape data from LinkedIn
We need to scrape data from LinkedIn based on our list. For each entry, we need to find and collect available data if it exists on the LinkedIn profile, including the profile picture on the LinkedIn social network, email address, links to social media, company website, and… Data Parsing ∙ 6 days 4 hours back ∙ 28 proposals |