Development of a parser script for the website
In brief:
There is a ready-made MySQL database.
We need to write a parser that will once a day (at night) access the donor site via a specific URL, retrieve data from there, and store it in MySQL.
A bit more detail:
We have a database and a primitive web interface to it.
In this interface, a task is first created. The task consists only of a title and a target URL.
Example of a target URL: https://suchen.mobile.de/fahrzeuge/search.html?cn=DE&dt=ALL_WHEEL&fr=2019%3A&isSearchRequest=true&ms=7700%3B8%3B%3B&od=up&ref=srp&refId=e280ae1d-f6ad-85ad-050d-5743bdf92864&s=Car&sb=p&vc=Car
And inside the task, there are entities of the listings.
The parser's task is to scan the target page once a day and add information about all the cars on that page to the database.
So the parser should gather the following information about the cars:
- id
- name (string)
- photo URL
- price
If this car was not previously in our database, it is added.
If it was, the price is updated. But the price is stored in a related table because we need to keep track of price dynamics rather than just the current price.
The project's goal is to create a table where the rows are cars, the columns are dates, and at the intersections are either the price or a dash.
A rough visualization of what we should get in our interface as output is attached.
But right now we are looking for someone to write a parser that will fill the database with this data. We will handle the output in the web interface ourselves. Please leave responses indicating the cost and timeframe. Also, please specify what technologies you will use to complete the task.
Work through escrow, deadlines are not limited. Priority in candidate selection is given to cost and experience.
Applications 1
-
2 days67 USD
1444 9 0 2 days67 USD
💬 Good day! I am ready to complete the task of developing a parser that collects data daily from donor websites and updates the information in a MySQL database.
✅ Technology stack:
Python (Requests, Aiohttp, BeautifulSoup) — fast and efficient parsing without Selenium, ensuring high speed of operation.
Asyncio and multithreading — for simultaneous processing of multiple URLs, significantly speeding up data collection (optional).
MySQL (pymysql / SQLAlchemy) — for data storage and maintaining price change history.
… Logging and error handling — the script will be resilient to failures and automatically resume interrupted requests.
📌 Clarifications:
Does the parser need to navigate through all pages from the filter (pagination)?
Is it planned to work with only one donor website or will other resources be added?
🎯 My experience:
2+ years of developing high-performance parsers that work reliably even with dynamic websites.
Development of APIs and integrations with MySQL, including tracking data changes and collecting histories.
Ongoing support and improvement of developed solutions.
💪 I guarantee:
Quality execution of the task.
Support and refinement upon request.
Affordable pricing and quick execution.
I would be happy to discuss the details in private messages and offer the optimal solution for your project. I look forward to your response!
-
1 day16 USD
411 6 1 1 day16 USD
Hello!
I am ready to develop a parsing script for
your website.
Please tell me more about:
* the purpose of parsing (what information needs to be extracted)
… * the structure of the website (HTML matrix, API)
* the volume of data
* the format of the output information
Then I will be able to clarify the deadlines and cost.
-
4 days67 USD
655 6 1 4 days67 USD
Hello. I am ready to create an application for collecting data from a specified website based on a list of links and exporting the results to a mysql database.
-
7 days178 USD
96760 1276 1 10 7 days178 USD
Hello. I have extensive experience with Node.js/Python. I am ready for collaboration.
-
3 days45 USD
1673 100 5 3 3 days45 USD
Good day. I will make such a parser. Write to me, I will be glad to cooperate with you!
-
10 days267 USD
1315 7 0 10 days267 USD
Good day.
I am ready to take on your project.
I can develop a parser for you to add car listings using no-code/low-code tools and/or Node.js (if needed).
Message me privately, we will discuss all the details and nuances, and find the best solution for you.
-
3 days45 USD
726 9 1 3 days45 USD
Good day! I have carefully studied your project and am ready to start its implementation. Let's discuss the details for the best execution.
Current freelance projects in the category Data Parsing
Parsing products, preparation for import to WPScrape the full catalog of these websites: https://svit-mebliv.ua/ https://kompanit.com.ua/ru https://amia.com.ua/ https://mebliromax.com.ua/ https://pehotin.com.ua/catalog/ https://www.sokme.ua/ru/ All products need to be combined into one general table for import into WP.… Web Programming, Data Parsing ∙ 1 day 20 hours back ∙ 54 proposals |
I am looking for a programmer for OpenCart.Good day 1) It is necessary to implement on the website dneprkomfort.dp.ua A module for Ukrainian banks has been purchased, and we have already integrated Mono Bank Here is an example from our competitor It is necessary to implement installment payments, purchase in parts… Web Programming, Data Parsing ∙ 2 days 17 hours back ∙ 48 proposals |
A specialist in Telegram promotion is required.
28 USD
Tasks: invite real users from the username database to new chats and send messages to the target database. Only quality traffic and work with a live audience are of interest — performers using bots, fake engagement, or low-quality methods are requested NOT TO DISTURB. Work… Data Parsing, Social Media Marketing (SMM) ∙ 6 days 20 hours back ∙ 9 proposals |
Consultation on parsing Instagram account subscribersHello. It is necessary to conduct a preliminary assessment of the feasibility of the following task. I have a list of Instagram accounts. The goal is to obtain contact information (primarily email addresses) of users who follow these accounts. Previously, I encountered companies… Data Parsing ∙ 10 days 14 hours back ∙ 13 proposals |
A specialist is needed to find contacts of decision-makers in Ukraine.It is necessary to gather a database (or ready database) of contacts of decision-makers (DMs) in companies in Ukraine. Information Gathering, Data Parsing ∙ 10 days 19 hours back ∙ 22 proposals |
Odessa