Develop a parser for ads from the site minda.city or baraholka.ge/ru
89 USD Technical task (TT) for the development of a classifieds parser from the website minda.city or baraholka.ge/ru (duplicates)
Goal:
Create a classifieds parser from the website https://minda.city/, which will collect specific data and transmit it via API.
Requirements:
Website for parsing:
- URL: https://minda.city/
Collected data:
- City
- Region
- Category
- Subcategory
- Phone number (or multiple numbers if provided)
- Name
- Date of ad placement
Data transmission format:
- All collected data must be transmitted via API.
- Data format: JSON.
- Example JSON structure:
jsonCopy code{
"city": "Tbilisi",
"region": "Kartli",
"category": "Real Estate",
"subcategory": "Apartment Rental",
"phone_numbers": ["+995123456789", "+995987654321"]
}
API for data transmission:
- Specify the API URL for data transmission (will be provided later).
- Data transmission method: POST.
Parser operation algorithm:
- The parser should collect all ads from the website, breaking them down into smaller categories in case of page quantity restrictions (for example, if a maximum of 100 pages with 15 ads each is displayed, it is necessary to split into subcategories).
- After collecting all data, the parser should run once a day to gather new ads.
Technical requirements:
- Support for multithreading to speed up the parsing process.
- Possibility of working through proxies to bypass blocks (not many ads, may not be required).
- Error handling and logging (mechanisms for retrying in case of unsuccessful data transmission or site unavailability).
Data update frequency:
- The parser should run every 24 hours to collect new data.
- Possibility of manual launch for urgent data updates.
Additional requirements:
- There should be the possibility of expanding the parser's functionality in the future (adding new fields, changing data collection logic).
- Documentation for installing and running the parser.
- Code comments for better understanding of the operational logic.
Development stages:
- Parser development and testing.
- Integration with API for data transmission.
- Testing the full parser operation cycle.
- Handover of documentation and source code.
Completion deadlines:
- Parser development and testing: [10 days]
- API integration and testing: [10 days]
The parser should run on a server managed by the Linux operating system
Парсер должен работать на сервере под управлением операционной системы Linux
-
7 days89 USD
645 11 0 7 days89 USD
Hello, ready to complete your project, write to discuss the details
-
20 days178 USD
888 18 2 1 20 days178 USD
Hello!
I am interested in your project, I have extensive experience in parsing and processing large volumes of data. Also, after working on the project, I provide my own host for deploying the project and a proxy pool to bypass blocks of frequent requests to the donor server.
Contact me to discuss the details and deadlines for completing this project!
-
1 day89 USD
1876 28 2 2 1 day89 USD
Good day.
I have a lot of experience in creating bots.
The price and deadlines depend on the project details.
I will be glad to cooperate.
Have a nice day.
-
1 day445 USD
8193 63 1 1 day445 USD
Good day!
I am ready to help you with the development of a parser for ads from the minda.city website and transferring data through the API. I am looking forward to discussing all the details and starting work on the project!
-
20 days223 USD
2199 16 0 20 days223 USD
Hello. Interesting task, I will be glad to cooperate. I use leading modern fault-tolerant technologies. I have previously developed parsers and my own API. I will implement multithreading, add proxies, logging, and all other necessary functionality. I will help with server deployment. The code will be written cleanly (any programmer will be able to understand it) taking into account security requirements, the project will be easily scalable. Write me privately to discuss the details.
-
3 days91 USD
726 9 1 3 days91 USD
Hello! I have reviewed your project and I am ready to start working immediately. I guarantee excellent quality and efficiency.
-
10 days223 USD
1982 47 7 2 10 days223 USD
Hello!
I have significant experience in developing parsers and automating processes. I am ready to create a parser for ads from the website minda.city, which will collect and transmit data via API according to your technical specification.
My skills include:
• Parsing data using libraries such as BeautifulSoup and Requests for efficient data collection.
• Implementing multithreading to speed up the parsing process.
• Configuring work through proxies to bypass blocks.
… • Handling errors and logging to ensure the reliability and stability of the parser.
• Formatting data in JSON and transmitting them via API using the POST method.
Ready to discuss project details, deadlines, and cost in private messages.
Best regards, Pavel
-
10 days89 USD
85 10 days89 USD
I work with parsers in C# .NET, I write for Windows. If you need this, let's get in touch and start working.
-
10 days223 USD
683 3 0 10 days223 USD
I am ready to take on the job, I already have ready parsers for movies from websites where all movies and video streams are parsed, descriptions and all information, I also developed a parser for European companies where there are millions of data about various business companies, addresses, phone numbers, etc. I develop parsers in php + bash for ease and simplicity of use on servers without browser virtualization like Selenium, etc., and I have integrated with databases and WordPress websites where data is saved in created posts during parsing, nuances can be discussed.
I am ready to discuss budgets but with changes in deadlines, I also noticed that you have several tasks for parsers, I could do all of them at once in one configurable parser.
My resume: https://djinni.co/q/351767df01/
Also, LinkedIn: https://www.linkedin.com/in/merely-igor/
-
10 days178 USD
237 2 1 10 days178 USD
Hello!
I am ready to take on your project, I will use Python3.12.
Regarding daily parsing (once every 24 hours), I suggest setting up a server and installing a separate script in cron.
For the website, I will start by analyzing using BurpSuite, then I will choose the most suitable implementation method and start development.
Current freelance projects in the category Data Parsing
Carrier databaseInterested in compiling a database of carriers in Ukraine for the year 2026, including tankers, tarpaulins, grain carriers, and others. It is preferable to develop a table. Data Parsing ∙ 8 minutes back ∙ 7 proposals |
Consultation on parsing Instagram account subscribersHello. It is necessary to conduct a preliminary assessment of the feasibility of the following task. I have a list of Instagram accounts. The goal is to obtain contact information (primarily email addresses) of users who follow these accounts. Previously, I encountered companies… Data Parsing ∙ 3 days 15 hours back ∙ 12 proposals |
A specialist is needed to find contacts of decision-makers in Ukraine.It is necessary to gather a database (or ready database) of contacts of decision-makers (DMs) in companies in Ukraine. Information Gathering, Data Parsing ∙ 3 days 20 hours back ∙ 17 proposals |
Need to scrape data from LinkedIn
We need to scrape data from LinkedIn based on our list. For each entry, we need to find and collect available data if it exists on the LinkedIn profile, including the profile picture on the LinkedIn social network, email address, links to social media, company website, and… Data Parsing ∙ 4 days 1 hour back ∙ 28 proposals |
Parsing and classification of data
We are looking for a developer to implement a system for collecting and structuring data from open sources. We have a database of small business owners in the USA, which contains the person's name, company name, address, and state. It is necessary to build a process for… Web Programming, Data Parsing ∙ 4 days 2 hours back ∙ 41 proposals |
Zaporizhzhia