Develop a parser for ads from the website https://gancxadebebi.ge/ru/
Technical task (TT) for the development of a classifieds parser from the website https://gancxadebebi.ge/ru/
Goal:
Create a classifieds parser from the website https://gancxadebebi.ge/ru/ that will collect specific data and transmit it via API.
Requirements:
Website for parsing:
Collected data:
- City
- Region
- Category
- Subcategory
- Phone number (or multiple numbers if provided)
- Date of ad placement
Data transmission format:
- All collected data should be transmitted via API.
- Data format: JSON.
- Example JSON structure:
jsonCopy code{
"city": "Tbilisi",
"region": "Kartli",
"category": "Real Estate",
"subcategory": "Apartment Rental",
"phone_numbers": ["+995123456789", "+995987654321"]
}
API for data transmission:
- Specify the API URL for data transmission (will be provided later).
- Data transmission method: POST.
Parser operation algorithm:
- The parser should collect all ads from the website, breaking them down into smaller categories in case of page quantity restrictions (for example, if a maximum of 100 pages with 15 ads each is displayed, it is necessary to split into subcategories).
- After complete data collection, the parser should run once a day to gather new ads.
Technical requirements:
- Support for multithreading to speed up the parsing process.
- Possibility of working through proxies to bypass blocks (not many ads, may not be required)
- Error handling and logging (mechanisms for retrying in case of unsuccessful data transmission or site unavailability).
Data update frequency:
- The parser should run every 24 hours to collect new data.
- Possibility of manual launch for urgent data updates.
Additional requirements:
- There should be the possibility of expanding the parser's functionality in the future (adding new fields, changing data collection logic).
- Documentation for installing and running the parser.
- Code comments for better understanding of the operation logic.
- The parser should run on a server running the Linux operating system.
Development stages:
- Parser development and testing.
- Integration with API for data transmission.
- Testing the full parser operation cycle.
- Handover of documentation and source code.
Completion deadlines:
- Parser development and testing: [10 days]
- API integration and testing: [10 days]
-
1783 28 2 2 Good day.
I have a lot of experience in creating bots.
The price and deadlines depend on the project details.
I will be glad to cooperate.
Have a nice day.
-
8193 63 1 Good day!
I am ready to help you with implementing a parser for collecting data from the website https://gancxadebebi.ge/ru/ and sending it via API. I am looking forward to discussing all the details and starting work!
-
3356 70 1 Hello.
I specialize in writing parsers from scratch.
I use JavaScript when creating software.
I have reviewed the project, the website, and I am ready to discuss it more specifically in private.
-
1982 47 7 2 Hello!
I have significant experience in developing parsers and automating processes. I am ready to create a parser for ads from the website minda.city, which will collect and transmit data via API according to your technical task.
My skills include:
• Parsing data using libraries such as BeautifulSoup and Requests for efficient data collection.
• Implementing multithreading to speed up the parsing process.
• Configuring work through proxies to bypass blocks.
… • Handling errors and logging to ensure the reliability and stability of the parser.
• Formatting data in JSON and transmitting them via API using the POST method.
Ready to discuss project details, deadlines, and cost in private messages.
Best regards, Pavel
-
85 I work with parsers in C# .NET, I write for Windows. If you need this, let's get in touch and start working.
-
726 9 1 Good day! Your project looks very promising. I am ready to start working on it and complete it at the highest level.
-
683 3 0 I am ready to take on the job, I already have ready parsers for movies from websites where all movies and video streams are parsed, descriptions and all information, I also developed a parser for European companies where there are millions of data about various business companies, addresses, phone numbers, etc. I develop parsers in php + bash for ease and simplicity of use on servers without browser virtualization like Selenium, etc., and integrated with a database and a WordPress site where data is saved as posts during parsing, nuances can be discussed.
I am ready to discuss budgets but with changes in deadlines, also noticed that you have several tasks for parsers, I could do all at once in one configurable parser.
My resume: https://djinni.co/q/351767df01/
Also LinkedIn: https://www.linkedin.com/in/merely-igor/
Current freelance projects in the category Data Parsing
Database of websites on WooCommerceIt is necessary to compile a database of Ukrainian online store websites on WooCommerce with the contact information provided on the sites. Only active websites (indicator: updated catalog/content, working domain) Table format - website address, phone number, e-mail. Data Parsing ∙ 1 day 2 hours back ∙ 19 proposals |
Create a dashboard in https://airtable.com/ for the performance of advertising creatives from Facebook ads.Full specification https://docs.google.com/document/d/1_n_oYRNZWYxalUA---DM5AD1b5ZSrtePw5J4G42svGw/edit?usp=sharing Databases & SQL, Data Parsing ∙ 2 days 17 hours back ∙ 17 proposals |
Creation of an Excel file for uploading products to the websites of other partners.I am interested in creating an Excel table with all parameters. Here is the website - https://heiztechnik.com.ua/ And the positions I am interested in to be transferred: Manual boilers: 1) TIS UNI 15-95 kW (10) pcs 2)TIS HARD 150-500 kW (7) pcs Pellet boilers: 1)TIS PELLET… Data Parsing ∙ 2 days 21 hours back ∙ 34 proposals |
A developer is required for parsing the catalog and automating data import.Detailed technical specifications in the attached document Please indicate the estimated cost and timeline in your response Do you have experience working with parsing large catalogs What possible difficulties or limitations do you see in this task Databases & SQL, Data Parsing ∙ 3 days back ∙ 39 proposals |
Find a product feed (Google Merchant XML) for a website on OpenCart
16 USD
It is necessary to find a direct link to the active product feed (XML) of a competitor for Google Merchant Center Platform (CMS): OpenCart / ocStore Find the original feedRequirements for the result: Working link to the XML file Python, Data Parsing ∙ 3 days 5 hours back ∙ 22 proposals |