PART 3 — PARSER Emirates Auction.com + DATABASE (Backend infrastructure)
🎯 Goal
Develop an automated parsing system for Emirates Auction auto auctions that will save data into a centralized PostgreSQL relational database and provide an API for the catalog website.
🧱 Architecture
Language and Framework: Python 3.10+, Django Rest Framework
Parsing: Selenium + Undetected ChromeDriver, Requests, BeautifulSoup
Background Tasks: Celery + Redis
Data Storage: PostgreSQL
Dockerization: optional (Docker + docker-compose)
Logging: JSON logs + error reports
Authorization: if necessary (in auctions)
Proxies: mandatory
Anti-captcha: support for 2Captcha or similar
📥 Data to Collect
| Field | Description |
|---|---|
| Brand and Model | For example: "Toyota Camry" |
| Year of Manufacture | 2019, 2020, etc. |
| Mileage | In miles or kilometers |
| Sale Price | In dollars or AED |
| VIN | Unique vehicle identifier |
| Condition | Damaged / intact / damages |
| Location | Country / city / warehouse |
| Fuel | Gasoline / Diesel / Electric, etc. |
| Transmission | Automatic / Manual |
| Sale Date | Source-dependent |
| Photos (5+) | Image links |
| Link to Lot | Direct link to source |
📌 System Requirements
Scheduled operation (cron/Celery Beat)
Multithreading and scalability
Ability to rerun tasks (e.g.,
manage.py parse --source copart)API endpoints:
/api/cars/— list/api/cars/<vin>/— cardFiltering: brand, model, year, mileage, fuel type, etc.
API documentation (Swagger/OpenAPI)
🔧 Additional Requirements
Documented database structure
Extendability to new auctions
Manual task execution capability
Duplicate protection (VIN + sale date)
Failure notifications (optional — Telegram, email)
💾 Expected Result
✔ Working parser
✔ Data is saved daily into PostgreSQL
✔ API endpoints with filtering
✔ Documentation and startup instructions
-
15 days500 USD
128 15 days500 USDHello!
I am a Python developer with experience in parsing dynamic websites using Selenium, utilizing proxies and anti-captcha. I have created reliable solutions with PostgreSQL, Celery for background tasks, and REST API on Django Rest Framework with filtering and documentation.
I am ready to implement an Emirates Auction parser with data storage in a database, set up an API with filters, background tasks, and notifications. I can also assist with Dockerization and logging.
I would be happy to discuss details and start working.
Best regards,
… Urmant
-
30 days500 USD
733 7 0 30 days500 USDHello!
I have reviewed your technical assignment for developing a parser for the IAAI auto auction and building an API on Django REST Framework. The task is well thought out, and I am ready to implement it in full accordance with the requirements.
What I will do:
A parser using Selenium, Requests, and BeautifulSoup to collect all necessary data from the auto auction.
Organization of background tasks via Celery + Redis with schedule support (Celery Beat).
Data storage in PostgreSQL with duplicate protection (VIN + sale date).
REST API with filtering by main parameters, Swagger/OpenAPI documentation.
… Support for proxies and anti-captcha (2Captcha or similar).
Ability to extend to other auctions and manual task execution.
Logging in JSON format and failure notifications (Telegram/email optional).
Optional Dockerization (Docker + docker-compose).
Technologies: Python 3.10+, Django REST Framework, PostgreSQL, Celery, Redis, Selenium.
Timeline and budget:
Approximately 3–4 weeks for the full development cycle with testing. Cost is negotiable depending on details and volume.
I am ready to discuss details, provide a work plan, and outline stages.
-
30 days500 USD
211 30 days500 USDHello!
We are very interested in your project. Our team, consisting of experienced developers and UI/UX designers, has extensive experience in creating large-scale and scalable platforms. We specialize in developing reliable, high-performance, and intuitive solutions that meet the latest standards.
We use advanced technologies:
Frontend: React and Next.js
Backend: Java, Spring Boot, Microservices
Design: Our UI/UX designer guarantees aesthetics and ease of use.
Others: PostgreSQL, MongoDB, Redis, AWS/GCP/Azure, Docker, Kubernetes.
We have successfully implemented a number of complex projects in fintech, e-commerce, SaaS, creating high-load and scalable systems. We are ready to show relevant cases in a personal meeting.
We are confident that our experience and comprehensive approach will help successfully implement your project. We would be happy to discuss details and costs!
-
40 days500 USD
182 40 days500 USDGood afternoon
I will create a parser for Emirates Auction.com and integrate it into the database structure, which will be connected to the final version of the website that integrates three parsers for three different sites, as well as the website itself
Thank you
-
15 days500 USD
1015 6 0 15 days500 USDGood day. I have extensive experience in creating parsers and using Django/DRF. Feel free to contact me.
Current freelance projects in the category Data Parsing
Create a dashboard in https://airtable.com/ for the performance of advertising creatives from Facebook ads.Full specification https://docs.google.com/document/d/1_n_oYRNZWYxalUA---DM5AD1b5ZSrtePw5J4G42svGw/edit?usp=sharing Databases & SQL, Data Parsing ∙ 16 hours 18 minutes back ∙ 13 proposals |
Creation of an Excel file for uploading products to the websites of other partners.I am interested in creating an Excel table with all parameters. Here is the website - https://heiztechnik.com.ua/ And the positions I am interested in to be transferred: Manual boilers: 1) TIS UNI 15-95 kW (10) pcs 2)TIS HARD 150-500 kW (7) pcs Pellet boilers: 1)TIS PELLET… Data Parsing ∙ 20 hours 27 minutes back ∙ 30 proposals |
A developer is required for parsing the catalog and automating data import.Detailed technical specifications in the attached document Please indicate the estimated cost and timeline in your response Do you have experience working with parsing large catalogs What possible difficulties or limitations do you see in this task Databases & SQL, Data Parsing ∙ 23 hours 19 minutes back ∙ 34 proposals |
Find a product feed (Google Merchant XML) for a website on OpenCart
16 USD
It is necessary to find a direct link to the active product feed (XML) of a competitor for Google Merchant Center Platform (CMS): OpenCart / ocStore Find the original feedRequirements for the result: Working link to the XML file Python, Data Parsing ∙ 1 day 4 hours back ∙ 19 proposals |
Parsing products from supermarketsNeed a specialist (parsing + Google Sheets + automation). Goal: Create a system for automatic retrieval and updating of food prices from Silpo and NOVUS supermarkets with data output to Google Sheets. What needs to be implemented: Create a main Google Sheets table with a product… Data Parsing, Information Gathering ∙ 1 day 12 hours back ∙ 43 proposals |