PART 2 — IAAI PARSER + DATABASE (Backend infrastructure)
500 USD 🎯 Goal
Develop an automated parsing system for the IAAI auto auction that will save data into a centralized relational PostgreSQL database and provide an API for the catalog website.
🧱 Architecture
Language and framework: Python 3.10+, Django Rest Framework
Parsing: Selenium + Undetected ChromeDriver, Requests, BeautifulSoup
Background tasks: Celery + Redis
Data storage: PostgreSQL
Dockerization: optional (Docker + docker-compose)
Logging: JSON logs + error reports
Authorization: if necessary (at auctions)
Proxies: mandatory
Anti-captcha: support for 2Captcha or an equivalent
📥 Data to be collected
| Field | Description |
|---|---|
| Make and model | For example: "Toyota Camry" |
| Year of manufacture | 2019, 2020, etc. |
| Mileage | In miles or kilometers |
| Sale price | In dollars or AED |
| VIN | Unique vehicle identifier |
| Condition | Damaged / intact / damages |
| Location | Country / city / warehouse |
| Fuel | Gasoline / diesel / electric, etc. |
| Transmission | Automatic / manual |
| Sale date | Source-dependent |
| Photos (5+) | Image links |
| Link to lot | Direct link to source |
📌 System requirements
Scheduled operation (cron/Celery Beat)
Multithreading and scalability
Ability to rerun tasks (e.g.,
manage.py parse --source copart)API endpoints:
/api/cars/— list/api/cars/<vin>/— cardFiltering: make, model, year, mileage, fuel type, etc.
API documentation (Swagger/OpenAPI)
🔧 Additional requirements
Documented database structure
Ability to extend to new auctions
Manual task launching capability
Protection against duplicates (VIN + sale date)
Failure notifications (optional — Telegram, email)
💾 Expected result
✔ Working parser
✔ Data is saved daily into PostgreSQL
✔ API endpoints with filtering
✔ Documentation and launch instructions
-
30 days500 USD
733 7 0 30 days500 USDHello!
I have reviewed your technical assignment for developing a parser for the IAAI auto auction and building an API on Django REST Framework. The task is well thought out, and I am ready to implement it fully in accordance with the requirements.
What I will do:
- Parser using Selenium, Requests, and BeautifulSoup to collect all necessary data from the auto auction.
- Organize background tasks via Celery + Redis with scheduling support (Celery Beat).
- Store data in PostgreSQL with duplicate protection (VIN + sale date).
- REST API with filtering by main parameters, Swagger/OpenAPI documentation.
… - Support for proxies and anti-captcha (2Captcha or similar).
- Ability to extend to other auctions and manually run tasks.
- Logging in JSON format and failure notifications (Telegram/email optional).
- Optional Dockerization (Docker + docker-compose).
Technologies: Python 3.10+, Django REST Framework, PostgreSQL, Celery, Redis, Selenium.
Timeline and budget:
Approximately 3–4 weeks for the full development cycle with testing. Cost is negotiable depending on details and volume.
I am ready to discuss details, provide a work plan, and outline stages.
-
30 days499 USD
211 30 days499 USDHello!
We are very interested in your project. Our team, consisting of experienced developers and UI/UX designers, has extensive experience in creating large-scale and scalable platforms. We specialize in developing reliable, high-performance, and intuitive solutions that meet the latest standards.
We use advanced technologies:
Frontend: React and Next.js
Backend: Java, Spring Boot, Microservices
Design: Our UI/UX designer guarantees aesthetics and ease of use.
Others: PostgreSQL, MongoDB, Redis, AWS/GCP/Azure, Docker, Kubernetes.
We have successfully implemented a number of complex projects in fintech, e-commerce, SaaS, creating high-load and scalable systems. We are ready to show relevant cases in a personal conversation.
We are confident that our experience and comprehensive approach will help successfully implement your project. We look forward to discussing details and costs!
-
1 day500 USD
2225 32 0 1 day500 USDGood afternoon. I already have all the ready solutions for copart and iaai. I have a database of millions of cars. It collects data from Live auctions and also through filters. Price is 2000 USD per website.
-
40 days500 USD
182 40 days500 USDGood afternoon
I will create an IAAI parser and integrate it into the database structure environment, which will be connected to the final version of the website that integrates three parsers from three different sites, as well as the website itself
Thank you
-
13 days500 USD
290 1 0 13 days500 USDHello! I represent SolidWay and am ready to assist with the development of your automated data parsing system from the IAAI auto auction. We have extensive experience with similar projects, including the use of Python and Django Rest Framework, as well as integration with PostgreSQL for data storage.
We are familiar with the necessary technologies such as Selenium, Celery, and Redis, and can effectively implement multithreading and scalability to ensure reliable system operation. Our team has also mastered data protection and documentation methods, which will allow us to provide you with complete API and database structure documentation.
We will discuss the project details to precisely determine the best way to implement it. The time and cost will be defined after a more in-depth discussion of your requirements. We look forward to your response!
-
15 days500 USD
1015 6 0 15 days500 USDGood day. I have extensive experience in creating parsers and using Django/DRF. Feel free to contact me.
Current freelance projects in the category Data Parsing
Create a dashboard in https://airtable.com/ for the performance of advertising creatives from Facebook ads.Full specification https://docs.google.com/document/d/1_n_oYRNZWYxalUA---DM5AD1b5ZSrtePw5J4G42svGw/edit?usp=sharing Databases & SQL, Data Parsing ∙ 21 hours 43 minutes back ∙ 16 proposals |
Creation of an Excel file for uploading products to the websites of other partners.I am interested in creating an Excel table with all parameters. Here is the website - https://heiztechnik.com.ua/ And the positions I am interested in to be transferred: Manual boilers: 1) TIS UNI 15-95 kW (10) pcs 2)TIS HARD 150-500 kW (7) pcs Pellet boilers: 1)TIS PELLET… Data Parsing ∙ 1 day 1 hour back ∙ 33 proposals |
A developer is required for parsing the catalog and automating data import.Detailed technical specifications in the attached document Please indicate the estimated cost and timeline in your response Do you have experience working with parsing large catalogs What possible difficulties or limitations do you see in this task Databases & SQL, Data Parsing ∙ 1 day 4 hours back ∙ 37 proposals |
Find a product feed (Google Merchant XML) for a website on OpenCart
16 USD
It is necessary to find a direct link to the active product feed (XML) of a competitor for Google Merchant Center Platform (CMS): OpenCart / ocStore Find the original feedRequirements for the result: Working link to the XML file Python, Data Parsing ∙ 1 day 10 hours back ∙ 21 proposals |
Parsing products from supermarketsNeed a specialist (parsing + Google Sheets + automation). Goal: Create a system for automatic retrieval and updating of food prices from Silpo and NOVUS supermarkets with data output to Google Sheets. What needs to be implemented: Create a main Google Sheets table with a product… Data Parsing, Information Gathering ∙ 1 day 17 hours back ∙ 46 proposals |
Dubai