We are looking for an outsourcing specialist for tasks related to parsing catalogs, manufacturer websites, and OEM sources.
We need to collect structured information from various websites: product catalogs, equipment models, parts compatibility, OEM part numbers, product names, source links, and other fields depending on the specific site.
Main tasks:
- analyzing websites and finding the optimal way to obtain data: API, HTML, JSON, CSV/XLSX, PDF, or other available sources;
- writing scripts for data collection;
- cleaning, normalizing, and structuring data;
- delivering the result in CSV, Google Sheets, or an agreed structure for further import into our database;
- implementing re-runs without duplicating records;
- logic for data updates: new / updated / unchanged;
- logging runs, errors, and the number of collected/updated records;
- brief documentation: how to run the script, what dependencies are needed, what fields are collected, what unique key is used.
Required skills:
- Python or another relevant language for scraping / data extraction;
- requests, BeautifulSoup, lxml, pandas;
- Selenium or Playwright for JavaScript websites;
- working with API, JSON, CSV, XLSX;
- basic understanding of SQL or data preparation for database import;
- Git / GitHub;
- ability to work with regular data updates and deduplication / upsert logic;
- attention to data structure and script stability.
It would be a plus:
- experience in parsing e-commerce websites, parts catalogs, OEM catalogs, or technical documentation;
- experience working with Google Sheets API;
- experience processing PDF catalogs or tables;
- experience setting up regular script runs;
- ability to describe source limitations and risks of maintaining the parser.
Collaboration format:
We plan to work hourly. For each new site, a brief technical discovery needs to be done first: analyze the source, understand the data retrieval method, assess complexity, risks, and estimated implementation time.
After that, we agree on the scope of work and the limit of hours for implementation.
In your response, please send:
- examples of scraping / data extraction projects;
- GitHub or code samples, if available;
- your optimal hourly rate;
- what tools you usually use.
