Senior Data Engineer with Amazon experience (Project)
We are looking for a Senior Data Engineer to build an automated data collection system.
Main tasks:
Automate the process of obtaining reports from Amazon and other resources.
Develop and maintain solutions for browser automation using Selenium, Playwright, and Puppeteer.
Manage proxy servers and browser fingerprinting methods to ensure effective data collection.
Work with cloud environments for scalable data processing.
Use API for parallel data loading.
Store and manage collected data in SQL databases.
Use Requests and BeautifulSoup for effective web scraping.
Requirements:
Experience in automating the retrieval of Amazon reports.
High proficiency in Python for scripting and automation.
Practical experience with browser automation (Selenium, Playwright, Puppeteer).
Deep understanding of proxy server management and browser fingerprinting technologies.
Experience in setting up task scheduling and working with cloud environments.
Expert knowledge of API integrations for parallel data retrieval.
Good knowledge of SQL for database management.
Knowledge of Requests and BeautifulSoup for web scraping.
-
33 days75 USD
1069 10 0 33 days75 USD
I have extensive experience in scraping and a lot of completed projects using requests (requests, aiohttp) and automation with browsers (playwright, pyppeteer, selenium), bypassing various types of protection (akamai, cloudflare, perimeter x) and captchas (reCAPTCHA, image captcha, geetest icon captcha, geetest v3/v4 slide captcha, hCAPTCHA, tiktok captcha, funcaptcha, worldfirstcaptcha, cloudflare captcha), performing login and data collection under authorization (using cookies, tokens, and sessions).
-
Дот нет не підійде?
-
Current freelance projects in the category Data Parsing
LinkedIn mailing
120 USD
LinkedIn Mailing It is necessary to launch a LinkedIn mailing to the specified database. 30,000+ contacts We are waiting for proposals Email Marketing, Data Parsing ∙ 1 day 7 hours back ∙ 9 proposals |
Parsing company emails from a specific industry
113 USD
Find contacts (e-mail, phone number) of companies engaged in the specified business mentioned in this Google document https://docs.google.com/document/d/1_d-iLxLSL3gjRvo1GmUpWNm0Pm5YoKGcEvaiDc_2I0g/edit?usp=sharing The result should be in the form of a table with the following… Data Parsing ∙ 2 days 7 hours back ∙ 31 proposals |
Need a parser for the online store https://www.lcsc.com/It is necessary to regularly (once a month, or upon script launch) obtain up-to-date information about the products available in the store. https://www.lcsc.com/ from the catalog of all sections.… Data Parsing ∙ 3 days 12 hours back ∙ 43 proposals |
OpenCart — rental catalog of special equipment
135 USD
OpenCart — Equipment Rental Catalog Need to launch an equipment rental catalog on OpenCart. Theme: excavators cherry pickers forklifts generators cranes scaffolding other construction equipment. It is preferable that you already have a ready-made template or developments… Web Programming, Data Parsing ∙ 4 days 5 hours back ∙ 59 proposals |
Transfer the program - the server where the program was located has crashed (officially permitted parsing of government data)
46 USD
Hello! My client has encountered the case described below. We need help transferring to a new server and testing the program. It would be better to have a programmer who understands parsing. Software & Server Configuration, Data Parsing ∙ 4 days 9 hours back ∙ 30 proposals |
Kyiv