Budget: 3500 UAH Deadline: 6 days
Good day, I have worked multiple times with the DEX platform and can implement your project within 6 days.
I design a proper architecture for easy deployment with the help of Docker and can package everything needed there. Proficient in bin, bash, zsh at a high level, confident Linux user.
Regarding the technology stack, I have a strong background.
For parsing, I use proxies, user-agents, and specify various headers when necessary. I can work with the inspector, JavaScript, DOM, extract data even from AJAX and GraphQL.
Main parsing libraries: aiohttp, lxml, bs4, scrapy.
Web automation: Selenium.
Creating APIs in Golang and Python, GinGo, Flask, FastAPI, RestfulAPI, Swagger.
Experience working with Google Sheets and Google Cloud Console.
Ability to work with various SQL and NoSQL databases.
Solving captchas with anticaptcha.
Knowledge of Semaphore, threading, concurrent.future. Ability to work with numpy and more_itertools, specifically chunked for dividing parallel scraping into uniform streams, which greatly speeds up the collection of large volumes of data.
Basic knowledge for building web interfaces.
Additionally, useful skills include extracting hidden APIs and working with XML.
PyQuery for working with HTML documents.
Pyppeteer also for automations.