Budget: 2000 UAH Deadline: 3 days
Good day .I prescribe a skilled architecture for a simple deploy with the help of a docker and I can pack there everything you need, knowledge of bin, bash, zsh at a high level, a confident user of Linux.With technology, I have a big background.
In parsing I use proxy, user-agent and the list of different headers according to the needs, I know how to work with the inspector, javascript, home, I know how to extract data even from ajax and graphql
Basic libraries for parsing: aiohttp, lxml,bs4, scrapy
Web Automation: Selenium
Creating API, on golang and python, GinGo, Flask, FastAPI, RestfulAPI, Swagger
I have experience with Google Sheets and Google Cloud Console.
Capacity to work with different bases of sql and nosql.The solution is anticaptcha.Knowledge of flows Semaphore, threading, concurrent.future. Capacity to work with numpy and more_itools and namely chunked to break down parallel scraping on equal flows, which faster the collection of volume data.
Basic Knowledge for Building Web Interfaces
Also with useful skills, the ability to access hidden API, and work with xml
PyQuery to work with HTML documents
Pyppeteer also for automation