Budget: 100 USD Deadline: 3 days
Good afternoon, if the websites are different, then the logic and IDs of the websites for registration fields will be different. If they are similar, then such implementation is possible. Additional costs will include anti-captcha and proxies. I would also recommend purchasing a few. We can discuss the project in more detail, I will tell you everything, explain, and then you can make further decisions.
Briefly about myself:
I design a proper architecture for easy deployment using Docker and can package everything needed there. I have a high level of knowledge in bin, bash, zsh, and I am a confident Linux user.
Creating both regular bots with aiogram and user bots with pyrogram.
In terms of technology stack, I have a strong background.
For web scraping, I use proxies, user-agents, and specify various headers when necessary. I can work with the inspector, JavaScript, DOM, extract data even from AJAX and GraphQL.
Main libraries for web scraping: aiohttp, lxml, bs4, scrapy.
Web automation: Selenium.
Creating APIs in Golang and Python, GinGo, Flask, FastAPI, RestfulAPI, Swagger.
I have experience working with Google Sheets and Google Cloud Console.
Ability to work with various SQL and NoSQL databases.
Solving captchas with anticaptcha.
Knowledge of threading Semaphore, threading, concurrent.future. Ability to work with numpy and more_itertools, specifically chunked for dividing parallel scraping into uniform streams, which greatly speeds up the collection of large volumes of data.
Basic knowledge for building web interfaces.
Also, useful skills include extracting hidden APIs and working with XML.
PyQuery for working with HTML documents.
Pyppeteer for automations.