www.m-ets.ru scrapper
https://m-ets.ru scrapper.
I deciphered the m-ets cipher and created the functions for generating cookies on the fly.
The scrapper is asynchronous. It works with Celery. You can monitor tasks with Flower.
The scrapper is super effective. It uses only bs4. There is a possibility of using proxy.
It scrapes around 110K lots. The total data size is above 10GB. The database record has more than 30 fields.
It downloads all files and extracts all periods from a lot page.
I used MongoDB database.
I attached the example of database record.
I deciphered the m-ets cipher and created the functions for generating cookies on the fly.
The scrapper is asynchronous. It works with Celery. You can monitor tasks with Flower.
The scrapper is super effective. It uses only bs4. There is a possibility of using proxy.
It scrapes around 110K lots. The total data size is above 10GB. The database record has more than 30 fields.
It downloads all files and extracts all periods from a lot page.
I used MongoDB database.
I attached the example of database record.
Хмельницкий 
Сильно занят