Parcing and data publication

I was assigned to obtain data from a specific section, ad panels, processing these ads, and synchronizing data with the client’s website. Interval of 1 hour.
The project currently covers 6 cities, and collects up-to-date information on real estate rental, collects full information on the advertisement, phone, photo, makes a photo cut, and will post the already processed information on the customer’s website. Everything works on requests, so the speed is high, at the time of writing the article the script for 1 city (2 categories) broke 1500+ objects, the relevance and speed of work was about 2.5 minutes.