Parser of the car parts catalog b2c.ad.ua

The task was to spark all the goods of several car brands from the car parts catalog on the supplier's website. All the car brands were first collected. There were 22,000 models of cars. It was necessary to spark a catalogue for each model and spark all goods in all categories. 4,500,000 car parts were eventually scattered. Parsing took 2 weeks on the i7-3930k 3.2 GHz, 32 GB of operating memory. Parser worked on a browser emulator in 12 streams