An asynchronous parser has been developed for collecting products from the online store azi.ua with automatic data saving in an SQLite database.
The project is built on an asynchronous architecture that allows for efficient processing of a large number of pages and reduces the load on the server.
Functionality
asynchronous data collection (aiohttp + asyncio)
automatic traversal of categories and pages
server load control (Semaphore)
parsing product names and prices
saving data in an SQLite database
protection against duplicate records
Result
structured SQLite database
data categorized
ready for analysis or further processing
Technologies
Python, aiohttp, asyncio, BeautifulSoup, SQLite
Usage
market analysis
price monitoring
data collection for stores
automation of parsing
#python #parsing #scraping #aiohttp #sqlite #automation #data
The project is built on an asynchronous architecture that allows for efficient processing of a large number of pages and reduces the load on the server.
Functionality
asynchronous data collection (aiohttp + asyncio)
automatic traversal of categories and pages
server load control (Semaphore)
parsing product names and prices
saving data in an SQLite database
protection against duplicate records
Result
structured SQLite database
data categorized
ready for analysis or further processing
Technologies
Python, aiohttp, asyncio, BeautifulSoup, SQLite
Usage
market analysis
price monitoring
data collection for stores
automation of parsing
#python #parsing #scraping #aiohttp #sqlite #automation #data