Automated Product Parser for Shopify from AliExpress
Project description:
A universal parser has been developed for collecting product data from AliExpress for further import into Shopify. The project supports several operating modes, allowing for the processing of both individual products and bulk requests, significantly simplifying the process of catalog formation for the online store.
Key functional capabilities:
Parsing a single product:
A link to an individual product is accepted.
The result is saved in the format defined in the template.
Parsing a search query:
The user sets a limit on the number of products to parse.
A list of products is formed from the search page according to the specified format, but with multiple entries.
Parsing a list of links:
A CSV file with a list of product links, separated by commas, is accepted.
Parsing is performed for each link, and the results are formatted in the same way as for a single product, but output as a dataset.
Output file formats:
For each parsing mode, three types of files are generated:
CSV – basic report with product data.
JSON – alternative format for convenience in working with data.
Shopify CSV – filled file for uploading to Shopify, meeting official requirements.
Uploading photos:
For each product, photos are uploaded to hosting.
A separate folder is automatically created for each product, the name of which is generated as a unique ID.
Within the folder, subfolders are created to separate main photos and review photos.
Limitations – up to 250 photos per product, using only main photos (review photos are also uploaded but placed separately).
Other important requirements:
The project interface is user-oriented.
Files contain instructions for matching fields from the parsing file for correct data transfer to the file.
Parsing and data processing:
Implemented using Python with libraries for working with HTTP requests and HTML parsing.
Report generation: Automatic creation of files in CSV and JSON formats for convenient further analysis and data upload.
Integration with Shopify: Formation of a file for uploading products to Shopify according to the official template, providing a basic structure for further manual changes.
Automation of photo uploads: Photos from the product description are automatically uploaded to hosting and organized into separate folders, facilitating image management.
The implementation of this project allows for the automation of the data collection process for products from AliExpress and their subsequent import into Shopify. Thanks to the flexibility of parsing modes (single product, search query, list of links) and support for saving data in multiple formats, the system significantly simplifies the creation and filling of product catalogs. The project demonstrates the ability to integrate various technologies to create effective automation tools, which is particularly relevant for modern e-commerce.
A universal parser has been developed for collecting product data from AliExpress for further import into Shopify. The project supports several operating modes, allowing for the processing of both individual products and bulk requests, significantly simplifying the process of catalog formation for the online store.
Key functional capabilities:
Parsing a single product:
A link to an individual product is accepted.
The result is saved in the format defined in the template.
Parsing a search query:
The user sets a limit on the number of products to parse.
A list of products is formed from the search page according to the specified format, but with multiple entries.
Parsing a list of links:
A CSV file with a list of product links, separated by commas, is accepted.
Parsing is performed for each link, and the results are formatted in the same way as for a single product, but output as a dataset.
Output file formats:
For each parsing mode, three types of files are generated:
CSV – basic report with product data.
JSON – alternative format for convenience in working with data.
Shopify CSV – filled file for uploading to Shopify, meeting official requirements.
Uploading photos:
For each product, photos are uploaded to hosting.
A separate folder is automatically created for each product, the name of which is generated as a unique ID.
Within the folder, subfolders are created to separate main photos and review photos.
Limitations – up to 250 photos per product, using only main photos (review photos are also uploaded but placed separately).
Other important requirements:
The project interface is user-oriented.
Files contain instructions for matching fields from the parsing file for correct data transfer to the file.
Parsing and data processing:
Implemented using Python with libraries for working with HTTP requests and HTML parsing.
Report generation: Automatic creation of files in CSV and JSON formats for convenient further analysis and data upload.
Integration with Shopify: Formation of a file for uploading products to Shopify according to the official template, providing a basic structure for further manual changes.
Automation of photo uploads: Photos from the product description are automatically uploaded to hosting and organized into separate folders, facilitating image management.
The implementation of this project allows for the automation of the data collection process for products from AliExpress and their subsequent import into Shopify. Thanks to the flexibility of parsing modes (single product, search query, list of links) and support for saving data in multiple formats, the system significantly simplifies the creation and filling of product catalogs. The project demonstrates the ability to integrate various technologies to create effective automation tools, which is particularly relevant for modern e-commerce.
Irpen 
Available for hire
Offer work