Supplier product parser in Python and Scrapy
Supplier site parser, about 4000 products. Need to crawl all pages once a day.
1. Authorization using a cookie file.
2. Search for all product pages
3. Extract Images, Names, Prices (shown only after authorization) and availability
4. Write data to a mysql database on the server and save images
The site is very simple, without js loading and so on.
Client's review of cooperation with Vitalii Zhovnirchyk
Supplier product parser in Python and ScrapyThank you. A professional in parsers
Freelancer's review of cooperation with Andrey Lyts
Supplier product parser in Python and ScrapyThank you for choosing me as the performer. We agreed on a permanent collaboration.
-
I have a parser for this website. It has been working in the client for several years.
It writes information to MySql.
The parser logs into the account and parses everything quickly.
It is written using requests, not Scrapy.
It works fast.
There are also about 30 parsers for similar websites with the same products as on andopt.
… The price is indicated for 1 website. If you take parsers for other similar websites from me, I will give a discount.
-
414 1 0 Hello, can we move to private messages to discuss the details and also what kind of website it is?
-
1094 10 0 Good afternoon!
Write to me, we will discuss the details and get started.
I will develop in Python.
Sincerely, Andrey!
-
3411 32 0 Good day.
I can solve this task with a Python script.
We can discuss the details in private messages.
You can also provide a link to another site that requires mandatory authorization.
-
3367 84 0 Ready to take it on.
But we need to clarify the order details, write!
I will implement it with a script in Python.
-
Так может сайт покажите?
-
Current freelance projects in the category Python
Calculate the location of the lost iPhone
56 USD
The phone was lost a day ago, the live location through the FIND MY app is no longer updating, the phone seems to be offline, lost mode is enabled. I need to determine the exact location of this device using some unconventional methods - I have tried everything available online… Python, Data Parsing ∙ 2 hours 30 minutes back ∙ 2 proposals |
Creation of a TikTok farm with income generation
602 USD
Looking for a person who can write software for a TikTok farm, so we can generate traffic and earn income. We are seeking a ready-made solution with a full cycle. Python, Bot Development ∙ 2 hours 58 minutes back ∙ 3 proposals |
AI Commenting Platform for TikTok and Instagram.Project Goal Develop a system that allows managing a large number of TikTok and Instagram accounts and automatically posting relevant comments under selected videos using AI. Main Functionality1. Account Management It is necessary to implement the ability to connect accounts:… AI & Machine Learning, Python ∙ 1 day 10 hours back ∙ 18 proposals |
Build a customer classification model1. There is client data in Mongo/SQL (approximately 20,000 entries with raw data). 2. It is necessary to build features and a classification model of clients into behavioral groups based on this data. 3. The project should be completed in Python. AI & Machine Learning, Python ∙ 3 days 4 hours back ∙ 39 proposals |
IT Automation of VAT Reporting
223 USD
It is necessary to develop a system for automating the transfer of sales data from the CRM to the accounting system Wafeq. The system should import bank and payment reports, automatically reconcile payments with invoices, generate invoices for VAT reporting, and minimize manual… AI & Machine Learning, Python ∙ 3 days 9 hours back ∙ 49 proposals |