Develop a parser for Chrome Web Store
112 USD If you have done similar parsers or have similar projects in your portfolio, please indicate, this will be a big plus. The budget is approximate, so please provide your approximate forecasts.
Thank you!
Here is the preliminary technical task, the final one will be after detailed discussion with the performer.
===============
Develop a parser for Chrome Web Store, which should parse all possible data from the store, such as:
1. Detailed information about the extension/theme
- Name
- Description
- Category
- Reviews
- ...and much more
2. Download the extension archive and get additional information from it (I will provide a tool that allows this, or help set it up)
- Save file
- File size
- Extension translations
- Manifest data
3. Categories and category indexes
4. Collections and indexes by collections
5. Search dropdown key issuance index (keywords will be pre-passed to the script)
6. Search result key issuance index (keywords will be pre-passed to the script)
Technical requirements:
1. The script should be launched from the console
2. Support for multithreading (as there are many extensions and data, parsing needs to be optimized)
3. Configure data storage in Postgresql and CSV
4. The parser must be able to solve various blocking, such as captcha or IP blocking, using proxies or other tools
5. Implement a logging system to track the parser's status during execution
6. Provide reports after script execution (number of processed extensions, categories, keywords, etc.)
It would be a plus if:
- Good knowledge of databases and their optimization to reduce data duplicates during repeated parsing
- Parsing not by markup, but by requests to the backend (as this will be important for this partner)
- Experience in writing similar parsers
-
15 days337 USD
786 27 2 2 15 days337 USD
Hello! I have extensive experience in writing parsers and bots. Well acquainted with the possibilities of bypassing captchas, changing IP and User-Agent, using proxies, and downloading files from websites. A good option would be to implement this on Selenium, you can try through requests, but this option loses in the context of bypassing blocking. Are you planning to use Google accounts or parse without them? We can discuss the project in detail in private messages.
-
1 day449 USD
8193 63 1 1 day449 USD
Hello everyone! Ready to start working on writing a parser for Chrome Web Store. Looking forward to discussing the project details and getting started. Thank you!
-
10 days449 USD
2912 44 0 10 days449 USD
Good day.
I can implement it in nodejs
----------------------------------
-
15 days607 USD
8867 60 0 1 15 days607 USD
Good day!
Ready to create a parser for Chrome Web Store.
Have experience in developing similar bots.
We write in Python. Ranked 9th on the platform in this language.
Looking forward to collaborating!
-
5000 грн за розв'язок капчі? 😂 😅
-
В чому питання?
-
може в тому що обійти капчу не так то просто. на її розробку витрачаються набагато більші суми. а ви хочете за копійки її обійти
-
1. Це не фінальний бюджет, я зазначив описі, щоб кандидати пропонували свій. Але я згоден, мій косяк, потрібно було просто нічого не вводити в поле. На жаль зараз не можу це змінити.
2. Не факт що потрібно буде вирішувати капчу, це мої здогадки. Можливо потрібно буде використовувати проксі і цього вистачить, поки не спробуємо не взнаємо.
3. Для вирішування капч вже є купа інструментів в тому числі платних, тому тут не обовʼязково потрібно буде писати окремий скрипт рекогнішену капч з інтеграцією з Open AI.
-
Current freelance projects in the category Data Parsing
Database of websites on WooCommerceIt is necessary to compile a database of Ukrainian online store websites on WooCommerce with the contact information provided on the sites. Only active websites (indicator: updated catalog/content, working domain) Table format - website address, phone number, e-mail. Data Parsing ∙ 1 day 8 hours back ∙ 19 proposals |
Create a dashboard in https://airtable.com/ for the performance of advertising creatives from Facebook ads.Full specification https://docs.google.com/document/d/1_n_oYRNZWYxalUA---DM5AD1b5ZSrtePw5J4G42svGw/edit?usp=sharing Databases & SQL, Data Parsing ∙ 2 days 22 hours back ∙ 17 proposals |
Creation of an Excel file for uploading products to the websites of other partners.I am interested in creating an Excel table with all parameters. Here is the website - https://heiztechnik.com.ua/ And the positions I am interested in to be transferred: Manual boilers: 1) TIS UNI 15-95 kW (10) pcs 2)TIS HARD 150-500 kW (7) pcs Pellet boilers: 1)TIS PELLET… Data Parsing ∙ 3 days 3 hours back ∙ 34 proposals |
A developer is required for parsing the catalog and automating data import.Detailed technical specifications in the attached document Please indicate the estimated cost and timeline in your response Do you have experience working with parsing large catalogs What possible difficulties or limitations do you see in this task Databases & SQL, Data Parsing ∙ 3 days 5 hours back ∙ 39 proposals |
Find a product feed (Google Merchant XML) for a website on OpenCart
16 USD
It is necessary to find a direct link to the active product feed (XML) of a competitor for Google Merchant Center Platform (CMS): OpenCart / ocStore Find the original feedRequirements for the result: Working link to the XML file Python, Data Parsing ∙ 3 days 11 hours back ∙ 23 proposals |
Kyiv