Budget: 6000 UAH Deadline: 3 days
Hi, I am familiar with your task, ready to start.
My stick: JS, TS, ReactJS, Redux, SCSS...
Write, I will be happy to help.
Oleksandr Bodyul
Winning proposal- Projects 8
- Rating -
- Rating 960
Budget: 6600 UAH Deadline: 6 days
Good morning, familiar with your archive and TZ in it, everything is clear, ready to step forward.About myself: I prescribe a skilled architecture for a simple deploy with the help of a docker and I can pack there everything you need, knowledge of bin, bash, zsh at a high level, a reliable Linux user.I’m sure I realize both web interfaces and GUI interfaces, you can look at the portfolio, https://github.com/sashabodiul and can personally show real projects.by PyQt5,kivy, tkinter, Flask, FastAPI, Django
With technology, I have a big background.
In parsing I use proxy, user-agent and the list of different headers according to the needs, I know how to work with the inspector, javascript, home, I know how to extract data even from ajax and graphql
Basic libraries for parsing: aiohttp, lxml,bs4, scrapy
Web Automation: Selenium
Creating API, on golang and python, GinGo, Flask, FastAPI, RestfulAPI, Swagger
I have experience with Google Sheets and Google Cloud Console.
Capacity to work with different bases of sql and nosql.The solution is anticaptcha.Knowledge of flows Semaphore, threading, concurrent.future. Capacity to work with numpy and more_itools and namely chunked to break down parallel scraping on equal flows, which faster the collection of volume data.
Basic Knowledge for Building Web Interfaces
Also with useful skills, I know how to work with API, how to access hidden API, and how to work with xml
PyQuery to work with HTML documents
Pyppeteer also for automation
- Projects -
- Rating -
- Rating 321
Budget: 4750 UAH Deadline: 7 days
Good morning, ready to get to work. I would like to clarify about the translation: does it go through the API of the Google Translator? The price depends on the number of sites in the parser, the amount is ready to be discussed and agreed. Do you need it with Python? Or optional? Write, I will be happy to answer your questions and participate in your project.
Budget: 4800 UAH Deadline: 10 days
Good day .
I have experience working with the Selenium parser. I have good skills with Python.
Ready to work on your project.
Budget: 5500 UAH Deadline: 3 days
a good day. I can get to work right now. There is experience
Proposals concealed
Proposals are currently absent
-
Igor Fedorenko 16 March 2024Здравствуйте, парсить сайты разные или какой-то один? разные сайты разная верстка соответственно разные селекторы что усложняет задачу и соответственно цену,для этого нужны линки тех сайтов с которых нужно брать инфу, и обязательно на пайтоне писать?
-
Igor Fedorenko 16 March 2024ну это понятно, вопрос был как принципиально писать на пайтоне, и если не принципиально то хотелось бы увидеть ввесь список доноров
-
Platon Y.
17 March 2024
Непринципиально, можно и с нуля написать. Там только интерфейс частично сделан.
Current freelance projects in the category Data Parsing
A specialist is needed to collect and structure open information about sellers from marketplaces. It is necessary to determine the possibility of automated data collection and to form a database of sellers. In your response, please indicate: which marketplaces you have experience working with; what data you can obtain (seller name, link, categories, rating, number of products, other available fields); examples of similar projects.
Technical task Project Configuration of filling and synchronization of two Prom.ua stores with suppliers of auto parts. Task It is necessary to implement the loading and updating of products from auto parts suppliers for two online stores on Prom.ua. ⸻ 1. Connecting suppliers It is necessary to connect suppliers through: Supplier API; XML, CSV, XLS price lists; or another available method of obtaining products from the supplier's website. It is important to ensure complete synchronization of products between the supplier and the Prom.ua stores. ⸻ 2. Filtering and selection of products It is necessary to implement the ability to select products during import based on the following parameters: Car brand; Category of parts; Subcategory of parts; Other available characteristics. Example: For each store, there should be the ability to separately determine which categories of products and which car brands need to be loaded. Additional requirements for product selection It is necessary to implement the ability to select products during import not only by car brands and categories of parts but also by product availability status. There should be the ability to configure the following scenarios: Import only products that are in stock with the supplier; Do not import products with the status "out of stock"; Disable or remove products from Prom.ua after they are out of stock with the supplier. During pricing configuration, there should be the ability to combine filters: By car brand; By category of parts; By subcategory; By product availability. Example: Import only parts for Volkswagen and Audi, category "Braking system", that are in stock with the supplier. It is also necessary to implement a mechanism to prevent duplication of products from different suppliers. If the same product is present with multiple suppliers, only one product record should be imported into the catalog. Criteria for selecting a product when duplicates are detected: Priority is given to the product that is in stock with the supplier; If the product is in stock with several suppliers, priority is given to the product with the lowest price; If the cheapest product is out of stock, the system should choose the cheapest product among those that are in stock; Duplicate products from other suppliers should not create separate entries in the catalog. Example: Import only parts for Volkswagen and Audi, category "Braking system", that are in stock with the supplier. If the same part is available from several suppliers, only one entry is imported into the catalog — from the supplier with the lowest price among those who have the product in stock. ⸻ 3. Import of product cards During import, the following should be automatically loaded: Product name; Article; Photos; Product description; Price; Product characteristics; Manufacturer; Other available parameters. ⸻ 4. Updates It is necessary to set up automatic: Price updates when changed by the supplier ⸻ 5. Removal of unavailable products Products that are no longer in stock with the supplier should: Be disabled; or Be removed from Prom.ua (by agreement). ⸻ 6. Filling the stores It is necessary to: Create a category structure; Create subcategories; Correctly distribute products across categories; Check the correctness of product import. ⸻ 7. Work results After the work is completed, there should be: Suppliers connected; Product import configured; Price updates configured; New product addition configured; Disabling or removal of unavailable products configured; Prom.ua stores fully filled and ready for operation.
A Telegram bot is needed for automatic searching and monitoring of "BUY IT NOW" cars at auctions in the USA (Copart, IAAI). The bot should operate automatically and send notifications about new cars that meet the specified filters.Main functionalityFilter settings: 1. Car brand; 2. Model; 3. Year of manufacture (from/to); 4. Fuel type; 5. Engine volume; 6. Mileage; 7. Price range; Bot functions: 1. Automatic monitoring of new lots; 2. Checking for updates every 1-2 minutes; 3. Protection against duplicate notifications (anti-duplicate); 4. Ability to add and remove filters through the bot menu; 5. Saving settings of already existing car searches. Message format: 1. Photo of the car (4 photos); 2. Title and lot number; 3. Year of manufacture; 4. Mileage; 5. Engine type and volume; 6. Buy it now price; 7. Link to the lot.
Scrape the full catalog of these websites: https://svit-mebliv.ua/ https://kompanit.com.ua/ru https://amia.com.ua/ https://mebliromax.com.ua/ https://pehotin.com.ua/catalog/ https://www.sokme.ua/ru/ All products need to be combined into one general table for import into WP. Each product should be in two languages (UA+RU). There are also variable products, which should be saved as variations in the basic WP functionality. Import to the site can be done through plugins or a custom solution, so the format of the table can be discussed.