Repair the script on Python and set the performance on the server
you need to work out the finished parsing of the products written on Python, in general now everything works properly, only parsing is performed in one stream.
The tasks should be done so that parsing worked in a few flows but so that there is no large burden on the donor from which parsing will be performed. In this question it is necessary that you have experience and you could give advice about the number of flows and so on. You need to set the performance of this script on the server. It also requires a advice to choose a server - price.
I will show the executive.
If you are easier to offer your parsing I can also consider this option.
Client's review of cooperation with Oleksandr K.
Repair the script on Python and set the performance on the serverOleksandr did a great job with the task, completing everything and even more!
I recommend for cooperation!
Freelancer's review of cooperation with Oleksandr Ranichev
Repair the script on Python and set the performance on the serverOleksandr is a polite person, describes tasks in detail, always in touch, knows well what he needs in terms of edits, describes them well. It was a pleasure to work with.
-
Ready to perform right now.
I have great experience in writing parseries on Python as well as server settings.
-
335 1 0 Welcome to Alexandra!
I have experience in writing and specializing in Python.
For the organization of multi-direction I plan to use the possibilities of the corresponding libraries and data caching - this will allow you to perform parsing in several streams or currents, make several requests at the same time (and receive data faster).
The server - DigitalOcean will go, it has a lot of settings. You need to choose a fee for the number of CPUs, the volume of operating memory and the network transmission capacity - the more, the better for the project.
I look forward to your message if you are interested in cooperation.
…
with respect
Peaceful Heaven
-
814 14 2 Welcome to!
There are a few questions about your task.
1 . "A few streams" is a sufficiently extensive concept. Do you remember that one parser should use several streams; or several streams, and on each of them - their own parser instance?
The 2nd I’ve done this, I can help you. The script itself I will run as a service, and the script will be re-loaded if something happens wrong with it. In addition, about the server itself: I offer you the service DigitalOcean. I have lunch for its quality. Here is his ratings: https://www.digitalocean.com/pricing/droplets
If you are interested in my application, please contact me personally!
-
397 14 0 Hello, my name is Bogdan and I would like to work on your project. Ready to solve both the first and the second tasks.
Your speed task is solved by Scrapy or threading provided that there is no long waiting for response from the server. You can send the code to assess the cost and time, and I will also give recommendations on vps that I use for my projects.
Tech Stack
by Python
- Selenium / Playwright
- requests + bs4
… The Proxies
The CAPTCHA SOLVER
by Scrapy
by PostgreSQL
The Fast API
The Digital Ocean
by Linux
If necessary, I will present my projects.
Current freelance projects in the category Data Parsing
Car RIA website parser
33 USD
Need a contact parser for the auto ria website. Collect phone numbers / car (make, model, year) (into a table, for future SMS mailings) Data Parsing ∙ 13 hours 54 minutes back ∙ 36 proposals |
Svitlahata
17 USD
It is necessary to import 1819 products from the XML/YML feed of Prom.ua to OpenCart 3. A ready XML file is available, which contains product names, descriptions, prices, photos, specifications, manufacturers, and categories. Requirements: import all products to OpenCart… Content Management Systems, Data Parsing ∙ 1 day back ∙ 31 proposals |
Data parsing through mobile APILooking for a person with experience in data parsing through mobile API, for parsing e-commerce, rozetka and similar sites. Tasks: 1. Intercepting traffic from the mobile application (Android), setting up a proxy, analyzing requests. 2. Identifying the necessary API endpoints… Python, Data Parsing ∙ 2 days 19 hours back ∙ 30 proposals |
Looking for a programmer or vibe coding Automation scraping data 2https://drive.google.com/file/d/14tP5XWJB9acV4gn_cJrFwMpihUj3EbQz/view?usp=sharing I accidentally sent that link Web Programming, Data Parsing ∙ 2 days 21 hours back ∙ 39 proposals |
Create a dashboard in https://airtable.com/ for the performance of advertising creatives from Facebook ads.Full specification https://docs.google.com/document/d/1_n_oYRNZWYxalUA---DM5AD1b5ZSrtePw5J4G42svGw/edit?usp=sharing Databases & SQL, Data Parsing ∙ 7 days 16 hours back ∙ 20 proposals |