Update/rewrite the Python3.10 Scrapy parsers

Databases & SQL, Python — incorrectly specified categories?

45 USD

Client's review of cooperation with Anton Getalo

Update/rewrite the Python3.10 Scrapy parsers

45 USD

A lot of attempts were made to implement the project, but unfortunately it failed.

1.9

Oleksandr L.

3 October 2022

Project translated automatically. Log in or register, to view the original Hello to you. There are two parsers (websites: ebay.de, momox.de) working on Python3.10 Scrapy synchronically. It is in the BD MySQL. Redis is also used for synchronous parallel parsing. For six months they worked without any questions. The following problems are now observed: 1) the speed of adding goods to the BD fell from 800/min to 400-500/min. A minimum of 750/min. 2) one parser began to distant significantly from the other. The longer it passes, the greater the gap. Permissible break no more than 10% of the total call and goods. The task is to address the above problems. The way of solving within the language of Python version 3x is not important, the main thing is to the set goal. It will be re-written parsers or the updating of the existing - not fundamental.

Proposals 4 Discussions 2

Kostyantin Tkachenko

2 0

Projects -
Rating -
Rating 72

Budget: 5000 UAH Deadline: 3 days

I will invent the solution, I will find the narrow places (there may be a problem in the script performance environment, not in the script itself) if necessary I will re-work the solution to the set goal.

Pavlo Shevchuk

4 2

Projects 4
Rating -
Rating 303

Budget: 1999 UAH Deadline: 1 day

I have experience with scrapy. Ready to fulfill the task.

Anton Getalo

Winning proposal

6 2

Projects 6
Rating -
Rating 244

Budget: 2000 UAH Deadline: 3 days

Ready to make your order
The task is clear
I do it in the right time and in the best way.
Write, ready to start

The list does not show proposals concealed by the client or freelancer with a Plus profile, as well as proposals violating rules

Oleksandr L.
Kharkiv, Ukraine

Projects 206
Rating 5.0
Rating 14 785