Update/rewrite the Python3.10 Scrapy parsers
45 USD 
There are two parsers (websites: ebay.de, momox.de) working on Python3.10 Scrapy synchronically.
It is in the BD MySQL. Redis is also used for synchronous parallel parsing.
For six months they worked without any questions.
The following problems are now observed:
1) the speed of adding goods to the BD fell from 800/min to 400-500/min. A minimum of 750/min.
2) one parser began to distant significantly from the other. The longer it passes, the greater the gap. Permissible break no more than 10% of the total call and goods.
The task is to address the above problems. The way of solving within the language of Python version 3x is not important, the main thing is to the set goal. It will be re-written parsers or the updating of the existing - not fundamental.
Client's review of cooperation with Anton Getalo
Update/rewrite the Python3.10 Scrapy parsersA lot of attempts were made to implement the project, but unfortunately it failed.
-
3 days111 USD
120 2 0 3 days111 USD
I will invent the solution, I will find the narrow places (there may be a problem in the script performance environment, not in the script itself) if necessary I will re-work the solution to the set goal.
-
1 day44 USD
328 4 2 1 day44 USD
I have experience with scrapy. Ready to fulfill the task.
-
Winning proposal3 days45 USD
244 6 2 Winning proposal3 days45 USD
Ready to make your order
The task is clear
I do it in the right time and in the best way.
Write, ready to start
-
А Вы состояние разных сревсов, в том числе бд проверяли. Может бд уже большой и медленно записывает, поставте логирование работы разных видов и после мониоринга полученных данных на несколько дней, разберете в чем проблема!
-
Не умею этого делать.
Если возьметесь - сделайте ставку.
-
Kharkiv