Help with Python Multi-Tacity Solution on a Live Piece of Code
4 USD I need to process 80k domains (hiting for each webarchive data) and I made a script on Python that does it. But he does it consistently and slowly.. So I just started studying Python, I can’t deal with multiple precision at all... and I ask for help from the community.
I have a code field that creates a task pool (transmitting in it i is the domain number in DataFrame)
It causes a function that must in multi-direction mode with the use of proxy to make requests to the webarchive.. and the result of the request the number result puts in the data frame cell. And here I got difficulty - what I just didn't try - nothing goes out 😔
As a completed project, I need a working refined piece of my code, which I can insert into my project instead of the link - so that the references to Webarchive go in a multi-direction parallel mode
Client's review of cooperation with freelancer
Help with Python Multi-Tacity Solution on a Live Piece of CodeThe second time Daniel me solve my question in Python code - and the second time quickly, clearly and efficiently. Thank you !
Freelancer's review of cooperation with Sergey Samoylenko
Help with Python Multi-Tacity Solution on a Live Piece of CodeThe customer has chosen a convenient time for both sides to perform. The task was placed correctly, and Sergey came out in time. It was a pleasure to collaborate 🙂
-
1 day4 USD
1069 41 0 1 day4 USD
Welcome to!
I looked at your code. You use a synchronous library of requests with an asynchronous code, so that makes no sense. It is possible not to use asynchronousness, but to run the function in different processes. The work will depend on the call and the specified flows in the code and on your PC.
-
Используйте, async или multiprocessing
-
Sergey Samoylenko ТОВ "СЕОПОРТ"
с этим я и не смог пока разобраться ... https://ru.stackoverflow.com/questions/1122964/async-вызов-функции-с-http-request
-
Если надо как можно быстрее и пулл задач поддерживает паралельные запросы используйте второй метод.
-
Ссылка на стакьоверфлоу не действительна.
-
чего только люди не придумают, чтоб про GIL не читать %)
запустил бы олдскульно по процессу на ядро и было б щасте
кстати, на с\о уже ответили -
Sergey Samoylenko ТОВ "СЕОПОРТ"
я повторюсь - не могу я пока осилить async - сложно мне пока..
-
перевожу: на с\о посоветовали использовать асинхронную библиотеку, потому что http.requets работает синхронно всегда
мультипроцессинг в самом примитивном варианте выглядит как запуск скрипта несколько раз
код почитаю уже завтра. есть полная версия? -
Sergey Samoylenko ТОВ "СЕОПОРТ"
комментарии я понял - и понимаю, что async требует другого формата request - я пробовал - не получилось. побился головой об стенку - написал сюда. Multiprocessing сейчас пробую
-
Current freelance projects in the category Python
Application developmentI wish to create a mobile application for communication, the app should have audio and video calls, group chat creation, the ability to sync with phone contacts, account settings: email binding, 2FA, phone number, the ability to customize app notifications, change the app… Java, Python ∙ 13 hours 39 minutes back ∙ 26 proposals |
Setting up two-way integration of WhatsApp with Odoo CRMHello! We are looking for a specialist to implement a technical task for setting up a two-way integration of the WhatsApp messenger with the Odoo CRM system. ⚠️ Important technical clarification: The official WhatsApp Business API (WABA) is not considered. It is necessary to… Python, Web Programming ∙ 23 hours 34 minutes back ∙ 22 proposals |
Data parsing through mobile APILooking for a person with experience in data parsing through mobile API, for parsing e-commerce, rozetka and similar sites. Tasks: 1. Intercepting traffic from the mobile application (Android), setting up a proxy, analyzing requests. 2. Identifying the necessary API endpoints… Python, Data Parsing ∙ 2 days 20 hours back ∙ 30 proposals |
Find a product feed (Google Merchant XML) for a website on OpenCart
16 USD
It is necessary to find a direct link to the active product feed (XML) of a competitor for Google Merchant Center Platform (CMS): OpenCart / ocStore Find the original feedRequirements for the result: Working link to the XML file Python, Data Parsing ∙ 8 days 5 hours back ∙ 29 proposals |
Development of a TikTok farm (content factory)It is necessary to develop a system for centralized management of multiple TikTok accounts with automatic content publishing, using individual proxies and simulating natural account activity. Functional Requirements1. Account Management Adding and removing TikTok accounts.… Python, Bot Development ∙ 8 days 16 hours back ∙ 23 proposals |
Kyiv