Enhance the PHP parsing script with multithreading or the use of proxies on the hosting.
45 USD There is a script written in php that parses the manufacturer's website by iterating through all possible combinations of serial numbers (like PF567GHT) and saves the results of the responses to a file. The parsing is done through the manufacturer's API for these purposes. The request is a post curl, and the response is in json format regarding the status of the serial number.
The only problem is that after parsing 200-500 thousand serial numbers (with a pause of 1 second after every 10 serial numbers), I get banned for some time and then after a while, there is a possibility to continue parsing from this ip. Everything is executed in an infinite loop on a regular hosting via cron, where the use of proxies is prohibited, but scripts can run indefinitely in time.
I need help in enabling the possibility of running several such php scripts in parallel via cron, each with its own ip, so that it doesn't get banned after several hundred thousand. Or your option for implementation and bypassing the hosting restriction on the use of proxies.
-
2 days45 USD
3840 78 0 2 days45 USD
If the hosting blocks the proxy, then the ban cannot be bypassed in any way. Unless you parse from this hosting through another server. This is the first time I've heard that hosting does not allow the use of proxies! The best option is to change the hosting!
-
2 days45 USD
3715 88 0 2 days45 USD
Good afternoon, I can correct
-
7 days156 USD
2138 22 2 7 days156 USD
Hello, I can rewrite all of this in Python with proxies and multithreading. I have extensive experience in parsing.
-
1 day45 USD
1328 35 1 1 day45 USD
Good afternoon. I am working on writing scripts in PHP. I need to take a look at your code and what the problem is with the proxy.
-
Очень странно, что хостинг запрещает использовать прокси. Но даже если это так, надо просто искать нормальные платные прокси.
-
Покупал платные Прокси для теста и не мог получить страницу через curl запрос. После обращения в поддержку хостинга о данной проблеме - получил ответ, что хостинг запретил использование Прокси.
-
Якщо номер такого формату PF567GHT, то чого би просто не створити БД, яка би мала 12 000 000 000 записів ? І не треба нічого парсити. Просто з БД вибирайте необхідний номер і все.
-
Базу серійних номерів ви створите, проте щоб дізнатись який статус цього серійного номеру в базі виробника - потрібно робити запит до сайту виробника та відповідно обробити його відповідь на своїй стороні
-
Ну так то для цього всякі мікросервіси підінімають, на других хостингах
-
Current freelance projects in the category Bot Development
Automation bot for playerok.com
89 USD
1. Main Menu and Monitoring Dashboard screen updated in real-time (or by button): Status of key modules (On/Off). Current tasks: number of pending code/email deliveries from buyers, active orders. Financial summary for the current date (Total amount, net profit considering… Engineering, Bot Development ∙ 10 hours 24 minutes back ∙ 23 proposals |
A simple checkpoint bot needs to be created for the GTA5 server.
56 USD
Operating principle: https://www.youtube.com/watch?v=yTTRQfYSfaY In short, there is a large checkpoint, you stand on it and press the letter "E" (English), 6 small checkpoints appear, and the bot just needs to run and press "E" at the checkpoints. I tried using Python and AHK -… Bot Development ∙ 14 hours 23 minutes back ∙ 7 proposals |
Integration of the analytics system with the Database in Tables
112 USD
The current analytics system needs to be brought to a stable working state. Currently, data from CRM, telephony, and advertising accounts is pulled through Supabase via MSP into Google Sheets, but some processes still require manual control. This needs to be eliminated.1.… AI & Machine Learning, Bot Development ∙ 1 day 6 hours back ∙ 28 proposals |
Telegram bot for hiring/searching employees. For job searching.
25 USD
1. General Concept Creation of a Telegram bot for automating recruitment and mutual job searching. The system operates on the principle of active response and mutual confirmation of interest (Double Opt-In). The system includes two roles: Employer (Company Owner) and Worker (Job… Python, Bot Development ∙ 1 day 8 hours back ∙ 82 proposals |
Two-way messaging exchange between CRM Creatio and Telegram
156 USD
Implement a two-way messaging exchange between CRM Creatio and Telegram according to the specifications https://docs.google.com/document/d/1Y8qL2CJwwmVSrJOXfQipoi27t-wkvDx1UmA2-niTtWs/edit?usp=sharing Web Programming, Bot Development ∙ 1 day 20 hours back ∙ 45 proposals |
Kyiv