Circuit 429 errors (retlimit)
There is a site to which a huge number of queries ( queries asynchronous ) fly they are to collect information and return to the customer. One query returns information for 30 ms+, after 100 queries, the site has 429 errors, i.e. a retlimate.
Not authorized (without API)
We are currently using a certain number of proxy, but we are looking for another option.
Needed to. If you do not turn around, then increase the number of requests sent to a point, without losing the speed.
Proxy, sessions, hosts, TLS and everything you can offer for the solution.
-
1 day11 USD
33 1 day11 USD
Good Morning,
In the private message I can send ways to solve this problem.
ready to contact you.
-
Добрий день! А підскажете, що за ресурс? Цікаво з предметною областю ознайомитись)
-
429 помилка - це 98% реакція на ip адресу, тож збільшення кількості проксі є найлогічнішим з варіантів. Ну ще, звичайно, треба на вашу конкретну реалізацію дивитись, може ви десь недодивились.
-
Ну, поперше, вам не власться зберегти швидкість. Вам треба згенерувати помилку, зробити перевірку, якщо код 429, то прописати retry-after: секунди, або виконати зміну проксі, перед тим почистивши сессію. А взагалі так, треба бачити ресурс та реалізацію
-
Доброго дня, маю 12 пунктів як позбутися цієї проблеми.
Якщо цікаво пишіть в ПП. Чекаю вашої відповіді.
-
Current freelance projects in the category Data Parsing
Consultation on parsing Instagram account subscribersHello. It is necessary to conduct a preliminary assessment of the feasibility of the following task. I have a list of Instagram accounts. The goal is to obtain contact information (primarily email addresses) of users who follow these accounts. Previously, I encountered companies… Data Parsing ∙ 2 days 21 hours back ∙ 12 proposals |
A specialist is needed to find contacts of decision-makers in Ukraine.It is necessary to gather a database (or ready database) of contacts of decision-makers (DMs) in companies in Ukraine. Information Gathering, Data Parsing ∙ 3 days 1 hour back ∙ 17 proposals |
Need to scrape data from LinkedIn
We need to scrape data from LinkedIn based on our list. For each entry, we need to find and collect available data if it exists on the LinkedIn profile, including the profile picture on the LinkedIn social network, email address, links to social media, company website, and… Data Parsing ∙ 3 days 7 hours back ∙ 27 proposals |
Parsing and classification of data
We are looking for a developer to implement a system for collecting and structuring data from open sources. We have a database of small business owners in the USA, which contains the person's name, company name, address, and state. It is necessary to build a process for… Web Programming, Data Parsing ∙ 3 days 8 hours back ∙ 41 proposals |
Svitlahata
17 USD
It is necessary to import 1819 products from the XML/YML feed of Prom.ua to OpenCart 3. A ready XML file is available, which contains product names, descriptions, prices, photos, specifications, manufacturers, and categories. Requirements: import all products to OpenCart… Content Management Systems, Data Parsing ∙ 4 days 11 hours back ∙ 34 proposals |