Changes to Python3
11 USD 
There is a parser on Python3. Working in the Docker under Ubuntu 20.04
Parsite in BD MySQL.
You need to add the following functions:
1 . Proxy support with authorization.
2nd Calculate call-to requests for 1 proxy per day.
For example, I have a list of 300 proxy. I set the limit of requests = 100/day. Once 100 requests from the current proxy are made, it must take the next proxy. And so until all the proxy will be used or the days will not pass. If the proxy has ended before the days have passed - the parser must stand on a break until the days have passed even for one proxy, then resume the work.
The limit must be set before the start.
Client's review of cooperation with freelancer
Changes to Python3Everything is performed greatly. and professionally. I recommend !
Freelancer's review of cooperation with Oleksandr L.
Changes to Python3Всё отлично, вышла небольшая задержка.
Но заказчик всё понял, подождал.
Рекомендую, к сотрудничеству
-
1 day14 USD
1641 23 0 1 day14 USD
Hello to Alexander. Experience in Python + 1 year. The task is clear, ready to take it today.
-
на чем написан парсер? Это реквест + суп, скрапи или селениум?
Откуда нужно будет брать прокси? -
Сергей, Вы видимо не внимательно прочли описание проекта.
Парсер писать не нужно - он уже написан.
Нужно в существующий парсер добавить функционал.
Прокси я покупаю сохраняю в файл.
-
Я прочитал внимательно, меня интересует на чем он реализован, так как работа с прокси разная бывает.
Насчет файла, я правильно понимаю, что его нужно будет пробрасывать в докер при каждой смене, что бы не останавливать парсинг?
-
написан на реквест + суп
на лету прокси меняться не будут, т.е. смена прокси происходит, когда парсер остановлен.
вообще, идея менять на лету мне нравиться, но по крайней мере пока эта опция не нужна
-
Current freelance projects in the category Data Parsing
Parsing company emails from a specific industry
113 USD
Find contacts (e-mail, phone number) of companies engaged in the specified business mentioned in this Google document https://docs.google.com/document/d/1_d-iLxLSL3gjRvo1GmUpWNm0Pm5YoKGcEvaiDc_2I0g/edit?usp=sharing The result should be in the form of a table with the following… Data Parsing ∙ 3 hours 17 minutes back ∙ 14 proposals |
Need a parser for the online store https://www.lcsc.com/It is necessary to regularly (once a month, or upon script launch) obtain up-to-date information about the products available in the store. https://www.lcsc.com/ from the catalog of all sections.… Data Parsing ∙ 1 day 8 hours back ∙ 41 proposals |
OpenCart — rental catalog of special equipment
135 USD
OpenCart — Equipment Rental Catalog Need to launch an equipment rental catalog on OpenCart. Theme: excavators cherry pickers forklifts generators cranes scaffolding other construction equipment. It is preferable that you already have a ready-made template or developments… Web Programming, Data Parsing ∙ 2 days 1 hour back ∙ 57 proposals |
Transfer the program - the server where the program was located has crashed (officially permitted parsing of government data)
46 USD
Hello! My client has encountered the case described below. We need help transferring to a new server and testing the program. It would be better to have a programmer who understands parsing. Software & Server Configuration, Data Parsing ∙ 2 days 4 hours back ∙ 29 proposals |
Website parsingImplementation of 4 parsers (directory websites) is required. There is a technical specification, and there is a code example as a reference. The tasks include: Writing a parser Integrating a proxy Deduplication logic (transfer the logic from the example) Hashing logic based… Data Parsing ∙ 3 days 21 hours back ∙ 44 proposals |
Kharkiv