Spark all the region's domains all the time from the expireddomains base.

Data Parsing, Python — incorrectly specified categories?

43 USD

Client's review of cooperation with Zaman Yusifov

Spark all the region's domains all the time from the expireddomains base.

43 USD

Projects suspended by mutual agreement

2.5

Maxim C.

26 May 2022

Project translated automatically. Log in or register, to view the original The goal is to obtain a list of all the domain drops available for registration in a given region from the extiredomains.net service at all times (2016 n.a.). At the moment, it's 390 squares of domains. The service can only view the first 50 pages of 200 links to the page (in total 10k) and restrict the export of data in the report to 4k domains from the current filter. The data for the last month only are sorted by date. The solution is to apply a set of filters that will allow more than 90% of the domains to be seen. You have to go through the maximum number of filters with a narrow sample so you can unload all the domains in it. The initial solution is to do a filter for all possible combinations of 2 Latin letters in the domain name and to do this search every year from 2016 to 2022, downloading all links from each page of the pagination (n+1, max51). Preliminary estimates are that this will require about 200,000 actions and will need to test the parser's work on the IP banana (in case of problem we will provide proxies). Offer your initial approximate value, as it is not possible to do so. A lot of nuances. Perhaps you will offer a better option or logic for the filter, which we would be happy to consider. References to a detailed filter algorithm, a document with maximum details and screen shots of the service, and all details will be discussed with the performers in personal messages.

Proposals 4 Withdrawn 1

Zaman Yusifov

Winning proposal

0 1

Projects -
Rating -
Rating 107

Budget: 1900 UAH Deadline: 4 days

Добрый день, имею большой опыт в работе с парсингом данных таже с блокирующих сервисов готов взяться за ваше задание и выполнить его, по вашей же схеме, схема может быть немного изменена в зависимости после изучения самого сайта мною. Пишите обсудим начнем работу.

Alex Sorokopud

25 1

Budget: 1000 UAH Deadline: 2 days

Предлагаю реализовать с помощью библиотеки selenium. Он будет перебирать все фильтры и парсить все домены(записывать будет в txt файл).Если такой домен уже есть то будет просто пропуск.Если вас устраивает библиотека selenium, то буду рад сотрудничеству!

Ihor Solokha

41 2

Projects 41
Rating -
Rating 2 601

Budget: 4000 UAH Deadline: 7 days

Добрый день. Готов выполнить задание, Так как сложные задачи очень хорошо влияют на портфолио. По цене ориентировочно указал, по срокам от 2 до 7 дней +-

Similar project: Пасринг компаний линкедина

Maxim C.
Kishinev, Moldova

Projects 70
Contests 1
Rating 4.7
Rating 5 265

Spark all the region's domains all the time from the expireddomains base.

Client's review of cooperation with Zaman Yusifov

Spark all the region's domains all the time from the expireddomains base.

2.5

Maxim C.

Zaman Yusifov

Alex Sorokopud

Ihor Solokha

Proposals concealed

Proposals are currently absent

Proposals concealed