Project translated automatically. Log in or register, to view the original You need to write a multi-strom parser for vk (40 streams).Parsers will be working on Ubuntu 18.04. Parsers are linked to parsing users, links to their profiles.Processed links must be removed from the list.The parser must download the avatar of the user, and the last ten avatar (photos that were avatar, if listed to the right).Photos must be saved in the folder, one user = one folder, the folder must be called the user profile number, for example, vk.com/xxxxxx/, so the folder will be called xxxxxx.Authorization is not required, but if the user has the avatar available after login, the link to it must be saved in a separate text file, in which is a list of the same users.One stream, it is always = one proxy = one user agent, the same.The number of flows must be regulated in the config.Proxy should also be taken out of the list.The proxy list is formed into a JSON file, the proxy is private with login and password.You need to prepare the user agents, innet has a list of the most popular user agents.Parser per minute must process 40 accounts, preferably parser implement in the form of a script that I will simply run with a crown once a minute.If the user profile is not closed, then the photos are downloaded according to the algorithm described above, if closed, then the photo that is seen is one current avatar of the user.There must be a file of errors in which proxy should be written if they do not work.At the beginning of work I will issue a VDS server, proxy 40 pieces, with login and password authorization.Server with LAMP, if you need to install any other components, then put, in this case you need to write a detailed instructions on how to install a parser on a similar server from scratch.

Proposals 3 Discussions 3

Serhii Zabirnykov

Winning proposal

27 0

Projects 6
Rating -
Rating 465

Budget: 5000 RUB Deadline: 1 day

Welcome, you are ready to implement this project.
To clarify the details of the project and the full cost, go to LS or...
Skype for Spider13 Software
ICQ 3533966
Posts Tagged @spider13software
The website is https://spider13.net/

The list does not show proposals concealed by the client or freelancer with a Plus profile, as well as proposals violating rules

Anatoly Anatolyevich 25 December 2018

если на компе нет 40 ядер, то смысла в 40 потоках нет. 1 ядро = 1 поток, если 1 ядро - 2 потока, то эти 2 потока будут выполняться друг за другом, что ломает суть одновременной работы

Aleksandr Turkin

25 December 2018

что за бредятина, у меня аналогичный парсер на php только еще с авторизацией и работой по api, в 40 потоков работает на VDS KVM на одном ядре с одним гигом оперативы, обрабатывает 40 аккаунтов в минуту, а этот парсер еще проще. Если Вы не компетентный в этом деле, не пишите бред и не смущайте людей

Anatoly Anatolyevich 25 December 2018

Бредятина твое задание. Если запускать 40 потоков и чтобы они работали одновременно, а не друг за другом, надо 40 ядер! Иначе, результат будет такой же, как с 1 потоком!

Add Comment

Current freelance projects in the category PHP

Support for the store on OpenCart

Web Programming 35 proposals 16:08

Not specified
Integration of ChoiceQR → KeyCRM via API

Python 59 proposals 13:25

Not specified
Urgent project — Senior WordPress/WooCommerce/Stripe developer to complete VAT setup and

Content Management Systems 33 proposals 2 August

134 USD
WordPress Developer: Greenhouse Harvest API V2 to V3 Upgrade

Website Development 58 proposals 30 July

Not specified
Light application

Desktop Apps 67 proposals 28 July

172 USD

Aleksandr Turkin
Novosibirsk, Russia

Projects 30
Rating -
Rating 1 123

Serhii Zabirnykov

Serhii Zabirnykov

Proposals are currently absent

Current freelance projects in the category PHP

Support for the store on OpenCart

Integration of ChoiceQR → KeyCRM via API

Urgent project — Senior WordPress/WooCommerce/Stripe developer to complete VAT setup and

WordPress Developer: Greenhouse Harvest API V2 to V3 Upgrade

Light application