Parking of pages in Python
You need to do a service that will regularly once a week download and store certain pages from the Amazon.The service should stand on Linux VPS, mysql or postgres database.You need to download each page with an interval of 5-15 minutes.stages of work.The work will be considered to be completed when the work will be completed at all stages:
1 Give recommendations for buying VPS with good price/quality.2ndSet up the VPS and set up/set up the Docker and all work will be done within the Docker.
3 Installation of the base and all the necessary on the docker.The structure of the base looks like this - record number, date and time of download, file size, product code, product link, page source code
4 Direct development of the script
5 Customer development in which you can make the setting of this web client, or description of how to change the code by ssh
6 Heat
7 Transmission of code and settings and instructions/documentation on work and product changes
8 Implementation of the application, i.e.At least 2,000 pages of reviews should be downloaded within two weeks.Proxy or IP or similar items for blocking are not more than $10 a month.
The Amazon code goes on the link https://www.amazon.com/product-reviews/B07QFV9ZNC/, the latest numbers are ASIN products.I will submit the full list of assin requests when the code is ready and for the test - here are these assins B07Z64HQ1L, B07HRR4L5R, B01L8050AA, B00OAXPU5I, B07BMR1M5J
Please note that reviews can be on several pages and we need parsing from all pages - this is for example the second page for reviews on this product - https://www.amazon.com/product-reviews/B07QFV9ZNC/ref=cm_cr_arp_d_paging_btm_next_2?pageNumber=2
After the project is completed, there are several such orders.For example, split the page in detail and enter all the data in the BD.I will review the application only with reference to the portfolio.The estimate of time and price for work
Client's review of cooperation with Sergey Pasinoga
Parking of pages in PythonThe problem is well solved, the difficult task is solved.
Freelancer's review of cooperation with Valentin L
Parking of pages in PythonCongratulated with collaboration!
The task was placed clearly, without submarine stones.
Communication was smooth, without any misunderstandings.
I recommend cooperation.
-
Valentine, good day !
Amazon has already worked, including with reviews about the product.
Also, there are already ready systems to work with proxy, blocking and so on.
One proxy there is not enough, it is necessary to work properly with cookies and user agents.
I am ready to help you with any issues in this project, please contact us.
-
2267 73 4 4 Welcome to the project volume, if you are interested in quality and the unwillingness to waste time, and you need a solution. Write it.
-
Обязательно на Python?
-
Valentin L Profitpalm Agency
Сам работаю на Питоне, поэтому и исполнение через
-
Current freelance projects in the category Data Parsing
I am looking for a programmer for OpenCart.Good day 1) It is necessary to implement on the website dneprkomfort.dp.ua A module for Ukrainian banks has been purchased, and we have already integrated Mono Bank Here is an example from our competitor It is necessary to implement installment payments, purchase in parts… Web Programming, Data Parsing ∙ 7 hours 31 minutes back ∙ 19 proposals |
A specialist in Telegram promotion is required.
29 USD
Tasks: invite real users from the username database to new chats and send messages to the target database. Only quality traffic and work with a live audience are of interest — performers using bots, fake engagement, or low-quality methods are requested NOT TO DISTURB. Work… Data Parsing, Social Media Marketing (SMM) ∙ 4 days 9 hours back ∙ 9 proposals |
Consultation on parsing Instagram account subscribersHello. It is necessary to conduct a preliminary assessment of the feasibility of the following task. I have a list of Instagram accounts. The goal is to obtain contact information (primarily email addresses) of users who follow these accounts. Previously, I encountered companies… Data Parsing ∙ 8 days 4 hours back ∙ 13 proposals |
A specialist is needed to find contacts of decision-makers in Ukraine.It is necessary to gather a database (or ready database) of contacts of decision-makers (DMs) in companies in Ukraine. Information Gathering, Data Parsing ∙ 8 days 9 hours back ∙ 21 proposals |
Need to scrape data from LinkedInWe need to scrape data from LinkedIn based on our list. For each entry, we need to find and collect available data if it exists on the LinkedIn profile, including the profile picture on the LinkedIn social network, email address, links to social media, company website, and… Data Parsing ∙ 8 days 15 hours back ∙ 28 proposals |