Parking of pages in Python
79 USD You need to do a service that will regularly once a week download and store certain pages from the Amazon.The service should stand on Linux VPS, mysql or postgres database.You need to download each page with an interval of 5-15 minutes.stages of work.The work will be considered to be completed when the work will be completed at all stages:
1 Give recommendations for buying VPS with good price/quality.2ndSet up the VPS and set up/set up the Docker and all work will be done within the Docker.
3 Installation of the base and all the necessary on the docker.The structure of the base looks like this - record number, date and time of download, file size, product code, product link, page source code
4 Direct development of the script
5 Customer development in which you can make the setting of this web client, or description of how to change the code by ssh
6 Heat
7 Transmission of code and settings and instructions/documentation on work and product changes
8 Implementation of the application, i.e.At least 2,000 pages of reviews should be downloaded within two weeks.Proxy or IP or similar items for blocking are not more than $10 a month.
The Amazon code goes on the link https://www.amazon.com/product-reviews/B07QFV9ZNC/, the latest numbers are ASIN products.I will submit the full list of assin requests when the code is ready and for the test - here are these assins B07Z64HQ1L, B07HRR4L5R, B01L8050AA, B00OAXPU5I, B07BMR1M5J
Please note that reviews can be on several pages and we need parsing from all pages - this is for example the second page for reviews on this product - https://www.amazon.com/product-reviews/B07QFV9ZNC/ref=cm_cr_arp_d_paging_btm_next_2?pageNumber=2
After the project is completed, there are several such orders.For example, split the page in detail and enter all the data in the BD.I will review the application only with reference to the portfolio.The estimate of time and price for work
Client's review of cooperation with Sergey Pasinoga
Parking of pages in PythonThe problem is well solved, the difficult task is solved.
Freelancer's review of cooperation with Valentin L
Parking of pages in PythonCongratulated with collaboration!
The task was placed clearly, without submarine stones.
Communication was smooth, without any misunderstandings.
I recommend cooperation.
-
Winning proposal14 days79 USD
Winning proposal14 days79 USD
Valentine, good day !
Amazon has already worked, including with reviews about the product.
Also, there are already ready systems to work with proxy, blocking and so on.
One proxy there is not enough, it is necessary to work properly with cookies and user agents.
I am ready to help you with any issues in this project, please contact us.
-
21 days226 USD
2267 73 4 4 21 days226 USD
Welcome to the project volume, if you are interested in quality and the unwillingness to waste time, and you need a solution. Write it.
-
Обязательно на Python?
-
Valentin L Profitpalm Agency
Сам работаю на Питоне, поэтому и исполнение через
-
Current freelance projects in the category Data Parsing
Need a parser for the online store https://www.lcsc.com/It is necessary to regularly (once a month, or upon script launch) obtain up-to-date information about the products available in the store. https://www.lcsc.com/ from the catalog of all sections.… Data Parsing ∙ 12 hours 5 minutes back ∙ 35 proposals |
OpenCart — rental catalog of special equipment
135 USD
OpenCart — Equipment Rental Catalog Need to launch an equipment rental catalog on OpenCart. Theme: excavators cherry pickers forklifts generators cranes scaffolding other construction equipment. It is preferable that you already have a ready-made template or developments… Web Programming, Data Parsing ∙ 1 day 4 hours back ∙ 52 proposals |
Transfer the program - the server where the program was located has crashed (officially permitted parsing of government data)
46 USD
Hello! My client has encountered the case described below. We need help transferring to a new server and testing the program. It would be better to have a programmer who understands parsing. Software & Server Configuration, Data Parsing ∙ 1 day 8 hours back ∙ 29 proposals |
Website parsingImplementation of 4 parsers (directory websites) is required. There is a technical specification, and there is a code example as a reference. The tasks include: Writing a parser Integrating a proxy Deduplication logic (transfer the logic from the example) Hashing logic based… Data Parsing ∙ 3 days back ∙ 44 proposals |
Collection (parsing) of product database from supplier websites (Excel / CSV)
226 USD
Collection of product database from supplier websites (Excel / CSV) Good day. A specialist is required to collect and structure data from several supplier websites, access to which will be provided.Task: A unified product database needs to be created in Excel (XLSX) or CSV… Web Programming, Data Parsing ∙ 4 days 8 hours back ∙ 105 proposals |
Kyiv