Parsing a website with dynamic data
You need to write a parser (use JS or something based on it, NodeJS). I am ready to discuss Python, but priority is JS.
On the site, advertisements appear dynamically, you need to refresh the page once a minute and collect data.
Data needs to be stored in a MySQL database (I will provide the table structure).
The site has Cloudflare protection, so maximum masking + use of proxies is essential (I will provide).
Also, either help or instructions on how everything works and how to deploy it on the server will be needed.
Client's review of cooperation with Andrii C.
Parsing a website with dynamic dataSuper performer!!! Even before the start of our collaboration, he pointed out possible "underwater stones," then tested possible solutions and suggested the optimal one. I really liked the approach to work and the experience with parsing! I will definitely reach out again. I recommend.
Freelancer's review of cooperation with Stanislav Rudych
Parsing a website with dynamic dataThe client clearly set the task, was constantly in touch, and explained everything well as questions arose. I recommend him to everyone.
-
673 7 0 Good evening! I will write in Python + Selenium!
I will bypass cloudflare….
I will be able to set it up on the server! I will connect the database.
-
525 3 0 Good day! I have experience with bypassing Cloudflare, we can try it on your project.
-
225 Hello. Very interesting task. I am ready to complete it according to all your requirements.
-
726 9 1 Hello! I have reviewed your project and am ready to start working. I am confident that I can meet all your expectations.
-
Розгорнути на сервері, якщо там стоїть захист клоудфаре і без підключення сторонніх (платних сервісів обходу) не вийде. Якщо можна покажіть проект в приватні.
-
Current freelance projects in the category Data Parsing
Parsing products, preparation for import to WPScrape the full catalog of these websites: https://svit-mebliv.ua/ https://kompanit.com.ua/ru https://amia.com.ua/ https://mebliromax.com.ua/ https://pehotin.com.ua/catalog/ https://www.sokme.ua/ru/ All products need to be combined into one general table for import into WP.… Web Programming, Data Parsing ∙ 1 day 20 hours back ∙ 54 proposals |
I am looking for a programmer for OpenCart.Good day 1) It is necessary to implement on the website dneprkomfort.dp.ua A module for Ukrainian banks has been purchased, and we have already integrated Mono Bank Here is an example from our competitor It is necessary to implement installment payments, purchase in parts… Web Programming, Data Parsing ∙ 2 days 17 hours back ∙ 48 proposals |
A specialist in Telegram promotion is required.
28 USD
Tasks: invite real users from the username database to new chats and send messages to the target database. Only quality traffic and work with a live audience are of interest — performers using bots, fake engagement, or low-quality methods are requested NOT TO DISTURB. Work… Data Parsing, Social Media Marketing (SMM) ∙ 6 days 20 hours back ∙ 9 proposals |
Consultation on parsing Instagram account subscribersHello. It is necessary to conduct a preliminary assessment of the feasibility of the following task. I have a list of Instagram accounts. The goal is to obtain contact information (primarily email addresses) of users who follow these accounts. Previously, I encountered companies… Data Parsing ∙ 10 days 15 hours back ∙ 13 proposals |
A specialist is needed to find contacts of decision-makers in Ukraine.It is necessary to gather a database (or ready database) of contacts of decision-makers (DMs) in companies in Ukraine. Information Gathering, Data Parsing ∙ 10 days 19 hours back ∙ 22 proposals |