Data parsing from the website
334 USD It is necessary to set up data (product) parsing.
There is a source website (links will be provided in advance to the potential executor for assessing the complexity and scope of work) from which data needs to be parsed according to a schedule. The format of the data can be discussed further.
Next, this data should be added to the website's database with automatic checks for duplicates and data relevance.
As an additional option, there should also be a function for automatic price adjustment (a 10% price reduction) for items added to the website.
From the potential executor, we would like to see a description of how you plan to carry out this project in detail, as well as your experience in solving similar tasks. Without this, your bids will not be considered.
The project budget is ready to be discussed after clarifying the technical specifications and discussing details with the potential executor.
-
7 days334 USD
1970 25 1 7 days334 USD
Hello, Serhiy. If we are to develop a plan, first of all, I would create the necessary parser that will collect the information, then I would add a connection to your database and set up a script for finding duplicates. When there are no duplicates, we will update the price and add the products to your database. Next, we will deploy the product and set a timer for it. However, first of all, we need to understand which source we will be working with and how your database is structured.
-
1 day334 USD
1257 34 0 1 day334 USD
Good day.
Send the link.
I think I can help.
The price is negotiable.
-
5 days445 USD
852 21 0 5 days445 USD
Parsing will directly depend on where your site is located and what it is written on. For example, if it is WP, then a plugin can be created that will write to the database and give you the ability to configure it. I can elaborate more on everything, but I lack the details for this.
-
7 days334 USD
1754 34 3 7 days334 USD
Good day, I developed parsers, the last one I made a few days ago is a parser from Hotline and adding products to the database. I develop parsers based on requests, bypassing protection if it exists. I am waiting for information regarding the source of the parser, and if there is a technical specification.
-
1 day334 USD
1 day334 USD
Good day. I would like to see a website for order evaluation. You can view my previous work in the portfolio. I would be happy to collaborate.
-
7 days334 USD
1315 7 0 7 days334 USD
Good day.
I am ready to take on your project.
I can create a parser for you using no-code/low-code tools, or a combination of them with Node.js deployed on AWS.
Message me privately, we will discuss everything in more detail and find the best solution for you.
-
1 day334 USD
486 23 0 1 day334 USD
Good day.
What project seems to have no data? Well, I can write a server solution where everything will be parsed into a database, changing the price could be a web API, some web form, or it could be specified in a configuration file.
Technology stack: ASP .Net Core, C#, EF Core or Dapper.
But this is all conditional; to say something, we need to look at the site and a bit more details.
-
20 days334 USD
316 6 0 20 days334 USD
Write, we will discuss the details, I have experience in parsing, for example, I created a bot in tg MuzykaFreeBot that sends the user a soundtrack through parsing and saves track data in the database so that this track is not downloaded again.
-
1 day334 USD
559 11 0 1 day334 USD
Good day.
If you have a website on WordPress, then I do not work with this wonder.
If something else - write in private, we will discuss the details.
-
7 days401 USD
571 5 0 7 days401 USD
Good day
I mainly write parsers in Python + Selenium
I configure the schedule using APScheduler
We can organize the duplicate check in 2 ways:
- check by product title (+ possibly some characteristics)
- maintain a parallel database for the parser, where to store the parsed data along with the product article, which will prevent duplicates
… More specifically, we need to look at how to find the updated products, whether it is necessary to go through absolutely all products and categories each time, or if there are other ways.
-
4 days334 USD
3392 84 0 4 days334 USD
Ready to take it on.
But we need to clarify the order details, write!
I will implement it with a script in Python.
-
1 day334 USD
720 6 1 1 day334 USD
Professional skills:
Development of comprehensive web page parsers. Connecting to them and configuring SQL (PostgreSQL, MySQL) and NoSQL (Redis) databases. Development and configuration of user interface for parsers. Deployment of applications on cloud server (Google Cloud Platform) and their further support.
Work experience:
Among small projects, the creation of an application for synchronizing the product catalog of two online stores stands out, setting up the cloud server, and deploying the application on it. I note that this experience is very similar to your task, judging by the brief description of the project.
Approximate plan:
It is planned to use the API of the source site, if available; otherwise, a custom solution will be written. The database is planned to be in SQL format, specifically PostgreSQL.
The project structure should not be complex:
… Project repository
-- Database
-- Library for custom parser
---- Parser methods
-- Main file
I cannot provide a more precise plan, as it is necessary to see the site and clarify the project details.
I look forward to your response.
-
посилання можна побачити
-
Взагалі, цікаве завдання... точніше формулювання...
Ви на сервісі 6 років, та багато брошених проектів...
Такі претензійні умови, аж хочется зпитати, а клянятись до вам не потрібно, перед тім як подати заявку?
Таке відчуття, що вам просто потрібно, щоб вам надали ваше ж ТЗ з планом дій та технологій для виконання. -
Current freelance projects in the category Data Parsing
Consultation on parsing Instagram account subscribersHello. It is necessary to conduct a preliminary assessment of the feasibility of the following task. I have a list of Instagram accounts. The goal is to obtain contact information (primarily email addresses) of users who follow these accounts. Previously, I encountered companies… Data Parsing ∙ 2 days 15 hours back ∙ 12 proposals |
A specialist is needed to find contacts of decision-makers in Ukraine.It is necessary to gather a database (or ready database) of contacts of decision-makers (DMs) in companies in Ukraine. Information Gathering, Data Parsing ∙ 2 days 20 hours back ∙ 17 proposals |
Need to scrape data from LinkedIn
We need to scrape data from LinkedIn based on our list. For each entry, we need to find and collect available data if it exists on the LinkedIn profile, including the profile picture on the LinkedIn social network, email address, links to social media, company website, and… Data Parsing ∙ 3 days 2 hours back ∙ 27 proposals |
Parsing and classification of data
We are looking for a developer to implement a system for collecting and structuring data from open sources. We have a database of small business owners in the USA, which contains the person's name, company name, address, and state. It is necessary to build a process for… Web Programming, Data Parsing ∙ 3 days 3 hours back ∙ 41 proposals |
Svitlahata
17 USD
It is necessary to import 1819 products from the XML/YML feed of Prom.ua to OpenCart 3. A ready XML file is available, which contains product names, descriptions, prices, photos, specifications, manufacturers, and categories. Requirements: import all products to OpenCart… Content Management Systems, Data Parsing ∙ 4 days 6 hours back ∙ 34 proposals |
Kyiv