Scrape the Steam site
89 USD Website https://store.steampowered.com/
All games in Ukrainian and English (region Ukraine and USA), except for adult games (sex content).
Soundtracks, programs, and other content are not needed, only games.
Each category contains subcategories, for example, Arcade, Casual, Open World, Shooters, and many others.
The list of links for parsing is not provided, it needs to be collected independently. The website has links to all categories and different operating systems.
1. The data should be in the form of json files (100 mb each), so that it can be uploaded to the mysql database for our structure using a script.
2. The first file consists of two sections: "categories" and "apps".
- "categories" contains an array of objects, which include "title" (category/section name) and link (full link to the category/section)
- "apps" contains an array of objects, which include all information about the application.
Each subsequent file does not contain the division into "categories" and "apps", as the entire list of categories is in the first file. Further, only information about the applications.
3. The structure of the objects contained in the "apps" array:
link - Full link to the application/game
name_company - Developer
company_link - Full link to the developer
title - Application/game title
content - Description of the application/game (text description and all technical information: version, price, updates, languages, etc.)
categories - All categories to which the application/game belongs, for example, ['Indie', 'Strategy']
rated - Age restrictions
update - Last update of the application/game
reviews - Number of reviews for the application/game
rating - Application rating
price - Cost (price)
size - Size of the application (megabytes)
compatibility - Compatibility (Windows, MacOS, Linux, SteamOS, etc.), for example, ['Windows', 'macOS']
logo_image - Link to the image from the page - Logo of the application/game
logo_path - Name of the image from the page - Logo of the application/game
all_image - Link to the image from the page - “screenshots” of the application/game (the first 3 screenshots, if there are no images, then such a game is skipped)
all_image_path - Name of the image from the page - “screenshots” of the application/game
3. For these files, we need a folder:
- With images (logo of the application/game + images from the application/game page)
In summary, we need to have:
- 1.json, 2.json, 3.json... - files with all information about all categories and applications/games
- images_1, images_2, images_3... - folders with images from the application/game pages, can be divided into 5 gb each
Client's review of cooperation with Anna G.
Scrape the Steam siteThe work was done excellently. Fast and quality. I recommend!
Freelancer's review of cooperation with Aleksandr A.
Scrape the Steam siteI recommend this client to all freelancers looking for professional and productive collaboration. Working with this client was very successful and fruitful for me. Communication was open, constructive, and pleasant throughout the entire project. The client was always available, willing to cooperate, and demonstrated a deep understanding of the task. The technical assignment was detailed and clear, which allowed me to effectively complete the task without any additional questions or uncertainties. Their realistic expectations and flexibility in work significantly eased the task execution process. Overall, this collaboration was very beneficial and showed that well-prepared tasks and open communication can greatly facilitate work and lead to successful outcomes.
-
Winning proposal3 days89 USD
487 4 0 Winning proposal3 days89 USD
Hello! Good day. I am interested in your project. Having researched it, I am ready to start working on it. I write in Python. I can offer optimal solutions to achieve the best results. For a more detailed discussion, I need to review your website and assess its complexity. Write to me, I will be happy to collaborate.
-
4 days33 USD
338 2 0 4 days33 USD
Hello!
I have experience in creating parsers for data collection and processing. I will gladly help with your project.
I will develop a parser that collects the necessary information and performs the required functions. I work until full approval.
Message me privately, and we will discuss the details.
P.S. We will agree on the price, I am working on increasing my rating on the exchange.
-
3 days67 USD
3298 70 1 3 days67 USD
Hello.
I am ready to complete the project. The technical specifications are well described.
I write scripts from scratch for a specific task. I use JavaScript. The result of the work will be of high quality.
Feel free to reach out, I will be happy to collaborate.
Current freelance projects in the category Data Parsing
Consultation on parsing Instagram account subscribersHello. It is necessary to conduct a preliminary assessment of the feasibility of the following task. I have a list of Instagram accounts. The goal is to obtain contact information (primarily email addresses) of users who follow these accounts. Previously, I encountered companies… Data Parsing ∙ 2 days 3 hours back ∙ 12 proposals |
A specialist is needed to find contacts of decision-makers in Ukraine.It is necessary to gather a database (or ready database) of contacts of decision-makers (DMs) in companies in Ukraine. Information Gathering, Data Parsing ∙ 2 days 8 hours back ∙ 16 proposals |
Need to scrape data from LinkedIn
We need to scrape data from LinkedIn based on our list. For each entry, we need to find and collect available data if it exists on the LinkedIn profile, including the profile picture on the LinkedIn social network, email address, links to social media, company website, and… Data Parsing ∙ 2 days 13 hours back ∙ 27 proposals |
Parsing and classification of data
We are looking for a developer to implement a system for collecting and structuring data from open sources. We have a database of small business owners in the USA, which contains the person's name, company name, address, and state. It is necessary to build a process for… Web Programming, Data Parsing ∙ 2 days 15 hours back ∙ 41 proposals |
Svitlahata
17 USD
It is necessary to import 1819 products from the XML/YML feed of Prom.ua to OpenCart 3. A ready XML file is available, which contains product names, descriptions, prices, photos, specifications, manufacturers, and categories. Requirements: import all products to OpenCart… Content Management Systems, Data Parsing ∙ 3 days 17 hours back ∙ 34 proposals |
Kyiv