Importing a database from files
Number of records: ±2 millionData volume: ±150 Gb Database: PostgreSQL (will be hosted on DigitalOcean)
Requirements:Logging so that you can catch errors and be confident in the integrity of the data.High speed of import. You need to choose the optimal way to import data to PostgreSQL. The desired speed is 2-5 hours. Permited speed 12 hours.
Database Structure:URLTitle Pages Category (laptops/device/hwid)Type of device (sound/video/ etc...) - only for the deviceBrand of the manufacturer (Acer/Asus/Nvidia/Intel/ etc...)The rest of the HTML textThe number of characters in the field "The rest of the HTML text"The original name of the folder and the file from which it was imported
Reference for example of the source data:
Applications 1
Client's review of cooperation with Sergey Pasinoga
Importing a database from filesEverything was done in full volume, with excellent quality, in time and on all questions were obtained exhaustive answers.
Freelancer's review of cooperation with Sam B.
Importing a database from filesVery pleased with cooperation!
Strictly prescribed TZ, complete accompaniment throughout the development of the project.
Immediate response to any requests, access and other questions.
A very professional and quality approach to work. I recommend to everyone!
Current freelance projects in the category Data Parsing
It is necessary to develop a Telegram bot for monitoring cars from auctions in the USA (Copart, IAAI)A Telegram bot is needed for automatic searching and monitoring of "BUY IT NOW" cars at auctions in the USA (Copart, IAAI). The bot should operate automatically and send notifications about new cars that meet the specified filters.Main functionalityFilter settings: 1. Car… Data Parsing, Bot Development ∙ 1 hour 6 minutes back ∙ 31 proposals |
Parsing products, preparation for import to WPScrape the full catalog of these websites: https://svit-mebliv.ua/ https://kompanit.com.ua/ru https://amia.com.ua/ https://mebliromax.com.ua/ https://pehotin.com.ua/catalog/ https://www.sokme.ua/ru/ All products need to be combined into one general table for import into WP.… Web Programming, Data Parsing ∙ 2 days 17 hours back ∙ 55 proposals |
A specialist in Telegram promotion is required.
28 USD
Tasks: invite real users from the username database to new chats and send messages to the target database. Only quality traffic and work with a live audience are of interest — performers using bots, fake engagement, or low-quality methods are requested NOT TO DISTURB. Work… Data Parsing, Social Media Marketing (SMM) ∙ 7 days 17 hours back ∙ 9 proposals |
Consultation on parsing Instagram account subscribersHello. It is necessary to conduct a preliminary assessment of the feasibility of the following task. I have a list of Instagram accounts. The goal is to obtain contact information (primarily email addresses) of users who follow these accounts. Previously, I encountered companies… Data Parsing ∙ 11 days 12 hours back ∙ 13 proposals |
A specialist is needed to find contacts of decision-makers in Ukraine.It is necessary to gather a database (or ready database) of contacts of decision-makers (DMs) in companies in Ukraine. Information Gathering, Data Parsing ∙ 11 days 16 hours back ∙ 22 proposals |