Importing a database from files
Number of records: ±2 millionData volume: ±150 Gb Database: PostgreSQL (will be hosted on DigitalOcean)
Requirements:Logging so that you can catch errors and be confident in the integrity of the data.High speed of import. You need to choose the optimal way to import data to PostgreSQL. The desired speed is 2-5 hours. Permited speed 12 hours.
Database Structure:URLTitle Pages Category (laptops/device/hwid)Type of device (sound/video/ etc...) - only for the deviceBrand of the manufacturer (Acer/Asus/Nvidia/Intel/ etc...)The rest of the HTML textThe number of characters in the field "The rest of the HTML text"The original name of the folder and the file from which it was imported
Reference for example of the source data:
Applications 1
Client's review of cooperation with Sergey Pasinoga
Importing a database from filesEverything was done in full volume, with excellent quality, in time and on all questions were obtained exhaustive answers.
Freelancer's review of cooperation with Sam B.
Importing a database from filesVery pleased with cooperation!
Strictly prescribed TZ, complete accompaniment throughout the development of the project.
Immediate response to any requests, access and other questions.
A very professional and quality approach to work. I recommend to everyone!
Current freelance projects in the category Data Parsing
Scrape the database and add it to the Telegram chatScrape the database from List.ua and add by numbers to the Telegram chat. The chat is about repairs and interior design. Data Parsing, Customer Support ∙ 1 hour 16 minutes back ∙ 13 proposals |
It is necessary to develop a Telegram bot for monitoring cars from auctions in the USA (Copart, IAAI)A Telegram bot is needed for automatic searching and monitoring of "BUY IT NOW" cars at auctions in the USA (Copart, IAAI). The bot should operate automatically and send notifications about new cars that meet the specified filters.Main functionalityFilter settings: 1. Car… Data Parsing, Bot Development ∙ 8 hours 49 minutes back ∙ 59 proposals |
Parsing products, preparation for import to WPScrape the full catalog of these websites: https://svit-mebliv.ua/ https://kompanit.com.ua/ru https://amia.com.ua/ https://mebliromax.com.ua/ https://pehotin.com.ua/catalog/ https://www.sokme.ua/ru/ All products need to be combined into one general table for import into WP.… Web Programming, Data Parsing ∙ 3 days 1 hour back ∙ 57 proposals |
A specialist in Telegram promotion is required.
28 USD
Tasks: invite real users from the username database to new chats and send messages to the target database. Only quality traffic and work with a live audience are of interest — performers using bots, fake engagement, or low-quality methods are requested NOT TO DISTURB. Work… Data Parsing, Social Media Marketing (SMM) ∙ 8 days 1 hour back ∙ 9 proposals |
Consultation on parsing Instagram account subscribersHello. It is necessary to conduct a preliminary assessment of the feasibility of the following task. I have a list of Instagram accounts. The goal is to obtain contact information (primarily email addresses) of users who follow these accounts. Previously, I encountered companies… Data Parsing ∙ 11 days 20 hours back ∙ 13 proposals |