Create a database for analysis
I am looking for a specialist to create a database for further detailed data analysis.
The source information consists of 20 + Excel files, each containing 200 + thousand rows of data.
These files need to be consolidated into one file, and based on this, a pivot table should be created for further modeling or data selection for information analysis. Alternatively, any other solution that allows analyzing such a large amount of data based on the parameters present in the table should be created.
Importantly, this "tool" or database must be created with the ability to update/add data without involving a developer.
Client's review of cooperation with Mykyta S.
Create a database for analysisattentive specialist. patience and quality recommendations are the main traits of a specialist. Thank you for your work!
Freelancer's review of cooperation with Denis Shishko
Create a database for analysisThe project is completed, payment received.
The client was in touch and tested the result, but the collaboration was not easy. Some expectations regarding the final tool were not clearly defined at the start, which led to misunderstandings and the need to revise the approach during the process.
I would also note that communication was at times harsh and conflictual. I recommend future performers to work only after detailed agreement on the technical specifications, examples of required reports/scenarios, and clear acceptance criteria.
The project is completed, but the collaboration was tense.
-
Good day.
I can help with this task. To be honest, I wouldn't consolidate everything into one "big Excel" file, because with 20+ files of 200+ thousand rows each, it starts to feel more like a punishment than a tool for analysis.
I would suggest a slightly more proper solution:
- consolidation of all Excel files into a single structure
- loading data into a database
- building pivot tables / selections based on the required parameters
… - the ability to add new files without involving a developer
- preparing a foundation for further analysis, filtering, BI, or modeling
What I can propose for implementation:
- PostgreSQL as the main database
- import from Excel through a separate understandable script or simple interface
- normalization and cleaning of data during loading
- formation of pivot tables / views for analysis
- instructions so you can update the data yourself later
In the end, you will receive not just "one file," but a working tool that does not break under the volume of data and allows you to work calmly with analytics.
If needed, I can also help separately:
- think through the database structure
- create automatic updates
- connect Power BI / Excel / Python analytics on top of this database
For an accurate estimate of timelines and costs, it would be good to look at 1-2 sample files and understand:
- whether they have the same structure
- which fields are important for analysis
- which pivot tables / selections are needed as output
-
Good day
20+ files have the same column structure?
I can offer you to do everything based on a database + Django admin panel.
I completed a similar project a couple of days ago. It required processing and calculating data on 2,500,000 records. I will quickly adapt it to your files.
Feel free to reach out.
-
Good day
I can implement a similar solution. Let's discuss the details such as the data format, what analyses are needed, and who will be using the system.
-
Good day. I have been working with databases for over 10 years, I guarantee the efficiency and quality of building a structured database (for example, in Access).
-
278 Hello!
I have experience in processing large datasets and I am ready to create a system for you based on SQL and Python. I will set up automatic loading of new files so that you can update the database yourself with one click without my assistance. In the end, you will receive a fast tool for analysis and instructions for it.
Please let me know if all 20+ files have the same column structure or if they differ depending on the period? Thank you!
-
690 5 0 Hello!
I have experience in building similar pipelines and analytical dashboards. I can propose an optimal architecture where new files are added without the involvement of a developer, as you want, and the data is automatically consolidated and updates the dashboards. I will immediately lay the groundwork for scalability for further modeling.
Feel free to reach out!
-
417 2 0 Hello
I have completed a similar task, 2 daily reports with over 200,000 rows, imported into a database (a convenient uploader, just upload the file from the PC and that's it, without complicated actions), the backend combines these 2 reports. We display all of this in the Metabase dashboard for analysis.
What I propose
Data consolidation
Combining all Excel files into a single structure (essentially — a centralized database, not a "heavy" Excel).
Cleaning and unifying fields: date formats, column names, data types, duplicates, gaps.
Building a database for analysis
Creating an analytical model (tables + relationships) for quick slices and filtering by parameters.
… Preparing "pivot" tables/views for modeling and further analysis.
Analytics in Metabase
Connecting Metabase to the database.
Setting up ready-made dashboards, filters, segments, drill-down analysis.
Query templates for data selection "in 2 clicks."
Updates without a developer
A simple process for adding new files (through a folder/import) is set up.
Automatic or semi-automatic data updates according to instructions for your team.
Documentation + brief user training.
Result for you
A single source of truthful data instead of dozens of Excels.
Quick analytics of large volumes without "file crashes."
A ready tool for modeling, reporting, and decision-making.
-
1383 26 0 Hello, Denis.
I have done similar projects - I know the nuances and will do exactly what is described. There are a few clarifications before starting.
Final price/timeframe after all clarifications.
-
9972 117 0 Hello.
I have experience with PostgreSQL. I can load your data into the database. Write to me, we will discuss.
-
95799 1272 1 10 Hello. I have extensive experience with Python. I am ready to collaborate. Please contact me.
-
716 4 0 Hello!
For 10 years, I have specialized in complex projects that require high qualifications.
I have extensive experience with similar projects.
I can professionally create a database for analysis.
The exact price will be determined after clarifying the technical specifications.
Work plan:
Analysis of the structure of incoming files and identification of key parameters for analysis
Selection of a technological solution that supports data updates without involving a developer
Consolidation of all tables into a single structured array
… Cleaning, integrity checking, and unification of record formats
Deployment of the database or analytical environment
Creation of pivot tables and tools for filtering and modeling
Setting up a simple mechanism for self-uploading new data
Testing processing speed and accuracy of results
Preparation of instructions and final handover of the solution
-
1768 17 1 Good day. I specialize in CRM, dashboards, databases, and web services for processing, accounting, and analytics. Convenient and modern design. Development is fully turnkey.
Integration with artificial intelligence and other automations can be implemented. CRM is my main focus, so I can offer many interesting options.
Feel free to reach out.
-
702 1 0 Hello! I am ready to develop such a system. I have experience working with various databases. I offer quality and fast work without loss of quality. Write to me)
-
1008 21 0 11:54 AM
Good day. I am free now, I can start immediately.
20 files × 200k+ rows. I suggest transferring the data to PostgreSQL and creating a simple web interface: uploading new files with a button, filters, and pivot tables — to work with the data without a developer. If needed — backups and replication.
Clarification: is the structure of all files the same? Which analysis parameters are the most important?
-
957 5 0 1 Good day.
My name is Oleksiy.
I am a Full-Stack developer, specializing in the development of websites, bots, scripts, and automation systems.
I am ready to offer a stable and professional solution and implement it in a short time.
I would be happy to discuss all the details in private messages, including price and deadlines, and start working.
-
886 3 0 Hello! I have extensive experience working with large datasets (Big Data) in Python.
Your volume (4 million+ rows) is too heavy for regular Excel, so I propose an automated solution based on Python + PostgreSQL:
1. A script will automatically gather all your Excel files into a single fast database.
2. You will be able to add new files to the folder and update the database with the press of a button, no developer needed for this.
3. I will set up a convenient tool for querying and pivot tables (Power BI or a simple web interface in Python), where the data will fly.
I am ready to discuss the structure of your tables and suggest the optimal architecture option!
-
687 8 0 I can create a database, or rather process files using Borland Delphi. It will be a practical and convenient program for viewing and analyzing file searches. The program will only be in gray color, as the focus is on practicality and performance rather than design.
-
976 4 0 Good day
My name is Dmytro, I represent the company King Kong Lab
I can build a convenient database and a tool for analyzing large Excel files without "crashes" and manual work
What I will do
I will combine all files (20+ with 200k rows each) into a single structure
I will clean and normalize the data
I will build a database (PostgreSQL / BigQuery or another optimal option)
I will create a convenient tool for analysis (dashboards / filters / pivot tables)
Most importantly
… I will set up simple data updates
so you can add new files yourself (via Excel / Google Sheets / import) without involving a developer
I can also
set up automatic updates
add quick filters and selections for your tasks
prepare data for further modeling
Timeline
3–7 days
I am ready to look at sample files and suggest an optimal solution
I would be happy to collaborate
-
1722 4 0 Good day. I can implement a solution for you to consolidate 20+ Excel files with over 200,000 rows, build a single database, and create an analytical tool for selection, modeling, and working with pivot tables. For such a volume of data, I would recommend not just one large Excel file, but a more stable solution based on a database + a user-friendly interface for updating and analysis, so that the system works quickly and without Excel limitations.
-
1539 35 3 Good day. With such a volume of data, it is definitely necessary to use an industrial database. I would choose MSSQL. The database should process data in seconds. Excel will not handle it. Moreover, MSSQL already has an MS SQL Report Server. Reports can already be built. It is also necessary to implement automatic (semi-automatic) data loading. I can create such a utility; the programming language does not matter (1C, Delphi, C#...). At the same time, PowerBI can be used. However, it is slower than MS SQL Report Server. Everything depends on the requirements. Just digital reports, or visualization in the form of graphs.
-
3092 11 0 Good day!
I am developing in Python.
I have been designing databases since 2017.
I have designed a large number of databases for large corporations in various teams' SCADAs.
Let's discuss your project, I am confident that I can help you with automation for your business.
-
2277 36 0 Good day, from your files it is possible to create a single database and a website for adding new types of data. The database and website can be hosted on paid services - Supabase and Vercel. This will be a plus as it will be accessible from any device and location.
-
4182 198 2 5 There is experience in creating scalable solutions for working with large volumes of data (over 4 million rows), using MySQL/PostgreSQL and effective aggregation. A process can be prepared to consolidate these Excel files into a single database with a convenient structure for quick construction of pivot tables or custom filtering.
I propose to create a database on PostgreSQL with carefully thought-out indexes and schema, as well as to develop an interface (possibly on Laravel/Vue) that will allow easy updating/adding of new files through a web form without involving a developer. If necessary, the import can be automated through scripts or even set up an ETL process.
I am ready to discuss the details of parameters and data formats to choose the most optimal solution for your needs.
-
4975 41 4 1 Good day!
I have experience in creating databases and working with large volumes of data. I am ready to consolidate your Excel files, develop an effective solution for analysis (including pivot tables or another system), and ensure the ability to easily update data without involving a developer.
Write to me, and we will discuss the details.
-
240 I will gladly complete the project! I have experience in creating databases, specifically Excel!
-
1213 8 0 Hello! We have experience in consolidating large arrays of Excel data and building analytical databases. We implement this through automated loading, cleaning, normalization, and structuring of 20+ files into a single analytical model. We will provide access to the database with support for further modeling.
Current freelance projects in the category Databases & SQL
Power BI
16 USD
The dashboard runs on a Google server, we need to transfer all logic + code Required skills: deployment of ETL processes on a Linux server + working with BigQuery and Postgre There is working code that runs on Google, where the database itself is, we need to transfer it to… Python, Databases & SQL ∙ 2 days 22 hours back ∙ 15 proposals |
Need a 1C specialist for refinements and development.I am looking for a 1C specialist for freelance collaboration. I am currently working with a contractor who provides support and maintenance for the 1C system. However, due to the contractor's workload, there is a need for prompt execution of additional tasks, improvements, and… Databases & SQL ∙ 4 days 22 hours back ∙ 11 proposals |
Restoring Instagram after a banOn March 3, 2026, my Instagram was blocked due to a violation of rules. I believe there has been some mistake, as the page was personal with photos and videos of my personal trips. I did not post any comments anywhere. I have sent several appeals. I cannot download my files… Databases & SQL, Web Programming ∙ 5 days 9 hours back ∙ 6 proposals |
Eliminate the issue of incomplete data import from Excel files of Nova Poshta specifications into 1C:
45 USD
Goal: There is a processing in 1C for uploading the specifications of Nova Poshta. For unclear reasons, it has stopped loading some tabular data. We need to find the reason and eliminate the problem of incomplete data import from Excel files of Nova Poshta specifications into… System & Network Administration, Databases & SQL ∙ 8 days 16 hours back ∙ 16 proposals |
Accounting, planning, and sales system for a mushroom farm
601 USD
Here is the complete, final text of the Technical Assignment (TA). It combines all your requirements: 16 chambers, 20 contractors, a schedule by days, accounting for containers, profitability calculation, and a mandatory division into three grades of mushrooms. You can fully… Databases & SQL, Client Management & CRM ∙ 10 days 20 hours back ∙ 61 proposals |