Need a backend developer for a data aggregator (API & CSV) – long-term collaboration
🚀 Project Description:
I am looking for a backend developer for long-term collaboration who will help create and maintain data collection and verification systems. The first project involves developing a server solution for collecting and processing information about companies by VAT number from various public and private APIs (for example, VIES and national services), as well as through uploading CSV files.
📌 Key Requirements:
- API Integration: Retrieving data from public and private APIs (I will provide test data).
- CSV Processing: Uploading data to the database and supporting periodic updates.
- Real-time Data Processing: Analyzing API responses based on specified criteria.
- Logging All Operations: Saving requests, responses, errors, analysis results, and user output.
- Flexible Validation System: Ability to customize validation rules for API responses.
- Minimal Test Interface: Simple UI for testing API requests (full frontend is not needed yet).
- Optimal Data Update: Recommendation needed for the best approach.
📌 Technology Stack:
- Open to suggestions for the best stack.
- The solution must be scalable, efficient, and reliable for handling large volumes of data.
🎯 Who I Am Looking For:
- A developer for long-term collaboration who will work on similar projects.
- Experience in API integration, data processing, and logging.
- Ability to work with CSV and optimize databases.
- Ability to propose and implement the best backend architecture.
- Knowledge of VAT verification systems and company registries (a plus).
💰 Budget and Timeline:
- To be discussed depending on your expertise and proposed solution.
📩 In your application, please specify:
- Your experience in API integration and working with CSV.
- What technology stack you recommend and why.
- If you have similar projects in your portfolio.
- An estimate of completion timelines.
- If you are open to ongoing collaboration on similar projects.
I look forward to applications and would be happy to collaborate with an experienced developer! 🚀
-
Hello! I am the project manager of the Dzencode company.
We have experience in developing web services, CRM systems, and programs of varying complexity. We develop from scratch and refine existing ones. We use two strategies for organizing work on projects – Outsourcing and Outstaffing.
Over 8 years of experience. Our team has the necessary expertise to perform such tasks. We also write and integrate APIs, implement payment systems.
We are ready to offer you our developer for outstaffing.
Our rate: from 15 USD/hour. Minimum order is 1 working day - 8 hours, minimum price 120 USD.
…
Can we discuss your project in the chat?
We can work with a secure agreement on the exchange.
Best regards, dZENcode manager.
-
283 Good day! 👋
I have experience working with API integration and processing CSV files.
One of the projects is a system for collecting and processing CSV files from a website with subsequent processing and searching in the database.
I recommend using the Python stack (FastAPI), PostgreSQL for data storage, and Celery for background updates and logging, which ensures scalability and stability.
I am ready for long-term collaboration, quickly adapt to requirements, and am willing to discuss details and propose optimal solutions. 🚀
-
128 Good day!
I am interested in your project — I have experience in API integration.
Experience:
✔ API integration.
✔ CSV processing (import, update, validation).
✔ Logging and caching (Serilog, Redis).
…
Proposed stack (.NET Core):
🔹 ASP.NET Core (Web API) + Entity Framework Core
🔹 SQL Server / PostgreSQL
🔹 Redis (caching), Hangfire (background tasks)
🔹 Docker for scaling
⏳ Estimated timeline: 3 weeks for the first version.
I look forward to your feedback! 🚀
-
3861 15 0 Good day!
I am a full-stack developer with 15 years of experience.
I am ready to join your project and support similar solutions in the long term.
1. I have extensive experience in integrating various APIs, preferably with available documentation. I have worked with data parsing, generation, and processing of CSV files, particularly for product imports.
2. For this task, Node.js + MongoDB would be a great fit:
…
MongoDB allows for convenient storage of JSON structures, especially when working with unstructured or variable API responses.
If needed, a relational database can be easily integrated — I have experience with those as well.
3. I once created a data collection system and maintained it up to date with a domain name database, subsequently using this data in internal processes. (feedback: https://freelancehunt.com/project/parser-na-node-js/634091.html)
4. Without a detailed technical specification, it is difficult to estimate accurately, but preliminarily — from 1 to 2 months for the implementation of the first version.
5. I am interested in a long-term partnership.
P.S. I can send my CV upon request.
-
654 24 0 Good afternoon, Artem
I have experience and am ready for permanent work
Let's discuss the details, after which I will be able to provide you with more specific information regarding deadlines, pricing, and the technical stack with architecture
Message me privately
Best regards, Alexander
-
96691 1276 1 10 Hello. I have extensive experience with Node.js, I have also worked a lot with various APIs, and I have also worked many times on tasks where it was necessary to parse CSV. I am ready to collaborate.
-
326 1 0 Hello, this is a typical parsing and ETL task. There can be many solutions, and it's better to choose according to needs, using popular frameworks is advantageous as it will be easy to maintain the project. For example - for task orchestration - airflow (a popular framework, easy to maintain, easy to find executors) for parsing - scrapy (a popular framework, easy to maintain, easy to find executors). Such a solution is very easy to scale - docker/swarm, k8s/k3s. But this approach is for a large project. Perhaps to start, it’s better to use celery/redis + fastapi, as has already been suggested.
-
682 6 0 Good task., it will be interesting to work.
I have experience in building similar systems, I can show in private communication.
I think we need to use a simple stack:
* FastApi
* Celery + Redis
* Postgress DB
It is impossible to estimate the timeline based on this task description because there is little specificity, but I think in two to three weeks the main skeleton of the backend will be ready.
-
2993 60 0 Artem, hello,
I have worked on similar projects where I integrated APIs for collecting and processing data from various sources, as well as worked with CSV files for their processing and updating in databases. There is a case of developing a system for processing financial data, where there was integration with an API, as well as processing large data arrays with loading into the database.
My recommendation is to use Docker containerization to ensure scalability and ease of deploying the solution in different environments. Regarding testing API requests, a simple UI can be implemented to check requests, which will provide flexibility without excessive complexity.
As for timelines, an initial prototype can be developed in about a few weeks, but more complex features and integrations may require additional time. If you are looking for ongoing collaboration, I am ready to work on similar projects.
Write if you want to discuss details, budget, and timelines. I can suggest several technology options for your project, depending on the requirements.
-
631 5 0 Good afternoon
I will try to help, feel free to reach out
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
-
Гнучка система перевірки: Можливість налаштовувати правила валідації відповідей API. - які валідації повинні відбуватись? У вас є приклад таких правил? Великий обсяг даних - це скільки? Як часто повинна проводитись перевірка данних з джерел? Робив недавно подібну систему: Багато парсерів які запускались по своєму розкладу (брали інфу по API або простий парсинг сторінок, одразу робилась перевірка чи запис новий чи вже був оброблений (окрема база sqlite для кожного парсера)), перетворення данних в узагальнену структуру данних, відправка на окремий сервіс (FastAPI), де дані оброблялись далі і зберігались в Postgresql. Проксі, аккаунти сервісів з данними (де потрібно) надаєте?
-
Ви для початку уточніть , csv файли це не від ДІЇ будуть ? і запитайте заявників як вони збираються через АПІ обробляти csv в кілька гігабайт і 80% зникнуть )
-
Current freelance projects in the category Databases & SQL
It is necessary to check the scripts and update the data in the Postgres database.It is necessary to correct the SQL scripts for the Postgres database. It is required to check the scripts and update data from external Excel tables and between two Postgres databases (different servers). Scripts will be run through AnyDesk using Navicat. List of data for… Databases & SQL ∙ 2 days 9 hours back ∙ 18 proposals |
Need an Airtable architect to build a relational schema and a new clean Airtable base.Need help rethinking and building a clean relational schema for an internal operational system on Airtable. The current database is already in use by the team, but it has grown organically: the structure is partially flat, some tables/views are actively used, while others are… Databases & SQL, Desktop Apps ∙ 3 days 2 hours back ∙ 9 proposals |
Basketball Coaching Education Platform + Custom CMSBasketball Coaching Education Platform + Custom CMSProject Overview We are looking for an experienced web development team or full-stack developer to build a modern basketball coaching education platform. The website will provide basketball coaches with access to educational… Databases & SQL, Web Programming ∙ 3 days 20 hours back ∙ 90 proposals |
Integration of Viber in 8.3
223 USD
Need Viber integration into own CRM (1C 8.3)About the Company The company "Domofon System" is engaged in the installation and maintenance of intercom systems. Base of over 40,000 subscribers. We work on our own customized system based on 1C 8.3. We are looking for a specialist… Databases & SQL, Bot Development ∙ 3 days 23 hours back ∙ 18 proposals |
Refinement of 1C UT 11 for Zebra TSD (RDP): different sound signals when scanning
22 USD
Configuration: 1C UT 11 Address warehouse Zebra TC26 TSD Work via RDP Product scanning is performed in receiving, placement, picking documents, and other warehouse operations. Current problem: Warehouse workers operate through the Zebra TSD. When scanning, they do not always… C#, Databases & SQL ∙ 5 days 21 hours back ∙ 6 proposals |