Data parser and API service modernization
267 USD About the project
There is an existing parser and API service that processes an average of 1,000 to 10,000 requests per minute. Clients receive data in real-time.
The service has been operational for 8 years now.
The project needed modernization. An old version of Node.js was used, specifically version 10, and part of the architecture required optimization. The service was holding up, but it needed to "move to a new level" in terms of technology and scaling. Development was started but not completed, as the developer disappeared and eventually ended up "in the trenches."
I am looking for a strong developer who:
- Has extensive experience with Node.js (Express.js) — optimizing the current application or developing a new one from scratch, so to speak, an improved version of the current application.
- Has been working with JavaScript for 8+ years.
- Is well-versed in Redis (I would like to use Redis for caching and optimization to reduce the load from multilingual support).
- Handles data traffic volumes of 30+ TB per month.
What I need in the project:
- To add new fields to the API.
- To slightly change the structure of the API data response.
- To add some new parameters for data filtering.
- To add 3 new REST API requests.
- To collaboratively work on the data parser that forms the API.
- I would also like to implement sockets - but this is not critical and can wait.
What is currently available:
There is an API for data that needs to be redone (working) on Node.js version 10. You can check it in Postman.
There is a new API that has already been migrated to the new system - but it works with a lot of errors. You can check it in Postman.
A fully functional application (code) that needs improvement. I still want to stay on Node.js and Express.js.
Conditions:
- I will prefer someone who will work on a partnership model (as has been the case all this time): Payment in the form of 20% of the income from clients on an ongoing basis. Since the data is in real-time, clients make monthly payments.
- I will also consider options for payment per task or hourly. But again, I will prioritize those who are willing to work on a partnership basis.
I will send everything that interests you in a private message.
Work results
Client's review of cooperation with Illia S.
Data parser and API service modernizationThe developer completed a full project ahead of schedule for creating a data parser based on Express.js and JavaScript, demonstrating a high level of technical preparation and responsibility. During the work process, he showed a systematic approach: starting from analyzing requirements and designing the architecture of the service, to testing and documenting key decisions.
The code is written with a clear emphasis on structure and readability. The logic for handling requests, parsing, and further data processing is clearly separated, which significantly simplifies the maintenance and development of the project. It is important to note that the developer paid attention to error handling and logging — this allows not only to track the current state of the service's operation but also to respond promptly to non-standard situations.
His approach to scalability deserves special mention. The project was designed so that it could be easily adapted to new data sources or integrated with other services. The use of Express.js turned out to be a successful solution: it provided ease of API configuration and flexibility for future enhancements.
In addition to the technical side, I want to highlight the communication. The developer was always open to discussing details, made suggestions for improvements, and argued convincingly for the solutions he considered most effective. He demonstrated the ability to work with priorities: focusing on the main tasks without getting bogged down in secondary ones, while still maintaining the quality of implementation.
In the end, a reliable tool was created, which became an important part of the project. The work was done qualitatively and on time, and the code can be rightly called a model of competent development in JavaScript. I am confident that this experience demonstrates the high professional level of the developer and his readiness for more complex and large-scale tasks.
Freelancer's review of cooperation with Alekandr T.
Data parser and API service modernizationThe collaboration was maximally productive. The client formulates tasks competently, promptly provides all necessary information and materials. They know their business very well.
-
1 day267 USD
953 11 0 1 day267 USD
Good day, I am a developer with extensive experience in backend, including writing complex parsers (queues, caching, rate limiting for each worker in the queue, metrics, etc.) Node.JS, Express, Redis - a small part of what I have worked with. Partnership work sounds interesting, - feel free to reach out, we will discuss the details!
-
7 days379 USD
1616 8 0 7 days379 USD
Hello,
I am a developer in the field of AI/ML & JS-TS | WEB SCRAPING. I can complete your project. Write to me, and we will discuss.
-
7 days267 USD
9944 117 0 7 days267 USD
Hello.
I am a NodeJS developer. I am ready to take it on. Write to me, we will discuss.
-
7 days267 USD
178 7 days267 USD
Good day.
10+ years of development experience.
Main technologies I work with: Node.js (ts/js), Java (Kotlin).
Partnership model - no problem, we will of course need to discuss the terms further.
-
14 days267 USD
937 5 0 1 14 days267 USD
Hello, I have experience working with Node.js.
https://vaysed.me
-
Winning proposal20 days267 USD
2642 6 1 Winning proposal20 days267 USD
Hello!
Very interesting and serious project.
I specialize in creating such systems, and my main stack is Python/FastAPI. At the same time, I also have experience with Node.js/Express and can confidently handle the tasks of refactoring, adding endpoints, and integrating Redis for caching.
At the same time, if your goal is a radically new level of performance and scalability, as you mentioned, I would suggest considering a strategic transition to a core written in FastAPI in the future. This would allow you to get the most performance out of your hardware.
The partnership model (20% of revenue) interests me. I am ready to start with this format.
I am ready to review the code and discuss the details to choose the best path for the project.
Current freelance projects in the category Data Parsing
Research of the premium segment in KyivResearch of the premium segment in Kyiv It is necessary to search for open public communication channels with representatives of the premium segment in Kyiv. What needs to be collected: openly published email or phone number for contact, if it is posted in a public source. Who… Data Parsing, Information Gathering ∙ 8 hours 13 minutes back ∙ 10 proposals |
A specialist in Telegram promotion is required.
29 USD
Tasks: invite real users from the username database to new chats and send messages to the target database. Only quality traffic and work with a live audience are of interest — performers using bots, fake engagement, or low-quality methods are requested NOT TO DISTURB. Work… Data Parsing, Social Media Marketing (SMM) ∙ 3 days 2 hours back ∙ 8 proposals |
Collection of B2B database of companies in Germany
40 USD
Goal: To obtain a list of potential employers (clients) for B2B mailing. Region: Munich (München) + radius of 50 km. Required niches: Construction companies (Bauunternehmen) Food enterprises (Lebensmittelhersteller, meat processing plants, bakeries) Logistics and… Data Parsing, Lead Generation & Sales ∙ 3 days 5 hours back ∙ 34 proposals |
Consultation on parsing Instagram account subscribersHello. It is necessary to conduct a preliminary assessment of the feasibility of the following task. I have a list of Instagram accounts. The goal is to obtain contact information (primarily email addresses) of users who follow these accounts. Previously, I encountered companies… Data Parsing ∙ 6 days 21 hours back ∙ 13 proposals |
A specialist is needed to find contacts of decision-makers in Ukraine.It is necessary to gather a database (or ready database) of contacts of decision-makers (DMs) in companies in Ukraine. Information Gathering, Data Parsing ∙ 7 days 2 hours back ∙ 21 proposals |
Kharkiv