Need a Data Engineer for the development and implementation of an ETL system.
An experienced Data Engineer is needed for the development and implementation of an ETL (Extract, Transform, Load) system aimed at automating the collection, processing, and loading of data on advertising activity in the marketplace.
The system must integrate with various data sources, ensure their cleansing and transformation, and load the prepared data into an analytical warehouse for further analysis.
Tasks:
Development of ETL process architecture, including the creation of database structure, defining the sequence of operations, and selecting tools.
Integration with various data sources (e.g., CRM systems, analytical platforms, databases).
Implementation of data cleansing, normalization, and transformation processes to ensure their quality and consistency.
Setting up mechanisms for loading processed data into the target data warehouse or BI system.
Ensuring the reliability and fault tolerance of the system, including error handling and logging.
Expectations from the specialist who will implement this project:
Experience with ETL systems and data processing tools.
Knowledge of programming languages used in data engineering (e.g., Python, SQL).
Experience with various data sources and databases.
Understanding of data quality assurance principles and error handling.
If you have relevant experience and understand how to implement this task, I would be happy to discuss the project details.
Please leave your proposals regarding the deadlines and preliminary cost of task implementation.
-
10 days22 USD
34 10 days22 USD
Ready to complete the task. We need to discuss the details regarding ETL and the overall specifications for the system.
-
14 days225 USD
326 1 0 14 days225 USD
Hello. I can do everything on airflow (a framework for ETL in python). Integration with various data sources - need to look into it in more detail, there may already be ready-made plugins, if not, I will implement it in python or nodejs. I can also set up the infrastructure + deployment (vps + vpn + docker compose). For the actual cost and time, more details are needed. I would be happy to discuss everything or just consult. I am ready to start immediately.
-
5 days112 USD
4429 80 1 4 5 days112 USD
Trust a professional with over 10 years of experience! The rate and deadlines are current! I look forward to collaboration! Experience in commercial development of online stores on CMS, business portals, and corporate websites - 11 years! +CMS: WordPress(+Woocommerce) PrestaShop/Opencart/Joomla/Bitrix/MODX/DLE/Shopify php/html/css/js/Mysql, PhotoShop/Figma Examples of work (from scratch, turnkey): https://wildandorganic.com/ https://cryptosignals.org/ https://www.alternativemedicine.com.ua/ https://silkkiss.ua/ https://nordtrade.online/ https://v12coffee.com.ua/franchise/ https://smrtalgo.com/ https://sengero.no/ https://beautybysim.no/ https://sonatagalleri.com/ https://www.emmanuel.com.ua/ https://www.onsitecomputersinc.com/ https://express-tehbud.com/ https://korostenporcelain.com.ua/ https://sladok.com.ua/ https://pricemds.com/ https://picupmedia.com/ https://www.serasar.com/ https://integrisit.com/ https://franklinitsolutions.com/ https://www.raebel-latzke.ch/
-
30 days22 USD
250 37 1 2 30 days22 USD
An experienced Data Engineer is needed to develop and implement an ETL (Extract, Transform, Load) system aimed at automating the collection, processing, and loading of data on advertising activity in the marketplace. The system must integrate with various data sources, ensure their cleansing and transformation, and load the prepared data into an analytical warehouse for further analysis.
-
30 days22 USD
15892 378 0 1 30 days22 USD
Good day. I have practical experience in similar tasks: both design and implementation. To estimate the project cost, we need, of course, more details. We would be happy to discuss. Thank you.
Current freelance projects in the category Python
Creation of a multifunctional bot in Telegram
22 USD
(I will provide all materials in private messages) Here is a detailed project description: After pressing the button /start The bot sends a text with rules and terms of use (under the text, the button ‘acknowledged’) After pressing the button, the next message is… Python, Bot Development ∙ 7 hours 40 minutes back ∙ 62 proposals |
Find a product feed (Google Merchant XML) for a website on OpenCart
16 USD
It is necessary to find a direct link to the active product feed (XML) of a competitor for Google Merchant Center Platform (CMS): OpenCart / ocStore Find the original feedRequirements for the result: Working link to the XML file Python, Data Parsing ∙ 2 days 20 hours back ∙ 22 proposals |
Development of a TikTok farm (content factory)It is necessary to develop a system for centralized management of multiple TikTok accounts with automatic content publishing, using individual proxies and simulating natural account activity. Functional Requirements1. Account Management Adding and removing TikTok accounts.… Python, Bot Development ∙ 3 days 8 hours back ∙ 19 proposals |
Improve the performance of Claude Code and work on software development.I am currently developing CRM and Analytics software. I am using Claude Code, but I understand that the results are not the best in terms of changes. There are 2 tasks - Need help creating a preset for skills, MD, and so on to improve quality. Take verified ones that have been… AI & Machine Learning, Python ∙ 3 days 14 hours back ∙ 24 proposals |
OCR systemA system for recognizing text on postal envelopes (index for whom - only numbers). The text can sometimes be handwritten. Recognition of stamps (counting quantity and denomination) Python ∙ 3 days 18 hours back ∙ 26 proposals |