Data Engineer
3000 USDJob title: Data Engineer
Location: Fully Remote
Salary: $36k - $60k
Role Overview
This position requires a detail-oriented data engineer who can independently architect and implement data pipelines, while also serving as a trusted technical partner in client engagements and stakeholder meetings. You’ll work hands-on with PySpark, Airflow, Python, and SQL, driving end-to-end data migration and platform modernization efforts across Azure and AWS. In addition to technical execution, you’ll contribute to sprint planning, backlog prioritization, and continuous integration/deployment of data infrastructure. This is a senior-level individual contributor role with direct visibility across engineering, product, and client delivery functions.
Key Responsibilities
- Lead design and development of enterprise-grade data pipelines and cloud data migration architectures.
- Build scalable, maintainable ETL/ELT pipelines using Apache Airflow, PySpark, and modern data services.
- Write efficient, modular, and well-tested Python code, grounded in clean architecture and performance principles.
- Develop and optimize complex SQL queries across diverse relational and analytical databases.
- Contribute to and uphold standards for data modeling, data governance, and pipeline performance.
- Own the implementation of CI/CD pipelines to enable reliable deployment of data workflows and infrastructure (e.g., GitHub Actions, Azure DevOps, Jenkins).
- Embed unit testing, integration testing, and monitoring in all stages of the data pipeline lifecycle.
- Participate actively in Agile ceremonies: sprint planning, daily stand-ups, retrospectives, and backlog grooming.
- Collaborate directly with clients, stakeholders, and cross-functional teams to translate business needs into scalable technical solutions.
- Act as a technical authority within the team—leading architectural decisions and contributing to internal best practices and documentation.
Required Qualifications
- 4+ years of hands-on experience in data engineering, with proven success delivering complex data solutions in production environments.
- Expert-level programming skills in Python, including a deep understanding of OOP, performance tuning, and testing strategies.
- Advanced SQL skills: complex joins, CTEs, window functions, indexing, and query optimization.
- Strong experience with Apache Airflow, PySpark, and distributed data processing.
- Proficiency in architecting and delivering data solutions on Microsoft Azure, Amazon Web Services (AWS), or both.
- Demonstrated CI/CD experience for data pipelines and infrastructure (IaC and workflow deployments).
- Hands-on experience with Agile frameworks (Scrum, Kanban) and collaboration tools (Jira, Confluence, Git, etc.).
- Comfortable interfacing directly with clients, product owners, and non-technical stakeholders.
- Experience in regulated industries such as Healthcare or Financial Services, with understanding of privacy and compliance best practices (HIPAA, SOC 2, etc.).
Preferred Qualifications
- Familiarity with Snowflake, Databricks, or other modern data warehouse platforms.
- Experience with MLOps pipelines and tools such as MLflow, PyTorch, and cloud-based ML model delivery.
- Exposure to ETL platforms like Apache NiFi, Talend, or Informatica.
- Proficiency with DBT (Data Build Tool) for modular SQL transformations.
- Strong communication skills with a proven ability to provide mentorship, support knowledge sharing, and document engineering decisions.
- Experience with data visualization and supporting analytics teams through well-structured data marts or APIs.
If you are interested in, attach your updated resume with it.
-
30 days3000 USD
1 2 3 30 days3000 USDHello! I have reviewed your description and understand that you need a Data Engineer who is proficient with PySpark, Airflow, Python, SQL, cloud platforms Azure and AWS, builds ETL/ELT pipelines, implements CI/CD, and participates in planning through Agile. According to your technical specifications, I am well familiar with the entire required stack and approaches, have experience in real implementation of complex pipelines and client interactions, so I am ready to join without a long onboarding process. Also, I am always open to discussions over the phone!
-
30 days3000 USD
280 30 days3000 USDHello, Tony.
Thank you for description.
This opportunity feels like it was created for me and it really excites me.
I'm a senior developer with over 9 years of experience building and running data systems using Python, SQL, and CI/CD pipelines.
I’ve worked a lot with Apache Airflow and PySpark to move and process data in the cloud, and I know how to make things run fast and stay reliable.
I write clean, easy-to-maintain Python code and have strong skills in writing and tuning complex SQL queries. I’ve set up automated workflows using GitHub Actions and Azure DevOps, and I’m comfortable working on both AWS and Azure.
I’m used to working directly with customers and teams to understand their needs and turn them into working solutions.
If you're looking for someone who can take full ownership of your data pipelines and get things done right, I’m ready to jump in.
I am looking forward to working with u soon.
… Let’s build something new and grand that can transform our lives together.
Thanks again
Stanislav
-
3 days3010 USD
738 9 1 3 days3010 USDHello! I have reviewed the project and am ready to start working. I am confident you will be satisfied with the result.
Current freelance projects in the category AI & Machine Learning
Automation of processes through API and PythonBelow I described the current process and the result I would like to achieve. I also attach files of the real process to better understand how it looks in reality Current process Currently, the entire process is performed manually: uploading/downloading files, transferring… AI & Machine Learning, Python ∙ 1 hour 23 minutes back ∙ 18 proposals |
Create videos for TikTok / Experience working with AIA person who is well-versed in creating videos for TikTok Theme: IT / Promotion of our services Such experience with AI is very important We will send an example video — Payment is discussed individually for each video 3D Modeling, AI & Machine Learning ∙ 2 hours 12 minutes back ∙ 8 proposals |
Finding and Deploying the Best Projects for 4 Mac Mini M4 Machines
229 USD
Finding and Deploying the Best Projects for 4 Mac Mini M4 Machines Hello, I am looking for an experienced technical freelancer who understands Mac Mini M4 hardware, DePIN, blockchain nodes, AI inference, automation systems, Docker, and server monitoring. I currently have 4… AI & Machine Learning, Cryptocurrency & Blockchain ∙ 12 hours 40 minutes back ∙ 6 proposals |
Development of an AI consultant for a work visa verification website (WordPress)Development of an AI Consultant for a Work Visa Check Website (WordPress) About the Project An English-language website is being developed for the preliminary check of eligibility for a work visa in Israel. An AI consultant in the format of an online chat is needed to assist… AI & Machine Learning, Bot Development ∙ 20 hours 38 seconds back ∙ 30 proposals |
II agents and applications
609 USD
I'm looking for a person who is already working with AI agents that they have created, who knows how to ensure security, deploy a server, and create AI applications - someone who is already familiar with AI in practice. Why am I looking? To teach me how to do this, because I… AI & Machine Learning, AI Consulting ∙ 2 days 3 hours back ∙ 17 proposals |