Data Engineer with Airflow

2 days ago

Bengaluru, Karnataka, India Carnation Infotech Full time US$ 1,50,000 - US$ 2,00,000 per year

Job Title: Data Engineer Airflow & Microsoft Fabric

Position Summary

We are seeking a highly experienced Senior Data Engineer to support a short-term Azure Data Fabric implementation project. The ideal candidate will have strong expertise in Apache Airflow and hands-on experience with Azure Data Fabric, with a proven track record of designing and deploying scalable data solutions in cloud environments.

You will collaborate with a cross-functional team including Project Managers, Architects, and Business Analysts to deliver high-quality data engineering outcomes.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using Apache Airflow
  • Implement and optimize solutions within the Azure Data Fabric ecosystem
  • Integrate workflows with Azure services such as Data Lake, Synapse Analytics, Data Factory, and Purview
  • Collaborate with architects and analysts to translate business requirements into technical solutions
  • Ensure pipeline reliability, scalability, and performance
  • Apply CI/CD practices for data pipeline deployment
  • Uphold data governance, security, and quality standards

Required Skills & Qualifications

  • 68 years of experience in data engineering roles
  • Mandatory hands-on experience with Azure Data Fabric and its components
  • Expert-level proficiency in Apache Airflow
  • Strong programming skills in Python
  • Deep understanding of Azure cloud services for data processing and orchestration
  • Experience with data workflow scheduling, monitoring, and optimization
  • Familiarity with enterprise data environments and agile methodologies
  • Excellent communication and problem-solving skills

Nice-to-Have Skills

  • Experience with containerization tools (Docker, Kubernetes)
  • Knowledge of data modeling and ETL best practices
  • Familiarity with DevOps tools and practices

  • Airflow

    4 hours ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Airflow Senior data engineer Airflow, Python, Snowflake Loc: Pune, Bengaluru, Chennai CTC: Max 19 lpa Thanks & Regards, Indumati Nakate

  • Python/Airflow Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Rapsys Tech Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    • Proficiency in Python, PySpark and SQL for data processing and manipulation.• Min 5 years of experience in data engineering, specifically working with Apache Airflow and AWS technologies.• Understanding of Snowflake Data Lake is preferred.

  • Snowflake, Python, Airflow Engineer

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 322031NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Snowflake Python Airflow Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job Duties Team...

  • Python/Airflow Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Rapsys Technologies Pte. Ltd Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Years of experience: 5+ YearsJD:Responsibilities:Design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration.Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.Implement data integration and transformation processes to ensure...

  • Airflow Developer

    2 days ago

    Bengaluru, Karnataka, India ExaTech Inc Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Airflow Developer in Noida, Bangalore , PuneWe are seeking a skilledAirflow Developerto lead the migration of ETL workflows from Talend to Apache Airflow. The ideal candidate will have hands-on experience in designing, developing, and deploying data pipelines using Airflow, and a solid understanding of Talend ETL processes. This role involves analysing...

  • Apache Airflow

    4 weeks ago

    Bengaluru, Karnataka, India People Prime Worldwide Full time

    About Company :They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society.About...

  • Apache Airflow

    2 weeks ago

    Bengaluru, Karnataka, India People Prime Worldwide Full time

    About Company : They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society....

  • ETL Migration SME – Airflow to Talend

    2 days ago

    Bengaluru, Karnataka, India Aiprus Software Private Limited Full time US$ 1,25,000 - US$ 1,75,000 per year

    Job Title: ETL Migration SME – Airflow to TalendLocation: Bangalore, IndiaExperience: 8–10 YearsJob Type: Full-TimeDepartment: Data Engineering / IT TransformationRole OverviewWe are looking for a seasoned ETL Migration SME to lead the migration of enterprise data workflows from Apache Airflow to Talend. The candidate should have strong hands-on...

  • High Salary Apache Airflow Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Maneva Consulting Private Limited Full time

    Job DescriptionGreetings from ManevaJob DescriptionJob Title-Apache Airflow EngineerExperience- 3-10 daysLocation-BangaloreNotice-Immediate to 15 daysRequirements:-As a Senior Engineer with a focus on Managed Airflow Platform (MAP) support engineering.- Evangelize and cultivate adoption of Global Platforms, open-source software and agile principles within...

  • Data Engineer with AWS

    2 days ago

    Bengaluru, Karnataka, India Luxoft Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Project description We are looking for a skilled Data Engineer with strong experience in AWS and Apache Airflow to join a dynamic data team. You will be responsible for building and maintaining scalable data pipelines, orchestrating workflows, and ensuring data quality and availability across platforms. Responsibilities​Data Pipeline Development: Design,...