Data Engineer with Airflow

5 days ago

Bengaluru, Karnataka, India Carnation Infotech Full time US$ 1,50,000 - US$ 2,00,000 per year

Job Title: Data Engineer Airflow & Microsoft Fabric

Position Summary

We are seeking a highly experienced Senior Data Engineer to support a short-term Azure Data Fabric implementation project. The ideal candidate will have strong expertise in Apache Airflow and hands-on experience with Azure Data Fabric, with a proven track record of designing and deploying scalable data solutions in cloud environments.

You will collaborate with a cross-functional team including Project Managers, Architects, and Business Analysts to deliver high-quality data engineering outcomes.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using Apache Airflow
  • Implement and optimize solutions within the Azure Data Fabric ecosystem
  • Integrate workflows with Azure services such as Data Lake, Synapse Analytics, Data Factory, and Purview
  • Collaborate with architects and analysts to translate business requirements into technical solutions
  • Ensure pipeline reliability, scalability, and performance
  • Apply CI/CD practices for data pipeline deployment
  • Uphold data governance, security, and quality standards

Required Skills & Qualifications

  • 68 years of experience in data engineering roles
  • Mandatory hands-on experience with Azure Data Fabric and its components
  • Expert-level proficiency in Apache Airflow
  • Strong programming skills in Python
  • Deep understanding of Azure cloud services for data processing and orchestration
  • Experience with data workflow scheduling, monitoring, and optimization
  • Familiarity with enterprise data environments and agile methodologies
  • Excellent communication and problem-solving skills

Nice-to-Have Skills

  • Experience with containerization tools (Docker, Kubernetes)
  • Knowledge of data modeling and ETL best practices
  • Familiarity with DevOps tools and practices

  • Airflow

    3 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Airflow Senior data engineer Airflow, Python, Snowflake Loc: Pune, Bengaluru, Chennai CTC: Max 19 lpa Thanks & Regards, Indumati Nakate

  • Airflow

    3 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    AirflowSenior data engineerAirflow, Python, SnowflakeLoc: Pune, Bengaluru, ChennaiCTC: Max 19 lpaThanks & Regards,Indumati Nakateindumati.nakate@alphacom.in

  • Python/Airflow Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Rapsys Tech Solutions Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    • Proficiency in Python, PySpark and SQL for data processing and manipulation.• Min 5 years of experience in data engineering, specifically working with Apache Airflow and AWS technologies.• Understanding of Snowflake Data Lake is preferred.

  • Python/Airflow Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Rapsys Technologies Pte. Ltd Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Years of experience: 5+ YearsJD:Responsibilities:Design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration.Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.Implement data integration and transformation processes to ensure...

  • Snowflake, Python, Airflow Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 322031NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Snowflake Python Airflow Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job Duties Team...

  • Airflow Developer

    4 days ago

    Bengaluru, Karnataka, India ExaTech Inc Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Airflow Developer in Noida, Bangalore , PuneWe are seeking a skilledAirflow Developerto lead the migration of ETL workflows from Talend to Apache Airflow. The ideal candidate will have hands-on experience in designing, developing, and deploying data pipelines using Airflow, and a solid understanding of Talend ETL processes. This role involves analysing...

  • ETL Migration SME – Airflow to Talend

    5 days ago

    Bengaluru, Karnataka, India Aiprus Software Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: ETL Migration SME – Airflow to TalendLocation: Bangalore, IndiaExperience: 8–10 YearsJob Type: Full-TimeDepartment: Data Engineering / IT TransformationRole OverviewWe are looking for a seasoned ETL Migration SME to lead the migration of enterprise data workflows from Apache Airflow to Talend. The candidate should have strong hands-on...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Data Engineer - Senior Engineer/ManagerExperience Range: yearsLocation: Bengaluru, IndiaPrimary Skills Required:Position 1(Required Exp Range years): Java, Scala, Spark, Python, Kafka, Airflow, SQL, Databricks, Snowflake, Hive, AWS, Oracle Exadata, SAP Data ServicesPosition 2(Required Exp Range years): Java, Scala, Spark, Python, Kafka, Airflow, SQL,...

  • Technical Lead- Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Senior Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Infiniti Research Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior AWS Data Engineer (PySpark & Airflow)Location: BangaloreExperience: 6+ YearsAbout the RoleWe are seeking an experienced AWS Data Engineer with strong expertise in PySpark and Airflow to design, build, and manage large-scale data pipelines on AWS. The ideal candidate will have hands-on experience with cloud-native data engineering, data warehousing,...