
Airflow Developer
6 hours ago
Airflow Developer in Noida, Bangalore , Pune
We are seeking a skilled
Airflow Developer
to lead the migration of ETL workflows from Talend to Apache Airflow. The ideal candidate will have hands-on experience in designing, developing, and deploying data pipelines using Airflow, and a solid understanding of Talend ETL processes. This role involves analysing existing Talend jobs, re-engineering them in Airflow, and ensuring seamless integration with data sources and destinations.
Key Responsibilities:
- Analyze existing Talend ETL jobs and understand business logic and data flow.
- Design and implement equivalent workflows in Apache Airflow using Python.
- Develop DAGs (Directed Acyclic Graphs) for scheduling and monitoring data pipelines.
- Ensure data quality, error handling, and logging in Airflow pipelines.
- Collaborate with data engineers, analysts, and business stakeholders to validate migrated jobs.
- Optimize performance and scalability of Airflow workflows.
- Document migration processes, pipeline architecture, and operational procedures.
- Provide support during UAT and production deployment.
Required Skills:
- Strong experience with
Apache Airflow
(2+ years). - Hands-on experience with
Talend ETL tools
(Open Studio or Talend DI). - Proficiency in
Python
for scripting and pipeline development. - Experience with
SQL
and working with relational databases (e.g., PostgreSQL, MySQL, Oracle). - Familiarity with
cloud platforms
(AWS, GCP, or Azure) and cloud-native data services. - Understanding of
CI/CD pipelines
, version control (Git), and DevOps practices. - Knowledge of
data warehousing concepts
, ETL best practices, and data governance.
-
Airflow Developer
2 weeks ago
Bengaluru, Karnataka, India ExaTech Inc Full time ₹ 9,00,000 - ₹ 12,00,000 per yearAirflow Developer in Noida, Bangalore , PuneWe are seeking a skilledAirflow Developerto lead the migration of ETL workflows from Talend to Apache Airflow. The ideal candidate will have hands-on experience in designing, developing, and deploying data pipelines using Airflow, and a solid understanding of Talend ETL processes. This role involves analysing...
-
Apache Airflow
4 weeks ago
Bengaluru, Karnataka, India People Prime Worldwide Full timeAbout Company : They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society....
-
Snowflake and Airflow
1 week ago
Bengaluru, Karnataka, India Ashra Technology Full timeGreeting from Ashra technologies Role: Snowflake and airflow **Locations**:Pune/Bengaluru **Primary Skills**:IICS ETL, Snowflake & Airflow **Secondary Skills**:AWS & DBT framework and JD Experience with pipeline development using IICS ETL tool more than 3 years is a MUST - Experience with SQL more than 3 years is a MUST - Experience with pulling data...
-
Data Engineer with Airflow
2 weeks ago
Bengaluru, Karnataka, India Carnation Infotech Full time US$ 1,50,000 - US$ 2,00,000 per yearJob Title: Data Engineer Airflow & Microsoft FabricPosition Summary We are seeking a highly experienced Senior Data Engineer to support a short-term Azure Data Fabric implementation project. The ideal candidate will have strong expertise in Apache Airflow and hands-on experience with Azure Data Fabric, with a proven track record of designing and deploying...
-
Azure Iot
2 weeks ago
Bengaluru, Karnataka, India InnoWave Full timeAs an Azure IoT with Apache Airflow Engineer at InnoWave, you will be a key member of our IoT solutions team, responsible for designing, developing, and maintaining robust and scalable data processing pipelines. You will leverage Azure IoT services and Apache Airflow to build efficient workflows that enable real-time data ingestion, processing, and analysis,...
-
ETL Migration SME – Airflow to Talend
2 weeks ago
Bengaluru, Karnataka, India Aiprus Software Private Limited Full time US$ 1,25,000 - US$ 1,75,000 per yearJob Title: ETL Migration SME – Airflow to TalendLocation: Bangalore, IndiaExperience: 8–10 YearsJob Type: Full-TimeDepartment: Data Engineering / IT TransformationRole OverviewWe are looking for a seasoned ETL Migration SME to lead the migration of enterprise data workflows from Apache Airflow to Talend. The candidate should have strong hands-on...
-
ETL Migration SME – Airflow to Talend
5 hours ago
Bengaluru, India Aiprus Software Private Limited Full timeJob Title: ETL Migration SME – Airflow to Talend Location: Bangalore, India Experience: 8–10 Years Job Type: Full-Time Department: Data Engineering / IT Transformation Role Overview We are looking for a seasoned ETL Migration SME to lead the migration of enterprise data workflows from Apache Airflow to Talend. The candidate should have strong hands-on...
-
Python/Airflow Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Rapsys Technologies Pte. Ltd Full time ₹ 1,04,000 - ₹ 1,30,878 per yearYears of experience: 5+ YearsJD:Responsibilities:Design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration.Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.Implement data integration and transformation processes to ensure...
-
Python/Airflow Data Engineer
4 hours ago
Bengaluru, India Rapsys Technologies Pte. Ltd Full timeYears of experience: 5+ Years JD: Responsibilities: Design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration. Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment. Implement data integration and transformation processes to...
-
Data Engineer
3 days ago
Bengaluru, India Rapsys Technologies Full timeWe're Hiring : Data are seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and infrastructure.The ideal candidate will have expertise in AWS cloud services, Python programming, and Apache Airflow to support our data-driven initiatives and analytics needs.Location : Bangalore Urban, India.Work Mode : Work From...