Apache Airflow Dev
2 weeks ago
Job Description Description We are seeking an experienced Apache Airflow Developer to join our team in India. The ideal candidate will have a strong background in workflow orchestration and data engineering, with a passion for building scalable data pipelines. Responsibilities - Design, develop, and maintain workflows using Apache Airflow. - Implement and optimize data pipelines for data ingestion and transformation. - Monitor and troubleshoot existing workflows to ensure performance and reliability. - Collaborate with data engineers and data scientists to understand workflow requirements. - Document workflow processes and provide training to team members. Skills and Qualifications - 4-6 years of experience in Apache Airflow or similar workflow orchestration tools. - Strong understanding of Python programming and its libraries. - Experience with SQL and relational databases like PostgreSQL or MySQL. - Familiarity with cloud platforms such as AWS, GCP, or Azure. - Knowledge of data processing frameworks like Apache Spark or Apache Kafka. - Experience with version control systems like Git. - Strong problem-solving skills and attention to detail.
-
Airflow Reliability Engineer
4 days ago
Hyderabad, Telangana, India Astronomer Full time ₹ 8,00,000 - ₹ 12,00,000 per yearAstronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than 700 of the...
-
Airflow Reliability Engineer
4 days ago
Hyderabad, Telangana, India Astronomer Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAstronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than 700 of the...
-
Airflow Reliability Engineer
2 days ago
Hyderabad, Telangana, India Astronomer Full time ₹ 12,00,000 - ₹ 24,00,000 per yearAstronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than 800 of the...
-
Snaplogic & Airflow
2 weeks ago
Chennai, Tamil Nadu, India Virtusa Full timeWe are seeking a Senior Developer with expertise in SnapLogic and Apache Airflow to design, develop, and maintain enterprise-level data integration solutions. This role requires strong technical expertise in ETL development, workflow orchestration, and cloud technologies. You will be responsible for automating data workflows, optimizing performance, and...
-
Aws De- Airflow
4 days ago
Chennai, Tamil Nadu, India Willware Technologies Full time**Work mode: One week of onboarding at Chennai office and later Remote** - Design, develop, and deploy complex data pipelines using Apache Airflow on AWS infrastructure. - Architect, optimize, and automate data workflows to ensure reliability, scalability, and performance. - Collaborate with data scientists, analysts, and other stakeholders to understand...
-
AWS Data Engineer
5 days ago
Hyderabad, India Vision Excel Career Solutions Full timeJD : AWS Data EngineerJob location : HyderabadMust Have :- Design and develop efficient data pipelines using Python and orchestrate workflows with Airflow, ensuring reliable data ingestion, transformation, and storage.- Utilize Spark (Glue, EMR) for largescale data processing tasks, optimizing for performance and scalability.- Implement and manage streaming...
-
AWS Data Architect
5 days ago
Hyderabad, India Vision Excel Career Solutions Full timeRole : AWS Data Architect Job Description :Candidate should possess a deep understanding of big data technologies, cloud services, and data architecture, with a proven track record of leading data-driven projects to successful completion.Key Responsibilities :- Lead a team of data engineers, providing technical guidance and mentorship. - Develop and execute...
-
Pyspark Airflow Dev 1 2
1 week ago
Noida, India Iris Software Full time**ROLE: Framework Engineers** - **Primary Skill**(s): Python & PySpark development - **Secondary Skill**(s): Azure, Databricks - **Nice to have’s**: Concepts of Data Engineering; ML Ops; Airflow/DAG; understanding of deployment of AI/ML models; - Sr Developers : 6-9 years exp; - **Communication skills**...Good communication skills required as coordination...
-
Senior data engineer
1 week ago
Hyderabad, India Straive Full timeJob SummaryWe're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL/ELT solutions, collaborating with teams to...
-
Senior data engineer
1 week ago
Hyderabad, India Straive Full timeJob SummaryWe're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL/ELT solutions, collaborating with teams to...