Airflow Developer

2 weeks ago


Pune, Maharashtra, India Virtusa Full time
Airflow Developer
  • CREQ189195 Description We are seeking a skilled Data Engineer proficient in Airflow, with expertise in DBT (Data Build Tool).

The ideal candidate will play a key role in designing, developing, and maintaining data pipelines, ensuring the reliability and efficiency of data workflows within our organization.

ResponsibilitiesOverall 4 yrs experience with various data platforms, data warehousing initiatives including at least 1 implementation experience in building data pipelines, Schedule, Orchestrate with Airflow and DBT is Mandatory.

Having Data Engineering, Orchestration experience using Apache Airflow and Python.
Proficient in SQL and Python is a Must.
Collaborating with the team for ensuring suitable translation of architectural solutions into robust and effective implementation.

Thorough understanding and application of AWS services related to Cloud data platform is mandatory AWS S3, AWS Glue, Amazon Redshift.

Stay current with industry trends and advancements in ETL technologies, incorporating new tools and techniques as appropriate like Airflow and DBT specific CICD, Version Control and Automated Testing.

Collaborate with infrastructure and DevOps teams to deploy and monitor data pipelines in production environments.

Work closely with DBT Engineers to understand the dbt modelsShould have Ability to integrate logically different tasks into Data pipelines.

Must have good exposure to configure, schedule and orchestrate pipelines.
QualificationsBachelors or masters degree in computer science, engineering, or a related field.

Proven experience designing, implementing, and maintaining data pipelines using Airflow and DBT.Experience with cloud platforms AWS and their data services.

Experience with version control systems (, Git) and CI/CD pipelines.
Excellent problem-solving skills and attention to detail, with a commitment to delivering high-quality solutions in a fast-paced environment.
Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams.
Prior experience working in an Agile or iterative development environment is a plus.
Primary Location Pune, Maharashtra, India Job Type Experienced Primary Skills Hive Years of Experience 4 Qualification

We are seeking a skilled Data Engineer proficient in Airflow, with expertise in DBT (Data Build Tool).

The ideal candidate will play a key role in designing, developing, and maintaining data pipelines, ensuring the reliability and efficiency of data workflows within our organization.

ResponsibilitiesOverall 4 yrs experience with various data platforms, data warehousing initiatives including at least 1 implementation experience in building data pipelines, Schedule, Orchestrate with Airflow and DBT is Mandatory.

Having Data Engineering, Orchestration experience using Apache Airflow and Python.
Proficient in SQL and Python is a Must.
Collaborating with the team for ensuring suitable translation of architectural solutions into robust and effective implementation.

Thorough understanding and application of AWS services related to Cloud data platform is mandatory AWS S3, AWS Glue, Amazon Redshift.

Stay current with industry trends and advancements in ETL technologies, incorporating new tools and techniques as appropriate like Airflow and DBT specific CICD, Version Control and Automated Testing.

Collaborate with infrastructure and DevOps teams to deploy and monitor data pipelines in production environments.

Work closely with DBT Engineers to understand the dbt modelsShould have Ability to integrate logically different tasks into Data pipelines.

Must have good exposure to configure, schedule and orchestrate pipelines.
QualificationsBachelors or masters degree in computer science, engineering, or a related field.

Proven experience designing, implementing, and maintaining data pipelines using Airflow and DBT.Experience with cloud platforms AWS and their data services.

Experience with version control systems (, Git) and CI/CD pipelines.
Excellent problem-solving skills and attention to detail, with a commitment to delivering high-quality solutions in a fast-paced environment.
Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams.
Prior experience working in an Agile or iterative development environment is a plus.
Travel No
  • Airflow Developer

    2 weeks ago


    Pune, Maharashtra, India Virtusa Full time

    Airflow Developer Company: Looking for an expert Data Engineer with proficiency in Airflow and specialization in DBT (Data Build Tool). The ideal candidate will have a crucial role in the design, development, and maintenance of data pipelines, ensuring the efficiency and reliability of data workflows within the organization. Responsibilities: Overall 4...

  • Data Engineer

    2 months ago


    Pune, Maharashtra, India HyrEzy Talent Solutions Full time

    Job Description and Responsibilities :Solicit business, functional, non-functional and technical requirements through interviewing and requirements gathering process.Analyze and document above requirements and data definitions, perform data analysis, assist in change management, training and testing efforts.Works with stakeholders to gather requirements on...

  • Data Engineer

    4 weeks ago


    Pune, Maharashtra, India HyrEzy Talent Solutions Full time

    Job Description and Responsibilities :Solicit business, functional, non-functional and technical requirements through interviewing and requirements gathering process.Analyze and document above requirements and data definitions, perform data analysis, assist in change management, training and testing efforts.Works with stakeholders to gather requirements on...


  • Pune, Maharashtra, India OpsTree Solutions Full time

    Here is the Monument JD.JobDescriptionWeare seeking a skilled ETL (Extract Transform Load) developer withexpertise in AWS services to join our team.Asan ETL developer you will play a crucial role in designingdeveloping and maintaining robust ETL processes to support our dataintegration and analysis needs.ResponsibilitiesDesigndevelop and implement efficient...

  • Python Developer

    2 weeks ago


    Pune, Maharashtra, India Vyom Labs Pvt Ltd Full time

    Job Description : Strong Knowledge on Unix Platform Strong Working Hands on experience on Python Troubleshooting and Analytics skills are must Python Pandas and Numpy is a must Development experience on Flask Python-Elastic Search Integration is a positive Ability to create DAG's in Airflow is a plus

  • Python Developer

    2 weeks ago


    Pune, Maharashtra, India Vyom Labs Pvt Ltd Full time

    Job Description:Strong Knowledge on Unix PlatformStrong Working Hands on experience on PythonTroubleshooting and Analytics skills are mustPython Pandas and Numpy is a mustDevelopment experience on FlaskPython-Elastic Search Integration is a positiveAbility to create DAG's in Airflow is a plus

  • ETL Developer

    2 weeks ago


    Pune, Maharashtra, India Global Pharma Tek Full time

    Roles and Responsibilities-Proven hands-on Software Development experienceStrong Data Warehouse knowledge and experience, include data modelling, data ingestion, transformation, data consumption patternsStrong Snowflake SQL knowledge and experience, including developing and optimizing complex queries, creating efficient UDFs to extend the...

  • Python Developer

    2 months ago


    Pune, Maharashtra, India Corpxcel Consulting Full time

    Location : Pune OnlyRole type : IC and completely hands on Qualifications :- 2+ years of Java/Scala development experience.- 2+ years of SQL and NoSQL experience (handling structured and unstructured data).- 1+ years of extensive experience with Spark Processing engine.- 1+ years of experience with Big data tools / technologies/ Streaming (Hive, Impala,...

  • Python Developer

    4 weeks ago


    Pune, Maharashtra, India Corpxcel Consulting Full time

    Location : Pune OnlyRole type : IC and completely hands on Qualifications :- 2+ years of Java/Scala development experience.- 2+ years of SQL and NoSQL experience (handling structured and unstructured data).- 1+ years of extensive experience with Spark Processing engine.- 1+ years of experience with Big data tools / technologies/ Streaming (Hive, Impala,...

  • WovV Technologies

    2 months ago


    Pune, Maharashtra, India WovV Technologies Full time

    Location : Pune (Hybrid Work module compulsory, WFH not available).Experience : 5-7 years.Contract Duration : Contract position for 6 months (can be extended).Mandatory Technology : Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.Role and Responsibilities :- Scala is a mandatory skill here.- Please ensure that the...

  • ETL Developer

    2 weeks ago


    Pune, Maharashtra, India Global Pharma Tek Full time

    Roles and Responsibilities- Proven hands-on Software Development experience Strong Data Warehouse knowledge and experience, include data modelling, data ingestion, transformation, data consumption patterns Strong Snowflake SQL knowledge and experience, including developing and optimizing complex queries, creating efficient UDFs to extend the...

  • Python Developer

    2 weeks ago


    Pune, Maharashtra, India Corpxcel Consulting Full time

    Location : Pune OnlyRole type : IC and completely hands on Qualifications : 2+ years of Java/Scala development experience. 2+ years of SQL and NoSQL experience (handling structured and unstructured data). 1+ years of extensive experience with Spark Processing engine. 1+ years of experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE,...

  • Build Developer

    2 weeks ago


    Pune, Maharashtra, India Capgemini Engineering Full time

    Hello, I am thrilled to have found your profile as I was seeking innovative individuals with a deep experience in their field. If you are keen on this opportunity, kindly send your updated resume. Job Title: 3DX - Build Developer Duration: - Full Time Location: - Pune/Bangalore Job Description: 3DX - Build Developer Skills required: - Strong DevOps...


  • Pune, Maharashtra, India LTIMindtree Full time

    Exp- 5 to 15 Years Locations- PAN India LTIM locations Rel Experience- 3 Years (in Python/ Pyspar/ ScalaSpark) Scala development and design using Scala 3+ or Python Hadoop, Spark/Pyspark, Hive, YARN Data Modelling: A good data engineer should be able to design, implement and maintain data models that can support the organization's data storage and analysis...


  • Pune, Maharashtra, India Spectrum Full time

    GCP DeveloperLocation : PuneSkills :Strong knowledge in :a. GCP- Big Datab. Snowflakesc. BQ storaged. Airflowe. KubernetesCI /CD Experience in Devops. The resource will be working closely with the client and providing solutions for the new as well as existing requirements.Implementation of new pipelines and monitoring of the existing ones and reporting...

  • Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Rocket Consulting Full time

    A Data Engineer/developer having good experience working withPrimary skills : Python, AirFlow - ETL skills - GCPSecondary skills : Google Cloud Composer - Google Big Query - Google Cloud Storage SQL MS SQL Serve Proven experience as a Data Engineer/Developer with expertise in Python, Airflow, and GCP. Strong understanding of ETL concepts and best practices....

  • Build Developer

    2 weeks ago


    Pune, Maharashtra, India Capgemini Engineering Full time

    Hello,I happy to come across your profile while I was looking for some innovate folks, those who have knowledge In depth experience of your Skills .If you interested for this opportunity, Please share your updated resume to my Mail EMAIL: : 3DX -Build DeveloperDuration : Full TimeLocation: Pune/BangaloreJOB Description:3DX -Build DeveloperSkills...

  • MLOPs Engineer

    2 weeks ago


    Pune, Maharashtra, India Tekgence Inc Full time

    Experience: 5+YearsNP :Immediate to 30 DaysLocation: Pune/Chennai/Hyderabad/BangaloreMLOPs Engineer:Python, ML concepts and frameworks, Fast API, Graph QL, AWS, ML Flow, AirFlow, ML pipeline creation, drift monitoringStrong understating of Python, ML concepts and frameworks, Fast API, Graph QLExperience in developing scalable APIs.Knowledge of AWS, preferred...

  • Build Developer

    2 weeks ago


    Pune, Maharashtra, India Capgemini Engineering Full time

    Hello,I happy to come across your profile while I was looking for some innovate folks, those who have knowledge In depth experience of your Skills .If you interested for this opportunity, Please share your updated resume to my Mail EMAIL:Position : 3DX -Build DeveloperDuration : Full TimeLocation: Pune/BangaloreJOB Description:3DX -Build DeveloperSkills...

  • MLOPs Engineer

    2 weeks ago


    Pune, Maharashtra, India Tekgence Inc Full time

    Experience: 5+YearsNP :Immediate to 30 Days Location: Pune/Chennai/Hyderabad/Bangalore MLOPs Engineer: Python, ML concepts and frameworks, Fast API, Graph QL, AWS, ML Flow, AirFlow, ML pipeline creation, drift monitoring Strong understating of Python, ML concepts and frameworks, Fast API, Graph QL Experience in developing scalable APIs. Knowledge of AWS,...