Current jobs related to Intermediate Airflow Developer - India - iVedha Inc.

  • Intermediate Airflow Developer

    3 weeks ago

    India iVedha Inc. Full time

    INTERMEDIATE AIRFLOW DEVELOPER About the Role: We are looking for an experienced Intermediate Airflow Developer with over 2 years of experience to help transition our existing Windows scheduler jobs to Apache Airflow DAGs. In this role, you'll play a critical part in modernizing and optimizing our task automation processes by converting existing jobs into...

  • Intermediate Business Analyst

    3 weeks ago

    India UPS Full time

    Before you apply to a job select your language preference from the options available at the top right of this page Explore your next opportunity at a Fortune Global 500 organization Envision innovative possibilities experience our rewarding culture and work with talented teams that help you become better every day We know what it takes to lead UPS...

  • Intermediate Backend Engineer

    3 weeks ago

    India GitLab Full time

    Job DescriptionGitLab is an open-core software company that develops the most comprehensive AI-powered DevSecOps Platform, used by more than 100,000 organizations. Our mission is to enable everyone to contribute to and co-create the software that powers our world. When everyone can contribute, consumers become contributors, significantly accelerating human...

  • Odoo Developer And Consultant

    3 weeks ago

    India Perfonec Computers LLC Full time

    Job Description: We're seeking an experienced Odoo Developer and Consultant to enhance, support, maintain, and troubleshoot our current and future Odoo implementations.The ideal candidate will manage Odoo's continuous improvement, including implementation, design enhancements, functionality, and development to improve and optimize our business...

  • Intermediate Fullstack Engineer

    3 weeks ago

    India GitLab Full time

    Job DescriptionGitLab is an open-core software company that develops the most comprehensive AI-powered DevSecOps Platform, used by more than 100,000 organizations. Our mission is to enable everyone to contribute to and co-create the software that powers our world. When everyone can contribute, consumers become contributors, significantly accelerating human...

  • Odoo Developer and Consultant

    4 weeks ago

    India Perfonec Computers LLC Full time

    Job Description:We're seeking an experienced Odoo Developer and Consultant to enhance, support, maintain, and troubleshoot our current and future Odoo implementations. The ideal candidate will manage Odoo's continuous improvement, including implementation, design enhancements, functionality, and development to improve and optimize our business...

  • ETL Developer

    4 weeks ago

    India IntraEdge Full time

    Job Title: ETL Developer (AWS, Snowflake, IBM DataStage)Experience: 5 to 7 YearsLocation: India (Remote – Work from Home)Education: B.Tech in Computer Science or related fieldEmployment Type: Full-TimeJob Summary:We are seeking a skilled and experienced ETL Developer with 5–7 years of hands-on experience in building and managing ETL pipelines using AWS,...

  • Intermediate Infrastructure Security Engineer

    3 weeks ago

    India GitLab Full time

    Job DescriptionGitLab is an open-core software company that develops the most comprehensive AI-powered DevSecOps Platform, used by more than 100,000 organizations. Our mission is to enable everyone to contribute to and co-create the software that powers our world. When everyone can contribute, consumers become contributors, significantly accelerating human...

  • Senior Snowflake Developer

    4 weeks ago

    India iVedha Inc. Full time

    We're Hiring: Senior Snowflake Developer & Infrastructure Integration Expert (Remote)We're looking for a seasoned Snowflake Developer and Infrastructure Expert to take charge of full lifecycle implementations — from secure platform setup and cloud integration to high-performance data pipeline development.If you thrive at the intersection of data...

  • Frontend Developer

    4 weeks ago

    India BrainRocket Full time

    Please note that relocation to Sofia is required.Brain Rocket takes care of Visa and other administration related costs.Embark on an exhilarating journey with Brain Rocket as we amplify our IT hub in Cyprus.We're looking for an experienced Frontend Developer (Angular) to join our development team Responsibilities: Develop a complex i Gaming platform using...

Intermediate Airflow Developer

4 weeks ago

India iVedha Inc. Full time

INTERMEDIATE AIRFLOW DEVELOPER

About the Role:

We are looking for an experienced Intermediate Airflow Developer with over 2 years of experience to help transition our existing Windows scheduler jobs to Apache Airflow DAGs. In this role, you'll play a critical part in modernizing and optimizing our task automation processes by converting existing jobs into efficient, manageable, and scalable workflows in Airflow. You will also work on security hardening, implementing data pipelines, and designing ETL processes.

Key Responsibilities:

  • Convert Windows Scheduler Jobs to Airflow: Migrate existing Windows-based scheduled jobs into Airflow DAGs, ensuring smooth execution and reliability.
  • Develop and Optimize DAGs: Author, schedule, and monitor DAGs (Directed Acyclic Graphs) to handle data workflows, ETL tasks, and various automation processes.
  • Programming and Scripting: Use Python as the primary language for Airflow DAGs and task logic, with experience in SQL for data manipulation.
  • Set Up and Configure Airflow: Provide comprehensive instructions and configurations for setting up Airflow environments, including deployment, resource allocation, and high availability.
  • Security Hardening: Implement security best practices in Airflow, including role-based access control, network security, logging, and data protection.
  • Data Pipelines and ETL: Design and implement data pipelines to move, transform, and aggregate data, ensuring data accuracy and performance.
  • Troubleshooting and Optimization: Proactively monitor DAGs for performance issues, manage task dependencies, and optimize for performance and reliability.
  • Documentation and Knowledge Transfer: Document migration steps, Airflow setup instructions, and security configurations for future reference and knowledge sharing within the team.

Requirements:

  • 2+ years of experience in working with scheduling tools, task automation, and job orchestration.
  • Proficiency in Apache Airflow: Experience authoring and managing DAGs, with a solid understanding of Airflow architecture and best practices.
  • Strong Python Skills: Ability to write clear, maintainable Python code for data workflows and ETL processes.
  • SQL Knowledge: Proficiency in SQL for data manipulation within ETL tasks.
  • Experience with Windows Scheduler: Familiarity with converting Windows-scheduled jobs to Airflow and handling dependencies.
  • Security Awareness: Knowledge of security hardening principles within Airflow, including user roles, network configurations, and logging.
  • Problem-Solving Skills: Strong analytical skills to debug and troubleshoot workflow issues and optimize DAGs for performance.
  • Communication Skills: Ability to document and communicate setup processes, configurations, and migration steps clearly.

Preferred Qualifications:

  • Experience with Airflow in cloud environments such as AWS, GCP, or Azure.
  • Exposure to Docker and containerization for Airflow deployments.
  • Familiarity with DevOps practices and CI/CD tools.
  • Knowledge of additional programming languages like Bash, PowerShell, or JavaScript.