Airflow Developer

4 weeks ago


DehradunRemote, India Acelucid Technologies Private Limited Full time

Job Description :


We are seeking a skilled Airflow Developer with 4-5 years of experience to design, implement, and maintain efficient, scalable, and reliable workflows using Apache Airflow. The ideal candidate will have a strong understanding of data pipelines, ETL processes, and orchestration techniques. You will collaborate with cross-functional teams to ensure seamless integration and optimization of workflows in our data ecosystem.

Key Responsibilities :


- Design and develop workflows, DAGs (Directed Acyclic Graphs), and custom operators using Apache Airflow.


- Collaborate with data engineers, analysts, and stakeholders to understand requirements and translate them into scalable workflows.


- Monitor, troubleshoot, and optimize Airflow pipelines to ensure reliability and performance.


- Integrate Airflow with various data sources, storage systems, and APIs.


- Implement best practices for code quality, version control, and deployment processes.


- Write clear documentation for workflows, configurations, and processes.


- Ensure data pipeline scalability, security, and maintainability by implementing appropriate solutions.


- Manage and maintain the Airflow environment, including upgrades and plugin Skills and Qualifications :


- 4 to 5 years of experience in building and managing workflows with Apache Airflow.


- Proficiency in Python programming for Airflow DAGs and custom operator development.


- Strong understanding of ETL/ELT processes and data pipeline orchestration.


- Experience working with SQL and databases (e.g., PostgreSQL, MySQL, or NoSQL).


- Familiarity with cloud platforms (AWS, GCP, or Azure) and their data services.'


- Knowledge of CI/CD pipelines and version control systems (e.g., Git).


- Strong problem-solving skills and attention to detail.


Preferred Qualifications:


- Experience with containerization tools like Docker and orchestration systems like Kubernetes.


- Familiarity with big data technologies such as Spark, Hadoop, or Kafka.


- Understanding of data warehousing solutions like Snowflake, Redshift, or BigQuery.


- Knowledge of monitoring and alerting tools (e.g., Prometheus, Grafana).

(ref:hirist.tech)
  • Airflow Developer

    1 week ago


    Dehradun/Remote, India Acelucid Technologies Private Limited Full time

    Job Description : We are seeking a skilled Airflow Developer with 4-5 years of experience to design, implement, and maintain efficient, scalable, and reliable workflows using Apache Airflow. The ideal candidate will have a strong understanding of data pipelines, ETL processes, and orchestration techniques. You will collaborate with cross-functional teams to...

  • Data Engineer

    4 weeks ago


    Remote, India Innovistors Technological Solutions Pvt Ltd Full time

    As a Data Engineer you'll be :- Developing end to end ETL/ELT Pipeline working with Data Analysts of business Function.- Designing, developing, and implementing scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture- Mentoring Fother Junior Engineers in the Team- Be a "go-to" expert for data technologies...


  • Remote, India MindTrilogy IT Solutions Pvt. Ltd Full time

    About the Role:We are seeking a skilled Data Engineer with expertise in DBT, Python, SQL, and Airflow to join our dynamic team.Key Responsibilities:Design, build, and optimize scalable data pipelines to transform raw data into actionable insights.Use DBT or similar tools (Dataform, Talend, Apache Airflow, Dagster, etc.) to manage data transformation...


  • Remote, India MindTrilogy IT Solutions Pvt. Ltd Full time

    Job Description:We are seeking a skilled Data Engineer with expertise in DBT, Python, SQL, and Airflow to join our dynamic team. This role focuses on building robust data pipelines, optimizing data workflows, and enabling scalable data solutions.Key Responsibilities:Design, build, and optimize scalable data pipelines to transform raw data into actionable...

  • Gcp Data Architect

    5 days ago


    Remote, India RARR Technologies Pvt Ltd Full time

    We are seeking a skilled Data Engineer to join our team, proficient in **BigQuery, Dataflow, and Airflow,** with expertise in either **Python or Java programming languages**. As a Data Engineer, you will play a key role in designing, implementing, and optimizing data pipelines for our organization s data infrastructure. **Responsibilities**: - Design and...


  • Remote, India Talpro Full time

    Job Summary:Talpro is seeking an experienced Machine Learning Platform Engineer to join our team. As a Machine Learning Platform Engineer, you will play a critical role in designing, building, and maintaining the infrastructure and pipelines that power our machine learning models and data processing workflows.Main Responsibilities:Develop robust and...

  • Data Engineer

    3 weeks ago


    Remote, India FANISKO PRIVATE LIMITED Full time

    Job Title : Data Engineer with AIML Expertise Years of Experience : 3+ years Qualifications : Any UG/PG Location : Remote Employment Type : Contract / Full-Time Employment (FTE) Required by Date : Immediate start Share your profiles to Job Description : - Data Pipeline Development : Design, implement, and maintain scalable and efficient data pipelines for...

  • Data Engineer

    4 weeks ago


    Remote, India Yo HR Consultancy Full time

    Title: Data Engineer (Technical Lead)Experience : 8 years to 14 yearsWork Mode: Remote Job Description : As part of the team, you will be responsible for building and running the data pipelines and services that are required to support business functions/reports/dashboard.. We are heavily dependent on BigQuery/Snowflake, Airflow, Stitch/Fivetran, dbt ,...

  • Data Engineer

    1 week ago


    Remote, India Yo HR Consultancy Full time

    Title: Data Engineer (Technical Lead)Experience : 8 years to 14 yearsWork Mode: Remote Job Description : As part of the team, you will be responsible for building and running the data pipelines and services that are required to support business functions/reports/dashboard.. We are heavily dependent on BigQuery/Snowflake, Airflow, Stitch/Fivetran, dbt ,...

  • Data Architect

    4 days ago


    Remote, India Rackspace Full time

    **Job Title**: Data Architect - Abinitio (with cloud experience) **Location**: Work from Home/ Remote **Shift Time**: India General Shift **About the Role**: Our Cloud Data Services Team is looking for a skilled **Data Architect (Abinitio)** for a customer-facing role. In this position, you will work with cutting-edge technologies and tools to build,...

  • Data Engineer

    3 weeks ago


    Remote, India Sheryl strategic solutions Pvt. LTD . Full time

    Responsibilities : - Design, develop, and maintain data pipelines using Python, Snowflake, and Alteryx. - Orchestrate and manage data workflows using Airflow. - Proficiently work with Snowflake, including table creation, modifications, and data modeling. - Ensure data quality and integrity throughout the entire data lifecycle. - Collaborate with...


  • Remote, India FANISKO PRIVATE LIMITED Full time

    Data Engineering ExpertiseFANISKO PRIVATE LIMITED seeks a skilled Data Engineer to design and build scalable data pipelines using various tools and technologies. As a Data Engineer, you will be responsible for developing and managing cloud-based data storage solutions and databases.Responsibilities:Design and implement efficient data pipelines for processing...


  • Remote, India FANISKO PRIVATE LIMITED Full time

    About FANISKO PRIVATE LIMITEDFANISKO PRIVATE LIMITED is a leading technology company that offers innovative solutions to clients worldwide.We are currently seeking a skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and building scalable data pipelines using various tools and...


  • Remote, India FANISKO PRIVATE LIMITED Full time

    About the JobWe are seeking a highly skilled Data Engineer to join our team at FANISKO PRIVATE LIMITED. As a Data Engineer, you will play a key role in designing and building scalable data pipelines using various tools and technologies.Key Responsibilities:Design and implement efficient data pipelines for processing large datasetsCollaborate with data...

  • Aws Architect

    1 week ago


    Remote, India KUTIR Full time

    **Job Title: AWS Principal Architect** **Location: Remote** **Duration: Fulltime / Permanent** **Mandate Pointers to be focused**: - 70% -- Solutioning / Technical Architecting including Presales Support - 30% -- Overseeing existing and new opportunities Deliverables **Required Skills & Experience**: - Requires BA/BS in Mathematics, Computer Science,...

  • Cloud/DevOps Engineer

    4 weeks ago


    Chennai/Remote, India Coders Brain Technology Private Limited Full time

    Job Title : GCP Cloud/DevOps Engineer ( Application Containerization and KubernatesJob Summary : Looking for an experienced GCP Cloud/DevOps Engineer to design, implement, and manage cloud infrastructure and services across multiple environments. This role requires deep expertise in Google Cloud Platform (GCP) services, DevOps practices, and Infrastructure...

  • Data Engineer

    3 weeks ago


    Remote, India Innovistors Technological Solutions Pvt Ltd Full time

    As a Data Engineer you'll be :- Developing end to end ETL/ELT Pipeline working with Data Analysts of business Function.- Designing, developing, and implementing scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture- Mentoring Fother Junior Engineers in the Team- Be a "go-to" expert for data technologies and...

  • Patch Infotech

    4 weeks ago


    Remote, India Patch Infotech Pvt Ltd Full time

    Key Responsibilities :- Design, develop, and implement data pipelines to extract, transform, and load (ETL) data from various sources (databases, APIs, cloud storage, streaming platforms).- Develop and maintain data pipelines using tools like Apache Spark, Kafka, and other big data technologies.- Ensure data quality and integrity throughout the data...


  • Remote, India Talpro Full time

    Job Description:Talpro is seeking a highly skilled and motivated Machine Learning Platform Engineer to join our dynamic team.About the Role:We are looking for an experienced professional who can design, build, and maintain the infrastructure and pipelines that power our machine learning models and data processing workflows.Your Expertise:You will play a...

  • Senior Data Engineer

    4 weeks ago


    Remote, India Leewayhertz Full time

    We are seeking a skilled and motivated Data Engineer with a strong background in data integration, ETL processes, and data warehousing. The ideal candidate will have over 5 years of experience in data engineering, with a good understanding of data architecture, pipeline creation, and big data technologies. This role requires a proactive individual who can...