Airflow Consultant

1 day ago

Remote, India Nvizion Solution Full time ₹ 57,800 - ₹ 17,67,309 per year

We are seeking a Data Integration Engineer with expertise in building and orchestrating pipelines using Apache Airflow to integrate data from diverse sources into Snowflake. The ideal candidate will have strong experience with JDBC and API-based integrations (REST/JSON), hands-on skills in Postman, and proficiency in SQL encryption/decryption, Python development, and pipeline monitoring.

Key Responsibilities

  • Design, develop, and maintain Airflow DAGs to orchestrate end-to-end data workflows.
  • Integrate structured and unstructured data from multiple systems into Snowflake using JDBC connectors, APIs, and flat file ingestion.
  • Work with Postman and other tools to test, validate, and automate API integrations.
  • Implement SQL encryption/decryption techniques to secure sensitive datasets.
  • Perform data quality checks including row-level validation, hash-based reconciliation, and exception handling.
  • Build transformation logic in Python and SQL, ensuring performance and maintainability.
  • Implement detailed logging, monitoring, and alerting to guarantee pipeline reliability and compliance.
  • Collaborate with stakeholders to understand requirements and deliver scalable, production-ready solutions.

Required Skills

  • Strong proficiency in Apache Airflow for workflow orchestration.
  • Hands-on experience with Snowflake as a data warehouse.
  • Proven ability to integrate data via JDBC drivers, REST APIs, and Postman-tested endpoints.
  • Advanced knowledge of SQL, including encryption/decryption.
  • Strong programming background in Python for ETL/ELT development.
  • Experience with logging, monitoring, and data observability practices.

Job Types: Full-time, Contractual / Temporary, Freelance

Contract length: 6 months

Pay: ₹578, ₹1,767,309.69 per year

Work Location: Remote

  • Senior Data Engineer

    2 weeks ago

    Remote, India CloudZurf Consultant Full time ₹ 30,00,000 - ₹ 40,41,108 per year

    Location: RemotePosition: Full-timeDepartment: EngineeringKey ResponsibilitiesManage and optimize data and compute environments to enable efficient use of data assetsDesign, build, test, and deploy scalable and reusable systems capable of handling large volumes of dataLead a small team of developers; conduct code reviews and mentor junior...

  • Sr. Data Engineer

    2 weeks ago

    Remote, India Raman & Weil - - Disinfection Manufacturing Industry Full time ₹ 20,00,000 - ₹ 40,41,10,858 per year

    Project: Digital Marketing AnalyticsClient: Leading Bank in VietnamDuration: 6 Months (Consulting/Contracting)Start Date: Early OctoberWorking Model: RemoteWorking Language: EnglishAbout the Role:We are looking for a Data Engineer (Consultant) to support a 6-month engagement with a leading bank in Vietnam. The role involves building and maintaining data...

  • Senior Data Engineer

    3 weeks ago

    Pacific Remote Islands Marine National Monument, India CloudZurf Consultant Full time

    Location: Remote Position: Full-time Department: Engineering Key Responsibilities Manage and optimize data and compute environments to enable efficient use of data assets Design, build, test, and deploy scalable and reusable systems capable of handling large volumes of data Lead a small team of developers; conduct code reviews and mentor junior engineers...

  • Solution Architect

    2 weeks ago

    Remote, India Digivate Labs Full time

    **Position**: Solution Architect **Experience**: 10+ years **Qualification**: Bachelor’s or master’s degree in computer science, Software Engineering, or a related field **Location**: Gurgaon (Currently Work from Home till further notice) **Role Overview**: **Key Responsibilities**: **1. Solution Architecture & Delivery** - Design and implement...

  • Principal Data Engineer

    2 weeks ago

    Remote, India Autodesk Full time ₹ 8,00,000 - ₹ 20,00,000 per year

    Job Requisition ID #25WD91911Position Overview Autodesk is seeking a Principal Data Engineer to lead the design and development of data architecture, pipeline for our data team. In this role, you will shape the future of our data ecosystem, driving innovation across data pipelines, architecture, and cloud platforms. You'll partner closely with analysts,...

  • Sr. Data Engineer

    3 weeks ago

    Pacific Remote Islands Marine National Monument, India Raman & Weil - - Disinfection Manufacturing Industry Full time

    Project: Digital Marketing Analytics Client: Leading Bank in Vietnam Duration: 6 Months (Consulting/Contracting) Start Date: Early October Working Model: Remote Working Language: English About the Role: We are looking for a Data Engineer (Consultant) to support a 6-month engagement with a leading bank in Vietnam. The role involves building and maintaining...

  • Product Manager I

    2 weeks ago

    Remote, India Outseer Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    What you'll achieve:The Product Manager for Data will drive the success of our product portfolio, leading the development of data-driven capabilities across our Fraud Detection and Prevention platform and solutions. This role will partner closely with cross-functional teams, including engineering, data science, analytics, marketing, customer support,...

  • Principal Data Engineer

    2 weeks ago

    India - Remote Autodesk Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Requisition ID # 25WD91911Position OverviewAutodesk is seeking a Principal Data Engineer to lead the design and development of data architecture, pipeline for our data team. In this role, you will shape the future of our data ecosystem, driving innovation across data pipelines, architecture, and cloud platforms. You'll partner closely with analysts,...

  • Senior Databricks Developer

    3 weeks ago

    Pacific Remote Islands Marine National Monument, India Milestone Technologies Full time

    Company Overview Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over...