Lead Data Engineer

4 days ago

Ahmedabad, Gujarat, India Inferenz Full time ₹ 20,00,000 - ₹ 25,00,000 per year

About the Company

We are seeking a Lead Data Engineer with deep expertise in Snowflake, dbt, and Apache Airflow to design, implement, and optimize scalable data solutions. This role involves working on complex datasets, building robust data pipelines, ensuring data quality, and collaborating closely with analytics and business teams to deliver actionable insights. If you are passionate about data architecture, ELT best practices, and modern cloud data stack, we'd like to meet you.

About the Role

We are seeking a Lead Data Engineer with deep expertise in Snowflake, dbt, and Apache Airflow to design, implement, and optimize scalable data solutions.

Responsibilities

  • Pipeline Design & Orchestration: Build and maintain robust, scalable data pipelines using Apache Airflow, including incremental & full-load strategies, retries, and logging.
  • Data Modelling & Transformation: Develop modular, tested, and documented transformations in dbt, ensuring scalability and maintainability.
  • Snowflake Development: Design and maintain warehouse in Snowflake, optimize Snowflake schemas, implement performance tuning (clustering keys, warehouse scaling, materialized views), manage access control, and utilize streams & tasks for automation.
  • Data Quality & Monitoring: Implement validation frameworks (null checks, type checks, threshold alerts) and automated testing for data integrity and reliability.
  • Collaboration: Partner with analysts, data scientists, and business stakeholders to translate requirements into scalable technical solutions.
  • Performance Optimization: Develop incremental and full-load strategies with continuous monitoring, retries, and logging and tune query performance and job execution efficiency.
  • Infrastructure Automation: Use Terraform or similar IaC tools to provision and manage Snowflake, Airflow, and related environments.
  • Partner with data analysts, scientists, and business stakeholders to translate reporting and analytics requirements into technical specifications.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field.
  • 7–10 years of experience in data engineering, with strong hands-on expertise in:
  • Snowflake (data modelling, performance tuning, access control, streams & tasks, external tables)
  • Apache Airflow (DAG design, task dependencies, dynamic tasks, error handling)
  • dbt (modular SQL development, Jinja templating, testing, documentation)
  • Proficiency in SQL and Python (Spark experience is a plus).
  • Experience building and managing pipelines on AWS, GCP, or Azure.
  • Strong understanding of data warehousing concepts and ELT best practices.
  • Familiarity with version control (Git) and CI/CD workflows.
  • Exposure to infrastructure-as-code tools like Terraform for provisioning Snowflake or Airflow environments.
  • Excellent problem-solving, collaboration, and communication skills, with the ability to lead technical projects.
  • Good to have:
  • Experience with streaming data pipelines (Kafka, Kinesis, Pub/Sub).
  • Exposure to BI/analytics tools (Looker, Tableau, Power BI).
  • Knowledge of data governance and security best practices.

Pay range and compensation package

Not specified in the job description.

Equal Opportunity Statement

We are committed to diversity and inclusivity in our hiring practices.

  • Lead Data Engineer

    4 days ago

    Ahmedabad, Gujarat, India Circle K Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionAlimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 16,700 stores in 31 countries, serving more than 9 million customers each day. At Circle K, we are building a best-in-class global data engineering practice to support intelligent business decision-making and drive...

  • Lead Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Talworx is an emerging recruitment consulting and services firm , we are hiring for our Fintech Product based client, In this role, you will be working with a team or teams of enthusiastic members supporting our critical technology systems and guiding our business partners & end users with industry best practices, solution design, and creating long term...

  • Lead Data Engineer

    4 days ago

    Ahmedabad, Gujarat, India Advantmed Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are seeking a talented and experienced Lead Data Engineer to join our team and contribute to building a robust data platform on Azure Cloud. The ideal candidate will have hands-on experience designing and managing data pipelines, ensuring data quality, and leveraging cloud technologies for scalable and efficient data processing. The Data Engineer will...

  • Senior Administration Executive

    4 days ago

    Ahmedabad, Gujarat, India Technobeat Engineer Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    We are seeking a dedicated Senior Admin Executive. The role is to manage and preparation of reports, ensure accuracy, and maintain monthly documentation. Responsible for collecting data from engineers, guiding team in report creation, and submission.

  • Lead Data Architect

    4 days ago

    Ahmedabad, Gujarat, India RK HR Management Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Key Responsibilities: Define and lead enterprise data strategy & governance Oversee modern data platforms (Snowflake, Databricks, AWS, Kafka) Enable AI/ML for personalization, forecasting & analytics Partner cross-functionally with Marketing, Supply Chain, Finance & R&D Lead and mentor a high-performing data engineering teamWhat We're Looking For: 18+ years...

  • Lead Data Scientist

    4 days ago

    Ahmedabad, Gujarat, India eInfochips (An Arrow Company) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Lead AI/ML EngineerLocation: Ahmedabad, Pune, IndoreYears of Experience: 8 to 12 yearsNotice Period – 0-45 Days MaxWe are looking for a highly skilled and experienced Lead AI/ML Engineer to lead the development and deployment of machine learning solutions across the organization. The ideal candidate will possess deep technical expertise in ML...

  • Lead Data Engineer

    4 days ago

    Ahmedabad, Gujarat, India Advantmed Full time ₹ 1,20,00,000 - ₹ 2,50,00,000 per year

    We are seeking a talented and experienced Senior Data Engineer to join our team and contribute to building a robust data platform on Azure Cloud. The ideal candidate will have hands-on experience designing and managing data pipelines, ensuring data quality, and leveraging cloud technologies for scalable and efficient data processing. The Data Engineer will...

  • Lead Data Architect

    2 days ago

    Ahmedabad, Gujarat, India adani capital pvt ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Lead – Data Architect ResponsibilitiesLead the design and implementation of data architecture and data modeling solutions for airport operations, ensuring scalability, performance, and reliability. Collaborate with cross-functional teams to gather and understand data requirements and translate them into effective database designs and data management...

  • Lead Data Engineer

    4 days ago

    Ahmedabad, Gujarat, India Jobs via eFinancialCareers Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    *About the Role:Grade Level (for internal use):*11The Team:The Market Intelligence Industry Data Solutions business line provides data technology and services supporting acquisition, ingestion, content management, mastering, and distribution to power our Financial Institution Group business and customer needs. We focus on platform scalability to support...

  • Lead Data Engineer

    4 days ago

    Ahmedabad, Gujarat, India DnT Infotech Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Roles & Responsibilities:Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.Constructing infrastructure (on cloud - GCP) for efficient ETL processes from various sources and storage systems.Creating innovative data validation methods and data analysis tools.Ensuring compliance...