Lead Data Engineer

7 days ago

Ahmedabad, Gujarat, India Inferenz Full time

About the Company

We are seeking a Lead Data Engineer with deep expertise in Snowflake, dbt, and Apache Airflow to design, implement, and optimize scalable data solutions.

This role involves working on complex datasets, building robust data pipelines, ensuring data quality, and collaborating closely with analytics and business teams to deliver actionable insights.

If you are passionate about data architecture, ELT best practices, and modern cloud data stack, wed like to meet you.

About the Role :

We are seeking a Lead Data Engineer with deep expertise in Snowflake, dbt, and Apache Airflow to design, implement, and optimize scalable data solutions.

Responsibilities :

- Pipeline Design & Orchestration: Build and maintain robust, scalable data pipelines using Apache Airflow, including incremental & full-load strategies, retries, and logging.

- Data Modelling & Transformation: Develop modular, tested, and documented transformations in dbt, ensuring scalability and maintainability.

Snowflake Development: Design and maintain warehouse in Snowflake, optimize Snowflake schemas, implement performance tuning (clustering keys, warehouse scaling, materialized views), manage access control, and utilize streams & tasks for automation.

Data Quality & Monitoring: Implement validation frameworks (null checks, type checks, threshold alerts) and automated testing for data integrity and reliability.

Collaboration: Partner with analysts, data scientists, and business stakeholders to translate requirements into scalable technical solutions.

Performance Optimization: Develop incremental and full-load strategies with continuous monitoring, retries, and logging and tune query performance and job execution efficiency.

Infrastructure Automation: Use Terraform or similar IaC tools to provision and manage Snowflake, Airflow, and related environments.

Partner with data analysts, scientists, and business stakeholders to translate reporting and analytics requirements into technical :

- Bachelors or Masters degree in Computer Science, Information Technology, Data Engineering, or a related field.

710 years of experience in data engineering, with strong hands-on expertise in :

- Snowflake (data modelling, performance tuning, access control, streams & tasks, external tables)

- Apache Airflow (DAG design, task dependencies, dynamic tasks, error handling)

- dbt (modular SQL development, Jinja templating, testing, documentation)

- Proficiency in SQL and Python (Spark experience is a plus).

- Experience building and managing pipelines on AWS, GCP, or Azure.

- Strong understanding of data warehousing concepts and ELT best practices.

- Familiarity with version control (Git) and CI/CD workflows.

- Exposure to infrastructure-as-code tools like Terraform for provisioning Snowflake or Airflow environments.

- Excellent problem-solving, collaboration, and communication skills, with the ability to lead technical projects.

Good to have :

- Experience with streaming data pipelines (Kafka, Kinesis, Pub/Sub)

- Exposure to BI/analytics tools (Looker, Tableau, Power BI)

- Knowledge of data governance and security best practices.

(ref:hirist.tech)

  • Lead Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Crest Data Systems Full time

    Role : ReactJS Lead EngineerWe are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data Responsibilities :- Responsible for providing expertise in software development life...

  • Senior Software Engineer/Technical Lead

    2 weeks ago

    Ahmedabad, Gujarat, India Crest Data Full time US$ 90,000 - US$ 1,20,000 per year

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Anblicks - Lead Data Engineer - Snowflake Migration

    2 weeks ago

    Ahmedabad, Gujarat, India ANBLICKS CLOUD DATA ENGG PRIVATE LIMITED Full time

    Job Title : Lead Data Engineer Snowflake MigrationLocation : Hyderabad / AhmedabadExperience : 7+ YearsBe a Trailblazer in Our Data Modernization Center of Excellence (COE)At Anblicks, we are on a mission to modernize legacy data ecosystems and help enterprises unlock the power of the cloud. Our Data Modernization COE is at the forefront of this...

  • Senior Software Engineer/Technical Lead

    2 weeks ago

    Ahmedabad, Gujarat, India Crest Data Systems Full time

    Company Overview :Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics.The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Senior Software Engineer/Technical Lead

    4 days ago

    Ahmedabad, Gujarat, India Crest Data Systems Full time

    Company Overview :Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics.The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Data Engineering Lead

    2 weeks ago

    Ahmedabad, Gujarat, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Description">">Are you a skilled data engineer looking to lead a team and drive the design, development, and deployment of scalable data pipelines? We are seeking a Data Engineering Manager to oversee the development of frameworks for data ingestion, integration, and governance.">This is a critical leadership role for someone eager to solve complex data...

  • Lead Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India Arting Digital Full time

    Posting title : Lead Data Engineer (Databricks)Experience : 7+ YearsLocation : Pune/ AhmedabadWork mode : HybridPrimary skills : Databricks, Data Modelling/ Data Lakehouse, Gen AI, SQL, Python/Scala, Azure Data Factory (ADF)/AWS Glue, Docker, Team LeadQualification : Any Technical DegreeRoles & Responsibilities :- Lead the design, development, and...

  • Lead Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Circle K Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job DescriptionAlimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 16,700 stores in 31 countries, serving more than 9 million customers each day. At Circle K, we are building a best-in-class global data engineering practice to support intelligent business decision-making and drive...

  • Lead Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Inferenz Full time US$ 1,20,000 - US$ 1,50,000 per year

    About the CompanyWe are seeking a Lead Data Engineer with deep expertise in Snowflake, dbt, and Apache Airflow to design, implement, and optimize scalable data solutions. This role involves working on complex datasets, building robust data pipelines, ensuring data quality, and collaborating closely with analytics and business teams to deliver actionable...

  • Data Engineering Project Lead

    1 week ago

    Ahmedabad, Gujarat, India beBeeTechnical Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Technical Project Manager - Data EngineeringWe are seeking an experienced and highly skilled technical project manager to lead our data engineering initiatives. This role is a fantastic opportunity for individuals who want to leverage their expertise in managing cross-functional teams, developing strategic plans, and delivering successful...