Inferenz - Lead Data Engineer - Apache Airflow
2 weeks ago
About the CompanyWe are seeking a Lead Data Engineer with deep expertise in Snowflake, dbt, and Apache Airflow to design, implement, and optimize scalable data solutions.This role involves working on complex datasets, building robust data pipelines, ensuring data quality, and collaborating closely with analytics and business teams to deliver actionable insights.If you are passionate about data architecture, ELT best practices, and modern cloud data stack, wed like to meet you.About the Role :We are seeking a Lead Data Engineer with deep expertise in Snowflake, dbt, and Apache Airflow to design, implement, and optimize scalable data solutions.Responsibilities :- Pipeline Design & Orchestration: Build and maintain robust, scalable data pipelines using Apache Airflow, including incremental & full-load strategies, retries, and logging.- Data Modelling & Transformation: Develop modular, tested, and documented transformations in dbt, ensuring scalability and maintainability.Snowflake Development: Design and maintain warehouse in Snowflake, optimize Snowflake schemas, implement performance tuning (clustering keys, warehouse scaling, materialized views), manage access control, and utilize streams & tasks for automation.Data Quality & Monitoring: Implement validation frameworks (null checks, type checks, threshold alerts) and automated testing for data integrity and reliability.Collaboration: Partner with analysts, data scientists, and business stakeholders to translate requirements into scalable technical solutions.Performance Optimization: Develop incremental and full-load strategies with continuous monitoring, retries, and logging and tune query performance and job execution efficiency.Infrastructure Automation: Use Terraform or similar IaC tools to provision and manage Snowflake, Airflow, and related environments.Partner with data analysts, scientists, and business stakeholders to translate reporting and analytics requirements into technical :- Bachelors or Masters degree in Computer Science, Information Technology, Data Engineering, or a related field.710 years of experience in data engineering, with strong hands-on expertise in :- Snowflake (data modelling, performance tuning, access control, streams & tasks, external tables)- Apache Airflow (DAG design, task dependencies, dynamic tasks, error handling)- dbt (modular SQL development, Jinja templating, testing, documentation)- Proficiency in SQL and Python (Spark experience is a plus).- Experience building and managing pipelines on AWS, GCP, or Azure.- Strong understanding of data warehousing concepts and ELT best practices.- Familiarity with version control (Git) and CI/CD workflows.- Exposure to infrastructure-as-code tools like Terraform for provisioning Snowflake or Airflow environments.- Excellent problem-solving, collaboration, and communication skills, with the ability to lead technical projects.Good to have :- Experience with streaming data pipelines (Kafka, Kinesis, Pub/Sub)- Exposure to BI/analytics tools (Looker, Tableau, Power BI)- Knowledge of data governance and security best practices. (ref:hirist.tech)
-
Senior UI/UX
7 days ago
Ahmedabad, Gujarat, India Inferenz Full time ₹ 4,00,000 - ₹ 12,00,000 per yearLocation: AhmedabadRequired Experience: 5+ years (B2B IT sector preferred)Preferred Immediate JoinerInferenz is a Data & AI solution-led services company helping global enterprises accelerate their Data AI ROI journey. We partner with Healthcare and Hi-Tech organizations to build intelligent, scalable, and modern data ecosystems. Our design and marketing...
-
Sr. RPA Engineer
7 days ago
Ahmedabad, India Inferenz Full timeJob Description Position:RPA Engineer Location:Ahmedabad, Pune Required Experience:5+ Years Preferred Immediate Joiner Company Description Inferenz is a next-generation, data and AI solutions company headquartered in Ahmedabad, India, with a presence in Pune and Texas (USA). We focus on helping enterprises transform data into measurable business outcomes,...
-
Sr. RPA Engineer
1 week ago
Ahmedabad, Gujarat, India Inferenz Full time ₹ 6,00,000 - ₹ 18,00,000 per yearPosition:RPA EngineerLocation:Ahmedabad, PuneRequired Experience:5+ YearsPreferred Immediate JoinerCompany DescriptionInferenz is a next-generation, data and AI solutions company headquartered in Ahmedabad, India, with a presence in Pune and Texas (USA). We focus on helping enterprises transform data into measurable business outcomes, with deep expertise in...
-
Solution Architect
6 days ago
Ahmedabad, Gujarat, India Inferenz Full time**Location**:Ahmedabad, Pune **Required Experience**:8+ Years Preferred Immediate Joiner **Key Responsibilities**: - Architect and design end-to-end data and AI solutions that address business challenges and optimize decision-making. - Define and implement best practices for data architecture, data governance, and AI model deployment. - Evaluate and...
-
Gcp Data Engineer
2 weeks ago
Ahmedabad, Gujarat, India Synoptek Full time ₹ 15,00,000 - ₹ 25,00,000 per yearResponsibilitiesDesign, develop, and maintain robust and scalable data pipelines on the GCP.Hands on experience on GCP services such as BigQuery, Jitterbit, Cloud Dataflow, Cloud Pub/Sub, and Cloud Storage to build efficient data processing solutions.Develop and optimize ETL/ELT processes to extract, transform, and load data from various sources into data...
-
Data Engineer
5 days ago
Ahmedabad, India Tigi HR Solutions Pvt. Ltd. Full timeDescription : Data EngineerExperience : 46 YearsLocation : AhmedabadWere looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and systems. The ideal candidate will have hands-on experience with Snowflake, DBT, and Airflow, with a passion for building efficient, high-performance data workflows.Key Responsibilities : -...
-
Data Engineer
6 days ago
Ahmedabad, Gujarat, India TIGI HR Full time ₹ 4,00,000 - ₹ 6,00,000 per yearDescription : Data Engineer Experience : 46 Years Location : Ahmedabad Were looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and systems. The ideal candidate will have hands-on experience with Snowflake, DBT, and Airflow, with a passion for building efficient, high-performance data workflows. Key...
-
Senior Data Engineer
2 weeks ago
Ahmedabad, India Synergy Resources Solutions Full timeKey Responsibilities :Our client seeking an experienced and motivated Senior Data Engineer to join their AI & Automation team. The ideal candidate will have 58 years of experience in data engineering, with a proven track record of designing and implementing scalable data solutions.A strong background in database technologies, data modeling, and data pipeline...
-
Senior data engineer
1 week ago
Ahmedabad, India Analytix Business Solutions Full timeGreetings from Analytix Solutions…!!!We are seeking an experienced and motivated Senior Data Engineer to join our AI & Automation team. The ideal candidate will have 6–8 years of experience in data engineering, with a proven track record of designing and implementing scalable data solutions. A strong background in database technologies, data modeling,...
-
Senior data engineer
1 week ago
Ahmedabad, India Analytix Business Solutions Full timeGreetings from Analytix Solutions…!!!We are seeking an experienced and motivated Senior Data Engineer to join our AI & Automation team. The ideal candidate will have 6–8 years of experience in data engineering, with a proven track record of designing and implementing scalable data solutions. A strong background in database technologies, data modeling,...