Senior Data Engineer Position

5 hours ago

Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000
Job Opportunity

We are seeking a highly skilled Senior Data Engineer with deep technical expertise in ETL pipeline design, data modeling, and data infrastructure. This role is perfect for someone who thrives in a fast-paced, engineering-driven environment.

You'll work across the full data stack-from ingestion and transformation to orchestration and delivery-playing a key role in scaling our analytics and reporting capabilities.

The ideal candidate will have advanced proficiency in SQL and ETL/ELT design, strong experience with dbt, Airflow, and Spark, and a deep understanding of data modeling techniques.

Key Responsibilities:
  • Data Pipeline Design: Design and implement efficient, scalable ETL/ELT pipelines and data flows.
  • Transformation Models: Develop transformation models using dbt and orchestrate pipelines via Airflow.
  • Large-Scale Processing: Optimize large-scale processing jobs in Apache Spark.
  • Database Management: Tune and manage relational and analytical databases (PostgreSQL, Snowflake).
  • Schemas and Architecture: Architect and maintain schemas using Star Schema, 3NF, and SCD2 methodologies.
  • Lakehouse Architecture: Design and support lakehouse architectures and scalable storage solutions.
  • Data Governance: Implement and enforce data governance, validation, and quality control mechanisms.
Requirements:
  • SQL and ETL Expertise: Advanced proficiency in SQL and ETL/ELT design.
  • dbt and Airflow Experience: Strong experience with dbt, Airflow, and Spark.
  • Data Modeling Techniques: Deep understanding of data modeling techniques (Star Schema, 3NF, SCD2).
  • Database Tuning: Proven ability to optimize and tune PostgreSQL and Snowflake for performance.
  • Lakehouse Architecture Knowledge: Familiarity with lakehouse architecture principles and tools.
  • Data Governance Frameworks: Solid experience in data governance, validation frameworks, and pipeline monitoring.
  • DevOps Standards: Strong grasp of GitFlow, CI/CD pipelines, and containerization (Docker/Ansible).
Preferred Qualifications:
  • Cloud Platforms: Hands-on experience with cloud platforms (AWS, GCP, Azure).
  • IaC Tools and DevOps: Familiarity with IaC tools and DevOps best practices.
  • Regulated Environments: Experience working in regulated or enterprise environments with strict data governance policies.

  • Senior Data Engineering Lead

    1 day ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe seek an experienced data engineer to lead the design and development of large-scale data processing systems that enable advanced analytics and business intelligence.As a senior data engineer, you will be responsible for architecting and implementing scalable and robust data pipelines that collect, process, and store large volumes of...

  • Senior Data Engineer

    2 weeks ago

    Kanpur, Uttar Pradesh, India Betterbeans Consultants Pvt Ltd Full time

    Role : Senior Data EngineerExperience : 8-10 years' experienceSkill Set Required : Azure Data FactoryAzure DatabricksPythonSQL, PL/SQLSSISJob Role/Job Description : Senior Data Engineer will be responsible for designing, implementing, and maintaining data solutions on the Microsoft Azure Data platform and SQL Server (SSIS, SSAS, UC4 Atomic)Collaborate with...

  • Data Architect and Engineer

    1 day ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer NeededWe're looking for a highly skilled data engineer to join our team.Hands-on expertise in Python and PySpark is essential.5+ years of experience in data engineering with a focus on big data, telemetry, and streaming analytics.The ideal candidate will have strong business acumen, excellent communication skills, and the ability to work...

  • TAVS Senior Data Engineer(Location: Pune)

    4 weeks ago

    Kanpur, Uttar Pradesh, India DigiHelic Solutions Pvt. Ltd. Full time

    TAVS Senior Data EngineerLocation: PuneExperience: 12 Years1. Proficiency in PostgreSQL, including database design, optimization, and management. 2. Extensive experience with Databricks for data processing and analytics, and/or any other Apache Spark distribution. 3. Strong programming skills in Python, especially with libraries such as Pandas and NumPy. 4....

  • Senior Big Data Specialist

    1 day ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerDuties and ResponsibilitiesWe are seeking a highly skilled Data Engineer to design, develop, and maintain scalable data pipelines and ETL processes on Databricks.The ideal candidate will lead the architecture and implementation of high-performance data solutions, collaborating with business stakeholders, data scientists, and...

  • Senior Databricks Engineer Position

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeDatabricks Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Azure Databricks Developer RoleWe are seeking a skilled and experienced Azure Databricks developer to join our team for a short-term contract. This is a great opportunity to work with innovative AI solutions and contribute to the development of cutting-edge data analytics.Key Responsibilities:Create, modify, and optimize Azure Data Factory pipelines to...

  • Senior Test Engineering Manager

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeTESTMANAGER Full time US$ 1,50,000 - US$ 2,50,000

    Senior Test Engineering ManagerWe seek a seasoned Senior Test Engineering Manager to own and drive the quality vision across multiple teams.This leadership role involves defining test strategies for features, releases, and systems.The successful candidate will lead manual and automated testing efforts to ensure exceptional product quality.Mentorship is key...

  • Data Engineering Expert

    5 hours ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering ExpertAbout the Role:We are seeking a skilled Data Engineer to build and maintain large-scale data processing workflows using leading-edge technologies like Azure Databricks, PySpark, and Apache Spark.The ideal candidate will be responsible for performing rigorous data pre-processing tasks such as cleaning, transformation,...

  • Senior Data Engineering Specialist

    1 day ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data EngineerWe are seeking a highly skilled and experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines for data ingestion, processing, and storage.Key Responsibilities:Design and develop scalable data architectures and data models for efficient data...

  • Senior Informatica Developer

    4 days ago

    Kanpur, Uttar Pradesh, India Pacific Data Integrators Full time

    Job Title: Senior Data Engineer (IDMC-CDI)Primary Skills: SQL, IDMC (CDI), ETL Concepts BaseLocation: RemoteShift: US EST (5 PM to 2 AM IST)Experience: 5-12 YearsAbout UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various market-leading...