Sr. Data Engineer

4 days ago

Pune, Maharashtra, India Systems Plus Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Location: Pune

Employment Type: full-time

Designation: Sr. Data Engineer

Job Details

Role Overview

The ideal candidate will have strong hands-on experience working with Azure Databricks, Spark (PySpark), Delta Lake, Azure Data Factory, and Python as well as a solid understanding of data engineering best practices, governance, and CI/CD automation.

Key Responsibilities

Data Engineering & Pipeline Development

  • Design, develop, and optimize ETL/ELT pipelines using Azure Databricks (PySpark, SQL, Delta Lake)
  • Use Python extensively for scripting, pipeline orchestration, data transformation, and custom logic implementation
  • Develop metadata-driven ingestion frameworks across sources such as SQL Server, APIs, and file-based feeds (CSV, JSON, etc.)
  • Design and maintain Bronze, Silver, Gold layers in ADLS Gen2
  • Apply advanced Spark optimization techniques: partitioning, broadcast joins, caching, memory tuning

SQL Development & Data Modeling

  • Write optimized, scalable SQL queries for large datasets
  • Support dimensional modeling, data marts, and curated datasets for analytics use cases

Governance & Security

  • Implement Unity Catalog for access control, lineage, and data auditing
  • Work with Azure AD, Key Vault, and policies for securing access to data and secrets

DevOps & CI/CD Automation

  • Collaborate on CI/CD pipeline setup for Databricks notebooks, jobs, and ADF pipelines using Azure DevOps
  • Apply Git-based version control practices and deployment automation for data workloads
  • Contribute to infrastructure-as-code using Terraform or Bicep

Must-Have Qualifications

  • 5+ years of hands-on experience in data engineering roles
  • Strong experience with Azure Databricks and Apache Spark (PySpark)
  • Strong proficiency in Python for data engineering and scripting tasks
  • Experience building pipelines in Azure Data Factory or Synapse Pipelines
  • Proficiency with SQL, Delta Lake, ADLS Gen2, and Databricks Notebooks
  • Solid understanding of medallion architecture and data lake principles
  • Experience working with structured and semi-structured data
  • Exposure to CI/CD tools (Azure DevOps, Git) and Infrastructure-as-Code
  • Strong problem-solving, debugging, and optimization skills

Nice-to-Have Skills

  • Experience with Unity Catalog, Delta Live Tables (DLT), or Delta Sharing
  • Familiarity with Azure Synapse SQL Pools (Dedicated/Serverless)
  • Understanding of network security (Private Link, Key Vault, AAD integration)
  • Working knowledge of Terraform or ARM templates
  • Experience in data governance and compliance frameworks

Soft Skills

  • Proactive communication with remote/distributed teams
  • Ability to work under deadlines and adapt in a fast-paced environment
  • Strong documentation and collaboration practices

  • Sr. Data Engineer

    3 weeks ago

    Pune, Maharashtra, India ADP Full time

    ADP is hiring Sr. Data Engineer (Sr. Member Technical)Required Skills- Bachelor's / Engineering degree in Computer Science or Information Technology.- Postgraduate degree or diploma in Computer Science / Data Science is an added advantage.- AWS, SQL, Databricks, and Apache Spark certifications are a plus.- Strong foundation in data analytics and engineering,...

  • Sr. Data Engineer

    2 weeks ago

    Pune, Maharashtra, India ADP Full time

    ADP is hiring Sr. Data Engineer (Sr. Member Technical) Required Skills Bachelor's / Engineering degree in Computer Science or Information Technology. Postgraduate degree or diploma in Computer Science / Data Science is an added advantage. AWS, SQL, Databricks, and Apache Spark certifications are a plus. Strong foundation in data analytics and...

  • Sr. Data Engineer

    2 weeks ago

    Pune, Maharashtra, India ADP Full time

    ADP is hiring Sr. Data Engineer (Sr. Member Technical) Required Skills Bachelor's / Engineering degree in Computer Science or Information Technology. Postgraduate degree or diploma in Computer Science / Data Science is an added advantage. AWS, SQL, Databricks, and Apache Spark certifications are a plus. Strong foundation in data analytics and engineering,...

  • Sr. Data Engineer

    1 week ago

    Pune, Maharashtra, India Arting Digital Private Limited Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Posting title: Sr. Data Engineer (Databricks)Experience: 5+ YearsLocation: Pune/ AhmedabadWork mode: HybridPrimary skills: Databricks, Data Modelling/ Data Lakehouse, SQL, Python/Scala, Azure Data Factory (ADF)/AWS GlueQualification: Any Technical DegreeRoles & Responsibilities:Data Architecture & Development: Lead the design, development, and optimization...

  • Sr Qe

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 289224NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Sr QE to join our team in Pune Mah xc4 x81r xc4 x81shtra IN-MH India IN Senior Quality Engineer Roles ...

  • Data & Analytics Consulting Sr. Manager

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 291802NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Analytics Consulting Sr Manager to join our team in Pune Mah xc4 x81r xc4 x81shtra IN-MH India IN ...

  • Sr. Data Engineer

    1 week ago

    Pune, Maharashtra, India Nts Automation Labs Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are seeking a highly skilled Data Architect with expertise in AWS cloud services and data integration to join our team. The ideal candidate will be responsible for architecting, designing, and implementing scalable, secure, and high-performance data solutions. This role requires close collaboration with cross-functional teams and leadership in driving...

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Sr. CAE Engineer

    2 weeks ago

    Pune, Maharashtra, India Dathan Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Company DescriptionDathan provides CAE services specialized in Structural Analysis, Thermal Analysis, Non-linear Analysis, Flow Simulations, and Motion Simulation. Our expertise aids in optimizing designs and improving performance across various engineering applications. Located in Pune, our team ensures precise and reliable results through advanced...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...