Senior Data Engineer

7 days ago

Pune, Maharashtra, India Byond Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Senior Data Engineer

Location:
Pune

Experience:
4–6 years

Education:
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field

Job Description

Byond is hiring for a
confidential client
in the manufacturing domain. We are seeking a highly skilled
Senior Data Engineer
with strong expertise in
Azure Databricks, PySpark, and distributed computing
. The role involves developing and optimizing scalable ETL pipelines to support
manufacturing analytics
. You will be working with
high-frequency industrial data
to enable both
real-time
and
batch data processing
.

Key Responsibilities

  • Build scalable
    real-time and batch data processing workflows
    using Azure Databricks, PySpark, and Apache Spark.
  • Perform
    data pre-processing
    , including cleaning, transformation, deduplication, normalization, encoding, and scaling, to ensure high-quality inputs for downstream analytics.
  • Design, implement, and maintain
    cloud-based data architectures
    , including data lakes, lakehouses, and warehouses, aligned with
    Medallion Architecture
    .
  • Deploy and optimize
    data solutions
    on Azure (preferred), AWS, or GCP, focusing on
    performance, security, and scalability
    .
  • Develop and optimize
    ETL/ELT pipelines
    for structured and unstructured data sourced from
    IoT, MES, SCADA, LIMS, and ERP systems
    .
  • Automate workflows using
    CI/CD pipelines
    and DevOps best practices while ensuring
    security and compliance
    with industry standards.
  • Monitor, troubleshoot, and continuously improve
    data pipelines
    for high availability and reliability.
  • Utilize
    Docker and Kubernetes
    for containerized and scalable data processing.
  • Collaborate closely with
    automation teams, data scientists, and engineers
    to provide clean, structured data for
    AI/ML models
    .

Required Skills & Experience

  • 4+ years
    of proven experience in data engineering, with a strong focus on cloud platforms such as
    Azure (preferred), AWS, or GCP
    .
  • Proficiency in
    PySpark, Azure Databricks, Python, and Apache Spark
    .
  • Expertise in multiple database technologies, including:
  • Relational databases (e.g.,
    SQL Server, PostgreSQL
    )
  • Time-series databases (e.g.,
    InfluxDB
    )
  • NoSQL databases (e.g.,
    MongoDB, Cassandra
    )
  • Hands-on experience with
    containerization tools
    such as Docker and Kubernetes.
  • Strong
    analytical, problem-solving, and debugging skills
    , with meticulous attention to detail.
  • Excellent
    communication and collaboration skills
    with a proven track record of effective teamwork.
  • Comfortable working in a
    dynamic, fast-paced startup environment
    , with the ability to adapt quickly to changing priorities and responsibilities.

Nice-to-Have Skills

  • Familiarity with
    MLOps and DevOps practices
    , including
    model lifecycle management
    .
  • Experience working with
    industrial data sources
    like IoT, MES, SCADA, LIMS, and ERP.

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Senior Data Analyst

    20 hours ago

    Pune, Maharashtra, India Hevo Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Hevo:Hevo ) is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics.Hevo powers data analytics for 2000+ data-driven companies across multiple industry verticals, including , Postman, ThoughtSpot, Jawa Motorcycles. By automating complex data integration...

  • Senior Data Engineer

    3 days ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 8,00,000 - ₹ 20,00,000 per year

    Description : Location : Pune (Kharadi), India Experience : 8 YearsAbout the Role : We are seeking a highly skilled and experienced Senior Data Engineer to join our team in Pune. This role is crucial for designing, building, and optimizing our large-scale data processing systems and platforms. As a senior member of the team, you will apply your...

  • Senior QA Engineer

    1 week ago

    Pune, Maharashtra, India ICE Data Services Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    The Senior QA Engineer will be responsible for ensuring complete test coverage of data platform and product functionality, development, and maintenance of comprehensive test automation infrastructure, helping with debugging and validating fixes for production issue. This role is responsible for performing a variety of QA engineering tasks including design...

  • Senior Data Engineer

    5 days ago

    Pune, Maharashtra, India Sunbrilo Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are hiring for -Role: Senior Data EngineerExperience Range: 3 to 5 YearsQualification:Degree in Computer Science (or similar), alternatively well-founded professionalexperience in the desired fieldRoles & Responsibilities:As a Senior Data Engineer, you manage and develop the solutions in close alignment with various business and Spoke stakeholders. You...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Bajaj Finance Full time US$ 90,000 - US$ 1,20,000 per year

    Job PurposeThe Senior Data Engineer will be responsible for designing, building, and maintaining scalable and efficient data pipelines and architectures for the Enterprise Data Platform. This role will focus on enabling high-quality, reliable, and timely data access for analytics, reporting, and business decision-making. Working closely with business...

  • Senior GenAI Engineers

    7 days ago

    Pune, Maharashtra, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior GenAI Engineers to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Location: | Experience: 8+ yearsRole...

  • Senior Data Engineer

    7 days ago

    Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Now Hiring: Senior Data Engineer with 6+ Years of ExperienceLocation : Pune Are you a seasoned Data Engineer with a passion for #Azure cloud technologies? We are looking for a skilled professional to join our team in Pune, focusing on cutting-edge projects in data engineering.Key Responsibilities : - Develop and maintain high-performance #ETL/#ELT...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Avant Garde Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are seeking a talented and passionate Senior Data Engineer to join our growing data team. In this role, you will play a key part in building and scaling our data infrastructure, enabling data-driven decision-making across the organization. You will be responsible for designing, developing, and maintaining efficient and reliable data pipelines for both ELT...

  • Senior Data Engineer

    7 days ago

    Pune, Maharashtra, India NielsenIQ Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Engineer (PYTHON, SQL, PYSPARK, Data Modelling, Stored procedures) Job Description NIQ is looking for a Senior Data Engineer to join our Financial Services Engineering team. At NIQ, the Financial Services team uses alternative datasets to help global public equity investors (hedge funds, mutual funds, pension funds) make better investment...