Senior Data Engineer for Large-Scale Data Platforms

7 days ago


Pune, Maharashtra, India PubMatic Full time

PubMatic is a pioneering technology company that empowers digital content creators to maximize their revenue by delivering innovative data-driven solutions.

The company's sell-side platform enables customers to control access to their inventory, increase monetization, and drive return on investment across ad formats and devices.

We're seeking a seasoned Senior Software Engineer - Data Analytics to join our team and contribute to the development of highly scalable data platforms and services.

Key Responsibilities:

  • Design and implement highly scalable, fault-tolerant big data platforms to process terabytes of data.
  • Develop Big Data pipelines using modern technology stacks such as Spark, Hadoop, Kafka, HBase, Hive, and Presto.
  • Develop analytics applications using modern technology stacks such as Java, Spring, Tomcat, Jenkins, REST APIs, JDBC, Amazon Web Services, Hibernate.
  • Build data pipelines to automate high-volume collection and processing for real-time data analytics.
  • Customize reporting and analytics platforms based on customer requirements.
  • Lead multiple projects to develop features for data processing and reporting platforms.
  • Collaborate with cross-functional teams to build end-to-end products and features.
  • Develop robust and fault-tolerant systems to monitor data processing pipeline and performance.
  • Leverage data architecture strategies to propose data flows and storage solutions.
  • Manage Hadoop map reduce and Spark jobs to solve ongoing issues with cluster operation.
  • Participate in Agile/Scrum processes such as sprint planning, backlog grooming, and user story management.
  • Discuss software features with product managers to include in the PubMatic Data Analytics platform.

Requirements:

  • 4 to 6 years of coding experience in Java.
  • Solid computer science fundamentals, including data structure and algorithm design.
  • Expertise in developing Implementation of professional software engineering best practices.
  • Possession of big data technologies like Hadoop, Spark, Kafka, and Snowflake would be an added advantage.
  • Experience in developing and delivering large-scale big data pipelines and real-time systems would be preferred.

  • Senior Data Engineer

    3 weeks ago


    Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. is a leading provider of data, marketing solutions, sales, and research. With a 50-year history in the US, the company has established a strategic global centre of excellence in Pune, delivering mission-critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. has been a leading provider of data, marketing solutions, sales, and research for over five decades in the US. Our global centre of excellence in Pune delivers mission-critical data services to our customers worldwide, leveraging our proprietary cloud-based technology platform and business & consumer databases.Job SummaryWe are...

  • Senior Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. has been a leading provider of data, marketing solutions, sales, and research for 50 years in the US. With a strategic global centre of excellence in Pune, Data Axle delivers mission-critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business &...

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Data Axle Full time

    About Data Axle Data Axle Inc. has been a leading provider of data, marketing solutions, sales and research for decades in the US. We have established a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers through our proprietary cloud-based technology platform and leveraging our proprietary...

  • Senior Data Architect

    4 weeks ago


    Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. is a leading provider of data, marketing solutions, and research services. With a strategic global centre of excellence in Pune, we deliver mission-critical data services to our global customers using our proprietary cloud-based technology platform and leveraging our proprietary business & consumer databases.Job SummaryWe are...


  • Pune, Maharashtra, India PubMatic Full time

    Job Title: Senior Data Platform EngineerAt PubMatic, we're looking for a skilled Senior Data Platform Engineer to join our team. As a key member of our engineering team, you will design, develop, and deploy scalable and efficient data processing systems that meet the needs of our customers.Responsibilities:Design and implement data pipelines using modern...


  • Pune, Maharashtra, India valueaddsofttech Full time

    Job Summary:We are looking for an experienced Big Data Tester/DB Analyst to ensure the quality and integrity of our large-scale databases. The ideal candidate will possess strong analytical skills and expertise in data analysis, as well as experience working with massive datasets.Key Responsibilities:1. Design, develop, and execute testing strategies for...

  • Senior Data Engineer

    4 weeks ago


    Pune, Maharashtra, India NTT DATA Services Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team in Pune, India. As a key member of our data engineering team, you will be responsible for designing and developing big data platforms using Spark, HBase, Hive, and other Hadoop ecosystem technologies.Key Responsibilities:Design and develop big data platforms using...

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India NTT DATA Services Full time

    Job Requirements:We are seeking a highly skilled Senior Data Engineer to join our team at NTT DATA Services. The ideal candidate will have a strong background in data engineering, with expertise in designing and developing big data platforms.Key Responsibilities:Design and develop big data platforms using Spark, HBase, Hive, and other Hadoop ecosystem...

  • Senior Data Engineer

    4 weeks ago


    Pune, Maharashtra, India NTT DATA Services Full time

    Req ID: 298868 NTT DATA is a global leader in business and technology services, committed to helping clients innovate, optimize and transform for long term success. We are seeking a talented Senior Data Engineer to join our team in India.About the Role:We are looking for a skilled Data Engineer with expertise in designing and developing big data platforms....

  • Senior Data Engineer

    3 weeks ago


    Pune, Maharashtra, India NTT DATA Services Full time

    Job Requirements:We are seeking a highly skilled Senior Data Engineer to join our team in Pune, India. The ideal candidate will have a bachelor degree with 5+ years of programming experience on data platforms.Key Responsibilities:Design and develop big data platforms using expertise in Data Engineering.Deep understanding of data processing technology stacks:...


  • Pune, Maharashtra, India Data Axle Full time

    About the RoleData Axle is looking for a highly skilled Senior Data Engineer to design, implement, and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.


  • Pune, Maharashtra, India Luxoft Full time

    Project OverviewInformation and Document Systems is a global technology change and delivery organization. Our team is developing a strategic greenfield project to build a large-scale digital archive for documents and records. This project aims to replace existing archiving solutions and create an operational document store as a single point of truth for...


  • Pune, Maharashtra, India Radical Technologies Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Radical Technologies. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines and architectures. You will work closely with our data science team to develop and implement data...


  • Pune, Maharashtra, India NTT DATA Full time

    Job SummaryWe are seeking a skilled Systems Integration Senior Specialist to join our team in India. The ideal candidate will have a Master's or Bachelor's degree in computer science or a related field and at least 8 years of experience in implementing data applications and big data platforms.Expertise in designing, engineering, and deploying data ingestion,...


  • Pune, Maharashtra, India FedEx Full time

    **Data Engineering Role at FedEx**As a Senior Data Engineer at FedEx, you will be responsible for designing, developing, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Develop and implement data pipelines to process and integrate data from various sources.Design and maintain data warehouse and data lake...


  • Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc., a 50-year industry leader in data, marketing solutions, sales, and research, has set up a strategic global centre of excellence in Pune.Job Description:We are seeking a Senior Data Engineer to design, implement, and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.Key...


  • Pune, Maharashtra, India Radical Technologies Full time

    Radical Technologies is seeking a highly skilled Senior Data Engineer/Lead Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a focus on designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using Cloud computing platforms such as Azure...

  • Senior Data Engineer

    4 weeks ago


    Pune, Maharashtra, India FedEx Full time

    Job Title: Senior Data EngineerFedEx is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement scalable data pipelines and architectures to support business growth and...

  • Platform Engineer

    4 weeks ago


    Pune, Maharashtra, India NTT DATA Full time

    Job Title: Platform EngineerJob Summary:NTT DATA Services is seeking a skilled Platform Engineer to join our team in Pune, India. As a Platform Engineer, you will be responsible for designing, implementing, and maintaining cloud-based infrastructure and platforms to support the delivery of applications and services.Key Responsibilities:Design and implement...