Sr. Staff Data Engineer

2 weeks ago


Mumbai, Maharashtra, India The Nielsen Company Full time
At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future. ABOUT THIS JOB Platform engineers strike a balance between precision and disruption, between reliability and innovation. Nielsen is a tech company backed by over a century of forward momentum to show the world what's next—and we couldn't do it without our platform engineers.Nielsen Media is the market leader in content ratings across virtually all entertainment platforms including local and national TV, streaming, digital advertising, and more. In the role of Data Engineer on the Identity Team, you'll be responsible for developing the systems that estimate the audience consuming the content. This effort deals with massive data sets, demanding keen focus on both performance and design.

RESPONSIBILITIES

Use your knowledge of open source, cloud, and data technologies to architect better identity data products for our internal customers. Perform architectural reviews for critical business products to ensure they are properly built for reliability, scalability, and cost optimization. Design and implement low-latency large-scale data pipelines cleaning and transforming identity Review and refine the fundamental Data Engineering and SRE practices in the Identity platform and help define a standard for use around Nielsen. Mentor other platform team members to increase their technical and soft skills.

A LITTLE BIT ABOUT YOU

You have a genuine passion for DevOps and absolutely love learning new technologies. You don't just want to blindly use platforms and libraries; instead you have a desire to tear them apart and figure out how they work inside. You love scaling and optimizing and seeing just how far or how fast your projects can go. You see all of the building blocks in the community as legos and want to use them to build innovative new solutions at a faster pace than ever. You are also familiar with many of the following technologies and programming languages: Apache Spark (spark-sql, graphframes) Trino/Presto Airflow Python Scala Jupyter (Notebooks) Postgres AWS S3, EMR, IAM, KMS, EKS, RDS

QUALIFICATIONS

6-15 years of experience in a MLOps, Data Engineering, DBA or Database Developer role leading critical projects of high complexity. Capable of proposing/evaluating data system architectures for high-scale projects. In-depth knowledge and experience implementing core big data concepts and tools spanning source control, CI/CD, Infrastructure as Code, monitoring, alerting, logging. Deep knowledge of Apache Spark is a must - spark-sql internals specifically is a significant plus. Proficiency in AWS, with strong knowledge of S3, KMS and IAM. Experience training and mentoring junior team members. Experience with Apache Spark graphframes is a plus.
  • Sr. Data Scientist

    2 weeks ago


    Mumbai, Maharashtra, India Dew Software Full time

    Job Description·Cybersecurity is seeking a Sr. Data Scientist to join the Cyber AI team. This position will use machine learning, data engineering and Data Science principles to solve enterprise problems. This role is a key contributor to our practice and will be directly responsible for design, development, deployment and automation. The successful...

  • Sr Data Analyst

    2 months ago


    Mumbai, Maharashtra, India timesjobs Full time

    SALARY: 5 to 6 lakhsLOCATION:Mumbai, Maharashtra, IndiaVACANCIES: 1QUALIFICATION:Any graduateMALE/FEMALE:Male/FemaleEXPERIENCE: 2 to 5 yearsJOB DETAILSCollection and Collation of dataAnalysis and Interpretation of collected dataIdentifying patterns and trends in data setsReporting on daily/weekly/monthly business KPIs/metricsWorking alongside teams within...

  • Sr Data Analyst

    4 weeks ago


    Mumbai, Maharashtra, India timesjobs Full time

    SALARY: 5 to 6 lakhsLOCATION:Mumbai, Maharashtra, IndiaVACANCIES: 1QUALIFICATION:Any graduateMALE/FEMALE:Male/FemaleEXPERIENCE: 2 to 5 yearsJOB DETAILSCollection and Collation of dataAnalysis and Interpretation of collected dataIdentifying patterns and trends in data setsReporting on daily/weekly/monthly business KPIs/metricsWorking alongside teams within...


  • Mumbai, Maharashtra, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...


  • Mumbai, Maharashtra, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Sr. Data Scientist

    2 weeks ago


    Mumbai, Maharashtra, India Dew Software Full time

    Job Description · Cybersecurity is seeking a Sr. Data Scientist to join the Cyber AI team. This position will use machine learning, data engineering and Data Science principles to solve enterprise problems. This role is a key contributor to our practice and will be directly responsible for design, development, deployment and automation. The successful...

  • Sr. Engineer

    2 weeks ago


    Mumbai, Maharashtra, India Precision Hire Solution Full time

    Take Your Hiring to the Next Level Sr. Engineer - Procurement LNT/-E-P/ L&T Energy - HydrocarbonAmn Tower, Powai Posted On 10 May 2024 Required Experience 6 - 8 Years Skills Knowledge & Posting Location PROCUREMENT & SOURCING Minimum Qualification BACHELOR OF ENGINEERING (BE) Job Description Job Description - Sr. Engineer - Procurement Issue RFQ to...

  • Sr. Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India RBHU ETG Private Limited Full time

    Role: Senior Databricks EngineerExperience: 2-5 yearsResponsibilities:- Lead Data Engineering projects from start to finish.- Develop and deploy data lakehouse solutions using Databricks.- Proficient in Pyspark data modeling and data transformation.- Extract, transform, and store data from various sources into delta lake.- Maintain code versioning and...

  • Sr. Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India RBHU ETG Private Limited Full time

    Role: Senior Databricks EngineerExperience: 2-5 yearsResponsibilities:Lead Data Engineering projects from start to finish.Develop data lakehouse solutions using Databricks in live environments.Demonstrate expertise in Pyspark for data modeling and transformation.Extract and structure data from various sources (XML, CSV, text, etc.) and store it...

  • Sr Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India VolgaInfotech Pvt. Ltd Full time

    ** Looking for immediate joiners only ( within a week ). If interested, please revert back with your resume at along with your CTC / ECTC and Notice period **** We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining data pipelines in Domo Analytics Platform to extract,...


  • Mumbai, Maharashtra, India Upstox Full time

    Role: Sr. QA ManagerWe are looking for a Sr. QA manager with a solid experience in quality assurance, the successful candidate will be leading and managing one or more POD QA team/s and will be a single point of contact for all the releases, communications and various stats reports. This is a fast paced environment where the speed of Development and...

  • Sr. Server Engineer

    1 month ago


    Mumbai, Maharashtra, India Concentrix Full time

    Job Title:Sr. Server Engineer (TCF)Job DescriptionAs the Sr Engineer- Unix Support, you will be a responsible for delivering 2nd and 3rd line support for the Global Unix / Linux Platforms.This is an operational role, focusing on technical analysis and timely resolution, providing technical skills to resolve all service issues within agreed Service Level...

  • Sr. Server Engineer

    2 weeks ago


    Mumbai, Maharashtra, India Concentrix Full time

    Job Title:Sr. Server Engineer (TCF)Job DescriptionAs the Sr Engineer- Unix Support, you will be a responsible for delivering 2nd and 3rd line support for the Global Unix / Linux Platforms.This is an operational role, focusing on technical analysis and timely resolution, providing technical skills to resolve all service issues within agreed Service Level...

  • Sr. Server Engineer

    4 weeks ago


    Mumbai, Maharashtra, India Concentrix Full time

    Job Title:Sr. Server Engineer (TCF)Job DescriptionAs the Sr Engineer- Unix Support, you will be a responsible for delivering 2nd and 3rd line support for the Global Unix / Linux Platforms.This is an operational role, focusing on technical analysis and timely resolution, providing technical skills to resolve all service issues within agreed Service Level...

  • Sr Proposal Engineer

    2 weeks ago


    Navi Mumbai, Maharashtra, India sparkle clean tech pvt ltd, navi mumbai Full time

    Apply for Sr. Proposal Engineer, Career Progress Consultants in Navi Mumbai for Year of Experience on

  • Sr Proposal Engineer

    2 months ago


    Navi Mumbai, Maharashtra, India sparkle clean tech pvt ltd, navi mumbai Full time

    Apply for Sr. Proposal Engineer, Career Progress Consultants in Navi Mumbai for Year of Experience on

  • Sr Engineer

    2 weeks ago


    Mumbai, Maharashtra, India Precision Hire Solution Full time

    Sr. Engineer Procurement Company: L&T Energy Hydrocarbon Location: Amn Tower Powai Experience: 6-8 Years Skills Required: Knowledge & Posting in PROCUREMENT & SOURCING Minimum Qualification: BACHELOR OF ENGINEERING (BE) Job Description: Issue RFQ to Vendors Solicit offers from Vendors Coordinate with Engineering for Technical...


  • Mumbai, Maharashtra, India consultant Full time

    Openings for the role of data Engineer/ Sr Data EngineerMust Have :- 5-7+ years of extensive experience in a Data Engineer role- Solid experience with Python, PySpark, and SQL databases- Experience with Azure, Databricks, and GCP- Extensive knowledge of the full software development life cycle, incorporating industry best practices- Experience with ETL, data...


  • Mumbai, Maharashtra, India consultant Full time

    Openings for the role of data Engineer/ Sr Data EngineerMust Have :- 5-7+ years of extensive experience in a Data Engineer role- Solid experience with Python, PySpark, and SQL databases- Experience with Azure, Databricks, and GCP- Extensive knowledge of the full software development life cycle, incorporating industry best practices- Experience with ETL, data...

  • Senior Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...