Data Engineer for Identity Data Solutions

2 weeks ago


Bengaluru, Karnataka, India Nielsen Full time

About Nielsen

We are a leading global media measurement company that provides clients with the most accurate and actionable insights to drive their business decisions. At Nielsen, we empower our clients by providing them with data-driven solutions that enable them to better understand their audience and make informed decisions.

The Role

We are seeking an experienced Data Engineer to join our Identity team in this key role. As a Data Engineer, you will be responsible for designing and developing scalable and efficient data systems to support our client's needs. This is a critical role that requires a strong understanding of data engineering principles and experience working with big data technologies such as Apache Spark and AWS S3.

Responsibilities

  • Design and develop scalable and efficient data pipelines using Apache Spark and AWS S3
  • Develop data processing scripts using Python and Scala
  • Collaborate with cross-functional teams to ensure data quality and accuracy
  • Mentor junior engineers to improve their skills and knowledge

Requirements

To be successful in this role, you will need:

  • 5+ years of experience in a MLOps, Data Engineering, DBA or Database Developer role leading critical projects of high complexity
  • Capable of proposing/evaluating data system architectures for high-scale projects
  • In-depth knowledge and experience implementing core big data concepts and tools spanning source control, CI/CD, Infrastructure as Code, monitoring, alerting, logging
  • Deep knowledge of Apache Spark is a must - spark-sql internals specifically is a significant plus
  • Proficiency in AWS, with strong knowledge of S3, KMS and IAM
  • Experience training and mentoring junior team members

What We Offer

Nielsen offers a competitive salary of $150,000 - $200,000 per year, depending on experience, as well as a comprehensive benefits package including health insurance, retirement plan, and paid time off. We also offer opportunities for career growth and development through ongoing training and education.

About the Location

This role is located in New York City, USA. If you are not based in New York City, please note that relocation assistance may be available.



  • Bengaluru, Karnataka, India NTT DATA Full time

    About the Role:As a Cloud Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using GCP's BigQuery, Dataflow, and Dataproc technologies. Your expertise in ETL/ELT pipelines, data warehousing, and lakehouse solutions will enable us to efficiently process structured and unstructured data.Key...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Overview">We are seeking an experienced Technical Solutions Architect to join our team in Bangalore, India. As a key member of our Identity and Access Management (IAM) team, you will be responsible for designing and developing Okta IAM solutions to support our organization's Customer Identity and Access Management (CIAM) initiatives.">About the...

  • Data Engineer

    1 week ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team in Bangalore, India. As a key member of our team, you will play a crucial role in designing and implementing data pipelines, ensuring high-quality data for business insights.About the RoleThis is an exciting opportunity to work with cutting-edge technology and contribute to the growth...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Job DescriptionWe are seeking a skilled Identity Management Solution Architect to join our team in Bangalore, India.About the RoleProvide technical leadership in designing, configuring, and troubleshooting IAM solutions.Hands-on experience in CA SiteMinder, Azure AD B2C, EntraID is required, with Azure B2C knowledge/experience being an advantage.Implement...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    We are currently seeking a highly skilled Data Solutions Architect to join our team in Bangalore, India.About the Role:As a Data Solutions Architect, you will design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Main...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About NTT DATANTT DATA is a global innovator of business and technology services, serving 75% of the Fortune Global 100. Our diverse experts in over 50 countries collaborate to drive long-term success for clients.Job OverviewWe are seeking an experienced Senior AI Data Engineer and Solutions Architect to join our team in Bangalore, India. This role requires...


  • Bengaluru, Karnataka, India HEVO DATA Full time

    About the RoleWe're seeking a skilled Data Platform Solutions Expert to join our Sales team at HEVO DATA. This is an exciting opportunity for someone with a strong background in Data Domain to work closely with sales professionals, helping them understand customers' business and technical needs and demonstrate how our platform can solve their real-time data...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team in Bangalore, India. As an AI Data Engineer at NTT DATA, you will be responsible for developing and implementing traditional machine learning algorithms.Key Responsibilities:Design and deploy machine learning models in a production environment.Write and maintain Python code for data...


  • Bengaluru, Karnataka, India Ping Identity Full time

    Unlock Digital Freedom with Ping IdentityWe're changing the way people and businesses think about cybersecurity, digital experiences, and identity and access management. As a Senior Software Engineer at Ping Identity, you'll work on a cross-functional engineering team developing the next generation of Identity and Access Management SaaS products.About the...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Identity Security Systems Engineer Advisor to join our team at NTT DATA Services. This is an excellent opportunity for a talented professional to contribute to the delivery of cutting-edge security solutions.Job SummaryThe successful candidate will be responsible for designing, implementing, and maintaining...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the Role We are seeking a skilled Security Identity Okta Technical Solutions Architect Specialist to join our team in Bangalore, India. As part of NTT DATA, you will be responsible for designing and developing Okta IAM solutions to support our organization's CIAM initiatives. This role involves collaborating with cross-functional teams, including...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Data Engineer Cloud Migration Specialist to join our team in Bangalore, India.The successful candidate will be responsible for designing, building and maintaining scalable data pipelines using Databricks on AWS, as well as integrating data from multiple sources using AWS services such as S3, Lambda, Glue, and...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewNTT DATA is a leading global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success.We are currently seeking a highly skilled Security Identity Specialist for Okta Architecture to join our team in Bangalore, India.About the...


  • Bengaluru, Karnataka, India Lumen Data Full time

    Senior Business Development & Lead Generation ManagerAbout LumenData:LumenData is a leading provider of enterprise data management solutions. Our expertise lies in Master Data Management (MDM), Data Governance, and Data Quality, empowering organizations to manage and utilize their data effectively.Key Responsibilities:Identify and pursue new business...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Snowflake Data Engineer and Architect to join our team in Bangalore, India. This is a senior-level position that requires expertise in designing, developing, and maintaining large-scale data warehousing solutions using Snowflake.Key ResponsibilitiesDesign and implement efficient data models and architectures for...


  • Bengaluru, Karnataka, India Hevo Data Full time

    About the RoleWe are seeking an experienced Data Integration Solutions Specialist to join our team at Hevo Data. This is a challenging and rewarding role that requires a strong understanding of data integration solutions and excellent communication skills.Key ResponsibilitiesTo identify and qualify new business opportunities through targeted outreach and...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will play a crucial role in designing and implementing automated data pipelines.


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the Role: We are seeking a highly skilled Cybersecurity Identity Systems Expert to join our team in Bangalore, India. As an expert in security identity systems, you will play a critical role in designing and implementing secure identity management solutions for our clients. Job Summary: The ideal candidate will have extensive experience in Active...


  • Bengaluru, Karnataka, India HEVO DATA Full time

    Overview: We're seeking a skilled Senior Data Solutions Consultant to join our Sales team. This role involves working closely with the sales team to understand customers' business and technical needs and demonstrating how Hevo's platform can address their real-time data replication requirements.


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Senior Data Engineering Specialist to join our team in Bangalore, India. The successful candidate will have a strong background in ETL development and data engineering using Azure concepts and technologies.Key ResponsibilitiesDesign and implement high and low-level design documents for ETL processes.Develop ETL code in...