Sr. Staff Data Engineer

4 weeks ago


Gurgaon, India The Nielsen Company Full time
At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future.  ABOUT THIS JOB Platform engineers strike a balance between precision and disruption, between reliability and innovation. Nielsen is a tech company backed by over a century of forward momentum to show the world what’s next—and we couldn’t do it without our platform engineers.Nielsen Media is the market leader in content ratings across virtually all entertainment platforms including local and national TV, streaming, digital advertising, and more. In the role of Data Engineer on the Identity Team, you'll be responsible for developing the systems that estimate the audience consuming the content. This effort deals with massive data sets, demanding keen focus on both performance and design.

RESPONSIBILITIES

Use your knowledge of open source, cloud, and data technologies to architect better identity data products for our internal customers. Perform architectural reviews for critical business products to ensure they are properly built for reliability, scalability, and cost optimization. Design and implement low-latency large-scale data pipelines cleaning and transforming identity Review and refine the fundamental Data Engineering and SRE practices in the Identity platform and help define a standard for use around Nielsen. Mentor other platform team members to increase their technical and soft skills.

A LITTLE BIT ABOUT YOU

You have a genuine passion for DevOps and absolutely love learning new technologies. You don’t just want to blindly use platforms and libraries; instead you have a desire to tear them apart and figure out how they work inside. You love scaling and optimizing and seeing just how far or how fast your projects can go. You see all of the building blocks in the community as legos and want to use them to build innovative new solutions at a faster pace than ever. You are also familiar with many of the following technologies and programming languages: Apache Spark (spark-sql, graphframes) Trino/Presto Airflow Python Scala Jupyter (Notebooks) Postgres AWS S3, EMR, IAM, KMS, EKS, RDS

QUALIFICATIONS

6-15 years of experience in a MLOps, Data Engineering, DBA or Database Developer role leading critical projects of high complexity. Capable of proposing/evaluating data system architectures for high-scale projects. In-depth knowledge and experience implementing core big data concepts and tools spanning source control, CI/CD, Infrastructure as Code, monitoring, alerting, logging. Deep knowledge of Apache Spark is a must - spark-sql internals specifically is a significant plus. Proficiency in AWS, with strong knowledge of S3, KMS and IAM. Experience training and mentoring junior team members. Experience with Apache Spark graphframes is a plus.

  • Gurgaon, Haryana, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...


  • Gurgaon, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...


  • gurgaon, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...


  • gurgaon, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Sr DevOps Engineer

    1 month ago


    Gurgaon, Haryana, India LCX Full time

    Apply for Sr. DevOps Engineer, Career Progress Consultants in Gurgaon for 5 - 8 Year of Experience on

  • Sr DevOps Engineer

    3 weeks ago


    Gurgaon, Haryana, India LCX Full time

    Apply for Sr. DevOps Engineer, Career Progress Consultants in Gurgaon for 5 - 8 Year of Experience on

  • Sr DevOps Engineer

    1 day ago


    Gurgaon, India LCX Full time

    Apply for Sr. DevOps Engineer, Career Progress Consultants in Gurgaon for 5 - 9 Year of Experience on TimesJobs.com.


  • Gurgaon, Haryana, India AHEAD Full time

    AHEAD builds platforms for digital business. By weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help enterprises deliver on the promise of digital transformation.At AHEAD, we prioritize creating a culture of belonging, where all perspectives and voices are represented, valued, respected, and heard. We...

  • Sr. Data Engineer

    1 week ago


    Gurgaon, Haryana, India Altudo Full time

    We have a unique career opportunity for an experienced Data Engineer to play a key role in the growth of the Analytics practice. You will work with Altudo' s clients to deliver cutting-edge data & analytics solutions using modern data platforms such as Databricks, Snowflake and Microsoft Fabric. You will play a key role in leading complex engagements. In...

  • Sr. Data Engineer

    3 weeks ago


    gurgaon, India Altudo Full time

    We have a unique career opportunity for an experienced Data Engineer to play a key role in the growth of the Analytics practice. You will work with Altudo’ s clients to deliver cutting-edge data & analytics solutions using modern data platforms such as Databricks, Snowflake and Microsoft Fabric. You will play a key role in leading complex engagements. In...

  • Sr. Data Engineer

    1 month ago


    gurgaon, India Altudo Full time

    We have a unique career opportunity for an experienced Data Engineer to play a key role in the growth of the Analytics practice. You will work with Altudo’ s clients to deliver cutting-edge data & analytics solutions using modern data platforms such as Databricks, Snowflake and Microsoft Fabric. You will play a key role in leading complex engagements. In...


  • Gurgaon, Haryana, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a .Net Full Stack Sr. Developer to join our team in Gurgaon, Haryāna (IN-HR), India (IN).Job Duties•...


  • Gurgaon, India Cloud Staff Solutions Full time

    Experience: 6-9 years Job location: Bangalore and Gurgaon ( Hybrid). **1). Oracle HCM Platform Support** Prior Experience of HCM Release Management for Oracle HCM components (EXTRACT, ALERT, BIP, Reports), Well versed with Oracle CSM & FSM tool for automated Release Management - Prior experience of Managing Oracle POD, instance strategy, P2T, T2T, Data...


  • Gurgaon, India Fareportal Full time

    Title: Sr. Data Engineering ArchitectLocation: Gurgaon, INType: Hybrid, In-OfficeJob DescriptionWho We Are:Fareportal is a travel technology company powering a next-generation travel concierge service. Utilizing its innovative technology and company owned and operated global contact centres, Fareportal has built strong industry partnerships providing...

  • Data Engineer III

    1 week ago


    Gurgaon, Haryana, India Expedia Group Full time

    Data Engineer IIIAs a Data Engineer III with Expedia Engineering team you will have the opportunity to leverage your technical expertise to design solutions that enrich the Data and Intelligent service Metric Enablement platform with new features and functionality to run the business. As a senior data engineer on the team, we expect you to be able to have...


  • Gurgaon, Haryana, India Circle K Full time

    JOB DESCRIPTION Job Description Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 14,200 stores in 26 countries, serving more than 6 million customers each day. It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a...


  • Gurgaon, Haryana, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a .Net Full Stack Sr. Developer to join our team in Gurgaon, Haryāna (IN-HR), India (IN).Job Duties• Develop User...

  • Sr. Data Scientist

    1 week ago


    Gurgaon, Haryana, India Accel India Management LLP Full time

    Job Description: Sr. Data Scientist Industry: Indifi (Series D Accel Company) A Fin-tech venture funded by the largest global investors. Led by star leadership Location: Gurugram Ideal candidate must have: • Advanced understanding of statistical analysis, ability to apply analytics in all aspects of the business - risk, marketing, process etc •...

  • Sr Engineer

    1 month ago


    Gurgaon, India UnitedLex Full time

    About Us iRunway (Erstwhile UnitedLex) is a data and professional services company delivering outcomes that create value and competitive advantage for legal and the business. Our business is anchored by a passion for innovation brought to life by a global community of diverse individuals determined to deliver on the promise of data mastery, legal acumen,...

  • Sr Engineer

    3 weeks ago


    gurgaon, India UnitedLex Full time

    About Us iRunway (Erstwhile UnitedLex) is a data and professional services company delivering outcomes that create value and competitive advantage for legal and the business. Our business is anchored by a passion for innovation brought to life by a global community of diverse individuals determined to deliver on the promise of data mastery, legal...