Cloud-Based Big Data Architect

1 week ago


Bengaluru, Karnataka, India The Nielsen Company Full time

Job Overview

We are seeking an experienced Staff Software Engineer to join our team at The Nielsen Company. This is a fantastic opportunity to work with cutting-edge technologies and collaborate with creative engineers on high-performance projects.

About Nielsen Global Media

Nielsen Global Media uses innovative technology and industry-leading data science to tackle complex problems in marketing science. Our Intelligence Studio platform allows data scientists to focus on their core tasks by taking care of essential concerns like data access, logging, configuration, and resource negotiation.

Responsibilities

  1. Design and build software and integrations in cloud-based microservices environments (kubernetes) for big data applications with Spark, Ray, and other tools.
  2. Write software in various programming languages, including Python, TypeScript, Go, Java, and Scala.
  3. Collaborate with stakeholders and technical leadership to design and implement interfaces, workflows, and services that enhance the delivery of data science products.
  4. Participate in code reviews and ensure adherence to quality standards.
  5. Work within a cross-functional team to author clear and purposeful epics/stories.
  6. Promote and enforce best practices in development and operations.
  7. Identify opportunities and weaknesses in the platform architecture.
  8. Design and develop data visualization tooling using Electron, JupyterHub, Plotly, TypeScript, and Pandas to enhance data exploration workflows for data science.
  9. Integrate data science visualization and diagnostic tooling like TensorBoard, Ray Serving, and Spark History Server into an existing distributed compute and development environment.
  10. Build secure integrations with the Kubernetes API, enabling the management of user workloads in a shared environment with potentially sensitive data.
  11. Understand and debug interactions between cloud networking components (ALBs, Web API Proxies), cluster ingress, and security using Kong and Istio, Python-based Web Servers, and modern Web Transfer Protocols like WebSockets and HTTP/3.

A LITTLE BIT ABOUT YOU

  1. You have a proven track record of quickly learning and implementing new technologies as an experienced software engineer. You're excited to work on a high-performance team building ambitious products and looking for an opportunity to grow your career and technical depth by diving into a project working on the current state of the art in big data and cloud technologies.

Qualifications

  1. Bachelor's degree in Computer Science or a related technical field, or equivalent industry experience.
  2. Familiarity with TypeScript, Python, Kubernetes, Airflow, Electron, Jupyter, Pandas, Keras, Ray, TensorFlow, CUDA, Apache Spark, Istio, Scala, Java, Go, Kong, Cloud Software Design, Containerized Microservices, and Distributed Caching.
  3. Experience with machine learning (RNNs, CNNs, random forest, LLMs) is a plus.

Salary and Benefits

We offer an estimated salary range of $140,000 - $170,000 per year, depending on location and experience. We also provide a comprehensive benefits package, including health insurance, retirement plans, and paid time off.



  • Bengaluru, Karnataka, India Société Générale Assurances Full time

    About the RoleAt Société Générale Assurances, we are seeking an experienced Senior Cloud Architect to lead our team in designing and developing scalable cloud-based solutions using Java and Big Data technologies. As a key member of our IT department, you will be responsible for architecting, implementing, and maintaining our cloud infrastructure.

  • Big Data Architect

    1 week ago


    Bengaluru, Karnataka, India Telescopp Full time

    Job OverviewWe are seeking a seasoned Big Data Architect to lead the development of scalable big data solutions in Bengaluru. This is a mid-level, full-time position requiring 4-6 years of relevant experience. As a Big Data Architect at Telescopp, you will design and build robust big data infrastructure, develop ETL processes, collaborate with data...


  • Bengaluru, Karnataka, India NTT DATA Full time

    NTT DATA is a global technology services company with a presence in over 50 countries.We have a wide range of job opportunities available for talented professionals like you.About the Job:Job DescriptionWe are seeking a Senior Cloud Data Architect to join our team in Bangalore, India. The successful candidate will be responsible for designing and...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking an experienced Senior Cloud Data Architect to join our team at NTT DATA Services. As a key member of our data engineering team, you will be responsible for designing and implementing cloud-based data solutions on Azure Data platform.ResponsibilitiesDesign and develop big data processing notebooks using Azure DatabricksScripting...


  • Bengaluru, Karnataka, India Career Makers Full time

    Job Description:As a Cloud Architect with Big Data Expertise at Career Makers, you will play a pivotal role in designing and deploying large-scale web services that successfully integrate cloud deployment and scalability.Responsibilities:Design and implement n-tier architecture for enterprise-scale web servicesDevelop business/database abstraction layers and...


  • Bengaluru, Karnataka, India Luxoft Full time

    We are seeking a seasoned Cloud-Based Compliance Solutions Architect to join our team at Luxoft. In this role, you will be responsible for designing and implementing cloud-based compliance solutions that meet the needs of our clients in the financial services industry.The ideal candidate will have 7+ years of experience in Big Data technologies and extensive...


  • Bengaluru, Karnataka, India o9 Solutions, Inc. Full time

    About the RoleAs a Big Data Architect at o9 Solutions, you will play a key role in designing and deploying large-scale, data-intensive solutions using Spark, Delta Lake, and Airflow schedulers.Key Responsibilities:Collaborate with customers and technical consultants to design and recommend big data architecture solutions tailored to customer...


  • Bengaluru, Karnataka, India Mercedes-Benz Full time

    Job DescriptionAt Mercedes-Benz, we are seeking an experienced Data Engineer to join our team. As a key member of our cloud and big data team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.About the RoleWe are looking for a highly skilled data engineer with experience in building and managing data...

  • Cloud Architect

    3 weeks ago


    Bengaluru, Karnataka, India The Nielsen Company Full time

    We are seeking a skilled Cloud Architect to join our team of experts in developing and deploying scalable big data solutions. As a key member of our team, you will be responsible for designing and implementing cloud-based architectures that meet the needs of our business.Your primary objective will be to ensure project goals are achieved and aligned with...


  • Bengaluru, Karnataka, India Talent21 Management and Shared Service Pvt Ltd Full time

    Job OverviewWe are seeking an experienced Data Architect to join our Epsilon Attribution/Forecasting Product Development team at Talent21 Management and Shared Service Pvt Ltd. As a Principal Software Engineer, you will design, implement, and optimize data processing solutions using Scala, Spark, and Hadoop.About the RoleThe ideal candidate will have strong...

  • Data Architect

    4 weeks ago


    Bengaluru, Karnataka, India Databricks Full time

    Are you a data expert looking to make a meaningful impact in the industry?We are seeking a talented Data Architect with expertise in Big Data technologies to join our team at Databricks.About UsDatabricks is a leader in cloud-based data analytics, empowering customers to simplify their data workflows and drive business growth.We pride ourselves on our...

  • Data Architect

    4 weeks ago


    Bengaluru, Karnataka, India Prov HR Solutions Private Limited Full time

    Job Title: Data Architect - Cloud ExpertJob Summary: We are seeking a highly skilled Data Architect to lead our cloud-based data initiatives. The ideal candidate should have expertise in cloud architectures, ETL processes, and big data solutions.Responsibilities:Design and implement data architecture strategies to support business-driven initiatives.Develop...


  • Bengaluru, Karnataka, India NETSACH GLOBAL Full time

    Job Title: Big Data Engineer/ArchitectNetsach Global is seeking a highly skilled Big Data Engineer/Architect to design, develop, and maintain large-scale data processing systems and architecture. The ideal candidate will work closely with data scientists, analysts, and other stakeholders to ensure data systems are scalable, secure, and efficient, enabling...

  • Big Data Architect

    3 weeks ago


    Bengaluru, Karnataka, India Expertia AI Full time

    Job Description:We are seeking a highly skilled Big Data Architect to join our team at Expertia AI. This is a unique opportunity for a talented professional to take their career to the next level.About the Role:The successful candidate will design and implement scalable big data transformations and pipelines, leveraging cloud platforms like Azure...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly experienced and dynamic Strategic Data Architect Leader to join our Data, Analytics and AI team.Job SummaryThe ideal candidate will have a strong background in Data, Big Data and related technology and management, with a proven track record of leading innovation and architecture initiatives.Key ResponsibilitiesLead the...


  • Bengaluru, Karnataka, India Visionyle Solutions Full time

    At Visionyle Solutions, we are seeking a highly skilled Data Architect to join our team. This is an excellent opportunity for experienced professionals who have a strong background in designing and implementing big data solutions.We offer a competitive salary of $120,000 - $150,000 per annum, depending on experience and qualifications. The successful...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using Databricks on AWS.Job Responsibilities:Design and develop efficient data pipelines using Apache Spark and Databricks.Ingest data from multiple...


  • Bengaluru, Karnataka, India Visionyle Solutions Full time

    Join Visionyle Solutions as a Senior Big Data Architect and take on the exciting challenge of designing and implementing cutting-edge big data solutions. Expected Salary: $120,000 - $150,000 per year.About the Role:In this role, you will be working with our globally distributed team to develop innovative Hadoop-based solutions that meet business needs and...

  • Data Architect

    2 weeks ago


    Bengaluru, Karnataka, India Kognivera It Solutions Private Limited Full time

    Seeking an experienced Data Architect with a proven track record in designing and implementing scalable big data solutions on distributed platforms. As a key member of our team, you will be responsible for architecting data products using AWS services, data warehousing tools, and designing data platforms.About UsKognivera It Solutions Private Limited is a...


  • Bengaluru, Karnataka, India Prime Search Consultant Full time

    Job DescriptionWe are seeking a highly skilled Big Data Architect and Engineering Lead to join our team at Prime Search Consultant. This role will be responsible for architecting and developing large-scale data systems, leading cross-functional teams, and collaborating with stakeholders to drive business outcomes.About the Role:This is an exciting...