Cloud-Based Big Data Architect
1 week ago
Job Overview
We are seeking an experienced Staff Software Engineer to join our team at The Nielsen Company. This is a fantastic opportunity to work with cutting-edge technologies and collaborate with creative engineers on high-performance projects.
About Nielsen Global Media
Nielsen Global Media uses innovative technology and industry-leading data science to tackle complex problems in marketing science. Our Intelligence Studio platform allows data scientists to focus on their core tasks by taking care of essential concerns like data access, logging, configuration, and resource negotiation.
Responsibilities
- Design and build software and integrations in cloud-based microservices environments (kubernetes) for big data applications with Spark, Ray, and other tools.
- Write software in various programming languages, including Python, TypeScript, Go, Java, and Scala.
- Collaborate with stakeholders and technical leadership to design and implement interfaces, workflows, and services that enhance the delivery of data science products.
- Participate in code reviews and ensure adherence to quality standards.
- Work within a cross-functional team to author clear and purposeful epics/stories.
- Promote and enforce best practices in development and operations.
- Identify opportunities and weaknesses in the platform architecture.
- Design and develop data visualization tooling using Electron, JupyterHub, Plotly, TypeScript, and Pandas to enhance data exploration workflows for data science.
- Integrate data science visualization and diagnostic tooling like TensorBoard, Ray Serving, and Spark History Server into an existing distributed compute and development environment.
- Build secure integrations with the Kubernetes API, enabling the management of user workloads in a shared environment with potentially sensitive data.
- Understand and debug interactions between cloud networking components (ALBs, Web API Proxies), cluster ingress, and security using Kong and Istio, Python-based Web Servers, and modern Web Transfer Protocols like WebSockets and HTTP/3.
A LITTLE BIT ABOUT YOU
- You have a proven track record of quickly learning and implementing new technologies as an experienced software engineer. You're excited to work on a high-performance team building ambitious products and looking for an opportunity to grow your career and technical depth by diving into a project working on the current state of the art in big data and cloud technologies.
Qualifications
- Bachelor's degree in Computer Science or a related technical field, or equivalent industry experience.
- Familiarity with TypeScript, Python, Kubernetes, Airflow, Electron, Jupyter, Pandas, Keras, Ray, TensorFlow, CUDA, Apache Spark, Istio, Scala, Java, Go, Kong, Cloud Software Design, Containerized Microservices, and Distributed Caching.
- Experience with machine learning (RNNs, CNNs, random forest, LLMs) is a plus.
Salary and Benefits
We offer an estimated salary range of $140,000 - $170,000 per year, depending on location and experience. We also provide a comprehensive benefits package, including health insurance, retirement plans, and paid time off.
-
Senior Cloud Architect
3 weeks ago
Bengaluru, Karnataka, India Société Générale Assurances Full timeAbout the RoleAt Société Générale Assurances, we are seeking an experienced Senior Cloud Architect to lead our team in designing and developing scalable cloud-based solutions using Java and Big Data technologies. As a key member of our IT department, you will be responsible for architecting, implementing, and maintaining our cloud infrastructure.
-
Big Data Architect
1 week ago
Bengaluru, Karnataka, India Telescopp Full timeJob OverviewWe are seeking a seasoned Big Data Architect to lead the development of scalable big data solutions in Bengaluru. This is a mid-level, full-time position requiring 4-6 years of relevant experience. As a Big Data Architect at Telescopp, you will design and build robust big data infrastructure, develop ETL processes, collaborate with data...
-
Senior Cloud Data Architect
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeNTT DATA is a global technology services company with a presence in over 50 countries.We have a wide range of job opportunities available for talented professionals like you.About the Job:Job DescriptionWe are seeking a Senior Cloud Data Architect to join our team in Bangalore, India. The successful candidate will be responsible for designing and...
-
Senior Cloud Data Architect
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Services Full timeAbout the RoleWe are seeking an experienced Senior Cloud Data Architect to join our team at NTT DATA Services. As a key member of our data engineering team, you will be responsible for designing and implementing cloud-based data solutions on Azure Data platform.ResponsibilitiesDesign and develop big data processing notebooks using Azure DatabricksScripting...
-
Cloud Architect with Big Data Expertise
20 hours ago
Bengaluru, Karnataka, India Career Makers Full timeJob Description:As a Cloud Architect with Big Data Expertise at Career Makers, you will play a pivotal role in designing and deploying large-scale web services that successfully integrate cloud deployment and scalability.Responsibilities:Design and implement n-tier architecture for enterprise-scale web servicesDevelop business/database abstraction layers and...
-
Cloud-Based Compliance Solutions Architect
6 days ago
Bengaluru, Karnataka, India Luxoft Full timeWe are seeking a seasoned Cloud-Based Compliance Solutions Architect to join our team at Luxoft. In this role, you will be responsible for designing and implementing cloud-based compliance solutions that meet the needs of our clients in the financial services industry.The ideal candidate will have 7+ years of experience in Big Data technologies and extensive...
-
Big Data Architect Leader
4 days ago
Bengaluru, Karnataka, India o9 Solutions, Inc. Full timeAbout the RoleAs a Big Data Architect at o9 Solutions, you will play a key role in designing and deploying large-scale, data-intensive solutions using Spark, Delta Lake, and Airflow schedulers.Key Responsibilities:Collaborate with customers and technical consultants to design and recommend big data architecture solutions tailored to customer...
-
Data Engineer for Cloud and Big Data
1 week ago
Bengaluru, Karnataka, India Mercedes-Benz Full timeJob DescriptionAt Mercedes-Benz, we are seeking an experienced Data Engineer to join our team. As a key member of our cloud and big data team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.About the RoleWe are looking for a highly skilled data engineer with experience in building and managing data...
-
Cloud Architect
3 weeks ago
Bengaluru, Karnataka, India The Nielsen Company Full timeWe are seeking a skilled Cloud Architect to join our team of experts in developing and deploying scalable big data solutions. As a key member of our team, you will be responsible for designing and implementing cloud-based architectures that meet the needs of our business.Your primary objective will be to ensure project goals are achieved and aligned with...
-
Data Architect in Cloud and Big Data
2 weeks ago
Bengaluru, Karnataka, India Talent21 Management and Shared Service Pvt Ltd Full timeJob OverviewWe are seeking an experienced Data Architect to join our Epsilon Attribution/Forecasting Product Development team at Talent21 Management and Shared Service Pvt Ltd. As a Principal Software Engineer, you will design, implement, and optimize data processing solutions using Scala, Spark, and Hadoop.About the RoleThe ideal candidate will have strong...
-
Data Architect
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeAre you a data expert looking to make a meaningful impact in the industry?We are seeking a talented Data Architect with expertise in Big Data technologies to join our team at Databricks.About UsDatabricks is a leader in cloud-based data analytics, empowering customers to simplify their data workflows and drive business growth.We pride ourselves on our...
-
Data Architect
4 weeks ago
Bengaluru, Karnataka, India Prov HR Solutions Private Limited Full timeJob Title: Data Architect - Cloud ExpertJob Summary: We are seeking a highly skilled Data Architect to lead our cloud-based data initiatives. The ideal candidate should have expertise in cloud architectures, ETL processes, and big data solutions.Responsibilities:Design and implement data architecture strategies to support business-driven initiatives.Develop...
-
Big Data Solutions Architect
1 month ago
Bengaluru, Karnataka, India NETSACH GLOBAL Full timeJob Title: Big Data Engineer/ArchitectNetsach Global is seeking a highly skilled Big Data Engineer/Architect to design, develop, and maintain large-scale data processing systems and architecture. The ideal candidate will work closely with data scientists, analysts, and other stakeholders to ensure data systems are scalable, secure, and efficient, enabling...
-
Big Data Architect
3 weeks ago
Bengaluru, Karnataka, India Expertia AI Full timeJob Description:We are seeking a highly skilled Big Data Architect to join our team at Expertia AI. This is a unique opportunity for a talented professional to take their career to the next level.About the Role:The successful candidate will design and implement scalable big data transformations and pipelines, leveraging cloud platforms like Azure...
-
Strategic Data Architect Leader
1 week ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a highly experienced and dynamic Strategic Data Architect Leader to join our Data, Analytics and AI team.Job SummaryThe ideal candidate will have a strong background in Data, Big Data and related technology and management, with a proven track record of leading innovation and architecture initiatives.Key ResponsibilitiesLead the...
-
Data Architect with Big Data Expertise
1 week ago
Bengaluru, Karnataka, India Visionyle Solutions Full timeAt Visionyle Solutions, we are seeking a highly skilled Data Architect to join our team. This is an excellent opportunity for experienced professionals who have a strong background in designing and implementing big data solutions.We offer a competitive salary of $120,000 - $150,000 per annum, depending on experience and qualifications. The successful...
-
Cloud Data Engineer for Big Data Processing
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Services Full timeAbout the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using Databricks on AWS.Job Responsibilities:Design and develop efficient data pipelines using Apache Spark and Databricks.Ingest data from multiple...
-
Senior Big Data Architect
2 weeks ago
Bengaluru, Karnataka, India Visionyle Solutions Full timeJoin Visionyle Solutions as a Senior Big Data Architect and take on the exciting challenge of designing and implementing cutting-edge big data solutions. Expected Salary: $120,000 - $150,000 per year.About the Role:In this role, you will be working with our globally distributed team to develop innovative Hadoop-based solutions that meet business needs and...
-
Data Architect
2 weeks ago
Bengaluru, Karnataka, India Kognivera It Solutions Private Limited Full timeSeeking an experienced Data Architect with a proven track record in designing and implementing scalable big data solutions on distributed platforms. As a key member of our team, you will be responsible for architecting data products using AWS services, data warehousing tools, and designing data platforms.About UsKognivera It Solutions Private Limited is a...
-
Big Data Architect and Engineering Lead
20 hours ago
Bengaluru, Karnataka, India Prime Search Consultant Full timeJob DescriptionWe are seeking a highly skilled Big Data Architect and Engineering Lead to join our team at Prime Search Consultant. This role will be responsible for architecting and developing large-scale data systems, leading cross-functional teams, and collaborating with stakeholders to drive business outcomes.About the Role:This is an exciting...