Data Engineering Architect

21 hours ago


Bengaluru, Karnataka, India o9 Solutions, Inc. Full time
Revolutionize Enterprise Planning with o9 Solutions

We are seeking a highly skilled Data Engineering Architect to join our team at o9 Solutions, Inc. This is an excellent opportunity to be part of a fast-growing technology company that digitally transforms planning and decision-making for the enterprise and the planet.

About the Role:

This role involves designing, implementing, and maintaining large-scale data processing systems using Hadoop/Spark components (Hive, HDFS, Ambari, NiFi). You will play a key role in ensuring the smooth operation of our cloud-based solution, developing and deploying best-in-class tools that support continuous integration and continuous delivery processes.

As a Data Engineering Architect, you will collaborate with customers and technical consultants to design and recommend big data architecture solutions tailored to customer requirements. You will analyze complex distributed production environments and provide actionable recommendations for performance optimization.

Key Responsibilities:
  • Design and implement distributed systems and configurations for Spark, Delta Lake, Hadoop, and related technologies, particularly in cloud-based deployments.
  • Analyze complex distributed production environments and provide actionable recommendations for performance optimization.
  • Collaborate with customers and technical consultants to design and recommend big data architecture solutions tailored to customer requirements.
  • Develop and present detailed architectural documentation for customers' technical teams.
Required Skills and Qualifications:

We are looking for a candidate with 8+ years of experience in DevOps, with a focus on architecting large-scale storage, data processing, and globally distributed solutions. Proven expertise in designing and deploying large-scale, data-intensive solutions using Spark, Delta Lake, and Airflow schedulers is essential. Strong understanding of containerization and container orchestration using K8s to manage Spark jobs and other data-intensive applications is also required.

Familiarity with R and machine learning algorithms is an advantage. Excellent verbal and written communication skills are necessary to effectively translate customer requirements into technical solutions.

Benefits:

At o9 Solutions, you will have the opportunity to work with a talented team of professionals who are passionate about innovation and making a difference. We offer a competitive salary package, including a base salary of $180,000 per annum, plus benefits such as health insurance, retirement plan, and paid time off.

You will also have the opportunity to work on cutting-edge projects, develop your skills, and grow your career in a dynamic and supportive environment.


  • Senior Data Architect

    4 weeks ago


    Bengaluru, Karnataka, India Altair Engineering Full time

    Job Title: Senior Data ArchitectWe are seeking a highly skilled Data Architect to join our team at Altair Engineering. As a Senior Data Architect, you will be responsible for designing and implementing data solutions that drive business value.About the Role:This is a challenging and rewarding role that requires strong technical skills, excellent...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Snowflake Data Engineer and Architect to join our team in Bangalore, India. This is a senior-level position that requires expertise in designing, developing, and maintaining large-scale data warehousing solutions using Snowflake.Key ResponsibilitiesDesign and implement efficient data models and architectures for...

  • Lead Data Architect

    1 week ago


    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data ArchitectLocation: Yemalur, BangaloreAt Data Labs - LANDMARK GROUP, we are seeking a skilled Lead Data Architect to spearhead our engineering team in successfully designing and deploying cutting-edge analytics products.Main Responsibilities:Lead the architecture, design, and delivery of enterprise-grade microservices.Partner with Product...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    We are currently seeking a highly skilled Data Solutions Architect to join our team in Bangalore, India.About the Role:As a Data Solutions Architect, you will design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Main...


  • Bengaluru, Karnataka, India NTT DATA Full time

    NTT DATA is a global technology services company with a presence in over 50 countries.We have a wide range of job opportunities available for talented professionals like you.About the Job:Job DescriptionWe are seeking a Senior Cloud Data Architect to join our team in Bangalore, India. The successful candidate will be responsible for designing and...

  • Senior Data Architect

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job OverviewWe are seeking an experienced Senior Data Architect - Cloud Engineer to join our team in Remote India. The successful candidate will play a critical role in supporting and enhancing our Azure Data Lakehouse environment.About the RoleThis is an exciting opportunity to leverage your expertise in designing and implementing efficient data models,...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About NTT DATANTT DATA is a global innovator of business and technology services, serving 75% of the Fortune Global 100. Our diverse experts in over 50 countries collaborate to drive long-term success for clients.Job OverviewWe are seeking an experienced Senior AI Data Engineer and Solutions Architect to join our team in Bangalore, India. This role requires...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly experienced and dynamic Strategic Data Architect Leader to join our Data, Analytics and AI team.Job SummaryThe ideal candidate will have a strong background in Data, Big Data and related technology and management, with a proven track record of leading innovation and architecture initiatives.Key ResponsibilitiesLead the...

  • Senior Data Architect

    3 weeks ago


    Bengaluru, Karnataka, India Ness Digital Engineering Full time

    We are seeking an experienced Technical Data Engineer / ELT Developer to manage data ingestion and transformation, working with an offshore team to deliver efficient and scalable data solutions that align with business requirements and performance standards.Job OverviewNess Digital Engineering is looking for a skilled professional to design, build, and...


  • Bengaluru, Karnataka, India Data Inc Full time

    Overview of the RoleThe position is part of a global initiative to digitize at scale, simplifying the way we deliver change in Bank. To achieve this, we need to align businesses, functions, technology, data, and operations behind a shared vision. This involves providing clear and documented processes between business strategy and the delivery of change...


  • Bengaluru, Karnataka, India Capgemini Engineering Full time

    About Capgemini EngineeringWe are committed to creating a diverse and inclusive work environment where everyone has equal opportunities to grow and succeed. All applications welcome and will be considered based on merit against the job and/or experience for the position.Overview of the Role:Data Scientist Developer/Architect is a senior-level position that...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: Principal Data ArchitectWe are seeking a highly experienced Innovation and Technology Lead to join our team at NTT DATA Services. This role requires strategic thinking, excellent leadership skills, and the ability to drive technology adoption and efficiency improvements across the organization.


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking an experienced Senior Cloud Data Architect to join our team at NTT DATA Services. As a key member of our data engineering team, you will be responsible for designing and implementing cloud-based data solutions on Azure Data platform.ResponsibilitiesDesign and develop big data processing notebooks using Azure DatabricksScripting...

  • Senior Data Architect

    1 month ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleNTT DATA Services is seeking a highly skilled Senior Data Architect to join our team in Bangalore, India.The Ideal CandidateThis is an exceptional opportunity for an experienced data professional to work with cutting-edge technologies and contribute to the design and development of innovative solutions. To be successful in this role, you will...


  • Bengaluru, Karnataka, India BlueCloud Full time

    Company Overview :BlueCloud is a cloud-forward transformation company that helps organizations migrate to the cloud. We enable enterprises to transform their business by providing practical strategies and technology solutions.Job Description :We are seeking a Senior Data Engineer to design, architect, and develop solutions leveraging cloud big data...


  • Bengaluru, Karnataka, India Capgemini Engineering Full time

    Job DescriptionCapgemini Engineering is seeking a seasoned AI Solutions Architect to lead our data science initiatives across India. As a key member of our team, you will be responsible for developing innovative AI and machine learning solutions that drive business growth and improvement.About the RoleThe ideal candidate will have at least 10-15 years of...


  • Bengaluru, Karnataka, India Cloudera Full time

    Job Title: Data Engineering ArchitectWe are seeking a highly skilled Data Engineering Architect to join our team at Cloudera. As a Senior Software Engineer, you will play a key role in designing and building scalable data systems using Hadoop, Spark, Kafka, Hive, and HBase.About the Role:The successful candidate will be responsible for conceptualizing,...


  • Bengaluru, Karnataka, India Capgemini Engineering Full time

    Job Title: Strategic IoT ArchitectCompany Overview: Capgemini Engineering is a global leader in engineering and R&D services. We are committed to delivering innovative solutions that transform industries and improve lives.Salary: The estimated salary for this role is $120,000 - $180,000 per annum, depending on experience and location.Job Description: We are...


  • Bengaluru, Karnataka, India Visionyle Solutions Full time

    Job Title : Lead or Sr Data EngineerWith a strong background in application development, we are seeking a seasoned Data Engineering Lead to join our team. This role involves architecting, designing, developing, and deploying data engineering solutions that meet business requirements.The ideal candidate will have 6+ years of experience in a similar role, with...

  • Data Architect

    2 months ago


    Bengaluru, Karnataka, India Freelance Full time

    Job Title: Data ArchitectJob Summary:We are seeking a highly skilled Data Architect to join our team at Freelance. As a Data Architect, you will be responsible for designing and implementing data architectures that meet the needs of our business.Key Responsibilities:Develop and maintain data architectures, including databases and large-scale processing...