Bigdata Platform Architect

3 days ago

Bangalore, India o9 Solutions, Inc. Full time

Be part of something revolutionary

At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact doesn’t stop there. Businesses that plan better and faster also reduce waste, which drives better outcomes for the planet, too.

We're on the lookout for the brightest, most committed individuals to join us on our mission. Along the journey, we’ll provide you with a nurturing environment where you can be part of something truly extraordinary and make a real difference for companies and the planet .

About the role...

Role: Bigdata Platform Architect / DevOps Architect

This role involves the management, installation, and configuration of Hadoop/Spark components (Hive, HDFS, Ambari, NiFi), as well as designing the architecture to integrate with the o9 platform. You will play a key role in the design, maintenance, and productionization of Hadoop/Spark/Delta Lake clusters, addressing daily production issues, and implementing containerization and automation to facilitate easier maintenance for the DevOps team.

Key Responsibilities:

  • Collaborate with customers and technical consultants to design and recommend big data architecture solutions tailored to customer requirements.
  • Analyze complex distributed production environments and provide actionable recommendations for performance optimization.
  • Develop and present detailed architectural documentation for customers' technical teams.
  • Partner with o9’s Development, DevOps, and project teams to ensure the successful execution of projects.
  • Design and implement distributed systems and configurations for Spark, Delta Lake, Hadoop, and related technologies, particularly in cloud-based deployments.
  • Produce and maintain comprehensive technical documentation and user manuals for customers.
  • Stay current with the latest advancements in the distributed big data ecosystem and cloud technologies.

Qualifications and Skills:

Experience:

  • 8+ years of experience in DevOps, with a focus on architecting large-scale storage, data processing, and globally distributed solutions.
  • Proven expertise in designing and deploying large-scale, data-intensive solutions using Spark, Delta Lake, and Airflow schedulers .
  • Strong experience designing and optimizing data queries within Spark/Delta Lake environments , using tools such as Apache Hive, HDFS, Apache Spark , and Hadoop.
  • Strong understanding of containerization and container orchestration using K8s to manage Spark jobs and other data-intensive applications
  • Experience with the installation, administration, and tuning of cloud-agnostic and distributed data systems.
  • Extensive experience implementing solutions across cloud platforms (Azure, AWS, GCP).
  • Hands-on experience implementing big data use cases and a solid understanding of standard design patterns for Spark/distributed systems, including Airflow, NiFi, Kafka , and others.
  • Significant experience working with network-based APIs , ideally REST/JSON or XML/SOAP.

Skills:

  • Strong understanding of enterprise security solutions such as LDAP, Kerberos, and SSL implementation.
  • Expertise in networking, troubleshooting, and optimizing data transfer across systems.
  • Proficient in Python and Java development, including debugging and profiling.
  • Solid background in database administration and design; experience with data modeling is a plus.
  • Excellent verbal and written communication skills.
  • Familiarity with R and machine learning algorithms is an advantage.

Personal Attributes:

  • Ability to effectively translate customer requirements into technical solutions.
  • A strong team player who values transparency, open communication, and collaboration. At o9, we prioritize teamwork across all levels and functions.

Roadmap for Architects or what you will do as an Architect

  • Develop and maintain tools that ensure smooth operations of o9's cloud-based solution;
  • Develop and deploy best-in-class tools that support continuous integration and continuous delivery processes;
  • Design and optimize Bigdata platform using Delta lake, Spark/pyspark (Distributed Architecture) using spark code and spark Architecture
  • Perform system and network administration; manage o9 platform deployment at AWS, Azure, Google Cloud; Use Dockers to deploy and manage containers; Monitor infrastructure health using ELK cluster; Administer databases that are part of o9 platforms using MS SQL, Mongo
  • Develop and debug Custom Integration service tasks

What we’ll do for you:

  • Flat organization: With a very strong entrepreneurial culture (and no corporate politics).
  • Great people and unlimited fun at work.
  • Possibility to really make a difference in a scale-up environment.
  • Support network: Work with a team you can learn from every day.
  • Diversity: We pride ourselves on our international working environment.
  • Work-Life Balance:
  • Feel part of A team:

How the process works…

  • Respond with your interest to us.
  • We’ll contact you either via video call or phone call - whatever you prefer, with the further schedule status.
  • HackerEarth Online Assessment - Scenario based
  • During the interview phase, you will meet with the technical panel for 60 minutes. We will contact you after the interview to let you know if we’d like to progress your application.
  • There will be 3 rounds of technical discussion followed by a Managerial Round.
  • We will let you know if you’re the successful candidate. Good luck

More about us…

With the latest increase in our valuation from $2.7B to $3.7B despite challenging global macroeconomic conditions, o9 Solutions is one of the fastest-growing technology companies in the world today. Our mission is to digitally transform planning and decision-making for the enterprise and the planet. Our culture is high-energy and drives us to aim 10x in everything we do.

Our platform, the o9 Digital Brain, is the premier AI-powered, cloud-native platform driving the digital transformations of major global enterprises including Google, Walmart, ABInBev, Starbucks and many others.

Our headquarters are located in Dallas, with offices in Amsterdam, Paris, London, Barcelona, Madrid, Sao Paolo, Bengaluru, Tokyo, Seoul, Milan, Stockholm, Sydney, Shanghai, Singapore and Munich.

o9 is an equal opportunity employer and seeks applicants of diverse backgrounds and hires without regard to race, colour, gender, religion, national origin, citizenship, age, sexual orientation or any other characteristic protected by law

  • Bigdata platform architect

    2 days ago

    Bangalore, India O9 Solutions, Inc. Full time

    Be part of something revolutionary At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...

  • o9 Solutions, Inc. | Bigdata Platform Architect | bangalore

    3 weeks ago

    bangalore, India o9 Solutions, Inc. Full time

    Be part of something revolutionaryAt o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact doesn’t...

  • o9 Solutions, Inc. | Bigdata Platform Architect

    3 days ago

    bangalore, India o9 Solutions, Inc. Full time

    Be part of something revolutionary At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...

  • o9 Solutions, Inc. | Bigdata Platform Architect | bangalore

    3 weeks ago

    bangalore, India o9 Solutions, Inc. Full time

    Be part of something revolutionary At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...

  • Bigdata (Pyspark, Hive)

    5 days ago

    Bangalore, India Tata Consultancy Services Full time

    Role - Bigdata (Pyspark, Hive) Experience - 3 to 8 yrs Location - Mumbai/Pune/Chennai Desired Competencies (Technical/Behavioral Competency) Must-Have Spark Pyspark Hive HBase Good-to-Have DQ tool Agile scrum experience Exposure in data ingestion from disparate sources onto big data platform

  • Tata Consultancy Services | Bigdata

    5 days ago

    bangalore, India Tata Consultancy Services Full time

    Role - Bigdata (Pyspark, Hive) Experience - 3 to 8 yrs Location - Mumbai/Pune/Chennai Desired Competencies (Technical/Behavioral Competency) Must-Have Spark Pyspark Hive HBase Good-to-Have DQ tool Agile scrum experience Exposure in data ingestion from disparate sources onto big data platform

  • Tata Consultancy Services | Bigdata

    7 days ago

    bangalore, India Tata Consultancy Services Full time

    Role - Bigdata (Pyspark, Hive)Experience - 3 to 8 yrsLocation - Mumbai/Pune/ChennaiDesired Competencies (Technical/Behavioral Competency)Must-HaveSparkPysparkHiveHBaseGood-to-HaveDQ toolAgile scrum experienceExposure in data ingestion from disparate sources onto big data platform

  • Platform Architect

    1 month ago

    bangalore, India developrec Full time

    Salesforce Platform Architect (SAP and Web Integration experience needed) Bengaluru/Remote – Contract role We are seeking an experienced Salesforce and Web Integration Platform Architect to lead the end-to-end architecture for the digital eB2B portal. This role requires deep expertise in Salesforce (including B2B Commerce, Experience Cloud, Service...

  • Platform Architect

    1 month ago

    bangalore, India developrec Full time

    Salesforce Platform Architect (SAP and Web Integration experience needed)Bengaluru/Remote – Contract roleWe are seeking an experienced Salesforce and Web Integration Platform Architect to lead the end-to-end architecture for the digital eB2B portal.This role requires deep expertise in Salesforce (including B2B Commerce, Experience Cloud, Service Cloud,...

  • Sr. Site Reliability Engineer-Bigdata

    1 month ago

    Bangalore, India Visa Full time

    Job DescriptionPerson will be responsible to Perform Big Data SRE and Engineering activities on multiple Open-source Hadoop, HBASE and Spark clustersStrong Troubleshooting and debugging skills.Responsible for Big Data Production environment which includes Hadoop (HDFS and YARN), Hive, Spark, Livy, Hbase, Trino etcExperience on Cloud platform and Kubernetes...

  • myGwork | Cloud Support Engineer

    5 days ago

    bangalore, India myGwork Full time

    This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.DESCRIPTION:AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market...

  • GCP Architect

    3 weeks ago

    Bangalore, India SkillRecruit Full time

    GCP Data Architect Exp-13+ Years Location- Bangalore , Chennai , Kolkata , Gurugram , Pune Mandatory Skills- GCP, GCS, ,Bigdata query ,SQL ,Data Flow, DataProc with Py spark, PUB/SUB ,Airflow, Python/ Spark( All mandate) Primary Roles and Responsibilities Selecting and integrating any Big Data tools and frameworks required to provide...

  • SkillRecruit | GCP Architect | bangalore

    4 weeks ago

    bangalore, India SkillRecruit Full time

    GCP Data Architect Exp-13+ Years Location- Bangalore , Chennai , Kolkata , Gurugram , Pune Mandatory Skills- GCP, GCS, ,Bigdata query ,SQL ,Data Flow, DataProc with Py spark, PUB/SUB ,Airflow, Python/ Spark( All mandate) Primary Roles and Responsibilities Selecting and integrating any Big Data tools and frameworks required to provide requested...

  • Custom platform architect

    2 days ago

    Bangalore, India Tata Electronics Full time

    EXPERIENCE This role requires a strategic thinker who can help in shaping up a custom platform to build custom apps in an efficient manner in terms of timelines, user experience, cost of build and cost of operations. The platform will support applications that includes user apps, workflows, checklists, dashboards and integration with enterprise...

  • DevOps Architect

    4 weeks ago

    Bangalore, India o9 Solutions, Inc. Full time

    Be part of something revolutionary At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...

  • DevOps Architect

    4 weeks ago

    Bangalore, India o9 Solutions, Inc. Full time

    Be part of something revolutionary At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...

  • SkillRecruit | GCP Architect | bangalore

    4 weeks ago

    bangalore, India SkillRecruit Full time

    GCP Data ArchitectExp-13+ YearsLocation-Bangalore , Chennai , Kolkata , Gurugram , PuneMandatory Skills- GCP, GCS, ,Bigdata query ,SQL ,Data Flow, DataProc with Py spark, PUB/SUB ,Airflow, Python/ Spark( All mandate)Primary Roles and ResponsibilitiesSelecting and integrating any Big Data tools and frameworks required to provide requested capabilitiesDevelop...

  • Soc platform architect

    2 days ago

    Bangalore, India Mulya Technologies Full time

    So C Platform Architect Founded by highly respected Silicon Valley veterans - with its design centers established in Santa Clara, California. / Hyderabad So C Platform Architect So C Platform Architect defines platform architecture & solutions enabling the next generation So C product for company's ARM Neoverse based client compute business line....

  • Power Platform Architect

    1 month ago

    bangalore, India LTIMindtree Full time

    Hello Candidate, We have an opening of PowerPlatform Architect. Location:- LTIM Pan India Office. Notice Period:- immediate joiner. Minimum Experience Required:- 07yrs+ Job Description:- As a low-code no-code solution engineer, you know how to harness the latest technologies by developing low-code platforms and creating user-friendly solutions for your...

  • Power Platform Architect

    1 month ago

    bangalore, India LTIMindtree Full time

    Hello Candidate,We have an opening of PowerPlatform Architect.Location:- LTIM Pan India Office.Notice Period:- immediate joiner.Minimum Experience Required:- 07yrs+Job Description:-As a low-code no-code solution engineer, you know how to harness the latest technologies by developing low-code platforms and creating user-friendly solutions for your...