Bigdata platform architect

6 days ago

Bengaluru, India O9 Solutions, Inc. Full time
Be part of something revolutionary
At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact doesn’t stop there. Businesses that plan better and faster also reduce waste, which drives better outcomes for the planet, too.
We're on the lookout for the brightest, most committed individuals to join us on our mission. Along the journey, we’ll provide you with a nurturing environment where you can be part of something truly extraordinary and make a real difference for companies and the planet.
About the role...
Role: Bigdata Platform Architect / Dev Ops Architect
This role involves the management, installation, and configuration of Hadoop/Spark components (Hive, HDFS, Ambari, Ni Fi), as well as designing the architecture to integrate with the o9 platform. You will play a key role in the design, maintenance, and productionization of Hadoop/Spark/Delta Lake clusters, addressing daily production issues, and implementing containerization and automation to facilitate easier maintenance for the Dev Ops team.
Key Responsibilities:
Collaborate with customers and technical consultants to design and recommend big data architecture solutions tailored to customer requirements.
Analyze complex distributed production environments and provide actionable recommendations for performance optimization.
Develop and present detailed architectural documentation for customers' technical teams.
Partner with o9’s Development, Dev Ops, and project teams to ensure the successful execution of projects.
Design and implement distributed systems and configurations for Spark, Delta Lake, Hadoop, and related technologies, particularly in cloud-based deployments.
Produce and maintain comprehensive technical documentation and user manuals for customers.
Stay current with the latest advancements in the distributed big data ecosystem and cloud technologies.
Qualifications and Skills:
Experience:
8+ years of experience in Dev Ops, with a focus on architecting large-scale storage, data processing, and globally distributed solutions.
Proven expertise in designing and deploying large-scale, data-intensive solutions using Spark, Delta Lake, and Airflow schedulers.
Strong experience designing and optimizing data queries within Spark/Delta Lake environments , using tools such as Apache Hive, HDFS, Apache Spark , and Hadoop.
Experience with the installation, administration, and tuning of cloud-agnostic and distributed data systems.
Extensive experience implementing solutions across cloud platforms (Azure, AWS, GCP).
Hands-on experience implementing big data use cases and a solid understanding of standard design patterns for Spark/distributed systems, including Airflow, Ni Fi, Kafka , and others.
Significant experience working with network-based APIs , ideally REST/JSON or XML/SOAP.
Skills:
Strong understanding of enterprise security solutions such as LDAP, Kerberos, and SSL implementation.
Expertise in networking, troubleshooting, and optimizing data transfer across systems.
Proficient in Python and Java development, including debugging and profiling.
Solid background in database administration and design; experience with data modeling is a plus.
Excellent verbal and written communication skills.
Familiarity with R and machine learning algorithms is an advantage.
Personal Attributes:
Ability to effectively translate customer requirements into technical solutions.
A strong team player who values transparency, open communication, and collaboration. At o9, we prioritize teamwork across all levels and functions.
Roadmap for Architects or what you will do as an Architect
Develop and maintain tools that ensure smooth operations of o9's cloud-based solution;
Develop and deploy best-in-class tools that support continuous integration and continuous delivery processes;
Design and optimize Bigdata platform using Delta lake, Spark/pyspark (Distributed Architecture) using spark code and spark Architecture
Perform system and network administration; manage o9 platform deployment at AWS, Azure, Google Cloud; Use Dockers to deploy and manage containers; Monitor infrastructure health using ELK cluster; Administer databases that are part of o9 platforms using MS SQL, Mongo
Develop and debug Custom Integration service tasks
What we’ll do for you:
Flat organization: With a very strong entrepreneurial culture (and no corporate politics).
Great people and unlimited fun at work.
Possibility to really make a difference in a scale-up environment.
Support network: Work with a team you can learn from every day.
Diversity: We pride ourselves on our international working environment.
Work-Life Balance: UPATBA?feature=shared
Feel part of A team: Cyhes?feature=shared
How the process works…
Respond with your interest to us.
We’ll contact you either via video call or phone call - whatever you prefer, with the further schedule status.
Hacker Earth Online Assessment - Scenario based
During the interview phase, you will meet with the technical panel for 60 minutes. We will contact you after the interview to let you know if we’d like to progress your application.
There will be 2 rounds of technical discussion followed by a Managerial Round.
We will let you know if you’re the successful candidate. Good luck
More about us…
With the latest increase in our valuation from $2.7 B to $3.7 B despite challenging global macroeconomic conditions, o9 Solutions is one of the fastest-growing technology companies in the world today. Our mission is to digitally transform planning and decision-making for the enterprise and the planet. Our culture is high-energy and drives us to aim 10x in everything we do.
Our platform, the o9 Digital Brain, is the premier AI-powered, cloud-native platform driving the digital transformations of major global enterprises including Google, Walmart, ABIn Bev, Starbucks and many others.
Our headquarters are located in Dallas, with offices in Amsterdam, Paris, London, Barcelona, Madrid, Sao Paolo, Bengaluru, Tokyo, Seoul, Milan, Stockholm, Sydney, Shanghai, Singapore and Munich.
o9 is an equal opportunity employer and seeks applicants of diverse backgrounds and hires without regard to race, colour, gender, religion, national origin, citizenship, age, sexual orientation or any other characteristic protected by law

  • BigData Lead Developer

    5 days ago

    Bengaluru, Karnataka, India airbus Full time

    About Airbus India Private LimitedWe are seeking a highly skilled BigData Lead Developer - Data Architect to join our team in Bengaluru, India. As a key member of our organization, you will play a critical role in designing and developing high-quality server-side processing solutions using Python and PySpark.

  • Lead Bigdata Developer/ Lead Bigdata Engineer

    4 weeks ago

    Bengaluru, India Atyeti Inc Full time

    Job Description: Analyze, organize and process raw data using Bigdata technologies and ScalaPerform data validation, cleaning and transformation using big data technologies, Spark and ScalaIngest and manage data in HDFS/Hive and analyse data using Spark and produce meaningful insights for the business team.6+ years of high-tech industry and/or IT work...

  • BigData Specialist

    3 weeks ago

    Bengaluru, Karnataka, India airbus Full time

    Job Title: BigData SpecialistJob Description:You will join the Airbus team in charge of BigData Developpements & Support. Your mission will be to deliver innovative IT solutions that support digital transformation and efficient operations for customer services. More precisely, you will be dedicated to support Customer Services activities related to the...

  • Bigdata Engineer

    2 months ago

    Bengaluru, India Weekday Full time

    This role is for one of theWeekdaysclientsResponsibilities:Actas a handson coder with expertise in programming languages such asJava Python or Scala.Work extensively with BigData technologies like Hadoop MapReduce Spark HBase andElasticsearch.Apply solid knowledge ofprogramming principles and best development practices includingversion control policies unit...

  • Java BigData Architect

    4 weeks ago

    Bengaluru, Karnataka, India Daxx Full time

    Key ResponsibilitiesAs a Java BigData Engineer at Grid Dynamics, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Java. Your expertise in Linux OS, CPU performance, load average, network analysis, memory utilization, and JVM garbage collection strategies will be crucial in optimizing our data...

  • Big Data Architect

    6 months ago

    Bengaluru, India I Square Soft Full time

    Big Data Architect Job Description Candidate is responsible for guiding the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design, Infra design and build, testing, and deployment This position requires building the Bigdata/Hadoop/NoSQL DB capability in Infrastructure services under...

  • Data Architect for Machine Learning Platforms

    1 week ago

    Bengaluru, Karnataka, India MakeMyTrip Full time

    We are seeking an experienced Data Architect to lead the design and development of our machine learning platforms. This role will play a crucial part in empowering our customers with personalized experiences through data-driven insights.About UsMakeMyTrip is a leading online travel company, providing petabytes of raw data that fuels business growth,...

  • Java BigData Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Daxx Full time

    Job Description:We are seeking a highly skilled Java BigData Engineer to join our team. In this role, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement efficient data processing pipelines using Java and related technologies.Develop and maintain high-performance...

  • Senior Software Architect for Distributed Systems

    1 day ago

    Bengaluru, Karnataka, India LinkedIn Full time

    Role OverviewLeverage your expertise in designing and building large-scale distributed systems to drive business impact at LinkedIn. As a Senior Software Architect for Distributed Systems, you will be responsible for architecting the next-generation infrastructure and platforms that power our applications.About the RoleYou will work closely with...

  • Architect - Platform Integrations

    6 months ago

    Bengaluru, Karnataka, India Vunet Systems Full time

    Bengaluru Job ID : 1061 **Join Our Journey at VuNet**: At VuNet, we're at the forefront of developing an innovative Business Observability platform. Our approach integrates big data and machine learning to revolutionize how customer journeys are monitored and user experiences enhanced. Our cutting-edge solutions are transforming digital payment experiences...

  • IoT Solution Architect

    4 weeks ago

    Bengaluru, Karnataka, India Umanist Staffing LLC Full time

    Role Overview:The Umanist Staffing LLC is seeking a highly skilled IoT Solution Architect to play a crucial role in designing and implementing end-to-end solutions for IoT projects. The successful candidate will be responsible for understanding client requirements, designing scalable and secure architecture, and integrating various IoT components to deliver...

  • Platform Architect

    2 months ago

    Bengaluru, Karnataka, India HyreSpree Full time

    Job Role: Platform Architect Position - 1 Location - Bangalore Experience : 8+ Yrs Skills: *In-depth knowledge in architecting and building multi-tenant SaaS platform systems that are scalable, ensuring data security and isolation *In-depth knowledge and proficiency in various technologies, programming languages, and software development methodologies,...

  • Platform architect

    2 weeks ago

    Bengaluru, India Developrec Full time

    Salesforce Platform Architect (SAP and Web Integration experience needed)Bengaluru/Remote – Contract roleWe are seeking an experienced Salesforce and Web Integration Platform Architect to lead the end-to-end architecture for the digital e B2 B portal.This role requires deep expertise in Salesforce (including B2 B Commerce, Experience Cloud, Service Cloud,...

  • Platform Architect

    2 weeks ago

    Bengaluru, India developrec Full time

    Salesforce Platform Architect (SAP and Web Integration experience needed)Bengaluru/Remote – Contract roleWe are seeking an experienced Salesforce and Web Integration Platform Architect to lead the end-to-end architecture for the digital eB2B portal.This role requires deep expertise in Salesforce (including B2B Commerce, Experience Cloud, Service Cloud,...

  • Big Data Solutions Architect-[ Splunk, Hadoop]

    5 months ago

    Bengaluru, India Nutanix Full time

    **_Hungry, Humble, Honest, with a Heart. _** **The Opportunity**: Nutanix Solutions team oversees creating Nutanix Validated Designs, Reference Architectures, Technical Notes, and Best Practices Guides in multiple verticals like Hybrid Cloud, Networking, EUC, Database, SAP, Security, and networking. We are looking for an experienced BigData Specialist, who...

  • Principal ML Ops Architect

    2 months ago

    Bengaluru, India Tetrahed INC Full time

    Principal ML OpsArchitectResponsibilities:1.Strategic Leadership:a.Define and drive the overall ML Ops strategy and roadmap for theorganization aligning it with business objectives and technicalcapabilities.b. Oversee the designdevelopment and implementation of ML Ops platforms frameworks andprocesses.c. Foster a culture of innovationand continuous...

  • IoT Solution Architect

    2 months ago

    Bengaluru, India Umanist Staffing LLC Full time

    Overview:The IoTSolution Architect plays a crucial role in designing andimplementing endtoend solutions for IoT projects. They areresponsible for understanding client requirements designingscalable and secure architecture and integrating various IoTcomponents to deliver innovative solutions. The IoT SolutionArchitect works closely with crossfunctional teams...

  • Cloud Infrastructure Architect

    1 week ago

    Bengaluru, Karnataka, India Modus Enterprise Transformation Platform Full time

    About Modus Enterprise Transformation PlatformModus Enterprise Transformation Platform is a leading innovator in cloud infrastructure solutions. We are seeking a highly skilled Cloud Infrastructure Architect to join our team.

  • Senior Bigdata Developer

    4 weeks ago

    Bengaluru, Karnataka, India Guidewire Software Full time

    Guidewire Software is seeking a skilled Senior Bigdata Developer to join its Data Platform and Analytics team. The ideal candidate will have prior experience in building large-scale, cloud-native data platforms and analytics SaaS services in the public cloud.This team owns, builds, and operates Guidewire's cloud-native data platform and analytics SaaS...

  • Software Architect

    4 weeks ago

    Bengaluru, Karnataka, India Applied Materials Full time

    Key Responsibilities:As a key member of the Applied Materials team, this Software Architect will be responsible for designing and implementing high-performance, robust solutions.Technical Requirements:Proven expertise in Python, Elasticsearch, FastApi, and Python Scripting.Experience with custom search and analytics application development using FastApi and...