Big Data Specialist
2 weeks ago
At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact doesn’t stop there. Businesses that plan better and faster also reduce waste, which drives better outcomes for the planet, too.
We're on the lookout for the brightest, most committed individuals to join us on our mission. Along the journey, we’ll provide you with a nurturing environment where you can be part of something truly extraordinary and make a real difference for companies and the planet.
About the role….
- Design and build data pipelines with an emphasis on scale, performance, and reliability.- Provide technical expertise in the areas of design and implementation of planning solutions powered by Delta Lake Lakehouses implemented in-house.- Partner with the data teams, and enterprise architecture organization to ensure the best use of standards for the key data domains and use cases.- Continuous learner with an eye on emerging trends around data lake architecture and enterprise data solutions.- Support retail planning implementations which are time-critical
What you will do…….
Distributed Compute and Storage
- Write PySpark code, debug Spark errors, perform Root Cause Analysis and suggest solutions/workarounds.- Familiarity with Spark settings and changes needed to reduce run time.- Modify data storage and read/write architecture of existing distributed workloads to optimize the runtime.- Work with big data constructs such as Spark, HDFS, HIVE, and DeltaLake and apply them to o9 needs.- Work with containers and K8, Cloud constructs like S3 and large VM clusters to support Retail Supply Planning workloads.
Mentoring and Training
- Package, document and create training content with active demonstrations and iterative workshops with the broader implementation and customer teams. Educate cross-functional teams during the product life cycle.- Coach and ramp up team members to become independent contributors.
Product
- Participate in the process of collecting and understanding business / technical requirements with external (customers) and internal teams.- Work with Architects to translate business requirements to functional specifications and use cases and work with them to implement such features in the Supply Planning Product.- Help the team to improve platform capabilities.
What you will have….
Must Have
- BE, MCA or MS degree in Computer Science or Information Technology- 5-8 years of experience building solutions in big data technologies.- Strong experience programming with both Python, Pyspark and SPARK SQL.- Hands-on experience designing and building streaming data pipelines using Airflow, Kafka etc.- Must have experience building Data Lake and data warehouse solutions using ETL, and ELT pipelines on any of Databricks, Snowflake, Azure Data Lake etc.- Strong understanding of database and analytical technologies in the industry including modelling with OLAP databases- Strong understanding of cloud platforms like AWS, Azure, or GCP, and their services (e.g., EC2, S3, AKS, EKS, etc.).- Experience in continuous delivery through containers, and orchestration technologies.- Experience with Data Manipulation Libraries like Ray, and Polars is mandatory.- Ability to prioritize and manage work to critical project timelines in a fast-paced environment.
Nice to have:
- Experience with graph manipulation libraries on Spark (like GraphX) is an added advantage.- Supply Chain Planning software industry experience is an added advantage.- Databricks Certified Associate Developer for Apache Spark 3.0- Added advantage for experience in Scala on Spark.- Added advantage for experience with HDFS and HQL- AWS or any public cloud certification is a must.
More about us…
With the latest increase in our valuation from $2.7B to $3.7B despite challenging global macroeconomic conditions, o9 Solutions is one of the fastest-growing technology companies in the world today. Our mission is to digitally transform planning and decision-making for the enterprise and the planet. Our culture is high-energy and drives us to aim 10x in everything we do.
Our platform, the o9 Digital Brain, is the premier AI-powered, cloud-native platform driving the digital transformations of major global enterprises including Google, Walmart, ABInBev, Starbucks and many others.
Our headquarters are located in Dallas, with offices in Amsterdam, Paris, London, Barcelona, Madrid, Sao Paolo, Bengaluru, Tokyo, Seoul, Milan, Stockholm, Sydney, Shanghai, Singapore and Munich.
o9 is an equal opportunity employer and seeks applicants of diverse backgrounds and hires without regard to race, colour, gender, religion, national origin, citizenship, age, sexual orientation or any other characteristic protected by law
-
Azure Big Data Specialist
1 month ago
Bengaluru, India Global Pharma Tek Full timeREQ – – REFQ Azure Big Data Specialist No Industrial Layout Hosur Road Koramangala, Bengaluru, in Full-time Legal Entity: Bosch Global Software Technologies Private Limited Company Description Bosch Global Software Technologies Private Limited is a % owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of...
-
Bengaluru, India Société Générale Assurances Full timeSpecialist Software Engineer(Big Data)Permanent contract|Bangalore|IT (Information Technology)Specialist Software Engineer(Big Data)Bangalore, IndiaPermanent contractIT (Information Technology)ResponsibilitiesResponsible for understanding the software requirements and developing it into a working source code accordingly.Take accountability of delivering high...
-
Big Data Specialist
4 weeks ago
Bengaluru, India Tavant Full timeWith 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and...
-
Bengaluru, India Société Générale Assurances Full timeSpecialist Software Engineer(Big Data) Permanent contract|Bangalore|IT (Information Technology) Specialist Software Engineer(Big Data) Bangalore, India Permanent contract IT (Information Technology) Responsibilities Responsible for understanding the software requirements and developing it into a working source code accordingly. ...
-
Big Data Specialist
1 week ago
Bengaluru, India Tavant Full timeAbout The CompanyWith 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Consumer Lending, Manufacturing, Agtech, Media & Entertainment, and Retail in...
-
Big Data Specialist
4 weeks ago
Bengaluru, India Tavant Full timeWith 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and...
-
Big Data Specialist
4 weeks ago
Bengaluru, India Tavant Full timeWith 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and...
-
Big Data Architect
4 weeks ago
Bengaluru, India RiskInsight Consulting Pvt Ltd Full timeResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...
-
Big Data Specialist
3 weeks ago
Bengaluru, India o9 Solutions, Inc. Full timeBe part of something revolutionary.At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...
-
Big Data
1 month ago
Bengaluru, India AR TECHNOLOGY Full timeBig Data Developer **(Spark + Scala/ Python)** Exp **:5-9 Years** Key Pointers: - Hands-on with Spark + Scala **OR** Spark + Python - Excellent **coding experience** - Excellent communication experience Locations **:Bangalore, Chennai** JOB DETAILS - 1. Must have 3 years of hands-on working knowledge on Big Data technologies such as Hadoop, Spark,...
-
Big Data Developer
4 weeks ago
Bengaluru, India Unison Consulting Pte Ltd Full timeJob Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...
-
Big Data Architect
1 month ago
Bengaluru, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize...
-
Big Data Engineer
3 days ago
Bengaluru, India Virtusa Full timeBig Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible....
-
Big Data Engineer
1 day ago
Bengaluru, India Virtusa Full timeBig Data Engineer - CREQ188642 DescriptionLooking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible.Bachelor's...
-
Big Data Developer
1 month ago
Bengaluru, India Unison Consulting Pte Ltd Full timeJob Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...
-
Big Data Specialist
3 weeks ago
Bengaluru, India o9 Solutions, Inc. Full timeBe part of something revolutionary.At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...
-
Big Data Specialist
3 weeks ago
Bengaluru, India o9 Solutions, Inc. Full timeBe part of something revolutionary. At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...
-
Big Data Specialist
3 weeks ago
Bengaluru, India o9 Solutions, Inc. Full timeBe part of something revolutionary.At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...
-
Big Data Analyst
4 weeks ago
Bengaluru, India Corporate Resources Full timeJob DescriptionBig data analyst with knowledge of big data technologies and ability to analyze large volumes of data and bring out insightsReporting and presenting on data insightsHandson knowledge of scripting and using Big data toolsData analysis and processingIndustryIT-Software / Software ServicesFunctional AreaIT Software - Application Programming,...
-
Big Data Architect
4 weeks ago
Bengaluru, Karnataka, India Unison Consulting Full time**Responsibilities**: Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data...
