Staff Cloud Platform Engineer

3 weeks ago

Bengaluru, Karnataka, India Calix Full time
This position is based in Bangalore, India.

We, the Cloud Platform Engineering team at Calix are responsible for the Platforms, Tools, and CI/CD pipelines at Calix. Our mission is to enable Calix engineers to accelerate the delivery of world-class products while ensuring the high availability, reliability, security, and performance expected by our customers.

We are seeking Platform Engineers with proven expertise in the design and building of large-scale Cloud Infrastructure Platforms for Datalake to join our team and help us deliver the foundation on which Calix products can thrive. You will help us achieve our mission through innovative solutions.

Responsibilities:

  • Design, build, and maintain a scalable and reliable cloud-native data lake infrastructure using Presto, Alluxio, S3, Hive and Spark technologies.
  • Implement integration with Zookeeper for coordination and leader election across Datalake components.
  • Configure Presto to access and query data stored in Alluxio and S3, optimizing performance and resource utilization.
  • Deploy and manage Spark clusters for data processing and analytics tasks, leveraging Alluxio and S3 as storage layers.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement solutions that meet business objectives.
  • Develop and maintain automated workflows for data ingestion, processing, and transformation using Spark and other relevant tools.
  • Implement monitoring and alerting solutions to ensure the health and performance of the data lake infrastructure.
  • Provide technical guidance and support to junior team members, fostering a culture of continuous learning and improvement.

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or related field; or equivalent work experience.
  • 10+ years of experience as a Data Engineer or similar role, with expertise in building and managing cloud-native data lake infrastructure.
  • Strong proficiency in Presto, Alluxio, S3, Spark, Hive and Zookeeper, with hands-on experience in designing and implementing solutions using these technologies.
  • Experience with Spark Administration, Hive administration, Presto administration and AWS resource management.
  • Experience with monitoring of distributed systems.
  • Experience with infrastructure as code tools such as Terraform/Ansible for provisioning and managing cloud resources.
  • Experience with container orchestration platforms such as Kubernetes for deploying and managing Datalake components.
  • Solid understanding of distributed computing principles, data modelling, and database technologies.
  • Experience with serverless architecture would be plus like Lambda and EMR
  • Experience in Observability and Monitoring in AWS.
  • Fast learner and able to troubleshoot complex scenarios while process large volumes of data (Terabytes and Petabytes)
  • Excellent problem-solving skills, with the ability to troubleshoot complex issues and implement effective solutions.
  • Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
  • Having Databricks experience will be an added advantage.

Optional Skills:

  • JVM tuning. 
  • Alluxio cluster management. 

  • Staff Platform Engineer

    16 hours ago

    Bengaluru, Karnataka, India Stackhire Full time

    Job Title : Staff Platform Engineer Location : Bangalore, India (Hybrid) Job Overview : MontyCloud is seeking an exceptional Staff Platform Engineer, a seasoned individual contributor with deep technical expertise and a strategic mindset. This role is hands-on, requiring active participation in coding, feature development, and solving complex engineering...

  • Staff Platform Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Stackhire Full time

    Job Title : Staff Platform EngineerLocation : Bangalore, India (Hybrid)Job Overview :MontyCloud is seeking an exceptional Staff Platform Engineer, a seasoned individual contributor with deep technical expertise and a strategic mindset. This role is hands-on, requiring active participation in coding, feature development, and solving complex engineering...

  • Staff Platform Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Stackhire Full time

    Job Title : Staff Platform EngineerLocation : Bangalore, India (Hybrid)Job Overview :MontyCloud is seeking an exceptional Staff Platform Engineer, a seasoned individual contributor with deep technical expertise and a strategic mindset. This role is hands-on, requiring active participation in coding, feature development, and solving complex engineering...

  • Staff/Lead Platform Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Antal Full time

    Job Description :Job Title : Staff Platform EngineerLocation : Bangalore, India (Hybrid)About Company : This company is a leading innovator in cloud management, focused on transforming how organizations manage and optimize their cloud infrastructure. They offer cutting-edge solutions that simplify complex cloud environments, enabling businesses to scale...

  • Staff/Lead Platform Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Antal Full time

    Job Description :Job Title : Staff Platform EngineerLocation : Bangalore, India (Hybrid)About Company : This company is a leading innovator in cloud management, focused on transforming how organizations manage and optimize their cloud infrastructure. They offer cutting-edge solutions that simplify complex cloud environments, enabling businesses to scale...

  • Staff Platform Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Reltio Full time

    Staff Platform Engineer - DevOps at Reltio (View all jobs) Bangalore At Reltio, we believe data should fuel business success. Reltio's AI-powered data unification and management capabilities—encompassing entity resolution, multi-domain master data management (MDM), and data products—transform siloed data from disparate sources into unified,...

  • Staff Platform Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Commonwealth Bank Full time

    Job DescriptionOrganization:At CommBank, we never lose sight of the role we play in other people's financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent,...

  • Staff Platform Engineer

    3 weeks ago

    Bengaluru, Karnataka, India IG Group Full time

    Job Title Staff Platform EngineerStaff Platform EngineerAs a Staff Platform Engineer you will be managing and supporting the Linux infrastructure and the web technologies and constantly improving the platform with the shift left approach where every developer engineer is made self-sufficient with the platform solutions build to speed up their deliverables...

  • Staff Platform Engineer

    3 weeks ago

    Bengaluru, Karnataka, India IG Group Full time

    Job Description Staff Platform Engineer As a Staff Platform Engineer, you will be managing and supporting the Linux infrastructure and the web technologies and constantly improving the platform with the shift left approach where every developer/engineer is made self-sufficient with the platform solutions build to speed up their deliverables with...

  • Platform Engineering Engineer 3

    2 days ago

    Bengaluru, Karnataka, India Amadeus Full time

    Job Title Platform Engineering Engineer 3Common accountabilities - Works autonomously within defined processes and procedures or methodologies takes standard decisions and may support the development of solutions to complex problems of a recurring nature xe2x80x8b- Receives instruction guidance and direction from more senior level roles or manager with...

  • Cloud Platform Engineer

    5 days ago

    Bengaluru, Karnataka, India Motorola Solutions Full time

    About Motorola SolutionsAt Motorola Solutions, we're driven by a shared purpose - to help people be their best in the moments that matter. Our mission is to solve for safer by building the best possible technologies across every part of our safety and security ecosystem.The Cloud Platform Engineering TeamWe're responsible for developing and operating...

  • Cloud Engineer Lead

    13 hours ago

    Bengaluru, Karnataka, India TIDE PLATFORM TECHNOLOGY AND SERVICING PVT LTD Full time

    At Tide Platform Technology and Servicing Pvt Ltd, we are revolutionizing the finance industry with our cutting-edge platform designed to empower small businesses. Our mission is to provide innovative banking solutions that save time and money, while expanding into new markets.About the RoleWe are seeking a highly experienced Principal Cloud Engineer to join...

  • Staff Backend Software Engineer, Enterprise AI Platform

    3 weeks ago

    Bengaluru, Karnataka, India Cloudera Full time

    Job Description :  At Cloudera, we empower people to transform complex data into clear and actionable insights. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world's largest enterprises.   Join our Cloudera's Machine Learning Platform team as a Staff Backend Software Engineer. You'll...

  • Staff Platform Engineer – Network

    1 week ago

    Bengaluru, Karnataka, India Commonwealth Bank Full time

    Job DescriptionAs a Staff Platform Engineer - Network Automation Team, you will be focused on Network centric Automation and Systems, you will be at the forefront of designing, developing and implementing custom software driven automation solutions for integrating and managing network elements such as Firewalls, Switches and other Network Assets. You will...

  • Cloud Platform Engineer

    15 hours ago

    Bengaluru, Karnataka, India Guidewire Software Full time

    At Guidewire, we combine digital, core, analytics, and AI to deliver our platform as a cloud service. Our mission is to help Property and Casualty insurers engage, innovate, and grow efficiently.We are seeking a skilled Cloud Platform Engineer to join our team. As a key member of our engineering organization, you will be responsible for designing and...

  • Cloud Platform Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Continental Full time

    Job Description Continental's digital capabilities are growing every day. Our global Cloud Services team is at the forefront of this transformation, establishing scalable, secure, and efficient cloud platforms that power our innovative solutions worldwide. We are seeking an experienced Cloud Platform Engineer to design, implement, and maintain our...

  • Cloud Platform Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Continental Full time

    Job DescriptionContinental's digital capabilities are growing every day. Our global Cloud Services team is at the forefront of this transformation, establishing scalable, secure, and efficient cloud platforms that power our innovative solutions worldwide. We are seeking an experienced Cloud Platform Engineer to design, implement, and maintain our enterprise...

  • Cloud Platform Engineer

    7 days ago

    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    We are looking for a Cloud Platform Engineer to join our team at Coders Brain Technology Private Limited. In this role, you will be responsible for providing technical support for our cloud platform, ensuring system performance, and collaborating with various teams to enhance user experience.About the Role:Provide technical support for platform-related...

  • Senior Cloud and IoT Application Developer

    13 hours ago

    Bengaluru, Karnataka, India Swift Strategic Staff Solutions INC Full time

    **About the Role:**We are seeking a highly skilled Senior Cloud and IoT Application Developer to join our team at Swift Strategic Staff Solutions INC. As a key member of our technology services client, you will be responsible for designing, developing, and maintaining high-performance C++ applications for IoT devices and cloud platforms.The ideal candidate...

  • Cloud Platform Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Continental Full time

    Job DescriptionContinental's digital capabilities are growing every day. Our global Cloud Services team is at the forefront of this transformation, establishing scalable, secure, and efficient cloud platforms that power our innovative solutions worldwide. We are seeking an experienced Cloud Platform Engineer to develop, implement, and maintain our enterprise...