Cloud Platform Engineer

3 weeks ago


Bengaluru, Karnataka, India Calix Full time

Cloud Platform Engineer

We are seeking a skilled Cloud Platform Engineer to join our team at Calix. As a Cloud Platform Engineer, you will be responsible for designing, building, and maintaining large-scale cloud-native data lake infrastructure using Presto, Alluxio, S3, Hive, and Spark technologies.

Key Responsibilities:

  • Design and build scalable and reliable cloud-native data lake infrastructure.
  • Implement integration with Zookeeper for coordination and leader election across Datalake components.
  • Configure Presto to access and query data stored in Alluxio and S3, optimizing performance and resource utilization.
  • Deploy and manage Spark clusters for data processing and analytics tasks, leveraging Alluxio and S3 as storage layers.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement solutions that meet business objectives.
  • Develop and maintain automated workflows for data ingestion, processing, and transformation using Spark and other relevant tools.
  • Implement monitoring and alerting solutions to ensure the health and performance of the data lake infrastructure.
  • Provide technical guidance and support to junior team members, fostering a culture of continuous learning and improvement.

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or related field; or equivalent work experience.
  • 10+ years of experience as a Data Engineer or similar role, with expertise in building and managing cloud-native data lake infrastructure.
  • Strong proficiency in Presto, Alluxio, S3, Spark, Hive, and Zookeeper, with hands-on experience in designing and implementing solutions using these technologies.
  • Experience with Spark Administration, Hive administration, Presto administration, and AWS resource management.
  • Experience with monitoring of distributed systems.
  • Experience with infrastructure as code tools such as Terraform/Ansible for provisioning and managing cloud resources.
  • Experience with container orchestration platforms such as Kubernetes for deploying and managing Datalake components.
  • Solid understanding of distributed computing principles, data modeling, and database technologies.
  • Experience with serverless architecture would be a plus, such as Lambda and EMR.
  • Experience in Observability and Monitoring in AWS.
  • Fast learner and able to troubleshoot complex scenarios while processing large volumes of data (Terabytes and Petabytes).
  • Excellent problem-solving skills, with the ability to troubleshoot complex issues and implement effective solutions.
  • Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
  • Having Databricks experience would be an added advantage.

Optional Skills:

  • JVM tuning.
  • Alluxio cluster management.


  • Bengaluru, Karnataka, India ScaleneWorks Full time

    Job Title: Cloud Platform EngineerAbout the Role:We are seeking a skilled Cloud Platform Engineer to join our team at ScaleneWorks. As a Cloud Platform Engineer, you will be responsible for designing, building, and maintaining core services and infrastructure on Google Cloud Platform.Key Responsibilities:Experience with Google Cloud Platform and multi-cloud...


  • Bengaluru, Karnataka, India Motorola Solutions Kodiak Networks Full time

    Job Title: Cloud Platform EngineerAt Motorola Solutions, we're committed to helping people be their best in the moments that matter. As a Cloud Platform Engineer, you'll play a critical role in designing and implementing our cloud infrastructure and platform services, ensuring the reliability and security of our SaaS solutions for public safety customers.Key...


  • Bengaluru, Karnataka, India Motorola Solutions Full time

    Job Title: Cloud Platform EngineerAbout the Role:We are seeking a skilled Cloud Platform Engineer to join our team at Motorola Solutions. As a Cloud Platform Engineer, you will be responsible for designing and implementing continuous integration/continuous delivery (CI/CD) pipelines into multiple public cloud regions.Key Responsibilities:Design and implement...


  • Bengaluru, Karnataka, India Motorola Solutions Full time

    Job Title: Cloud Platform EngineerAbout the Role:We are seeking a skilled Cloud Platform Engineer to join our team at Motorola Solutions. As a Cloud Platform Engineer, you will be responsible for designing, implementing, and maintaining our cloud-based platform services.Key Responsibilities:Design and develop custom software solutions that centralize common...


  • Bengaluru, Karnataka, India Motorola Solutions Full time

    Job Title: Cloud Platform EngineerAt Motorola Solutions, we're committed to helping people be their best in the moments that matter. As a Cloud Platform Engineer, you'll play a critical role in designing and implementing our cloud-based solutions, ensuring the reliability and security of our services, and collaborating with cross-functional teams to drive...


  • Bengaluru, Karnataka, India Motorola Solutions Full time

    Job Title: Cloud Platform EngineerAt Motorola Solutions, we're committed to helping people be their best in the moments that matter. As a Cloud Platform Engineer, you'll play a critical role in designing and implementing our cloud-based solutions, ensuring the reliability and security of our services, and collaborating with cross-functional teams to drive...


  • Bengaluru, Karnataka, India SLK Full time

    Job Title: Cloud Platform EngineerAbout SLK Software: SLK Software Private Limited seeks a skilled Site Reliability Engineer (SRE) with expertise in Google Cloud Platform (GCP) and Java development.Job Responsibilities:Ensure the reliability, availability, and performance of cloud-based applications and services.Collaborate with development, operations, and...


  • Bengaluru, Karnataka, India Motorola Solutions Full time

    Job Title: Cloud Platform EngineerAt Motorola Solutions, we're driven by a shared purpose - to help people be their best in the moments that matter. As a Cloud Platform Engineer, you'll play a critical role in shaping the future of our safety and security ecosystem.Key Responsibilities:Design and implement continuous integration/continuous delivery (CI/CD)...


  • Bengaluru, Karnataka, India Commonwealth Bank Full time

    Job OverviewAs a Systems Engineer at Commonwealth Bank, you will be responsible for ensuring the stability and scalability of our cloud-based data platforms. This includes performing maintenance and support activities, as well as driving innovative process improvements that add significant business value.Key ResponsibilitiesDesign, develop, and maintain...


  • Bengaluru, Karnataka, India ScaleneWorks Full time

    **Job Summary**We are seeking a skilled Cloud Platform Engineer to join our team at ScaleneWorks. As a key member of our infrastructure team, you will be responsible for designing, building, and maintaining core services and infrastructure on Google Cloud Platform.**Key Responsibilities** Design and implement scalable and secure cloud-based infrastructure...


  • Bengaluru, Karnataka, India Cisco Full time

    Be Part of a High-Performance Team We are seeking a talented Cloud Engineer to join our team and contribute to the design, development, and operation of our cloud-based infrastructure, including collaboration with application development teams to ensure the reliability and performance of our infrastructure. Key Responsibilities Collaborate with software...


  • Bengaluru, Karnataka, India Wayfair Full time

    About the Role:We're looking for a seasoned engineering leader to join our Platform Reliability Engineering team at Wayfair. As a Cloud Platform Engineer Leader, you'll be responsible for designing and deploying scalable, durable, and resilient cloud-based platforms. Your expertise in cloud native design, software best practices, and infrastructure...


  • Bengaluru, Karnataka, India ADVA Full time

    Unlock Your PotentialAt ADVA, we're committed to innovation and growth. We're expanding our team and seeking talented individuals to join us in shaping the future of our cutting-edge platform.About the RoleThis is an exciting opportunity for an experienced engineer to take on a challenging and rewarding role, contributing to the development of our cloud...

  • Cloud Engineer

    6 days ago


    Bengaluru, Karnataka, India Aon Full time

    About Aon TechnologyAon Technology is responsible for supporting the delivery of global platforms in Aon, enabling enhanced productivity and value delivery at a truly enterprise scale. The team partners with teams across the organization to accelerate and drive the next wave of innovation on cloud.About the RoleAon is seeking an experienced Cloud Engineer to...


  • Bengaluru, Karnataka, India Motorola Solutions Full time

    Job Title: Cloud Platform EngineerAbout the Role:The Cloud Platform Engineering team at Motorola Solutions is responsible for designing and implementing continuous integration/continuous delivery (CI/CD) pipelines into multiple public cloud regions. As a Cloud Platform Engineer, you will be a key contributor to platform development activities, working on a...


  • Bengaluru, Karnataka, India Wayfair Full time

    About the RoleWayfair is a leader in the e-commerce space for all things home, and we're looking for a talented Cloud Native Platform Engineer to join our Platform Reliability Engineering team.We're a team of innovators who live and breathe modern technologies, and we're passionate about building scalable and reliable platforms that enable our customers to...


  • Bengaluru, Karnataka, India Wayfair Full time

    About the RoleWe're seeking a highly skilled Senior Cloud Engineer, Platforms to join our team at Wayfair. As a key member of our Cloud Engineering team, you will be responsible for designing, building, and maintaining scalable and reliable cloud-based systems that meet the needs of our e-commerce platform.Key ResponsibilitiesDesign and implement cloud-based...


  • Bengaluru, Karnataka, India DISH Network Full time

    Job Title: Cloud Native Platform EngineerAt DISH Network, we're reimagining the future of connectivity. Our Technology teams challenge the status quo and reimagine capabilities across industries. We're seeking a Cloud Native Platform Engineer to join our team and help us build a modern, hybrid cloud enterprise platform for all DISH to consume.Key...


  • Bengaluru, Karnataka, India DISH Network Full time

    Job Title: Cloud Native Platform EngineerJoin DISH Network Technologies, an EchoStar Company, in reimagining the future of connectivity. Our Technology teams challenge the status quo and reimagine capabilities across industries. As a Cloud Native Platform Engineer, you will play a vital role in connecting consumers with the products and platforms of...


  • Bengaluru, Karnataka, India Cloud Software Group Full time

    About This Team:At Cloud Software Group, we're pushing the boundaries of cloud-based solutions. Our Citrix Workspace App team is at the forefront, working on secure delivery of virtual apps to any device, anywhere. As a Senior Software Engineer, you'll be part of a collaborative and customer-focused environment, working well in a team. Expect a fast but...