Staff Software Engineer
2 weeks ago
The Cloud Platform Engineering team is responsible for the Platforms, Tools, and CI/CD pipelines at Calix.
We are looking for a GCP Cloud Platform Engineer to design, implement, and manage cloud infrastructure and data pipelines using Google Cloud Platform (GCP) services like DataStream, Dataflow, Apache Flink, Apache Spark, and Dataproc. The ideal candidate will have a strong background in DevOps practices, cloud infrastructure automation, and big data technologies. You will collaborate with data engineers, developers, and operations teams to ensure seamless deployment, monitoring, and optimization of data solutions.
Responsibilities:- Design and implement cloud infrastructure using IaC – Terraform etc.
- Automate provisioning and management of Dataproc clusters, Dataflow jobs, and other GCP resources
- Build and maintain CD pipelines for deploying data pipelines, streaming applications, and cloud infrastructure.
- Integrate tools like GitLab CI/CD, or Cloud Build for automated testing and deployment.
- Deploy and manage real-time and batch data pipelines using Dataflow, DataStream, and Apache Flink.
- Ensure seamless integration of data pipelines with other GCP services like Big Query, Cloud Storage, and Kafka or Pub/Sub.
- Implement monitoring and alerting solutions using Cloud Monitoring, Cloud Logging, and Prometheus.
- Monitor performance, reliability, and cost of Dataproc clusters, Dataflow jobs, and streaming applications.
- Optimize cloud infrastructure and data pipelines for performance, scalability, and cost-efficiency.
- Implement security best practices for GCP resources, including IAM policies, encryption, and network security.
- Ensure Observability is an integral part of the infrastructure platforms and provides adequate visibility about their health, utilization, and cost.
- Collaborate extensively with cross functional teams to understand their requirements; educate them through documentation/trainings and improve the adoption of the platforms/tools.
Education and Experience:
- 10+ years of overall experience in DevOps -cloud engineering, or data engineering.
- 3+ years of experience in DevOps, cloud engineering, or data engineering.
- Proficiency in Google Cloud Platform (GCP) services, including Dataflow, DataStream, Dataproc, Big Query, and Cloud Storage.
- Strong experience with Apache Spark and Apache Flink for distributed data processing.
- Knowledge of real-time data streaming technologies (e.g., Apache Kafka, Pub/Sub).
- Familiarity with data orchestration tools like Apache Airflow or Cloud Composer.
- Expertise in Infrastructure as Code (IaC) tools like Terraform or Cloud Deployment Manager.
- Experience with CI/CD tools like Jenkins, GitLab CI/CD, or Cloud Build.
- Knowledge of containerization and orchestration tools like Docker and Kubernetes.
- Strong scripting skills for automation (e.g., Bash, Python).
- Experience with monitoring tools like Cloud Monitoring, Prometheus, and Grafana.
- Familiarity with logging tools like Cloud Logging or ELK Stack.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
- Ability to work in a fast-paced, agile environment.
- India – (Flexible hybrid work model - work from Bangalore office for 20 days in a quarter)
-
Staff Software Engineer, Reliability
5 hours ago
Bengaluru, Karnataka, India Veeam Software Full time ₹ 12,00,000 - ₹ 24,00,000 per yearVeeam, the #1 global market leader in data resilience, believes businesses should control all their data whenever and wherever they need it. Veeam provides data resilience through data backup, data recovery, data portability, data security, and data intelligence. Based in Seattle, Veeam protects over 550,000 customers worldwide who trust Veeam to keep their...
-
Staff Software Engineer
2 weeks ago
Bengaluru, Karnataka, India Black Duck Software, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearBlack Duck Software, Inc. helps organizations build secure, high-quality software, minimizing risks while maximizing speed and productivity. Black Duck, a recognized pioneer in application security, provides SAST, SCA, and DAST solutions that enable teams to quickly find and fix vulnerabilities and defects in proprietary code, open source components, and...
-
Lead / Staff Software Engineer - SDET
2 days ago
Bengaluru, Karnataka, India Black Duck Software, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearBlack Duck Software, Inc. helps organizations build secure, high-quality software, minimizing risks while maximizing speed and productivity. Black Duck, a recognized pioneer in application security, provides SAST, SCA, and DAST solutions that enable teams to quickly find and fix vulnerabilities and defects in proprietary code, open source components, and...
-
Software QA Staff Engineer
2 weeks ago
Bengaluru, Karnataka, India Quest Software Full timeOverviewWe are seeking a dedicated Quality Assurance Engineer to join the One Identity Cloud team to ensure our products are delivered with high quality and meets customer expectations.You will collaborate with other technical staff to deliver consistently reliable hosted, SaaS solutions that support our users.ResponsibilitiesManaging test cases; defining...
-
Staff Software Development Engineer
4 days ago
Bengaluru, Karnataka, India Razorpay Software Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per yearRazorpay was founded by Shashank Kumar and Harshil Mathur in 2014. Razorpay is building a new-age digital banking hub (Neobank) for businesses in India with the mission is to enable frictionless banking and payments experiences for businesses of all shapes and sizes. What started as a B2B payments company is processing billions of dollars of payments for...
-
Staff Software Engineer
7 hours ago
Bengaluru, Karnataka, India Thomson Reuters Full time ₹ 12,00,000 - ₹ 36,00,000 per yearStaff Software Engineer- AIAre you passionate about building AI-driven software that transforms how professionals work? Join a dynamic and highly skilled team at Thomson Reuters, where we invest deeply in AI technologies and explore emerging fields with the backing of a global leader. As a Staff Software Engineer AI, you will play a lead role in...
-
Applications Engineering, Staff Engineer
4 days ago
Bengaluru, Karnataka, India Black Duck Software Full time ₹ 12,00,000 - ₹ 24,00,000 per yearBlack Duck Software, Inc. helps organizations build secure, high-quality software, minimizing risks while maximizing speed and productivity. Black Duck, a recognized pioneer in application security, provides SAST, SCA, and DAST solutions that enable teams to quickly find and fix vulnerabilities and defects in proprietary code, open source components, and...
-
Staff Software Engineer
4 days ago
Bengaluru, Karnataka, India PayPal Full time ₹ 12,00,000 - ₹ 36,00,000 per yearActs as a project or system leader, coordinating the activities of other engineers on the project or within the system Determines the technical tasks that other engineers will follow Actions result in the achievement of customer, operational, program or service objectives Proactively improves existing structures & processes Exercises judgement in reconciling...
-
Staff Software ML Engineer
7 hours ago
Bengaluru, Karnataka, India Netradyne Full time ₹ 20,00,000 - ₹ 25,00,000 per yearAbout NetradyneFounded in 2015, Netradyne is a technology company that leverages expertise in Artificial Intelligence, Deep Learning, and Edge Computing to bring transformational solutions to the transportation industry. Netradyne's technology is already deployed in thousands of vehicles; and our customers drive everything from passenger cars to...
-
Staff Software Engineer
1 week ago
Bengaluru, Karnataka, India Anonymous Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Description: Staff Software Engineer (ServiceNow HRSM)Company:Ecommerce RetailSub-function:Enterprise Business ServicesJob PurposeThe purpose of the Staff Software Engineer role is to lead the architectural design, development, and optimization of advanced, scalable HR Service Delivery and Management (HRSM) solutions using ServiceNow, Kafka, and MongoDB....