Scalable Systems Engineer

1 day ago

Vizag, Andhra Pradesh, India beBeeDistributedSystems Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Title: Distributed Systems Engineer

Greetings from the world of Big Data and Real-Time Processing.

Job Description:

We are seeking a highly skilled Distributed Systems Engineer to join our team. As a key member of our organization, you will be responsible for designing, implementing, and managing large-scale distributed systems that process real-time data streams.

Required Skills and Qualifications:

  • Kafka Administration: Proven experience with Kafka administration, including installation, configuration, and management of large-scale clusters on-prem and in the cloud.
  • Big Data and Hadoop Ecosystem: Strong understanding of the Big Data and Hadoop ecosystem, including HDFS, YARN, MapReduce, and related tools.
  • Apache Spark: Experience with Apache Spark, including its core components, such as Spark Core, Spark SQL, and Spark Streaming.
  • Linux/Unix Systems and Windows Server: Proficiency in Linux/Unix systems and Windows Server, including shell scripting, system administration, and troubleshooting.
  • Automation Tools: Knowledge of automation tools like Ansible, Terraform, and GitOps.
  • CI/CD Tools: Familiarity with CI/CD tools like GitLab and Jenkins.
  • Monitoring Tools: Understanding of monitoring tools like Prometheus, Grafana, and Dynatrace.
  • Atlassian Stack: Experience with the Atlassian stack, including JIRA, Confluence, and Bitbucket.

Responsibilities:

  • Design and implement scalable distributed systems that process real-time data streams.
  • Manage and maintain large-scale Kafka clusters on-prem and in the cloud.
  • Perform upgrades, patches, and disaster recovery planning for Kafka clusters.
  • Ensure security, availability, scalability, and fault tolerance of Kafka clusters.
  • Monitor performance, collect metrics, and optimize configurations for Kafka clusters.
  • Automate Kafka cluster installations, topic/ACL/connector deployments.
  • Collaborate with developers and provide expertise on Kafka and related ecosystems.
  • Maintain documentation, SOPs, and best practices for Kafka administration.
  • Troubleshoot issues in Kafka and related ecosystems.

Good to Have:

  • Experience with IBM MQ/RabbitMQ.
  • Knowledge of Elasticsearch, Kubernetes, and ServiceNow.
  • Strong troubleshooting and collaboration skills.

  • Highly Scalable Systems Expert

    1 week ago

    Vizag, Andhra Pradesh, India beBeeSite Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Key Positions: Site Reliability EngineerWe are looking for an experienced professional in Site Reliability Engineering to work on critical systems reliability, scalability, and performance.

  • Unlock Career Opportunities in Scalable Data Engineering

    23 hours ago

    Vizag, Andhra Pradesh, India beBeeMachineLearning Full time ₹ 18,00,000 - ₹ 25,00,000

    Machine Learning Systems EngineerJob Description:We are seeking a seasoned Machine Learning Systems Engineer to join our team. As a key member of our engineering infrastructure team, you will be responsible for designing and implementing scalable data pipelines and engineering infrastructure to support our enterprise machine learning systems.The ideal...

  • Systems Engineer

    2 days ago

    Vizag, Andhra Pradesh, India beBeeInnovation Full time ₹ 30,00,000 - ₹ 40,00,000

    Job DescriptionWe're seeking experienced engineers skilled in cloud-native design, legacy maintenance and SRE best practices.The Observability team needs individuals who can collaborate across Tech to ensure platforms and services are production-ready.Influence the design and architecture of systems as part of a Cloud Enablement journey.Work with software...

  • Building Scalable Automation Systems

    6 days ago

    Vizag, Andhra Pradesh, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 25,00,000

    Automation ProfessionalWe are seeking a seasoned Automation Professional to join our team.About the Role:An automation-first mindset is key to driving business growth and efficiency. As an Automation Professional, you will be responsible for designing, building, and maintaining powerful automations using no-code and low-code tools.Main...

  • Building Scalable Backend Systems

    1 week ago

    Vizag, Andhra Pradesh, India beBeeEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Backend Software Engineer RoleThis role involves designing, building and maintaining scalable backend services for a cutting-edge CRM platform. Develop and implement efficient data models in Postgres with analytics layers.Build secure, multi-tenant features using role-based access control and audit logging.Key Requirements:The ideal candidate has at least 4...

  • Data Systems Engineer

    21 hours ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionAs a senior data engineer, you will be part of a team that collaborates with teams across the globe to build scalable and secure data processing systems. The role involves closely collaborating with engineering teams and product management in an agile fast-paced environment.The ideal candidate will have a proven record of building ETL and...

  • System Engineer

    6 days ago

    Vizag, Andhra Pradesh, India Numeric Technologies Full time

    Job Title: Serve/System Engineer IIILocation: Bangalore-hybrid(Three days a month)Shift Timing: 3PM to 12AM(might required to work on call if required)Notice Period: ImmediateYou Will:• Maintain and optimize collaboration systems, including preventive and corrective maintenance, capacity planning, and scalability.• Record and manage changes,...

  • AI Engineer for Scalable Application Development

    7 days ago

    Vizag, Andhra Pradesh, India beBeeArtificial Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: AI Engineering ManagerWe are seeking an experienced and skilled AI engineer to lead the design, development, and delivery of scalable AI-powered applications.Key Responsibilities:AI Solution Design: Develop and deploy AI-powered applications from scratch, covering backend, frontend, and AI integration.Large Language Model Development: Build and...

  • Scalable Solutions Developer

    1 week ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 10,00,000 - ₹ 20,00,000

    Job Title:Senior Data Engineer - Scalable Solutions We are seeking a highly skilled Senior Data Engineer to join our team. The successful candidate will have extensive experience in designing, building, and optimizing scalable data solutions on Google Cloud Platform (GCP) and AtScale. Key Responsibilities: Design and develop scalable data platforms and...

  • Senior Data Systems Engineer

    2 hours ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 10,00,000 - ₹ 14,00,000

    We are seeking a seasoned professional in data engineering to join our team.Job Overview:The ideal candidate will be responsible for designing, implementing, and maintaining large-scale data systems on AWS.Key Requirements:AWSPythonPySparkDatabricksThe successful candidate should have 3-5 years of experience in data engineering with a strong understanding of...