Big Data Messaging Systems Engineer

2 days ago

Tirupati, Andhra Pradesh, India beBeeMessaging Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

As a scalable messaging systems engineer, you will be responsible for designing automated migration pipelines for moving enterprise data processing workloads to open-source or cloud-native clusters.

Key Responsibilities:
  • Design and script migration steps, automate validation, rollback, and monitoring tasks.
  • Develop and integrate custom plugins for message queue integration as part of migration workflows.
  • Build scalable continuous integration/continuous deployment processes for resource provisioning and configuration rollouts.
  • Ensure automated tests cover data integrity, performance, and interface post-migration.
  • Integrate with cloud orchestration (AWS MSK, Kubernetes operators), manage infrastructure-as-code.

Our ideal candidate will have experience with:

Desirable Skills:
  • CI/CD (Jenkins, GitHub Actions), Infrastructure as Code (Terraform, CloudFormation)
  • Data messaging system administration and migration
  • Scripting (Python, Go, Bash)
  • Messaging system integration custom plugin API, Maven/Gradle
  • Containerization (Docker, Kubernetes)
  • Monitoring/validation: Prometheus, Grafana
  • Automation of rollback/validation steps for migrations
  • Exposure to cloud services (AWS, GCP, Azure)
  • Data operations and security automation

We are looking for someone who is passionate about building reliable and efficient data processing systems, and has a strong understanding of distributed systems and messaging patterns. This role requires expertise in designing and implementing scalable solutions that meet the demands of large-scale data processing workloads.

  • Master Big Data Architect

    20 hours ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a seasoned Master Big Data Architect to spearhead the design and implementation of large-scale data architectures. The ideal candidate will have expertise in integrating various big data tools and frameworks, developing robust data pipelines using ETL processes, and driving innovation through technical leadership. Main...

  • Big Data Engineer Manager

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data Engineer Manager - Cloud ArchitectureOverviewWe are seeking a highly experienced and strategic engineering manager to lead our team of data engineers. The ideal candidate will have deep expertise in Big Data platforms, Microsoft Azure, and Databricks.The successful candidate will design and deliver scalable data pipelines and analytics...

  • Senior Data Systems Engineer

    2 hours ago

    Tirupati, Andhra Pradesh, India beBeeData Full time US$ 15,00,000 - US$ 20,00,000

    About UsWe are seeking a highly skilled Big Data Engineer with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our team.Job Responsibilities:We require the ideal candidate to have hands-on experience in building, scaling, and optimizing big data pipelines.The successful candidate will also be required to work on distributed data...

  • Senior Big Data Architect

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data ArchitectJob Summary:About this Role:We are seeking an experienced and strategic technology leader with expertise in designing and delivering scalable data solutions using Microsoft Azure, Databricks, and Big Data platforms.The ideal candidate will lead a team of talented engineers to architect and oversee the development of...

  • Solace Messaging Engineer

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeMessaging Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a Messaging Infrastructure Architect to join our team. As a key member of the team, you will be responsible for designing, deploying, and managing messaging infrastructure using Solace PubSub+ and Advanced Event Mesh.Key Responsibilities:Architect and deploy messaging infrastructure across cloud environmentsDefine and implement event-driven...

  • Engineering Manager – Big Data, Azure

    1 week ago

    Tirupati, Andhra Pradesh, India DataE2E Technologies Full time

    Technical Manager – AzureLocation: 100% RemoteEmployment Type: Full-timeShift Timing : 3 pm – 11 pm ISTJob Summary:About the Role:We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure, and Databricks.The ideal candidate will lead a team of talented data engineers to design and...

  • Big Data Hadoop Developer

    4 days ago

    Tirupati, Andhra Pradesh, India beBeeHadoop Full time ₹ 12,88,000 - ₹ 24,96,000

    Big Data Hadoop DeveloperWe are seeking a skilled Big Data Hadoop Developer to join our team. As a key member of our technology team, you will be responsible for designing, developing and implementing large-scale data processing systems using Big Data Hadoop ecosystem.Key Responsibilities:Design and develop scalable data pipelines using Hadoop, Spark, and...

  • Highly Experienced Big Data Systems Architect

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeAdministrator Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a skilled Kafka Administrator to lead the deployment and management of our production-grade Kafka clusters. The ideal candidate will have extensive experience in designing, deploying, and maintaining high-availability and fault-tolerant Kafka infrastructure.Key Responsibilities:Deploy and upgrade production-grade Kafka clusters to...

  • Leading Data Systems Engineer

    21 hours ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Key Data Engineering RoleWe are seeking an experienced data professional to join our analytics team. This individual will collaborate with cross-functional teams to design, build and maintain large-scale data systems.The ideal candidate will have a strong background in software engineering, experience with big data stacks and a passion for innovation and...

  • Senior Data Architect

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Engineer PositionWe are seeking a highly skilled and experienced Big Data Engineer to join our team at Alp Consulting Ltd.Job Description:Our ideal candidate will have 5-12 years of experience in designing and implementing Big Data solutions using distributed computing principles, Apache Spark, and related technologies. They will also have hands-on...