Senior Data Streaming Expert

3 days ago

Guntur, Andhra Pradesh, India beBeeStreaming Full time ₹ 18,00,000 - ₹ 25,00,000

Job Title: Senior Data Streaming Expert

We are seeking a seasoned expert to lead our data streaming efforts. As a key member of our team, you will be responsible for deploying and managing production-grade Kafka clusters, ensuring high availability and fault tolerance.

  • Data Cluster Management: Deploy and upgrade Kafka clusters using tools like Ansible and Chef, automating the installation and configuration process.
  • Troubleshooting: Identify and resolve critical production issues, optimizing Kafka performance and minimizing downtime.
  • Replication and Recovery: Configure MirrorMaker for effective disaster recovery between data centers.
  • Monitoring and Management: Deploy Provectus Kafka UI on a Kubernetes cluster for real-time monitoring and management.
  • Integration and Security: Integrate Schema Registry and deploy multiple Kafka Connectors for seamless data flow, implementing end-to-end security with SSL/TLS.
  • User Onboarding: Manage ACL permissions, create topics, and configure infrastructure to enhance message processing efficiency.
  • Performance Optimization: Conduct performance testing to optimize partitioning, replication, and retention policies.
  • System Integration: Integrate Kafka with ELK Stack and Solr for scalable data storage and analysis.
Qualifications

Bachelor's degree in Computer Science or related field required.

Required Skills

Technical Skills: Kafka, MirrorMaker, Kafka Streams, Schema Registry, Kubernetes, Docker, Ansible, Terraform, Monitoring & Logging, Programming & Scripting, Shell Scripting.

Experience: 3+ years of experience in data streaming and management.

Location: Bangalore, India.

  • Senior Data Engineer

    3 weeks ago

    Guntur, Andhra Pradesh, India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...

  • Senior Cloud Data Specialist

    7 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 22,00,000 - ₹ 26,00,000

    Job Title: Senior Data Engineer & Infrastructure ExpertWe are looking for a seasoned professional to lead full lifecycle implementations, from secure platform setup and cloud integration to high-performance data pipeline development.This role is ideal for individuals who thrive at the intersection of data engineering, infrastructure, and DevOps, and want to...

  • Expert Data Analyst

    3 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 4,00,000 - ₹ 5,00,000

    Management Information System ExpertiseShakti Brandz is a leading apparel house of brands renowned for its range of fashion offerings.We are seeking an experienced and skilled professional to join our dynamic team as a Management Information System (MIS) expert. The MIS expert will play a critical role in managing, analyzing, and interpreting data to support...

  • Senior Data Systems Architect

    5 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Description:As a Senior Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using Python and Pyspark.The ideal candidate will have hands-on coding expertise in Python and Pyspark, as well as strong experience with Telemetry, Big Data, and backend engineering.Domain knowledge of IoT systems,...

  • Cloud Data Architect

    2 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 20,05,312 - ₹ 24,25,760

    Senior Data Engineer Position OverviewOur organization seeks a highly skilled data engineer with extensive expertise in designing, building, and optimizing scalable data pipelines and lakehouse architectures.Key ResponsibilitiesDesign and develop efficient data pipelines using Azure Data Factory and Azure Synapse Analytics.Construct and optimize lakehouse...

  • Database Engineering Expert

    3 days ago

    Guntur, Andhra Pradesh, India beBeeDatabase Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Database DeveloperWe are seeking a seasoned Senior Database Developer to spearhead the development of large-scale database systems.Design and implement complex database solutions utilizing Microsoft technologies such as Azure Synapse Analytics and Dedicated SQL Pools.Develop and maintain intricate ETL processes using tools like Azure Data...

  • Senior Data Analysis Expert

    5 days ago

    Guntur, Andhra Pradesh, India beBeeDataAnalytics Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Analytics MentorWe're seeking a seasoned data analytics expert to deliver top-notch training, mentorship, and career guidance to aspiring data analysts.Key Responsibilities:Deliver live, interactive online sessions on core data analytics topics such as data wrangling, data visualization, statistical analysis, Excel, SQL, and Python.Guide learners...

  • Optimizing Data Flows

    2 hours ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Ingestion SpecialistWe are seeking an experienced Senior Data Ingestion Specialist to optimize our data ingestion workflows. This role involves designing, developing, and maintaining scalable and efficient data pipelines for integrating multiple sources into Databricks.Key Responsibilities:Design and develop data ingestion pipelines using...

  • Advanced Data Expert

    2 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Key Senior Data Scientist RoleThis is a full-time key position for a highly skilled Senior Data Scientist. The Senior Data Scientist will create, implement and maintain data models, conduct thorough analysis of large datasets to derive actionable insights, produce compelling data visualizations to communicate findings and work collaboratively with...

  • Senior Data Integration Specialist

    2 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 40,00,000

    Job Title: Senior Data Engineering ExpertAbout this OpportunityWe are seeking a highly skilled data engineer to join our team. As a senior informatica intelligent cloud services developer, you will be responsible for designing and developing end-to-end data integration solutions, optimizing workflows, and collaborating with business and technical...