Principal Data Systems Architect

1 day ago

Varanasi, Uttar Pradesh, India beBeeKafka Full time ₹ 90,00,000 - ₹ 1,20,00,000
Job Title

Kafka Infrastructure Specialist

About the Role

This is a high-profile opportunity to lead the deployment, management and maintenance of complex Kafka infrastructure. If you have experience in designing and optimizing Kafka clusters for scalability and performance, we want to hear from you.

Responsibilities
  • Kafka Cluster Management: Deploy and manage production-grade Kafka clusters ensuring high availability and fault tolerance.
  • Automation: Automate the installation and configuration of Kafka clusters using tools such as Ansible and Chef.
  • Troubleshooting: Troubleshoot critical production issues optimizing Kafka performance and minimizing downtime.
  • Data Replication: Configure MirrorMaker for data replication between two data centers ensuring effective disaster recovery.
  • Real-time Monitoring: Deploy and manage Provectus Kafka UI on a Kubernetes cluster for real-time monitoring and management.
  • Integration: Integrate Schema Registry and deploy multiple Kafka Connectors to facilitate seamless data flow.
  • User Onboarding: Onboard new users by managing ACL permissions creating topics and implementing end-to-end security with SSL/TLS.
  • Infrastructure Design: Design and manage Kafka infrastructure to enhance message processing efficiency.
  • Performance Optimization: Conduct performance testing to optimize partitioning replication and retention policies.
  • Integration with ELK Stack and Solr: Integrate Kafka with ELK Stack and Solr for scalable data storage and analysis.
Qualifications

We are looking for individuals with a Bachelor of Engineering (BE), Bachelor of Technology (BTech), Master of Computer Applications (MCA) or Master of Computer Science (MCS). Minimum 3+ years of experience in designing and managing large-scale Kafka infrastructure is required.

Required Skills and Qualifications

Skills: Kafka clusters, MirrorMaker, Kafka Streams, Schema Registry, Kubernetes, Docker, Ansible, Terraform, Monitoring & Logging, Programming & Scripting, Shell Scripting.

Experience and Location

We are based in Bangalore and require candidates with at least 3+ years of experience in this field. If you have the skills and qualifications required, please apply for this exciting opportunity.

  • Master Data Architect

    5 days ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Master Data ArchitectWe are seeking a skilled data professional to join our team as a Master Data Architect. As a key member of the organization, you will be responsible for designing, building, and maintaining large-scale data systems that fuel real-time insights.Your work will involve turning raw data points into actionable intelligence,...

  • Visionary Data Architect

    8 hours ago

    Varanasi, Uttar Pradesh, India beBeeDataManagement Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Enterprise Data Architect OpportunityEmbark on a transformative journey as an Enterprise Data Architect with our esteemed organization. You will be responsible for overseeing all activities related to client business data assets, ensuring alignment with the company's strategic objectives.About the Role:Lead the development and implementation of innovative...

  • Data Architect Position

    3 days ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 3,00,00,000

    Senior Data ArchitectWe are seeking a highly skilled Senior Data Engineer to join our growing team of consultants. This is a remote position with a contract duration of 1 year, potentially extendable.In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and...

  • Data Architect Specialist

    1 day ago

    Varanasi, Uttar Pradesh, India beBeeDataArchitect Full time US$ 80,000 - US$ 1,40,000

    Data Architect SpecialistAre you a data expert looking for a challenging role in the field of data engineering? Do you have experience with designing and developing scalable data pipelines using Python and AWS services such as S3, Redshift, Lambda, and Glue? If so, we want to hear from you!Key Responsibilities:Data Pipeline Development: Develop and maintain...

  • Data Architect

    2 days ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Key Responsibilities:Design and build data crawlers to extract customer data from various sources.Develop and optimize SQL queries to improve data loading and processing efficiency.Design and implement data warehouse models for efficient data storage and retrieval.Create and deploy SSIS packages to validate, transform, and synthesize customer...

  • Principal Software Architect

    2 days ago

    Varanasi, Uttar Pradesh, India beBeeTechnicalLead Full time ₹ 12,00,000 - ₹ 20,00,000

    Senior Technical LeadWe are seeking an exceptional Senior Technical Lead to spearhead the development of high-performance web applications. As a key member of our technical leadership team, you will be responsible for designing and implementing scalable, cutting-edge solutions using Node.js, MongoDB, and modern front-end frameworks.About the Role:You will...

  • Cloud Data Architect

    2 days ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 80,00,000 - ₹ 1,00,00,000

    Job Title: Cloud Data ArchitectOverview:The ideal candidate will design and implement cloud-based data architectures to support business growth. This includes developing scalable data pipelines, integrating with various systems, and ensuring data quality.Key Responsibilities:Design and implement cloud-based data architectures using Azure Databricks and Azure...

  • Enterprise Data Architect Lead

    1 day ago

    Varanasi, Uttar Pradesh, India beBeeDataWarehouse Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Architect Role: Leverage expertise in data architecture and management to design, implement, and optimize a robust data warehousing platform for the pharmaceutical industry.",

  • Solution Architect for Insurance Systems

    3 days ago

    Varanasi, Uttar Pradesh, India beBeeSolution Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Solution Architect for Insurance SystemsRole SummaryWe are seeking an experienced Solution Architect to design and implement software solutions using Guidewire BillingCenter. The ideal candidate will have a solid understanding of billing processes within the Property & Casualty insurance domain.Key ResponsibilitiesDesign, develop, and deploy...

  • Data Architect Specialist

    1 day ago

    Varanasi, Uttar Pradesh, India beBeeData Full time US$ 1,40,000 - US$ 1,70,000

    About our organization:We are a leading health and wellness company that empowers people to make healthier food choices. Our mission is to provide accessible and affordable nutritious food for everyone, regardless of economic status.Our team is committed to driving lasting behavior change and delivering long-term health outcomes. We partner with national and...