Big Data Messaging Architect

2 days ago

Dindigul, Tamil Nadu, India beBeeMessaging Full time ₹ 10,00,000 - ₹ 15,00,000

Job Title: Big Data Messaging Architect

We are seeking a highly skilled Kafka Administrator to join our team.

Responsibilities:
  • Design, deploy, and manage large-scale Kafka clusters for high availability and fault tolerance.
  • Automate the installation and configuration of Kafka clusters using tools such as Ansible, Chef, or Terraform.
  • Troubleshoot critical production issues to optimize Kafka performance and minimize downtime.
  • Configure MirrorMaker for data replication between two data centers to ensure effective disaster recovery.
  • Deploy and manage Provectus Kafka UI on a Kubernetes cluster for real-time monitoring and management.
  • Integrate Schema Registry and deploy multiple Kafka Connectors to facilitate seamless data flow.
  • Manage ACL permissions, create topics, and implement end-to-end security with SSL/TLS.
  • Optimize message processing efficiency by designing and managing Kafka infrastructure.
  • Conduct performance testing to optimize partitioning, replication, and retention policies.
  • Integrate Kafka with ELK Stack and Solr for scalable data storage and analysis.

Qualifications:

A Bachelor's, Master's, or Postgraduate degree in Computer Science, Engineering, or related field from a recognized institution is required.

Required Skills:

Kafka, Apache Kafka Streams, MirrorMaker, Schema Registry, Kubernetes, Docker, Ansible, Terraform, Monitoring & Logging, Programming & Scripting, Shell Scripting.

Experience:

A minimum of 3 years of experience in designing, deploying, and managing large-scale Kafka clusters is essential.

  • Big Data Engineer

    2 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job DescriptionOur team is seeking a skilled professional to manage and maintain our big data platform. The ideal candidate will have hands-on experience with Apache Druid in production, as well as strong analytical skills.Key Responsibilities:Develop and implement efficient data models for real-time analytics using Apache Druid.Collaborate with...

  • Senior Big Data Specialist

    4 days ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Title: Senior Big Data SpecialistWe are seeking an experienced professional to design, build, and maintain scalable data pipelines and ETL workflows using Spark and SQL.Main Responsibilities:Develop efficient data processing systems for large datasets.Create real-time streaming applications with Spark Streaming/Kafka.Collaborate with cross-functional...

  • Principal Big Data Scientist

    2 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 20,00,000

    Data Engineer RoleWe are seeking an experienced Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems.Job DescriptionThe ideal candidate will have a strong background in computer science or a related field, with at least 3-6 years of experience...

  • Principal Data Engineer

    2 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data EngineerLocation:BangaloreChennaiGurgaonPuneMumbaiExperience:7–10 YearsWe are seeking an experienced Big Data Architect to join our data engineering team. The ideal candidate will have a proven track record in designing, developing, and optimizing large-scale data pipelines and distributed data processing systems.The successful...

  • Data Architect Specialist

    4 days ago

    Dindigul, Tamil Nadu, India beBeedata Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Data Architect SpecialistWe are seeking a seasoned professional to spearhead our data architecture initiatives.

  • Expert Data Architect

    2 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 18,00,000

    About This RoleWe are looking for a skilled Data Architect to design and implement scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.Key Responsibilities:Collaborate with cross-functional teams to develop high-quality data solutions.Design and deploy efficient ETL/ELT pipelines with Azure Databricks by utilizing PySpark and...

  • Senior Data Solutions Architect

    6 days ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,54,400 - ₹ 21,11,200

    Job Title: Senior Data Solutions ArchitectWe are seeking a highly skilled Senior Data Solutions Architect to design, build and deploy large-scale data systems using cutting-edge technologies.Key Responsibilities:

  • DATA Solution Architect

    7 days ago

    Dindigul, Tamil Nadu, India Blue Cloud Softech Solutions Limited Full time

    Solution Architect – Data Platforms & Solution Delivery Experience: Minimum 7+ years in solution/data architecture and large-scale implementations Department: DIA – Architecture team Role Summary We are seeking an experienced Solution Architect to drive the design and delivery of enterprise data and analytics solutions. You will work closely with...

  • Chief Data Strategist

    4 days ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Drive Innovation in Data ArchitectureWe're seeking a skilled Data Architect to design, develop and govern our data architecture and pipelines.Design Scalable Data Architectures: Develop robust and scalable data architectures for warehousing and enterprise data platforms.Optimize Data Pipelines: Enhance data pipelines using Fivetran and Cloud...

  • High-Performance Data Solutions Architect

    11 hours ago

    Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Our company seeks a highly skilled Senior Data Engineer to join our growing team of consultants. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.Key ResponsibilitiesDesign, develop, and maintain scalable and robust data pipelines...