Data Streaming Solutions Architect

2 weeks ago

Kolkata, West Bengal, India beBeeApache Full time ₹ 1,04,000 - ₹ 1,30,878

Apache Kafka Integration Expert

">

We are looking for an experienced Apache Kafka integration specialist with a strong background in designing and implementing distributed data streaming solutions. The ideal candidate will have extensive knowledge of Kafka Streams, Kafka Connect, and other related technologies.

Responsibilities:

  • Design and implement scalable Kafka-based data pipelines to meet business requirements.
  • Develop and maintain high-quality integration solutions using Apache Kafka and related tools.
  • Manage and monitor Kafka clusters to ensure high availability, scalability, and performance.
  • Collaborate with cross-functional teams to understand integration needs and deliver robust solutions.
  • Implement best practices for data streaming, including message serialization, partitioning, and replication.
  • Monitor and troubleshoot Kafka performance, latency, and security issues.
  • Ensure data integrity and implement failover strategies for critical data pipelines.

Requirements:

  • Strong experience with Apache Kafka (Kafka Streams, Kafka Connect).
  • Proficiency in programming languages like Java, Python, or Scala.
  • Experience with distributed systems and data streaming concepts.
  • Familiarity with Zookeeper, Confluent Kafka, and Kafka Broker configurations.
  • Expertise in creating and managing topics, partitions, and consumer groups.
  • Hands-on experience with integration tools such as REST APIs, MQ, or ESB.
  • Knowledge of cloud platforms like AWS, Azure, or GCP for Kafka deployment.
  • Experience with monitoring tools like Prometheus, Grafana, or Datadog is a plus.
  • Exposure to DevOps practices, CI/CD pipelines, and infrastructure automation is a plus.
  • Knowledge of data serialization formats like Avro, Protobuf, or JSON is a plus.

Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, or a related field.

  • Senior Enterprise Data Solutions Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeData Architect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a seasoned data architect to lead the design and implementation of robust data solutions for our clients.Main Responsibilities:Develop and maintain complex data models for large-scale enterprise applications.Collaborate with cross-functional teams, including data architects, business analysts, and IT professionals, to deliver...

  • Big Data Architect Specialist

    1 week ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunitySr. Data Architect - Big Data SpecialistWe are seeking a highly skilled and experienced Senior Data Architect to join our team as a Big Data Specialist. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies.You will lead...

  • Big Data Architect

    1 week ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a seasoned data architect to design, develop, and optimize large-scale data pipelines and distributed data processing systems.The ideal candidate will have hands-on experience in Scala, Spark (PySpark), Python, Apache Kafka, and NiFi/Airflow for data processing, streaming solutions, and orchestration.Key ResponsibilitiesDesign and...

  • Data Solutions Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 14,62,500 - ₹ 19,30,000

    Job Title: Data Solutions ArchitectJob Description:We are seeking an experienced Senior Data Engineer to lead the development of large-scale data processing systems.As a Senior Data Engineer, you will design, develop, and maintain complex data pipelines using Airflow.You will work closely with cross-functional teams to identify business requirements and...

  • Big Data Architect

    1 week ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking a highly skilled Big Data Architect to lead the design and implementation of our data engineering systems. As a key member of our team, you will be responsible for architecting and building scalable systems using lakehouse architectures (Apache Iceberg, Delta Lake) to unify data lakes and warehouses.Key Responsibilities:Develop and...

  • Expert Data Solutions Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataSolutions Full time ₹ 15,12,000 - ₹ 2,01,60,000

    Expert Data Solutions ArchitectWe are seeking a highly skilled data solutions architect to design and implement scalable data pipelines using advanced technology frameworks.Key Responsibilities:Azure Synapse (At least 4+ years relevant experience)Microsoft Fabric (Hands-on experience with at least one project executed using Microsoft Fabric)Azure Data...

  • AWS Enterprise Data Solution Specialist

    1 week ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job SummaryWe are seeking a skilled AWS Data Architect to design and implement scalable data solutions on AWS, encompassing S3, Redshift, Glue, EMR, and Lambda.The ideal candidate will have expertise in building and optimizing data pipelines, warehouses, and data lakes, as well as collaborating with cross-functional teams to deliver end-to-end solutions.Key...

  • Chief Data Solutions Architect

    1 week ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewThe Team Lead for Advanced Data Systems Delivery will oversee a team responsible for delivering high-performance, scalable data solutions. This role requires expertise in designing and optimizing data architectures for mission-critical systems.Project Leadership & Delivery:Lead the end-to-end delivery of advanced data systems for mission-critical...

  • Senior Cloud Data Architect

    1 week ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Opportunity:We are seeking a seasoned Cloud Data Architect to lead the design and development of scalable ETL pipelines using Azure services and integrate data into AWS Datalake or other modern data platforms.Key Responsibilities:Develop, maintain, and optimize cloud-based ETL pipelines using Azure Data Factory and related services.Process, transform,...

  • Solution Architect

    2 weeks ago

    Kolkata, West Bengal, India BayOne Solutions Full time

    Role: Solution Architect (AI Infrastructure, Kubernetes & HPC)Location: Bangalore/PuneDuration: Full Time"Just a heads-up — the second round will need to be attended in person, as per the client's request."Role Type: Senior Role - Delivery-focused infrastructure role (non–presales; may include limited presales engagement)Core Focus AreasKubernetes...