Apache Kafka

1 week ago

Kolkata, India Bytes and Bits Information Technology Full time

**Open Positions**: 1
- **Requirement Type**: Immediate Joining
- **Nature of Employment**: Full time
- **Location**: Kolkata. Work from home as of now.
- **Skillset**: Kafka resources. Working knowledge of Java will be a plus
- **Responsibilities include**:

- Design, implementation and maintenance of an enterprise installation of Kafka
- Participating in the creation and execution of data governance, including message design, schema validation, and versioning
- Working with developers from other business unit technical teams to assist them in implementing functional solutions using Kafka
- Supporting the establishment of a platform SLA, including defining non-functional requirements
- Working with networks, data center, and infrastructure teams to optimize hardware solutions for the installation of Kafka
- **Core skills and experience**:

- Good experience in designing, implementing and maintaining Apache Kafka as part for Cloud Data Platform distribution
- Data pipeline and workflow management tools: Airflow, RunDeck, Nifi etc.
- Stream-processing systems: Kafka, Spark-Streaming, etc
- Experience in designing and developing high-volume mission critical transactional data integration solutions
- Knowledge of message queuing, stream processing and highly scalable ‘big data’ data stores
- Building processes supporting data transformation, data structures, metadata, dependency and workload management
- Proven experience of designing middleware message governance, topic subscription and management, including schema validation and version compatibility
- Knowledge of Service-oriented architecture and experience in API creation and management technologies (REST, SOAP etc)

  • Highly Experienced Apache Kafka Cluster Manager Wanted

    2 weeks ago

    Kolkata, West Bengal, India beBeeKafkaAdministrator Full time ₹ 20,00,000 - ₹ 30,00,000

    Apache Kafka Administrator RoleThis position involves managing and maintaining large-scale Apache Kafka clusters.Key responsibilities include ensuring the security, availability, scalability, and fault tolerance of Kafka clusters, as well as monitoring performance and collecting metrics to optimize configurations.The ideal candidate will possess extensive...

  • Apply in 3 Minutes! Software Engineer with Apache Flink

    3 days ago

    Hyderabad, Bengaluru, Kolkata, India Vertiscript Global It Services Private Limited Full time

    Job Description Key Responsibilities: Design, develop, and maintain real-time/batch data processing applications using Scala, Java, and Apache Flink. Build and optimize distributed data pipelines on AWS cloud infrastructure (EMR, Lambda, SQS, S3, EC2). Ensure reliability, scalability, and performance of streaming data applications. Collaborate with...

  • Big Data+pyspark

    2 weeks ago

    Kolkata, India Blue Ocean Ventures Full time

    Minimum 2+ years of working with hadoop distributions. - Hands-on experience of using Sqoop,Hive,Impala,Spark,kafka,kudu & basic hadoop commands. - Proficient in SQL, Python/Unix Shell scripting. - Good to have experience of working with Apache Nifi and Apache Airflow. - Working experience of a Devops pipeline/process. - Good understanding of ETL pipelines.

  • Big Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a seasoned data architect to design, develop, and optimize large-scale data pipelines and distributed data processing systems.The ideal candidate will have hands-on experience in Scala, Spark (PySpark), Python, Apache Kafka, and NiFi/Airflow for data processing, streaming solutions, and orchestration.Key ResponsibilitiesDesign and...

  • Senior Cloud Data Specialist

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Cloud Data EngineerWe are seeking a seasoned Cloud Data Engineer to join our team.Design and implement scalable data pipelines using Azure services like Data Factory, Databricks, and Synapse Analytics.Develop and optimize PySpark/Spark SQL jobs for large-scale batch and streaming data transformations.Ingest data from various sources including Apache Kafka,...

  • High-Performance Big Data Solutions Leader

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,50,000

    Big Data Engineer Role\This role involves leading the development of high-performance big data solutions. The ideal candidate will have 8+ years of experience in big data development and engineering, with strong hands-on expertise in Hadoop, Hive, HDFS, Apache Spark, and Kafka.\The key responsibilities include performing hands-on big data development work,...

  • Senior Java Software Engineer

    5 days ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Java Developer with Kafka Job Type: Full-Time Location: Pune/Chennai/Kolkata, IN Experience: - 8+ to 12+ Years Key Responsibilities: Key Responsibilities Design and develop backend services using J ava, Spring Boot, and microservices architecture . Implement real-time event streaming using Apache Kafka . Build, optimize, and maintain Kafka...

  • Lead Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleWe are seeking an experienced Data Engineer to play a critical role in designing, developing and managing data pipelines and transformation frameworks that enable analytics, reporting and business intelligence capabilities across the enterprise.The ideal candidate will have hands-on experience in Microsoft Azure data ecosystem and possess strong...

  • Expert Developer

    2 weeks ago

    Kolkata, West Bengal, India beBeeSoftware Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Title: Technical ExpertAre you a seasoned software professional with expertise in backend and frontend engineering? We are seeking a highly skilled and experienced Full Stack Software Engineer to join our team.Key Responsibilities:Develop and maintain data streaming solutions using Apache Kafka, ensuring seamless integration with other systems.Design,...

  • Senior Cloud Messaging Expert

    2 weeks ago

    Kolkata, West Bengal, India beBeeKafka Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Summary:Our organization is seeking an experienced Kafka Engineer to join our team. The ideal candidate will have expertise in designing and implementing automated migration pipelines for enterprise Kafka workloads to open-source or cloud-native clusters.    Responsibilities:Design, script, and provision migration steps for moving data between...