Kafka Data Engineer

2 weeks ago


Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

Mandatory skills :


- Azure, Kafka, Data Engineering or any Data Platforms background

- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes

- Terraform (Preferred not Compulsory), Bicep or other IaC.

- Helm (helm deployments as well writing charts).

- Azure DevOps pipelines.

- Engineer, Data Engineer, or similar roles with a strong focus on Kafka and data engineering within the Azure environment.

- Experience with Data pipelines for deploying database code - Postgres, Azure SQL, and SQL Server

Role Description :

This is a full-time role for a Kafka Data Engineer.

- The Kafka Data Engineer will be responsible for building and maintaining high-performance distributed data pipelines utilizing Apache Kafka.

- They will need to work closely with data architects and software engineers to ensure data pipeline robustness, correctness, and recoverability.

- They will need to incorporate scalable techniques to manage large amounts of data and access various data sources as well as implement Kafka producers and consumers.

This is a remote role.

Qualifications :

- Strong proficiency with Apache Kafka (including Kafka Connect, Kafka Streams, and Kafka Security)

- Experience with various data storage systems and data formats (e.g. AWS S3, Hadoop, Avro, Parquet)

- Experience with big data processing frameworks (e.g. Spark)

- Experience with developing solutions utilizing Java, Python, and Scala

- Strong experience with SQL and NoSQL databases

- Experience working with message queuing, stream processing, and highly scalable systems

- Bachelor's degree or higher in Computer Science, Software Engineering, or a related field

- Excellent communication and collaboration skills with the ability to work effectively in a remote environment

- Experience with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform is a plus

(ref:hirist.tech)
  • Kafka Architect

    3 weeks ago


    Bangalore, Karnataka, India ConnectPro Management Consultants Pvt Ltd. Full time

    Work Location: Bangalore. Hybrid model - Working in office 3 days in a week. Experience : 8+ Years. We are looking for a Kafka Architect who can Work alongside multiple Production Support, Development, System Admin, Project Managers and Engineering teams.Key Responsibilities: - Design, deploy, and manage Kafka clusters in a production environment, ensuring...

  • Unison Consulting

    3 weeks ago


    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    We are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure. You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams, and ensure high-quality data processing for our data analytics...

  • Kafka/DevOps Engineer

    4 weeks ago


    Bangalore, Karnataka, India RapidBraiins Full time

    Job Description : We are seeking a motivated and skilled Kafka DevOps Engineer to join our team. The ideal candidate will be responsible for designing and implementing data pipelines using Apache Kafka. This role requires expertise in Kafka platform management, integration with various data sources and sinks, and ensuring data integrity and security. Roles &...

  • Java Developer

    4 weeks ago


    Bangalore, Karnataka, India MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Job Summary :We are seeking a talented Java Developer with expertise in Kafka to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining high-performance, scalable Java applications with Kafka integration. This role requires strong Java programming skills, deep understanding of Kafka architecture and...

  • Java Developer

    4 weeks ago


    Bangalore, Karnataka, India Triumph Ladders Pvt. Ltd. Full time

    Location : BangaloreNotice Period : 0-30 DaysPrimary Skills :Apache Kafka; API; Big Data; CI/CD; DB Architecture & Design; Docker; ELK Stack (Elastic Search, Logstash, Kibana); GCP; Git (GitHub, GitLab, BitBucket, SVN); Hadoop / HDFS; HBase; HiPED; Hive; J2EE; Java; Jboss; JavaScript; Jenkins; JUnit; Kafka; MySQL; NoSQL; Postgres / Postgresql; Postman;...

  • Kafka Administrator

    4 weeks ago


    Bangalore/Hyderabad, Karnataka, India SPG CONSULTING AND SOLUTIONS SERVICES PVT LTD Full time

    Overview : The Kafka Admin plays a crucial role in managing and maintaining Apache Kafka clusters and ensuring their optimal performance. This position is vital in ensuring the smooth and efficient functioning of the Kafka infrastructure, which is essential for real-time data processing and analytics within the organization. The Kafka Admin collaborates with...

  • Kafka Adminstrator

    2 weeks ago


    Bangalore, Karnataka, India Rrootshell Technologiiss Pvt Ltd Full time

    7 or more years of demonstrated skill and experience in the design, installation, monitoring, and troubleshooting of messaging infrastructure such as RabbitMQ and Kafka in self-hosted and cloud environments is required. - Experience integrating Kafka with other technology products. - Understanding cloud data streaming technologies (Kafka/ksqlDB, StreamSets,...


  • Bangalore, Karnataka, India PeopleStrong Full time

    Our Client :Our client is a product and services engineering company. We are a team of Software Engineers, Architects, Managers, and Cloud Experts with expertise in Technology and Delivery ManagementRoles and Responsibilities:- The role is to be a hands-on engineer to set up and manage messaging platforms such as Apache Kafka, Rabbit MQ, Redis, etc..- The...


  • Bangalore, Karnataka, India Top Talent Technologies Pvt Ltd Full time

    Job Description :- Design, provision, and maintain data infrastructure using cloud-native services (e.g., Amazon MSK, Apache NiFi).- Collaborate with platform engineers, data scientists, analysts, and software engineers to ensure seamless data integration.- Optimize data infrastructure for performance, scalability, and cost-effectiveness.- Monitor and...

  • Backend Lead Engineer

    4 weeks ago


    Bangalore, Karnataka, India iMind Your Business Solutions Private Limited Full time

    Looking for a Backend Engineer for a Palo Alto, CA, US-based startup, setting up its development center in Bangalore. PreReq: MS / MTech - Computer Science - Tier 1 Institutes Only- We enable software development teams to effortlessly create functional test for microservices applications. First, we provide tools enabling engineers to easily create tests and...


  • Bangalore, Karnataka, India Mresult Services Private Limited Full time

    What are we looking for!- 10+ years of data engineering experience.- Strong experience with streaming platforms such as Kafka, Flink and big data platforms.- 5+ years of experience in building AWS data solutions using services such as storage, virtual machines, serverless technologies, parallel processing technologies, auto-scaling etc.- Background in data...

  • Software Engineer

    2 weeks ago


    Bangalore, Karnataka, India TalentXo Full time

    We are looking for a talented and motivated Software Engineer to join our growing Data Engineering & Analytics team. In this role, you will play a pivotal role in developing, maintaining, and improving our reporting products and data pipelines.Responsibilities :- Design and develop high-impact, user-facing features for our reporting products, leveraging your...

  • Inno Protech

    4 weeks ago


    Bangalore, Karnataka, India Inno Protech Solutions Private Limited Full time

    AWS Data EngineerExperience: 3-6 YearsLocation: Designing, developing, and deploying highly scalable and efficient data pipelines using containerization technologies like Docker/Kubernetes- Leveraging AWS services such as MSK (Managed Streaming Kafka) and S3 (Simple Storage Service) to build real-time data pipelines- Implementing and managing access controls...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India SPN Globe Full time

    Must Have Skills : Spark streaming, Kafka, AWS, Python, Data Engineering, PySpark, CI/CD, Kubernetes, Docker, Dynamo DB.Job Description :1) Proven experience as a Senior Data Engineer.2) A well-rounded engineer with good appetite for learning and ramping up on cutting edge technologies.3) Good analytical and debugging skills with self-starting capabilities...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India CliqHR Full time

    Job Description :Mandatory Skills : Microsoft Azure, Hadoop, Spark, Databricks, Airflow, Kafka, Py sparkRequirements :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python, Airflow, Scala, Kafka- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new...

  • Inno Protech

    4 weeks ago


    Bangalore, Karnataka, India Inno Protech Solutions Private Limited Full time

    Job Title : Data Engineer Job Description :We are looking for a skilled Data Engineer with expertise in Big Data technologies to join our dynamic team. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable and efficient data pipelines and systems to support our data processing and analytics needs. The ideal candidate...

  • Staff Engineer

    3 weeks ago


    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    We are urgently hiring for our client for the position of Staff Engineer - Data Engineering. Location : Anywhere in India.Np : max 30 days.What you'll do : As the Staff Engineer of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment. Staff...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Grizmo Labs Full time

    Responsibilities :- Develop, construct, test, and maintain architectures such as large-scale processing systems, and other infrastructure using tools and technologies such as Hadoop, Spark, and Kafka.- Assemble large, complex data sets that meet functional / non-functional business requirements, utilizing SQL, NoSQL, and cloud-based data warehousing...

  • Engineering Manager

    4 weeks ago


    Bangalore, Karnataka, India FX Consulting Full time

    Roles & Responsibilities : - Minimum 14+ years of professional hands-on experience in data engineering, data science, or a similar role.- Minimum of 2+ years of people management experience, hiring, developing, and promoting engineering talent.- Significant experience leading data architecture projects (medallion architecture pattern) and driving decisions...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Talent Corner HR Services Full time

    Skills and Qualifications :- Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).- Experience as a Data Engineer or similar role.- Strong proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL).- Experience with cloud-based data platforms (e.g., AWS, Azure, GCP).-...