Kafka Migration Specialist

3 weeks ago


Bengaluru, Karnataka, India EDGESOFT Full time
Job Title: Kafka Lead

Talentpro Edge is seeking a highly skilled Kafka Lead to join our team. As a key member of our engineering team, you will be responsible for leading the migration of Kafka workloads from AWS to GCP, utilizing Kubernetes and GCP-native services.

Responsibilities:
  • Design and implement a scalable Kafka infrastructure on Google Kubernetes Engine (GKE).
  • Develop and maintain comprehensive performance metrics dashboards for the Kafka ecosystem.
  • Collaborate with cross-functional teams to optimize Kafka API integration.
  • Conduct in-depth assessments of existing AWS Kafka deployments for migration planning.
  • Develop and execute a robust migration strategy encompassing data migration and consumer repointing.
  • Optimize Kafka performance and scalability for high-throughput data processing.
  • Implement robust monitoring and alerting for system health and performance.
  • Guarantee data integrity and security throughout the migration process.
  • Collaborate with engineering and data teams for seamless integration and optimal performance.
  • Design and implement a multi-tenant GKE environment to accommodate diverse workloads.
  • Deploy and configure Kafka Strimzi on the underlying infrastructure.
  • Identify and implement efficient data ingestion pipelines (e.g., Kafka Connect, Dataflow).
  • Conduct thorough fault simulation testing to mitigate potential risks.
  • Stay updated on Kafka developments and GCP services to recommend and implement improvements.
Requirements:
  • Bachelor's degree in Computer Science, Engineering, or related field (Master's degree preferred).
  • Proven hands-on experience as a Kafka Lead or similar role, with a minimum of 5 years of experience.
  • Deep knowledge of Kafka internals and ecosystem, including Kafka Connect, Kafka Streams, and KSQL.
  • Indepth knowledge of Apache Kafka architecture, internals, and ecosystem components.
  • Proficiency in scripting and automation for Kafka management and migration.
  • Hands-on experience with Kafka administration, including cluster setup, configuration, and tuning.
  • Proficiency in Kafka APIs, including Producer, Consumer, Streams, and Connect.
  • Strong programming skills in Java, Scala, or Python.
  • Experience with Kafka monitoring and management tools such as Confluent Control Center, Kafka Manager, or similar.
  • Solid understanding of distributed systems, data pipelines, and stream processing.
  • Experience leading migration projects to Google Cloud Platform (GCP), including migrating Kafka workloads.
  • Familiarity with GCP services such as Google Kubernetes Engine (GKE), Google Cloud Storage, Google Cloud Pub/Sub, and BigQuery.
  • Excellent communication and collaboration skills.
  • Ability to work independently and manage multiple tasks in a fast-paced environment.
  • Knowledge of containerization technologies such as Docker and Kubernetes.
  • Familiarity with related technologies such as Apache ZooKeeper, Apache Flink, or Apache Spark.
  • Working knowledge of hands-on experience with Strimzi Kafka
Nice to Have:
  • Kafka certification (e.g., Confluent Certified Developer, Confluent Certified Operator).
  • Google Cloud certification (e.g., Google Cloud Certified Professional Cloud Architect, Google Cloud Certified Professional Data Engineer).
  • Additional experience with other cloud platforms such as AWS or Azure.

  • Kafka Architect

    3 weeks ago


    Bengaluru, Karnataka, India EDGESOFT Full time

    Job Title: Kafka AdministratorWe are seeking a highly skilled Kafka Administrator to join our team at Edgesoft. As a key member of our technical team, you will be responsible for designing, implementing, and managing a scalable Kafka infrastructure on Google Kubernetes Engine (GKE).Responsibilities:Lead the migration of Kafka workloads from AWS to GCP using...


  • Bengaluru, Karnataka, India NR Consulting - India Full time

    Data Migration and Integration SpecialistAt NR Consulting - India, we are seeking a highly skilled Data Migration and Integration Specialist to join our team. The ideal candidate will have a strong background in data migration, SQL, and Salesforce, with a minimum of 7 years of experience in data migration and integration from different platforms into...


  • Bengaluru, Karnataka, India NR Consulting - India Full time

    **Job Title:** Data Migration Specialist**Overview:**NR Consulting - India is seeking a highly skilled Data Migration Specialist to join our team. As a Data Migration Specialist, you will be responsible for migrating and integrating data from various platforms into Salesforce.**Responsibilities:Migrate and integrate data from different platforms into...


  • Bengaluru, Karnataka, India GCC client Full time

    Data Migration Specialist RoleAt GCC client, we are seeking a highly skilled Data Migration Specialist to lead our big data migration initiatives. As a key member of our team, you will design and implement data migration strategies from on-premise Hadoop to AWS, ensuring seamless data flow and optimal system performance.Key Responsibilities• Design and...


  • Bengaluru, Karnataka, India Brillio Full time

    About Brillio: We are a powerhouse of digital transformations, born digital in 2014. Our superpowers include Cloud, AI, Mobile, and IoT. We are a partner of choice for leading companies worldwide, helping them leverage digital technologies. We have 15 locations across 6 countries – USA, Canada, Mexico, UK, Romania, and India. Our award-winning...


  • Bengaluru, Karnataka, India INES EIT Services India P. Ltd [Formerly Hewlett Packard Global Soft India P] Full time

    Job Title: Senior Cloud Migration SpecialistJob Summary:We are seeking a Senior Cloud Migration Specialist to lead our public cloud migration projects. The ideal candidate will have strong experience in driving cloud migration waves, particularly AWS migration, in a large enterprise setup.Key Responsibilities:- Lead the migration of large-scale workloads to...


  • Bengaluru, Karnataka, India Cigres Technologies Private Limited Full time

    Job SummaryWe are seeking a highly skilled JFrog Migration Specialist to lead our migration efforts from existing artifact management systems to JFrog Artifactory. As a key member of our team, you will be responsible for collaborating with cross-functional teams and stakeholders to understand the requirements and scope of the migration project.Key...


  • Bengaluru, Karnataka, India PradeepIT Consulting Services Pvt Ltd Full time

    Job Title: SAP Data Migration SpecialistJob Summary:We are seeking a highly skilled SAP Data Migration Specialist to join our team at PradeepIT Consulting Services Pvt Ltd. The ideal candidate will have a strong background in SAP data migration, with expertise in configuring and utilizing data migration tools such as SAP LSMW, SAP Migration Cockpit, SAP Data...


  • Bengaluru, Karnataka, India Reflections Info Systems Full time

    Migration ExpertiseAs a Data Migration Specialist at Reflections Info Systems, you will lead the migration from Informatica MDM to Ataccama MDM. This role requires a deep understanding of data migration strategies, plans, and timelines. Your expertise will ensure data accuracy, consistency, and completeness during migration.Data Quality and IntegrationYou...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Overview: As a Technical Migration Specialist at NTT DATA, you will play a crucial role in managing messaging environments with a minimum of 5 years of experience. Your expertise in Exchange Online Tenant to Tenant migrations, diagnosing incidents, and troubleshooting during the migration process will be invaluable to our team. Key Responsibilities: -...


  • Bengaluru, Karnataka, India GCC client Full time

    Job Title: Senior Data Migration SpecialistJob Summary:As a Senior Data Migration Specialist at GCC client, you will be responsible for designing and implementing data migration strategies from on-premise Hadoop to AWS. You will develop and optimize Spark jobs for data processing on AWS EMR, manage and maintain S3 storage solutions for data lake...


  • Bengaluru, Karnataka, India Q2 Full time

    Job SummaryWe are seeking a skilled Data Migration Specialist to oversee the planning, execution, and management of complex data migration projects. The ideal candidate will have a strong understanding of data migration tools, techniques, and technologies, including data extraction, transformation, and loading (ETL) processes, database management systems,...


  • Bengaluru, Karnataka, India Wipro Full time

    Job Description: As a key member of our team at Wipro, you will be responsible for designing and implementing scalable and efficient Kafka-based solutions.We are looking for an experienced Kafka Integration Specialist to join our team and contribute to the development of cutting-edge microservices-based applications.Your primary focus will be on setting up...


  • Bengaluru, Karnataka, India Pro Integrate Consulting Full time

    Job Title: Kafka Azure DevOps LeadCompany Description: Pro Integrate Consulting provides consulting services for a wide range of IT skills and technologies, serving clients across the globe.Role Description:- This is a remote contract role for a Kafka Azure DevOps Lead at Pro Integrate.- The role involves overseeing software development, test automation,...


  • Bengaluru, Karnataka, India ITQube LTD Full time

    Job Title: Senior CAD Migration SpecialistITQube LTD is seeking a highly skilled Senior CAD Migration Specialist to join our team. As a key member of our engineering team, you will be responsible for managing and executing the migration of CAD design and engineering data from legacy Teamcenter PLM systems to SAP PLM systems through SolidWorks.Key...


  • Bengaluru, Karnataka, India Diligent Full time

    About DiligentWe are Diligent, a global leader in modern governance, providing SaaS solutions across governance, risk, compliance, audit, and ESG. Our mission is to empower leaders with the technology, insights, and connections needed to drive greater impact and accountability.Job OverviewThe Customer Success Specialist (Data Migration) plays a vital role in...


  • Bengaluru, Karnataka, India Bosch Full time

    Job DescriptionWe are seeking a highly skilled SAP ABAP Migration Specialist to join our team at Bosch. The ideal candidate will have 4-6 years of experience in SAP ABAP with Data Migration, with a strong focus on migration tools such as LTMC, LTMOM, LSMW, BAPI, Idoc, and Debugging.The successful candidate will have good experience in ABAP & Migration...

  • Data Migration Expert

    3 weeks ago


    Bengaluru, Karnataka, India Tech Mahindra Full time

    Data Migration SpecialistAt Tech Mahindra, we are seeking a highly skilled Data Migration Specialist to join our team. As a key member of our data migration team, you will be responsible for planning, executing, and validating data migrations across various platforms.Key Responsibilities:Data Migration Planning and Execution: Develop and execute data...

  • Software Developer

    2 days ago


    Bengaluru, Karnataka, India Anthology Inc Full time

    Job Title: Software Developer - Data Migration SpecialistJob Summary:Anthology Inc is seeking a skilled Software Developer - Data Migration Specialist to join our team. The ideal candidate will have a strong background in database development, data migration, and SQL scripting.Key Responsibilities:Design, migrate, and program database effortsProvide...


  • Bengaluru, Karnataka, India Ontrack HR Services Pvt LTD Full time

    Job Description As a key member of our team at Ontrack HR Services Pvt LTD, we are seeking a highly skilled Cloud Infrastructure Migration Specialist to lead our cloud migration initiatives. The ideal candidate will have a strong background in cloud infrastructure solutions, including subscription design, identity and access management, network topology and...