Senior Big Data Engineer

4 days ago


Bengaluru, Karnataka, India IBCScorp Full time

At IBCScorp, we are looking for a highly skilled Senior Big Data Engineer to lead our event streaming initiatives using Apache Kafka.

As a key member of our engineering team, you will be responsible for designing and implementing data pipelines that integrate various data sources and sinks using Kafka. Your expertise in Kafka Streams and Connect will enable you to develop scalable and efficient streaming applications that meet the needs of our business.

We are seeking an experienced professional with a strong background in software development, data engineering, and event-driven architecture. Your ability to collaborate with cross-functional teams and communicate technical concepts effectively will be essential in driving the success of our project.

Key Responsibilities:

  • Design and implement high-performance data pipelines using Apache Kafka
  • Develop and maintain streaming applications using Kafka Streams and Connect
  • Collaborate with development teams to integrate Kafka with various data sources and sinks
  • Troubleshoot and optimize Kafka clusters for performance and reliability

Requirements:

  • 5+ years of experience in software development, data engineering, or a related field
  • 4+ years of experience working with Apache Kafka
  • Strong knowledge of Java or Python programming languages
  • Familiarity with cloud-based platforms such as AWS or GCP

What We Offer:

  • A competitive salary range of $140,000 - $200,000 per year, based on experience
  • Opportunities for career growth and professional development
  • A dynamic and collaborative work environment

Please note that these estimates are based on national averages and may vary depending on location.



  • Bengaluru, Karnataka, India Grid Dynamics Full time

    Job Description:We are seeking a highly skilled Senior Big Data Engineer to join our team at Grid Dynamics. As a key member of our big data team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Hadoop and Spring Boot.Responsibilities:- Design and develop scalable big data architectures using...


  • Bengaluru, Karnataka, India Guidewire Software Full time

    Guidewire Software is seeking a highly skilled Senior Big Data Engineer to join its Data Platform and Analytics team. The ideal candidate will have a strong background in designing and developing scalable and high-performance data pipelines for collecting, processing, and storing large datasets.Key Responsibilities:Design and develop data pipelines using...


  • Bengaluru, Karnataka, India TapTalent Full time

    Job Title: Senior Big Data Engineer - Cloud ExpertAt TapTalent, we are seeking a highly skilled Senior Big Data Engineer with expertise in Cloud Computing to join our team. As a Senior Big Data Engineer, you will be responsible for designing and implementing scalable data architectures using Cloud technologies. Your primary focus will be on building and...

  • Senior Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Nielsen Full time

    We are seeking a highly skilled Senior Data Engineer (Big Data Analytics) to join our team at Nielsen. This role will focus on designing, building, and maintaining large-scale data processing systems using big data technologies such as Apache Spark.About the Role:Design and develop scalable, reliable, and cost-effective data processing systemsCollaborate...


  • Bengaluru, Karnataka, India Adobe Full time

    Job SummaryWe are seeking an experienced Senior Big Data Engineer Lead to join our team at Adobe. This is a leadership role that requires strong technical expertise in designing, developing, and implementing large-scale data systems.


  • Bengaluru, Karnataka, India F335 Deutsche India Private Limited, Bangalore Branch Full time

    Job DescriptionSenior Big Data Engineer is required to develop and deliver engineering solutions to accomplish business goals at F335 Deutsche India Private Limited, Bangalore Branch. The successful candidate will be responsible for designing and coding stable and scalable data ingestion workflows, integrating into existing workflows, and working with team...

  • Senior Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India wm staffing solutions Full time

    Job Description: We are seeking a talented Senior Data Engineer - Big Data Pipelines to join our team at WM Staffing Solutions. In this role, you will be responsible for designing, developing, and supporting data pipelines using GCP Big Query, PySpark, Python, and Composer/Airflow. Key responsibilities:• Design and develop data pipelines using GCP Big...


  • Bengaluru, Karnataka, India GForce Consulting Solutions (OPC) Pvt. Ltd. Full time

    Senior Software EngineerGForce Consulting Solutions (OPC) Pvt. Ltd., a leading global IT services company, is seeking an experienced Senior Software Engineer for our Multinational Client.About the RoleThis role involves working with our client to design and develop cutting-edge big data solutions using AWS Data Bricks, S3, Redshift, EC2, Lambda, Azure data...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Krishpar Technologies Pvt. Ltd Full time

    Job Title: Big Data EngineerJob Summary: We are seeking a highly skilled Big Data Engineer to join our team at Krishpar Technologies Pvt. Ltd. The ideal candidate will have expertise in Hadoop, Hive, and other big data technologies. Key Responsibilities:Design and implement big data solutions using Hadoop, Hive, and other relevant technologies.Develop and...

  • Senior Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Huquo Full time

    At Huquo, we're seeking an experienced Senior Data Engineer to lead our cloud and big data initiatives. As a key member of our team, you'll be responsible for designing, implementing, and maintaining high-performance data engineering solutions on cloud platforms such as AWS and Azure.Key Responsibilities:Cloud Data Engineering: Utilize your expertise in...


  • Bengaluru, Karnataka, India Nielsen Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at Nielsen, where you will play a key role in developing and maintaining our Big Data solutions. As a Senior Software Engineer, you will be responsible for designing, implementing, and deploying scalable and reliable software systems that meet the needs of our...


  • Bengaluru, Karnataka, India Teva Pharmaceuticals Full time

    About the RoleWe're seeking a highly skilled Senior Big Data Developer to join our team at Teva Pharmaceuticals. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying large-scale data processing systems using cutting-edge technologies like Azure and Python.Key ResponsibilitiesDesign and implement data...


  • Bengaluru, Karnataka, India Oracle Full time

    At Oracle, we are seeking a highly skilled Senior Big Data Operations Engineer to join our team.About the RoleWe offer an attractive salary of $120,000 per year, depending on your location and experience.The ideal candidate will have 3-4 years of experience in Production Operations/Support area with a strong background in Big Data related Ops/Support,...


  • Bengaluru, Karnataka, India Société Générale Assurances Full time

    Job Title: Senior Big Data Application DeveloperAbout the Role:As a Senior Big Data Application Developer at Société Générale Assurances, you will be responsible for designing, developing, and maintaining large-scale big data applications using Hadoop and Spark. You will work closely with cross-functional teams to deliver high-quality software solutions...


  • Bengaluru, Karnataka, India Guidewire Software Full time

    Guidewire Software is seeking a highly skilled Senior Big Data Developer to join its Data Platform and Analytics team. This team owns, builds, and operates the company's cloud-native data platform and analytics SaaS offerings.The ideal candidate will have a strong background in building large-scale distributed data processing systems, with expertise in big...


  • Bengaluru, Karnataka, India Nielsen Full time

    We are seeking a highly skilled Senior Software Engineer for our big data team. As a key member of our team, you will be responsible for designing, implementing, and maintaining our cloud-based big data system.Key Responsibilities:Design and implement new features and methodologies to make our system more effective.Develop and maintain our application server...

  • Big Data Engineer

    1 month ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Role: Big Data EngineerKey Responsibilities:Design and develop scalable big data architectures using Hadoop and SparkImplement data processing pipelines using Scala and SparkCollaborate with cross-functional teams to deliver data-driven insightsRequirements:5+ years of experience in big data engineeringStrong knowledge of Hadoop, Spark, Scala, and...

  • Big Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India TapTalent Full time

    We are seeking a talented Data Engineering Lead to join our team at TapTalent. As a key member of our data engineering team, you will be responsible for the design and development of our big data platform.Main Responsibilities:Expertise in Data Engineering with a focus on big data processing technologies.Deep understanding of modern data processing...


  • Bengaluru, Karnataka, India Mercedes-Benz Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Mercedes-Benz Research and Development India Private Limited.ResponsibilitiesDesign and develop scalable big data platforms for fleet data analytics.Collaborate with cross-functional teams to integrate data engineering solutions.Analyze and resolve complex data engineering...


  • Bengaluru, Karnataka, India The Nielsen Company Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our Big Data team at The Nielsen Company. As a key member of our team, you will be responsible for designing, developing, and deploying complex software applications using Big Data technologies.Key ResponsibilitiesDesign and develop scalable, reliable, and cost-effective software...