Kafka DataEngineer

2 days ago

Bengaluru, Karnataka, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Description Kafka Data EngineerData Engineer to build and manage data pipelines that support batch and streaming data solutions. The role requires expertise in creating seamless data flows across platforms like Data Lake/Lakehouse in Cloudera, Azure Databricks, Kafka for both batch and stream data pipelines etc.ResponsibilitiesStrong experience in develop, test, and maintain data pipelines (batch & stream) using Cloudera, Spark, Kafka and Azure services like ADF, Cosmos DB, Databricks, NoSQL DB/ Mongo DB etc.Strong programming skills in spark, python or scala & SQL.Optimize data pipelines to improve speed, performance, and reliability, ensuring that data is available for data consumers as required.Create ETL pipelines for downstream consumers by transform data as per business logic.Work closely with Data Architects and Data Analysts to align data solutions with business needs and ensure the accuracy and accessibility of data.Implement data validation checks and error handling processes to maintain high data quality and consistency across data pipelines.Strong analytical and problem solving skills, with a focus on optimizing data flows and addressing impacts in the data pipeline. Qualifications8+ years of IT experience with at least 5+ years in data engineering and cloud-based data platforms.Strong experience with Cloudera/any Data Lake, Confluent/Apache Kafka, and Azure Data Services (ADF, Databricks, Cosmos DB).Deep knowledge of NoSQL databases (Cosmos DB, MongoDB) and data modeling for performance and scalability.Proven expertise in designing and implementing batch and streaming data pipelines using Databricks, Spark, or Kafka.Experience in creating scalable, reliable, and high-performance data solutions with robust data governance policies.Strong collaboration skills to work with stakeholders, mentor junior Data Engineers, and translate business needs into actionable solutions.Bachelors or masters degree in computer science, IT, or a related field.

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Infobell IT Full time ₹ 1,20,000 - ₹ 1,80,000 per year

    Job Title:Big Data DeveloperLocation:Bangalore (Work from Office)Experience:5+ YearsNotice Period:Immediate Joiners PreferredAbout Us:Infobell IT is a technology-driven company specializing inproduct engineering,AI,cloud modernization, anddata analytics. We work with leading enterprises to build scalable, high-performance, and cloud-native solutions.Key...

  • Senior Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Meril Full time ₹ 16,00,000 - ₹ 22,00,000 per year

    We're Hiring: Senior Data EngineerWe are looking for a highly skilledSenior Data Engineerto help build and scale our data pipelines and infrastructure. If you are passionate about modern data architectures, cloud platforms, and high-performance engineering, we want to meet you. Key Technical ResponsibilitiesDesign and build scalable ETL/ELT pipelines for...

  • Data Engineer – Hadoop

    1 week ago

    Bengaluru, Karnataka, India NAZZTEC Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    We are seeking an experiencedData Engineerwith strong expertise in theHadoop ecosystemandPySpark. The ideal candidate should have a deep understanding of large-scale data processing, data pipelines, and automation using Python.Key ResponsibilitiesDesign, develop, and optimize data pipelines using Hadoop and PySpark.Work extensively on HDFS, Hive, and...

  • Senior Machine Learning Engineer

    5 days ago

    Bengaluru, Karnataka, India NAZZTEC Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We're Hiring: Senior ML Engineer (Gen AI, Machine Learning)Mandatory Skills:Graph ML, Agentic AILocation:RemoteDomain:Generative AI | Machine Learning | Distributed Systems OverviewAre you energized by the idea of innovating withGenerative AI?Do you want to buildnext-gen AI-driven products with real-world global impact?This is agreenfield opportunityto...

  • Senior Data Engineer

    5 days ago

    Bengaluru, India Meril Full time

    🔍 We're Hiring: Senior Data EngineerWe are looking for a highly skilled Senior Data Engineer to help build and scale our data pipelines and infrastructure. If you are passionate about modern data architectures, cloud platforms, and high-performance engineering, we want to meet you.🔧 Key Technical ResponsibilitiesDesign and build scalable ETL/ELT...

  • Senior Data Engineer

    3 days ago

    Bengaluru, India Meril Full time

    We're Hiring: Senior Data EngineerWe are looking for a highly skilled Senior Data Engineer to help build and scale our data pipelines and infrastructure. If you are passionate about modern data architectures, cloud platforms, and high-performance engineering, we want to meet you.Key Technical ResponsibilitiesDesign and build scalable ETL/ELT pipelines for...

  • Senior Data Engineer

    2 days ago

    Bengaluru, India Meril Full time

    We're Hiring: Senior Data Engineer We are looking for a highly skilled Senior Data Engineer to help build and scale our data pipelines and infrastructure. If you are passionate about modern data architectures, cloud platforms, and high-performance engineering, we want to meet you.Key Technical ResponsibilitiesDesign and build scalable ETL/ELT...

  • Senior Data Engineer

    3 days ago

    Bengaluru, India Meril Full time

    We're Hiring: Senior Data EngineerWe are looking for a highly skilled Senior Data Engineer to help build and scale our data pipelines and infrastructure. If you are passionate about modern data architectures, cloud platforms, and high-performance engineering, we want to meet you.Key Technical ResponsibilitiesDesign and build scalable ETL/ELT pipelines ...

  • Senior Data Engineer

    3 days ago

    Bengaluru, India Meril Full time

    We're Hiring: Senior Data Engineer We are looking for a highly skilled Senior Data Engineer to help build and scale our data pipelines and infrastructure. If you are passionate about modern data architectures, cloud platforms, and high-performance engineering, we want to meet you.Key Technical ResponsibilitiesDesign and build scalable ETL/ELT...

  • Senior Data Engineer

    4 days ago

    Bengaluru, India Meril Full time

    We're Hiring: Senior Data Engineer We are looking for a highly skilled Senior Data Engineer to help build and scale our data pipelines and infrastructure. If you are passionate about modern data architectures, cloud platforms, and high-performance engineering, we want to meet you. Key Technical Responsibilities - Design and build scalable ETL/ELT pipelines...

  • Account Delivery Head

    4 weeks ago

    Bengaluru, India Tredence Inc. Full time

    About us:Tredence is a global data science solutions provider focused on solving the last mile problem inAI. The ‘last mile’ is the gap between insight creation and value realization. Headquartered inSan Jose, the company embraces a vertical-first approach and an outcome-driven mindset tohelp clients win and accelerate value realization from their...

  • Account Delivery Head

    4 weeks ago

    Bengaluru, India Tredence Inc. Full time

    About us:Tredence is a global data science solutions provider focused on solving the last mile problem inAI. The ‘last mile’ is the gap between insight creation and value realization. Headquartered inSan Jose, the company embraces a vertical-first approach and an outcome-driven mindset tohelp clients win and accelerate value realization from their...

  • Account Delivery Head

    4 weeks ago

    Bengaluru, India Tredence Inc. Full time

    About us:Tredence is a global data science solutions provider focused on solving the last mile problem inAI. The ‘last mile’ is the gap between insight creation and value realization. Headquartered inSan Jose, the company embraces a vertical-first approach and an outcome-driven mindset tohelp clients win and accelerate value realization from their...

  • Account Delivery Head

    3 weeks ago

    Bengaluru, India Tredence Inc. Full time

    About us:Tredence is a global data science solutions provider focused on solving the last mile problem inAI. The ‘last mile’ is the gap between insight creation and value realization. Headquartered inSan Jose, the company embraces a vertical-first approach and an outcome-driven mindset tohelp clients win and accelerate value realization from their...