Current jobs related to Technical Lead-ADF/spark/Kafka - bangalore - Wipro

  • Technical Lead

    1 month ago

    Bangalore, India Bizdeed HR Solutions Pvt.Ltd Full time

    Role : Technical Lead - Data : Bangalore (Work from Office) Job Type : : 8 yrs - 14 yrs Job Summary : We are looking for a Technical Lead with a strong background in Databricks, Airflow, PySpark/Spark, Kafka, and Cloud technologies to lead our data engineering efforts. The successful candidate will be responsible for architecting, designing, and...

  • Technical Lead

    5 days ago

    bangalore, India Mobileum Full time

    We are hiring for the position of Technical lead role based on below job criteria. Exp: 6+Yrs Rel Exp in telecom domain is preferable. Responsibilities & Deliverables: This person would be responsible for design, development and deployment of platform components. Job Description: As a Big data engineer you will be responsible for Design and development of...

  • Lead Data Engineer

    2 weeks ago

    Bangalore, India Rigel networks Full time

    Job Title : Lead Data EngineerLocation : BangaloreNotice Period : Immediate - 15 DaysAbout the Role :We are seeking a highly skilled Lead Data Engineer with extensive experience in data engineering and a strong background in Big Data technologies. The ideal candidate will have 7+ years of relevant experience, with expertise in Python, SQL, and AWS, and a...

  • Lead Data Engineer

    1 month ago

    Bangalore, Karnataka, India Rigel networks Full time

    Job Title : Lead Data EngineerLocation : BangaloreNotice Period : Immediate - 15 DaysAbout the Role :We are seeking a highly skilled Lead Data Engineer with extensive experience in data engineering and a strong background in Big Data technologies. The ideal candidate will have 7+ years of relevant experience, with expertise in Python, SQL, and AWS, and a...

  • Data Engineer

    1 month ago

    Bangalore, India Recro Full time

    Job Description : - Design, develop, and implement efficient data pipelines using Apache Spark for data ingestion, transformation, and loading (ETL) processes. - Utilize Spark SQL and other data processing techniques to manipulate and analyze large datasets. - Experience building and maintaining stream processing applications using technologies like...

  • Technical Lead

    4 weeks ago

    Bangalore, India Mobileum Full time

    We are a leading provider of analytics solutions for the Telecom industry. We believe in a world where people make decisions based on facts and truthful data. We optimize roaming, protect networks and improve customer experience across the board for telecom operators around the world – all through our Active Intelligence Platform. Headquartered in Silicon...

  • Technical lead

    4 weeks ago

    Bangalore, India Mobileum Full time

    We are a leading provider of analytics solutions for the Telecom industry. We believe in a world where people make decisions based on facts and truthful data. We optimize roaming, protect networks and improve customer experience across the board for telecom operators around the world – all through our Active Intelligence Platform. Headquartered in...

  • Technical Lead

    1 week ago

    bangalore, India Mobileum Full time

    We are hiring for the position of Technical lead role based on below job criteria.Exp: 6+YrsRel Exp in telecom domain is preferable.Responsibilities & Deliverables:This person would be responsible for design, development and deployment of platform components.Job Description:As a Big data engineer you will be responsible forDesign and development of...

  • Confluent Kafka Designer

    3 weeks ago

    Bangalore, India Torry Harris Integration Solutions Full time

    Confluent Kafka Designer Job Description Are you an experienced Confluent Kafka Developer looking for a new opportunity? Look no further than Torry Harris! We are currently seeking a talented and experienced individual to join our team as a Senior Confluent Kafka Developer. The Senior Confluent Kafka Developer will be responsible for designing,...

  • Confluent kafka designer

    3 weeks ago

    Bangalore, India Torry Harris Integration Solutions Full time

    Confluent Kafka Designer Job Description Are you an experienced Confluent Kafka Developer looking for a new opportunity? Look no further than Torry Harris! We are currently seeking a talented and experienced individual to join our team as a Senior Confluent Kafka Developer. The Senior Confluent Kafka Developer will be responsible for designing,...

  • Confluent Kafka Designer

    3 weeks ago

    bangalore, India Torry Harris Integration Solutions Full time

    Confluent Kafka DesignerJob DescriptionAre you an experienced Confluent Kafka Developer looking for a new opportunity? Look no further than Torry Harris! We are currently seeking a talented and experienced individual to join our team as a Senior Confluent Kafka Developer.The Senior Confluent Kafka Developer will be responsible for designing, developing, and...

  • Senior Data Engineer

    1 month ago

    Bangalore, India TekIT Software Solutions Full time

    Job Title : Data Engineer Location : Bangalore (Hybrid). What we are looking for :- 4+ years' overall work experience and bachelor's degree in Information Science, Computer Science, Mathematics, Statistics, or a quantitative discipline in science, business, or social science.- Minimum of 3 years of experience as a data developer using Python,...

  • Kafka Architect

    2 weeks ago

    Bangalore/Pune/Bhubaneshwar/Cochin/Kochi, India Risk Resources LLP Full time

    Key Responsibilities:- Design and implement real-time data streaming solutions using Kafka at an enterprise level.- Develop scalable and high-performance Kafka-based solutions to handle real-time data streams.- Collaborate with stakeholders to understand and define requirements for Kafka-based event streaming applications.- Implement and optimize Kafka...

  • Big Data Engineer/Lead

    4 weeks ago

    Bangalore, Karnataka, India TekPillar Full time

    Join our dynamic team in Bangalore as a Big Data Engineer contribute to our key data engineering initiatives! You will play a crucial role in managing and prioritizing projects while driving strategies and executing data engineering solutions.Job Title : Big Data Engineer/ LeadExperience : 4 to 9 YearsLocation : BangaloreKey Responsibilities : - Collaborate...

  • Confluent Kafka Designer

    3 weeks ago

    bangalore, India Torry Harris Integration Solutions Full time

    Confluent Kafka DesignerJob DescriptionAre you an experienced Confluent Kafka Developer looking for a new opportunity? Look no further than Torry Harris! We are currently seeking a talented and experienced individual to join our team as a Senior Confluent Kafka Developer.The Senior Confluent Kafka Developer will be responsible for designing, developing, and...

  • Confluent Kafka Designer

    5 days ago

    bangalore, India Torry Harris Integration Solutions Full time

    Confluent Kafka Designer Job Description Are you an experienced Confluent Kafka Developer looking for a new opportunity? Look no further than Torry Harris! We are currently seeking a talented and experienced individual to join our team as a Senior Confluent Kafka Developer. The Senior Confluent Kafka Developer will be responsible for designing, developing,...

  • Confluent kafka designer

    1 week ago

    Bangalore City, India Torry Harris Integration Solutions Full time

    Confluent Kafka Designer Job Description Are you an experienced Confluent Kafka Developer looking for a new opportunity? Look no further than Torry Harris! We are currently seeking a talented and experienced individual to join our team as a Senior Confluent Kafka Developer. The Senior Confluent Kafka Developer will be responsible for designing, developing,...

  • Technical Lead

    1 week ago

    bangalore, India Mobileum Full time

    We are hiring for the position of Technical lead role based on below job criteria.Exp: 6+YrsRel Exp in telecom domain is preferable.Responsibilities & Deliverables:This person would be responsible for design, development and deployment of platform components.Job Description:As a Big data engineer you will be responsible forDesign and development of...

  • Technical Lead

    1 week ago

    bangalore, India Mobileum Full time

    We are hiring for the position of Technical lead role based on below job criteria. Exp: 6+Yrs Rel Exp in telecom domain is preferable. Responsibilities & Deliverables: This person would be responsible for design, development and deployment of platform components. Job Description: As a Big data engineer you will be responsible for Design and development of...

  • Azure architect

    5 days ago

    Bangalore, India TEKNIKOZ Full time

    Greetings from Teknikoz Experience : 12+ Years Roles and Responsibilities * Works in tandem with our Architecture, Applications and Security teams * Identify and implement the most optimal and secure Azure cloud-based solutions for the company. * Design and implement end-to-end Azure data solutions, including data ingestion, storage, processing,...

Technical Lead-ADF/spark/Kafka

2 months ago

bangalore, India Wipro Full time

Tech Lead- Python, Spark/Scala, Kafka and Cloud storage on Azure Cloud platform

Role
Sr.Data Engineer
Years of Experience
5-7 Yrs
Preferred Location
HYD 2
Shift Timing (IST)
11:00 AM - 08:30 PM
Short Description
Develop batch and real-time streaming data pipelines using Python, Spark/Scala, Kafka and Cloud storage on the Azure Cloud platform, as well as implement and integrate APIs using Microservice architecture in SpringBoot/Java
Engagement Duration (in Months)
18
Engagement & Project Overview
IDStrat Transformation and ClinicalInsights
Primary Responsibilities
Build batch and real-time streaming data pipelines using Python, Spark/Scala, Kafka and Cloud storage on Azure Cloud platform
End-to-End ownership, implement to production deployment
Schedule ETL jobs, monitor the pipeline, resolving the issues
Contribute in designing the data solutions including integration, transformation and loading
Must Have Skills
Should have minimum 5-7 years of experience in Data Engineering and ETL
Minimum 2 years of experience in building data solutions on Azure Cloud
Experience in developing batch and real-time streaming data pipelines using Python, Spark/Scala, Kafka and Cloud storage on Azure Cloud platform
Hands on experience in implementing and integrating APIs using Microservice architecture in SpringBoot/Java
Experience in Azure Data Factory to streamline orchestration and data movement tasks and integrate with Databricks and optimize Spark ETL jobs
Experience in integrating, transforming, and consolidating data from various structured and unstructured data
Experience with Azure services such as ADLS, Databricks, AKS, Azure EventHub, CosmosDB
Strong hold on SQL and NoSQL databases
Translate complex functional and technical requirements into detailed design
Expert in CI/CD including automating data pipelines, monitoring data processes, and managing deployments
Propose best practices/standards
Excellent communication skills.
Nice To Have Skills
Snowflake