Technical Lead

3 weeks ago


Bangalore Urban, India Wipro Full time

Tech Lead-Python, Spark/Scala, Kafka and Cloud storage on Azure Cloud platform


Role

Sr.Data Engineer

Years of Experience

5-7 Yrs

Preferred Location

HYD 2

Shift Timing (IST)

11:00 AM - 08:30 PM

Short Description

Develop batch and real-time streaming data pipelines using Python, Spark/Scala, Kafka and Cloud storage on the Azure Cloud platform, as well as implement and integrate APIs using Microservice architecture in SpringBoot/Java

Engagement Duration (in Months)

18

Engagement & Project Overview

IDStrat Transformation and ClinicalInsights

Primary Responsibilities

Build batch and real-time streaming data pipelines using Python, Spark/Scala, Kafka and Cloud storage on Azure Cloud platform

End-to-End ownership, implement to production deployment

Schedule ETL jobs, monitor the pipeline, resolving the issues

Contribute in designing the data solutions including integration, transformation and loading

Must Have Skills

Should have minimum 5-7 years of experience in Data Engineering and ETL

Minimum 2 years of experience in building data solutions on Azure Cloud

Experience in developing batch and real-time streaming data pipelines using Python, Spark/Scala, Kafka and Cloud storage on Azure Cloud platform

Hands on experience in implementing and integrating APIs using Microservice architecture in SpringBoot/Java

Experience in Azure Data Factory to streamline orchestration and data movement tasks and integrate with Databricks and optimize Spark ETL jobs

Experience in integrating, transforming, and consolidating data from various structured and unstructured data

Experience with Azure services such as ADLS, Databricks, AKS, Azure EventHub, CosmosDB

Strong hold on SQL and NoSQL databases

Translate complex functional and technical requirements into detailed design

Expert in CI/CD including automating data pipelines, monitoring data processes, and managing deployments

Propose best practices/standards

Excellent communication skills.

Nice To Have Skills

Snowflake


  • Technical Lead

    3 weeks ago


    Bangalore Urban, India ITILITE Full time

    About Us: ( ITILITE ( is a fast growing business travel and expense platform disrupting a $2.5 Trillion industry. At ITILITE (lite-itineraries), we believe that companies deserve a travel solution that takes the pain out of work trips. Travelers should focus on their core work and not spend time on making travel bookings and then filing for expenses....

  • Technical Lead

    1 month ago


    Bangalore Urban, India Delhivery Full time

    We are seeking a highly skilled Technical Lead to join our dynamic and growing team. As a Technical Lead, you will be responsible for leading a team of developers to design, develop, and implement software solutions that meet our clients' needs. You will work closely with project managers, designers, and other stakeholders to ensure that projects are...

  • Technical Lead

    3 weeks ago


    Bangalore Urban, India Delhivery Full time

    We are seeking a highly skilled Technical Lead to join our dynamic and growing team. As a Technical Lead, you will be responsible for leading a team of developers to design, develop, and implement software solutions that meet our clients' needs. You will work closely with project managers, designers, and other stakeholders to ensure that projects are...

  • Technical Lead

    3 weeks ago


    Bangalore Urban, India Delhivery Full time

    We are seeking a highly skilled Technical Lead to join our dynamic and growing team. As a Technical Lead, you will be responsible for leading a team of developers to design, develop, and implement software solutions that meet our clients' needs. You will work closely with project managers, designers, and other stakeholders to ensure that projects are...

  • Technical Lead

    2 hours ago


    Bangalore Urban, India Bottomline Full time

    Develop code for system changes or new modules within company and architecture according to specifications and standards Participates and contribute in formal and informal code reviews Prepares and executes accurate unit test plans, test data, and test modules and scripts Documents code changes and unit test results per Best Practices Performs production...

  • SW technical lead

    2 weeks ago


    Bangalore Urban, India Centum T&S Full time

    CENTUM T&S, headquartered in France, is a business unit of Centum Electronics Group (Around 1000Cr turnover organization) offering a wide range of electronic and embedded systems design engineering services to international customers to help them realize complex products and sub systems. It includes design, development, qualification, value engineering,...


  • Bangalore Urban, India Netradyne Full time

    Job Title:NetSuite Technical and Functional LeadDepartment/Group: Cloud Group/BSGExperience:10+ yearsNetSuite Technical Consultant is an important role within the Business Systems Group. As NetraDyne continues its fast-paced growth, the development of our business systems plays a crucial role in supporting our expansion. The NetSuite Technical...


  • Bangalore Urban, India Netradyne Full time

    Job Title: NetSuite Technical and Functional Lead Department/Group: Cloud Group/BSG Experience:10+ years NetSuite Technical Consultant is an important role within the Business Systems Group. As NetraDyne continues its fast-paced growth, the development of our business systems plays a crucial role in supporting our expansion. The NetSuite Technical...


  • Bangalore Urban, India Netradyne Full time

    Job Title:NetSuite Technical and Functional LeadDepartment/Group: Cloud Group/BSGExperience:10+ yearsNetSuite Technical Consultant is an important role within the Business Systems Group. As NetraDyne continues its fast-paced growth, the development of our business systems plays a crucial role in supporting our expansion. The NetSuite Technical...


  • Bangalore Urban, India System Soft Technologies Full time

    Title: Salesforce Technical LeadHybrid in Bangalore7 + years of Experience in technology implementation for full lifecycle enterprise software projects5 + years of Experience in designing and developing full stack solutions using Salesforce Platform and related technologiesStrong experience with Salesforce CPQ and Billing solutionsExperience with DevOps...

  • Technical Lead

    3 weeks ago


    Bangalore Urban, India Wipro Full time

    Tech Lead-Python, Spark/Scala, Kafka and Cloud storage on Azure Cloud platform Role Sr.Data Engineer Years of Experience 5-7 Yrs Preferred Location HYD 2 Shift Timing (IST) 11:00 AM - 08:30 PM Short Description Develop batch and real-time streaming data pipelines using Python, Spark/Scala, Kafka and Cloud storage on the Azure Cloud platform, as well...

  • Technical Lead

    3 weeks ago


    Bangalore Urban, India Wipro Full time

    Tech Lead-Data Governance-Collibra/Data Quality/Axon Data Governance – 6+years to 10 Years Collibra Data quality Axon/Data Governance Communication skills should be good and should have hands on experience on collibra tools. should able to answer data governance concepts and uses cases. Should be Responsible for leveraging the Collibra Data...

  • Technical Lead

    4 weeks ago


    Bangalore Urban, India Wipro Full time

    Tech Lead-Data Governance-Collibra/Data Quality/AxonData Governance – 6+years to 10 Years Collibra Data quality Axon/Data GovernanceCommunication skills should be good and should have hands on experience on collibra tools. should able to answer data governance concepts and uses cases. Should be Responsible for leveraging the Collibra Data Governance...

  • Technical Lead

    3 weeks ago


    Bangalore Urban, India Wipro Full time

    Tech Lead-Data Governance-Collibra/Data Quality/AxonData Governance – 6+years to 10 Years Collibra Data quality Axon/Data GovernanceCommunication skills should be good and should have hands on experience on collibra tools. should able to answer data governance concepts and uses cases. Should be Responsible for leveraging the Collibra Data Governance...

  • Technical Lead

    4 weeks ago


    Bangalore Urban, India Wipro Full time

    Tech Lead-B3 Sr. Data Engineer – India • Will be working as an ELT Engineer for an enterprise data warehouse that handles data extraction, loading and transformation process for lead, sales, commission, calls, finance, and few other domains.• Will be involved in data pipeline design, data integration and data retention activities.• Will be guiding...

  • Technical Lead

    3 weeks ago


    Bangalore Urban, India Wipro Full time

    Tech Lead-B3 Sr. Data Engineer – India • Will be working as an ELT Engineer for an enterprise data warehouse that handles data extraction, loading and transformation process for lead, sales, commission, calls, finance, and few other domains. • Will be involved in data pipeline design, data integration and data retention activities. • Will be...

  • Technical Lead

    3 weeks ago


    Bangalore Urban, India Wipro Full time

    Tech Lead-B3 Sr. Data Engineer – India • Will be working as an ELT Engineer for an enterprise data warehouse that handles data extraction, loading and transformation process for lead, sales, commission, calls, finance, and few other domains.• Will be involved in data pipeline design, data integration and data retention activities.• Will be guiding...

  • Technical Lead

    21 hours ago


    Bangalore Urban, India Stealth Startup Full time

    What you’ll be doing We are much more than our job descriptions, but here is where you will begin: ● Collaborate with stakeholders, including product owners, project managers, and scrum masters, to define and clarify project requirements. ● Translate business requirements into technical specifications and ensure all stakeholders have a clear...

  • Technical Lead

    1 week ago


    Bangalore Urban, India ThoughtFocus Full time

    Job Description (Looking for early joiners) Experience:- 11 to 15 Years Skillsets we are looking for: 8 to 11 years of working experience in Data Engineering. 6+ years experience in PySprak. 5+ years experience in AWS Cloud. 5+ years experience in AWS Glue. 5+ years experience in AWS Redshift. 5+ years exp in AWS CI/CD pipeline like...

  • Technical Lead

    1 week ago


    Bangalore Urban, India ThoughtFocus Full time

    Job Description (Looking for early joiners) Experience:- 11 to 15 Years Skillsets we are looking for: 8 to 11 years of working experience in Data Engineering. 6+ years experience in PySprak. 5+ years experience in AWS Cloud. 5+ years experience in AWS Glue. 5+ years experience in AWS Redshift. 5+ years exp in AWS CI/CD pipeline like code build, code...