Lead Data Engineer

4 weeks ago

Bengaluru, India Recro Full time
Position: Data Engineer(Lead)

Location: WFO-Bangalore

Experience Level: 8+ years

Job Description:

Summary:

We're seeking a highly skilled and experienced Big Data Architect to join our innovative and dynamic team. You'll play a pivotal role in designing, building, and maintaining our scalable big data infrastructure. The ideal candidate will be a passionate problem-solver with a proven track record of developing robust data pipelines and architecting data products across diverse architectures.

Responsibilities:

- Design and architect big data solutions leveraging distributed platforms (e.g., Spark, EMR) to meet complex business needs.- Partner with data scientists, analysts, and software engineers to understand data requirements and propose innovative data solutions.- Develop, implement, and manage high-performing data pipelines for ingesting, transforming, and delivering data into our data warehouse and data lake.- Champion data quality by implementing robust data cleansing, transformation, and enrichment processes.- Continuously monitor and optimize data pipelines for peak performance, scalability, and cost-effectiveness.- Integrate security best practices into data pipelines and ensure data protection measures are in place.- Troubleshoot and debug complex data pipeline issues, performance bottlenecks, and data quality problems.- Advocate for and contribute to improvements in the overall data engineering process.- Foster a collaborative environment by mentoring and developing other data engineers in adopting best practices.

Attributes & Qualifications:

Technical Skills:

- 8+ years of experience in developing and architecting scalable big data applications or solutions.- Expertise in distributed processing frameworks like Spark (Python, Scala).- Experience with cloud platforms for data engineering (AWS S3, Managed Airflow, EMR/EC2, IAM etc. preferred).- Experience with data pipeline orchestration tools (Airflow, Jenkins) and CI/CD practices.- Proficiency in SQL databases (Presto, Snowflake) and data warehousing concepts.- Experience architecting data products in streaming, serverless, and microservices architectures.- Experience with Data Lakehouse architecture (e.g., Databricks Delta Lake, Medallion).- Strong understanding of data governance, data modeling, and data quality frameworks.- Familiarity with reporting and analytical tools (Tableau, Quicksight).

Soft Skills:

- Excellent problem-solving skills with a keen eye for detail.- Strong communication and collaboration skills across technical and non-technical audiences.- Ability to work independently and as part of a fast-paced, Agile/Scrum development team.- Passion for data, a continuous learning mindset, and a willingness to learn new technologies.

  • Senior Data Engineer

    3 days ago

    Bengaluru, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...

  • Digital Engineering Lead Engineer

    5 days ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 274698 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Bengaluru, Karnātaka (IN-KA), India...

  • Digital Engineering Lead Engineer

    3 days ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 274698 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Bengaluru, Karnātaka (IN-KA), India...

  • Digital Engineering Lead Engineer

    2 days ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 274727 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Bengaluru, Karnātaka (IN-KA), India...

  • Lead Data Engineer

    1 week ago

    Bengaluru, India UNO Digital Bank Full time

    We are seeking a highly motivated and experienced Data Engineering Lead to join our young team. The ideal candidate will possess a deep understanding of data engineering principles, a proven track record of leading data engineering initiatives, the ability to drive the development and implementation of robust data infrastructure and an understanding of the...

  • Digital Engineering Lead Engineer

    5 days ago

    Bengaluru, India NTT DATA Full time

    Job Description NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in bangalore, Karnātaka (IN-KA), India (IN).Java-5+ yrs,...

  • Digital Engineering Lead Engineer

    3 days ago

    Bengaluru, India NTT DATA Full time

    Job Description NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in bangalore, Karnātaka (IN-KA), India (IN).Java-5+ yrs,...

  • Lead Data Engineer

    1 month ago

    Bengaluru, India Epam Full time

    DescriptionEPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver...

  • Digital Engineering Lead Engineer

    4 days ago

    Bengaluru, India NTT DATA Services Full time

    Req ID:248703NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job...

  • Data Engineering Lead

    2 months ago

    Bengaluru, India UNO Digital Bank Full time

    We are seeking a highly motivated and experienced Data Engineering Lead to join our young team. The ideal candidate will possess a deep understanding of data engineering principles, a proven track record of leading data engineering initiatives, the ability to drive the development and implementation of robust data infrastructure and an understanding of the...

  • Data Engineering Lead

    2 months ago

    Bengaluru, India UNO Digital Bank Full time

    We are seeking a highly motivated and experienced Data Engineering Lead to join our young team. The ideal candidate will possess a deep understanding of data engineering principles, a proven track record of leading data engineering initiatives, the ability to drive the development and implementation of robust data infrastructure and an understanding of the...

  • Data Engineering Lead

    2 months ago

    Bengaluru, India UNO Digital Bank Full time

    We are seeking a highly motivated and experienced Data Engineering Lead to join our young team. The ideal candidate will possess a deep understanding of data engineering principles, a proven track record of leading data engineering initiatives, the ability to drive the development and implementation of robust data infrastructure and an understanding of the...

  • Digital Engineering Lead Engineer

    3 days ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 272210 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Lead Data Engineer

    2 months ago

    Bengaluru, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...

  • Lead Data Engineer

    1 month ago

    Bengaluru, India Spectrum Consultants India Private Limited Full time

    Lead Data Engineer SummaryExperience Required:10 - 15 YearsJob Term:PermanentLocation:BangaloreCategory:Software DevelopmentKBS India serves as a hub for innovation supporting operations for Koch companies: Georgia-Pacific, Molex, Guardian, INVISTA, Koch Ag & Energy Solutions, Koch Minerals and Trading, Koch Business Solutions, KES, etc., Specialties of...

  • Lead Data Engineer

    4 days ago

    Bengaluru, India Kenvue Full time

    Who We Are ? At Kenvue GCC Bengaluru, we realize the extraordinary power of everyday care. Built on over a century of heritage and rooted in science, we’re the house of iconic brands - including NEUTROGENA®, AVEENO®, TYLENOL®, LISTERINE®, JOHNSON’S® and BAND-AID® that you already know and love. Science is our passion; care is our talent. Our global...

  • Lead Data Engineer

    1 month ago

    Bengaluru, India Koch Global Services Full time

    Your JobThe Lead Data Engineer will report to the Data Engineering & BI Lead of the KGSI and will be responsible to develop and implement a future-state data analytics platform for both the back-end data processing and the front-end data visualization component for the Finance Data Delivery teams. This will be a hands-on role and the candidate will be...

  • Digital Engineering Lead Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Bengaluru, Karnātaka (IN-KA), India (IN).• Experience in...

  • Lead Data Engineer

    4 days ago

    Bengaluru, India Kenvue Full time

    Kenvue is currently recruiting for: Lead Engineer, Kenvue Data Platforms: This position reports into Sr Manager / Director and is based at Bengaluru. Who We Are: At Kenvue, we realize the extraordinary power of everyday care. Built on over a century of heritage and rooted in science, we’re the house of iconic brands - including NEUTROGENA®, AVEENO®,...

  • Lead Data Engineer

    5 days ago

    Bengaluru, India Kenvue Full time

    Kenvue is currently recruiting for:Lead Engineer, Kenvue Data PlatformsThis position reports into Sr Manager / Director and is based at Bengaluru.Who We AreAt Kenvue, we realize the extraordinary power of everyday care. Built on over a century of heritage and rooted in science, were the house of iconic brands - including NEUTROGENA, AVEENO, TYLENOL,...