Team Lead

3 days ago


Bengaluru, Karnataka, India Apex One Full time ₹ 12,00,000 - ₹ 36,00,000 per year

This is 100% WFO opportunity at our Whitefield, Bengaluru office. Please don't apply if you can't comply.

Position Overview:

We seek a highly skilled and experienced Data Engineering Lead to join our team. This role demands deep technical expertise in Apache Spark, Hive, Trino (formerly Presto), Python, AWS Glue, and the broader AWS ecosystem. The ideal candidate will possess strong hands-on skills and the ability to design and implement scalable data solutions, optimise performance, and lead a high-performing team to deliver data-driven insights.

Key Responsibilities:

Technical Leadership

Lead and mentor a team of data engineers, fostering best practices in coding, design, and delivery.

Drive the adoption of modern data engineering frameworks, tools, and methodologies to ensure high-quality and scalable solutions.

Translate complex business requirements into effective data pipelines, architectures, and workflows.

Data Pipeline Development

Architect, develop, and optimize scalable ETL/ELT pipelines using Apache Spark, Hive, AWS Glue, and Trino.

Handle complex data workflows across structured and unstructured data sources, ensuring performance and cost-efficiency.

Develop real-time and batch processing systems to support business intelligence, analytics, and machine learning applications.

Cloud & Infrastructure Management

Build and maintain cloud-based data solutions using AWS services like S3, Athena, Redshift, EMR, DynamoDB, and Lambda.

Design and implement federated query capabilities using Trino for diverse data sources.

Manage Hive Metastore for schema and metadata management in data lakes.

Performance Optimization

Optimize Apache Spark jobs and Hive queries for performance, ensuring efficient resource utilization and minimal latency.

Implement caching and indexing strategies to accelerate query performance in Trino.

Continuously monitor and improve system performance through diagnostics and tuning.

Collaboration & Stakeholder Engagement

Work closely with data scientists, analysts, and business teams to understand requirements and deliver actionable insights.

Ensure that data infrastructure aligns with organizational goals and compliance standards.

Data Governance & Quality

Establish and enforce data quality standards, governance practices, and monitoring processes.

Ensure data security, privacy, and compliance with regulatory frameworks.

Innovation & Continuous Learning

Stay ahead of industry trends, emerging technologies, and best practices in data engineering.

Proactively identify and implement improvements in data architecture and processes.

Qualifications:

Required Technical Expertise

Advanced proficiency with Apache Spark (core, SQL, streaming) for large-scale data processing.

Strong expertise in Hive for querying and managing structured data in data lakes.

In-depth knowledge of Trino (Presto) for federated querying and high-performance SQL execution.

Solid programming skills in Python with frameworks like PySpark and Pandas.

Hands-on experience with AWS Glue, including Glue ETL jobs, Glue Data Catalog, and Glue Crawlers.

Deep understanding of data formats such as Parquet, ORC, Avro, and their use cases.

Cloud Proficiency

Expertise in AWS services, including S3, Redshift, Athena, EMR, DynamoDB, and IAM.

Experience designing scalable and cost-efficient cloud-based data solutions.

Performance Tuning

Strong ability to optimize Apache Spark jobs, Hive queries, and Trino workloads for distributed environments.

Experience with advanced techniques like partitioning, bucketing, and query plan optimization.

Leadership & Collaboration

Proven experience leading and mentoring data engineering teams.

Strong communication skills, with the ability to interact with technical and non-technical stakeholders effectively.

Education & Experience

Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.

8+ years of experience in data engineering with a minimum of 2 years in a leadership role.

Qualifications:

8+ years of experience in building data pipelines from scratch in large data volume environments

AWS certifications, such as AWS Certified Data Analytics or AWS Certified Solutions Architect.

Experience with Kafka or Kinesis for real-time data streaming would be a plus.

Familiarity with containerization tools like Docker and orchestration platforms like Kubernetes.

Knowledge of CI/CD pipelines and DevOps practices for data engineering.

Prior experience with data lake architectures and integrating ML workflows.

Mandatory Key Skills - Spark,Python,Hive,ETL,Redshift,Athenda,IAM,S3,Kafka,AWS.


  • Design Lead

    2 weeks ago


    Bengaluru, Karnataka, India Team Pumpkin Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Note : Maximum CTC is 9 LPAPosition Overview:We are looking for a talented and experienced Design Lead to join our creative team. As a Design Lead, you will be responsible for overseeing the design direction of multiple projects within the agency, ensuring creative excellence, strategic alignment, and a high level of visual execution. You will work closely...

  • Design Lead

    1 week ago


    Bengaluru, Karnataka, India Team Pumpkin Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Position Overview:We are looking for a talented and experienced Design Lead to join our creative team. As a Design Lead, you will be responsible for overseeing the design direction of multiple projects within the agency, ensuring creative excellence, strategic alignment, and a high level of visual execution. You will work closely with the creative,...


  • Bengaluru, Karnataka, India Team Computers Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    We are seeking a highly skilled and experienced DV Lead to drive the verification of complex System-on-Chip (SoC) designs. The ideal candidate will be proficient in SoC-level verification methodologies, have strong expertise in writing C test cases for embedded systems, and lead verification planning and execution for SoC projects.Key Responsibilities:Lead...

  • SOC DV Lead

    2 weeks ago


    Bengaluru, Karnataka, India Team Computers Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Lead the verification planning and execution for complex SoC designs.Define and implement testbenches using SystemVerilog/UVM methodologies.Work closely with architecture, design, and firmware teams to understand the design and develop test strategies.Drive block-level and full-chip verification, including IP integration.Perform coverage analysis, debug, and...

  • Sales Team Leader

    2 weeks ago


    Bengaluru, Karnataka, India Team Techqart Pvt. Ltd. Full time ₹ 3,60,000 - ₹ 4,80,000 per year

    We are currently looking for an experienced Team Leader – Telesales to join our team. I got your reference from APNA Job Portal. Kindly look at the JD first.Job Title:- Team Leader – TelesalesLocation:- MG Road, BangaloreCompany:- Arnav Media & Entertainment Pvt. Ltd.Salary Range :- ₹30,000 – ₹40,000 per month* (depending on experience and...

  • Team Lead

    5 days ago


    Bengaluru, Karnataka, India Paytm Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Team Lead / Sr Executive-Backend-MF-Paytm MoneyThe Team Lead / Sr Executive-Backend will be responsible for leading the backend team and ensuring the smooth operation of backend processes. They will be involved in managing and optimizing backend systems to enhance performance and efficiency. The role will also involve collaborating with other teams to...

  • Team Lead

    4 weeks ago


    Bengaluru, Karnataka, India Trigent Software - Professional Services Full time

    Job description Role: Team Lead – International Voice Operations Location: Bangalore Shift: Rotational (including night shifts)Experience: 5+ years in a contact center environment, with at least 1–2 years in a team lead/supervisory role What You'll Do: Lead and motivate a team of customer service representatives.Monitor performance metrics and ensure...

  • Team Lead

    4 weeks ago


    Bengaluru, Karnataka, India Trigent Software - Professional Services Full time

    Job descriptionRole: Team Lead – International Voice OperationsLocation: BangaloreShift: Rotational (including night shifts)Experience: 5+ years in a contact center environment, with at least 1–2 years in a team lead/supervisory roleWhat You'll Do:Lead and motivate a team of customer service representatives.Monitor performance metrics and ensure KPIs are...

  • Team Lead

    2 weeks ago


    Bengaluru, Karnataka, India Trivora Advisory Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role DescriptionThis is a full-time, on-site role for a Team Lead at Trivora Advisory, located in Bengaluru. The Team Lead will oversee daily operations, manage team performance, and ensure projects are delivered on time and within budget. Responsibilities include mentoring team members, coordinating with clients, and facilitating effective communication...

  • Team Lead

    2 weeks ago


    Bengaluru, Karnataka, India Simply Vyapar Apps Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description:Vyapar is seeking a dynamic and results-driven individual to join our team as a Team Lead for Tele sales. The ideal candidate will be passionate about driving sales and leading a team to success. As a Team Lead, you will play a pivotal role in driving revenue growth, managing a team of tele sales representatives, and ensuring targets are met...