
Team Lead
3 days ago
This is 100% WFO opportunity at our Whitefield, Bengaluru office. Please don't apply if you can't comply.
Position Overview:
We seek a highly skilled and experienced Data Engineering Lead to join our team. This role demands deep technical expertise in Apache Spark, Hive, Trino (formerly Presto), Python, AWS Glue, and the broader AWS ecosystem. The ideal candidate will possess strong hands-on skills and the ability to design and implement scalable data solutions, optimise performance, and lead a high-performing team to deliver data-driven insights.
Key Responsibilities:
Technical Leadership
Lead and mentor a team of data engineers, fostering best practices in coding, design, and delivery.
Drive the adoption of modern data engineering frameworks, tools, and methodologies to ensure high-quality and scalable solutions.
Translate complex business requirements into effective data pipelines, architectures, and workflows.
Data Pipeline Development
Architect, develop, and optimize scalable ETL/ELT pipelines using Apache Spark, Hive, AWS Glue, and Trino.
Handle complex data workflows across structured and unstructured data sources, ensuring performance and cost-efficiency.
Develop real-time and batch processing systems to support business intelligence, analytics, and machine learning applications.
Cloud & Infrastructure Management
Build and maintain cloud-based data solutions using AWS services like S3, Athena, Redshift, EMR, DynamoDB, and Lambda.
Design and implement federated query capabilities using Trino for diverse data sources.
Manage Hive Metastore for schema and metadata management in data lakes.
Performance Optimization
Optimize Apache Spark jobs and Hive queries for performance, ensuring efficient resource utilization and minimal latency.
Implement caching and indexing strategies to accelerate query performance in Trino.
Continuously monitor and improve system performance through diagnostics and tuning.
Collaboration & Stakeholder Engagement
Work closely with data scientists, analysts, and business teams to understand requirements and deliver actionable insights.
Ensure that data infrastructure aligns with organizational goals and compliance standards.
Data Governance & Quality
Establish and enforce data quality standards, governance practices, and monitoring processes.
Ensure data security, privacy, and compliance with regulatory frameworks.
Innovation & Continuous Learning
Stay ahead of industry trends, emerging technologies, and best practices in data engineering.
Proactively identify and implement improvements in data architecture and processes.
Qualifications:
Required Technical Expertise
Advanced proficiency with Apache Spark (core, SQL, streaming) for large-scale data processing.
Strong expertise in Hive for querying and managing structured data in data lakes.
In-depth knowledge of Trino (Presto) for federated querying and high-performance SQL execution.
Solid programming skills in Python with frameworks like PySpark and Pandas.
Hands-on experience with AWS Glue, including Glue ETL jobs, Glue Data Catalog, and Glue Crawlers.
Deep understanding of data formats such as Parquet, ORC, Avro, and their use cases.
Cloud Proficiency
Expertise in AWS services, including S3, Redshift, Athena, EMR, DynamoDB, and IAM.
Experience designing scalable and cost-efficient cloud-based data solutions.
Performance Tuning
Strong ability to optimize Apache Spark jobs, Hive queries, and Trino workloads for distributed environments.
Experience with advanced techniques like partitioning, bucketing, and query plan optimization.
Leadership & Collaboration
Proven experience leading and mentoring data engineering teams.
Strong communication skills, with the ability to interact with technical and non-technical stakeholders effectively.
Education & Experience
Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
8+ years of experience in data engineering with a minimum of 2 years in a leadership role.
Qualifications:
8+ years of experience in building data pipelines from scratch in large data volume environments
AWS certifications, such as AWS Certified Data Analytics or AWS Certified Solutions Architect.
Experience with Kafka or Kinesis for real-time data streaming would be a plus.
Familiarity with containerization tools like Docker and orchestration platforms like Kubernetes.
Knowledge of CI/CD pipelines and DevOps practices for data engineering.
Prior experience with data lake architectures and integrating ML workflows.
Mandatory Key Skills - Spark,Python,Hive,ETL,Redshift,Athenda,IAM,S3,Kafka,AWS.
-
Design Lead
2 weeks ago
Bengaluru, Karnataka, India Team Pumpkin Full time ₹ 20,00,000 - ₹ 25,00,000 per yearNote : Maximum CTC is 9 LPAPosition Overview:We are looking for a talented and experienced Design Lead to join our creative team. As a Design Lead, you will be responsible for overseeing the design direction of multiple projects within the agency, ensuring creative excellence, strategic alignment, and a high level of visual execution. You will work closely...
-
Design Lead
1 week ago
Bengaluru, Karnataka, India Team Pumpkin Full time ₹ 1,04,000 - ₹ 1,30,878 per yearPosition Overview:We are looking for a talented and experienced Design Lead to join our creative team. As a Design Lead, you will be responsible for overseeing the design direction of multiple projects within the agency, ensuring creative excellence, strategic alignment, and a high level of visual execution. You will work closely with the creative,...
-
Lead Design Verification Engineer
2 weeks ago
Bengaluru, Karnataka, India Team Computers Full time ₹ 12,00,000 - ₹ 24,00,000 per yearWe are seeking a highly skilled and experienced DV Lead to drive the verification of complex System-on-Chip (SoC) designs. The ideal candidate will be proficient in SoC-level verification methodologies, have strong expertise in writing C test cases for embedded systems, and lead verification planning and execution for SoC projects.Key Responsibilities:Lead...
-
SOC DV Lead
2 weeks ago
Bengaluru, Karnataka, India Team Computers Full time ₹ 15,00,000 - ₹ 25,00,000 per yearLead the verification planning and execution for complex SoC designs.Define and implement testbenches using SystemVerilog/UVM methodologies.Work closely with architecture, design, and firmware teams to understand the design and develop test strategies.Drive block-level and full-chip verification, including IP integration.Perform coverage analysis, debug, and...
-
Sales Team Leader
2 weeks ago
Bengaluru, Karnataka, India Team Techqart Pvt. Ltd. Full time ₹ 3,60,000 - ₹ 4,80,000 per yearWe are currently looking for an experienced Team Leader – Telesales to join our team. I got your reference from APNA Job Portal. Kindly look at the JD first.Job Title:- Team Leader – TelesalesLocation:- MG Road, BangaloreCompany:- Arnav Media & Entertainment Pvt. Ltd.Salary Range :- ₹30,000 – ₹40,000 per month* (depending on experience and...
-
Team Lead
5 days ago
Bengaluru, Karnataka, India Paytm Full time ₹ 15,00,000 - ₹ 25,00,000 per yearTeam Lead / Sr Executive-Backend-MF-Paytm MoneyThe Team Lead / Sr Executive-Backend will be responsible for leading the backend team and ensuring the smooth operation of backend processes. They will be involved in managing and optimizing backend systems to enhance performance and efficiency. The role will also involve collaborating with other teams to...
-
Team Lead
4 weeks ago
Bengaluru, Karnataka, India Trigent Software - Professional Services Full timeJob description Role: Team Lead – International Voice Operations Location: Bangalore Shift: Rotational (including night shifts)Experience: 5+ years in a contact center environment, with at least 1–2 years in a team lead/supervisory role What You'll Do: Lead and motivate a team of customer service representatives.Monitor performance metrics and ensure...
-
Team Lead
4 weeks ago
Bengaluru, Karnataka, India Trigent Software - Professional Services Full timeJob descriptionRole: Team Lead – International Voice OperationsLocation: BangaloreShift: Rotational (including night shifts)Experience: 5+ years in a contact center environment, with at least 1–2 years in a team lead/supervisory roleWhat You'll Do:Lead and motivate a team of customer service representatives.Monitor performance metrics and ensure KPIs are...
-
Team Lead
2 weeks ago
Bengaluru, Karnataka, India Trivora Advisory Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole DescriptionThis is a full-time, on-site role for a Team Lead at Trivora Advisory, located in Bengaluru. The Team Lead will oversee daily operations, manage team performance, and ensure projects are delivered on time and within budget. Responsibilities include mentoring team members, coordinating with clients, and facilitating effective communication...
-
Team Lead
2 weeks ago
Bengaluru, Karnataka, India Simply Vyapar Apps Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Description:Vyapar is seeking a dynamic and results-driven individual to join our team as a Team Lead for Tele sales. The ideal candidate will be passionate about driving sales and leading a team to success. As a Team Lead, you will play a pivotal role in driving revenue growth, managing a team of tele sales representatives, and ensuring targets are met...