Lead Data Engineer

9 hours ago

uttar pradesh, India Unicorn Workforce Full time

About the RoleWe are looking for an experienced Lead Data Engineer to design, build, and optimize cloud-native data platforms on AWS. You will lead a team of Data Engineers and drive end-to-end development of scalable data pipelines, modern data architectures, and enterprise-grade data solutions for BFSI customers.This is a hands-on role with strong ownership across architecture, development, optimisation, and team leadership.Key ResponsibilitiesLeadership & DeliveryLead, mentor, and manage a team of Data Engineers to deliver high-quality outcomes.Own project planning, task delegation, sprint delivery, and quality assurance.Collaborate with cross-functional teams including data scientists, analysts, architects, and product teams.Data Engineering & ArchitectureArchitect, design, and implement scalable data pipelines using AWS, PySpark, and Airflow.Build and maintain ETL/ELT processes for ingestion, transformation, and publishing of structured/unstructured data.Develop scalable data models and cloud-native architectures aligned with BFSI requirements.Optimize data processing (Spark), data storage (S3, Iceberg/Hudi/Delta), and query performance.Cloud & Platform EngineeringWork across AWS services such as S3, Glue, EMR, Lambda, Redshift, Kinesis, RDS, CloudWatch, IAM.Ensure cost-efficiency, reliability, and scalability of the cloud data environment.Implement automation for CI/CD, data deployments, and pipeline orchestration.Governance, Security & ComplianceEnforce data governance standards, lineage tracking, and data quality frameworks.Implement data security, encryption, RBAC, and compliance aligned with BFSI/regulatory norms.Ensure high availability, monitoring, and proactive issue resolution.Required Skills & ExperienceCore Technical Skills6+ years of hands-on experience in data engineering.Strong expertise in PySpark for distributed data processing.Experience building and orchestrating pipelines using Airflow (DAGs, scheduling, monitoring).Strong AWS experience with focus on data services.Advanced SQL skills and experience in OLTP, OLAP, Data Lakes, and Data Warehouses.Experience with Hudi / Iceberg / Delta Lake.Proficiency in Python for ETL, utilities, and API integrations.Understanding of big data technologies (Spark, Hadoop ecosystem).Preferred SkillsExperience in BFSI (Banking, Insurance, NBFCs, AMCs) data ecosystems.Exposure to Docker, Kubernetes, and containerized data applications.API development experience (preferably Python/FastAPI/Flask).Experience working with data scientists and BI teams.Behavioral & Leadership SkillsStrong ownership mindset and accountability.Excellent problem solving and debugging skills.Ability to mentor junior team members and lead by example.Strong communication and stakeholder management.Ability to work in a fast-paced, entrepreneurial environment.EducationBachelor’s or Master’s degree in Computer Science, Engineering, or related field.

  • Only 24h Left: Mid Data Science

    2 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 312499 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Mid Data Science AIML GenAI Lead Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job Duties Job Title Data...

  • ▷ Immediate Start: Java Developer

    4 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 341931 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Java Developer - Digital Engineering Lead Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Here are the brief...

  • Digital Technology

    3 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 334421 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Technology - Lead Engineer to join our team in Noida Uttar Pradesh IN-UP India IN At NTT DATA we know that with the...

  • Lead Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Lumiq Full time

    Lead Data Engineer AWS Who we are LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance FSI industry We are trusted by the world s largest FSIs including insurers banks AMCs and NBFCs to address their data challenges Our clients include 40 enterprises with over 10B in deposits AUM collectively representing about 1B customers...

  • Qa Lead

    1 week ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 330385 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a QA Lead to join our team in Noida Uttar Pradesh IN-UP India IN Responsibilities Document and execute high quality test plans...

  • Network Engineering Advisor

    3 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 340213 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Network Engineering Advisor to join our team in Noida Uttar Pradesh IN-UP India IN JOB SUMMARY Designs secure network...

  • Lead Data Scientist

    2 weeks ago

    uttar pradesh, India Elite Corporate Solutions Private Limited Full time

    Job Description - Lead Data Scientist Job Title: Lead Data Scientist Location: Noida (On-site) Employment Type: Full-time —-------------------------------------------------------------------------------------------------------------------------------- About the Organization: Novel Patterns is at the forefront of leveraging cutting-edge technologies to...

  • Lead Data Scientist

    2 weeks ago

    uttar pradesh, India Elite Corporate Solutions Private Limited Full time

    Job Description - Lead Data Scientist Job Title: Lead Data Scientist Location: Noida (On-site) Employment Type: Full-time —-------------------------------------------------------------------------------------------------------------------------------- About the Organization: Novel Patterns is at the forefront of leveraging cutting-edge technologies to...

  • Lead Data Scientist

    2 weeks ago

    uttar pradesh, India Elite Corporate Solutions Private Limited Full time

    Job Description - Lead Data ScientistJob Title: Lead Data ScientistLocation: Noida (On-site)Employment Type: Full-time—--------------------------------------------------------------------------------------------------------------------------------About the Organization:Novel Patterns is at the forefront of leveraging cutting-edge technologies to deliver...

  • Data Engineer

    6 days ago

    uttar pradesh, India Tata Consultancy Services Full time

    TCS has been a great pioneer in feeding the fire of Young techies like you. We are global leaders in the technology arena and there's nothing that can stop us from growing together. TCS Hiring for skill "ADF, ADB, SQL, Pyspark, python". Role: Azure Data EngineerRequired Technical Skill Set: ADLS/ADF/ADB/Key VaultExperience: 8-12 YearsWork Location: Kolkata,...