Lead Data Engineer

1 week ago

gautam buddha nagar, India Unicorn Workforce Full time

About the Role We are looking for an experienced Lead Data Engineer to design, build, and optimize cloud-native data platforms on AWS. You will lead a team of Data Engineers and drive end-to-end development of scalable data pipelines, modern data architectures, and enterprise-grade data solutions for BFSI customers. This is a hands-on role with strong ownership across architecture, development, optimisation, and team leadership. Key Responsibilities Leadership & Delivery Lead, mentor, and manage a team of Data Engineers to deliver high-quality outcomes. Own project planning, task delegation, sprint delivery, and quality assurance. Collaborate with cross-functional teams including data scientists, analysts, architects, and product teams. Data Engineering & Architecture Architect, design, and implement scalable data pipelines using AWS, PySpark, and Airflow . Build and maintain ETL/ELT processes for ingestion, transformation, and publishing of structured/unstructured data. Develop scalable data models and cloud-native architectures aligned with BFSI requirements. Optimize data processing (Spark), data storage (S3, Iceberg/Hudi/Delta), and query performance. Cloud & Platform Engineering Work across AWS services such as S3, Glue, EMR, Lambda, Redshift, Kinesis, RDS, CloudWatch, IAM. Ensure cost-efficiency, reliability, and scalability of the cloud data environment. Implement automation for CI/CD, data deployments, and pipeline orchestration. Governance, Security & Compliance Enforce data governance standards, lineage tracking, and data quality frameworks. Implement data security, encryption, RBAC, and compliance aligned with BFSI/regulatory norms. Ensure high availability, monitoring, and proactive issue resolution. Required Skills & Experience Core Technical Skills 6+ years of hands-on experience in data engineering. Strong expertise in PySpark for distributed data processing. Experience building and orchestrating pipelines using Airflow (DAGs, scheduling, monitoring). Strong AWS experience with focus on data services. Advanced SQL skills and experience in OLTP, OLAP, Data Lakes, and Data Warehouses. Experience with Hudi / Iceberg / Delta Lake . Proficiency in Python for ETL, utilities, and API integrations. Understanding of big data technologies (Spark, Hadoop ecosystem). Preferred Skills Experience in BFSI (Banking, Insurance, NBFCs, AMCs) data ecosystems. Exposure to Docker, Kubernetes, and containerized data applications. API development experience (preferably Python/FastAPI/Flask). Experience working with data scientists and BI teams. Behavioral & Leadership Skills Strong ownership mindset and accountability. Excellent problem solving and debugging skills. Ability to mentor junior team members and lead by example. Strong communication and stakeholder management. Ability to work in a fast-paced, entrepreneurial environment. Education Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.

  • AI/ML Engineering Lead

    3 days ago

    gautam buddha nagar, India DataAlchemy.AI Full time

    AI/ML Engineering Lead About DataAlchemy.ai DataAlchemy.ai delivers practical, secure, and transformational AI solutions that make complex technology simple, trusted, and effective for organizations across industries. We provide a full spectrum of end-to-end services—AI strategy and phased roadmaps, digital transformation consulting, high-quality data...

  • Data Architect

    2 weeks ago

    gautam buddha nagar, India Iris Software Inc. Full time

    Experience: 12+ years ; Location: Noida/Pune ; immediatejoinerspreferred please share your resume at suhashini.singh@irissoftware.com About the Role: We’re looking for a Data Architect to lead the design and implementation of scalable, high-performance data solutions on the cloud. You will lead data architecture, engineering, and analytics initiatives,...

  • Azure Architect

    1 week ago

    gautam buddha nagar, India Polestar Analytics Full time

    Job Title: Azure Architect – Analytics & Data Services Location: Noida/Kolkata/Bengaluru Job Type: Full-time Experience: 8+ years Industry: Analytics Services Roles and Responsibilities Lead end-to-end architecture design for data and analytics solutions on Azure. Define and implement Azure-based modern data platforms, including data lakes and data...

  • Project Lead

    21 hours ago

    gautam buddha nagar, India Beroe Inc Full time

    About the Role We are seeking an accomplished Project Lead – Python & AI Developer to lead end-to-end delivery of AI-powered analytics and product development initiatives . The ideal candidate is a strategic and hands-on technical leader with deep expertise in Python, Artificial Intelligence, predictive modeling, and analytics engineering . You will drive...

  • Engagement / Program Lead

    3 days ago

    gautam buddha nagar, India DataAlchemy.AI Full time

    Engagement / Program Lead About DataAlchemy.ai DataAlchemy.ai delivers practical, secure, and transformational AI solutions that make complex technology simple, trusted, and effective for organizations across industries. We provide a full spectrum of end-to-end services—AI strategy and phased roadmaps, digital transformation consulting, high-quality data...

  • Data Scientist and AI Engineer

    6 days ago

    gautam buddha nagar, India Synopsys Inc Full time

    Alternate Job Titles: AI Data Scientist – Customer Success Generative AI Specialist Data Analytics Engineer Business Intelligence AI Analyst CRM Data Scientist We Are: At Synopsys, we drive the innovations that shape the way we live and connect. Our technology is central to the Era of Pervasive Intelligence, from self-driving cars to learning machines. We...

  • Platform Lead

    20 hours ago

    gautam buddha nagar, India DataAlchemy.AI Full time

    Platform Lead Overview We are an early-stage startup building an intelligent, agentic talent management SaaS platform that reimagines how organizations source, assess, and engage with talent through AI-driven autonomy and insight. As the Platform Lead, you will play a pivotal role in shaping both the product and engineering culture from the ground up. You...

  • Lead Automation QA Engineer

    2 weeks ago

    gautam buddha nagar, India QAIN-Finity Full time

    NOTE : Please only apply after reading the JD. Experience : 6–10 Years Location : [Noida / Hybrid] Employment Type : Full-Time Job Description - Lead Automation QA Engineer [Playwright/Typescript] About the Role: We are seeking an experienced Lead Automation QA Engineer for one of our client to drive test automation initiatives, ensure product quality, and...

  • Data Scientist

    1 week ago

    gautam buddha nagar, India Info Origin Inc. Full time

    NEW OPPORTUNITY || IMMEDIATE TO 30 DAYS JOINERS REQUIRED || Position Title:- Data Scientist Experience Required:- 3+ Years Location:- Noida, UP (Hybrid) About the Role We’re seeking a Data Scientist to lead NLP/ML research efforts and architect end-to-end solutions. You will be instrumental in driving innovation, mentoring junior team members, and working...

  • Data Analyst Intern

    1 week ago

    Gautam Buddha Nagar, India Makunai Global Full time ₹ 4,00,000 - ₹ 6,00,000 per year

    Key ResponsibilitiesPerform web scraping using Python tools like BeautifulSoup, Requests, Selenium, or Scrapy.Build automated scripts to extract data from websites, directories, and APIs.Clean, transform, and validate data to ensure accuracy and consistency.Store and manage scraped data using CSV, Excel, SQL, or cloud databases.Analyze datasets to identify...