Lead Data Engineer

1 hour ago

New Delhi, India ITC Infotech Full time

Lead Data EngineerLocation: Banglore/Pune (Hybrid)Mode: HybridShift Timing: 2 PM to 11 PMExperience: 7-12 years. 3+ years in cloud data platforms and Databricks.Purpose:We are seeking a hands-on Technical Lead to drive the ingestion of high-volume mainframe RPC data into Databricks, enabling scalable machine learning workflows. This role is critical to building a robust data foundation for training thousands of AI models that detect anomalous behavior across applications, services, and functions.Key Responsibilities- Mainframe Data Ingestion: - Design and implement scalable pipelines to extract, parse, and ingest RPC logs and technical attributes from mainframe systems into Delta Lake on Databricks. - ML-Ready Data Engineering: - Transform and structure data for time-series modelling and anomaly detection across thousands of models. - ML Workflow Integration: - Collaborate with ML engineers to ensure data pipelines support SARIMA, ANN, and other model types; enable automated retraining and scoring. - Performance Optimization: - Tune Spark jobs, Delta Lake storage, and cluster configurations for billions of records and real-time aggregation. - FinOps & Cost Control: - Monitor and optimize Databricks resource usage; implement auto-scaling and cost-aware job scheduling. - Monitoring & Alerting: - Integrate Databricks-native alerting for pipeline health, data anomalies, and job failures.Required Skills- Strong hands-on experience with Databricks, Apache Spark, Delta Lake, and MLflow - Proven expertise in mainframe data integration (e.g., SMF, RPC logs, VSAM, DB2) - Strong Python and PySpark programming skillsPreferred Skills- Databricks experience with CI/CD tools GitHub Actions - Knowledge of FinOps principles for cloud cost optimization

  • Operations Data Lead

    1 week ago

    New Delhi, India Data Unveil Full time

    Position Title: Operations Data LeadExperience:5 Years to 6 Years Location:Hyderabad, Telangana Hire Type:Full Time, On-site Start Date:ImmediateOverview: The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations and delivery processes are...

  • Data Analytics Lead

    2 days ago

    delhi, India NTT DATA Full time

    Build, manage, and foster a high-functioning team of data engineers and Data analysts. Collaborate with business and technical teams to capture and prioritize platform ingestion requirements. Experience of working with manufacturing industry in building a centralized data platform for self service reporting. Lead the data analytics team members, providing...

  • Sr Operations Data Lead

    4 weeks ago

    New Delhi, India Data Unveil Full time

    Position Title: Sr Operations Data LeadExperience: 4 Years to 6 YearsLocation: Hyderabad, TelanganaHire Type: Full Time, On-siteStart Date: ImmediateOverview:The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations and delivery processes are...

  • Lead Data Engineer

    3 weeks ago

    New Delhi, India Anblicks Full time

    Lead Data Engineer Location: Hyderabad or Ahmedabad Experience: 8+ years Skills: Snowflake, Python/Pyspark, SQLOnly Immediate to 15 Days joiners apply.Key Responsibilities: Lead the end-to-end Snowflake platform implementation, including architecture, design, data modeling, and governance. Oversee the migration of data and pipelines from legacy platforms to...

  • lead Data Engineer

    3 weeks ago

    New Delhi, India Cozzera Full time

    Job Title: Lead Data EngineerExperience: 8–10 YearsLocation: Remote ( 1 week from noida office then remote)Job Overview:We are looking for an accomplished Lead Data Engineer with 8–10 years of experience inarchitecting, building, and managing complex data ecosystems using Python, Databricks(Delta Lake, Spark, MLflow), and modern orchestration frameworks....

  • Lead Data Engineer

    2 days ago

    New Delhi, India People Prime Worldwide Full time

    Senior & Lead Data EngineerJob Details:- Client: Egen - Role: Senior & lead Data Engineer - Experience: 7-12 Years - Location: Hyderabad - Interview Mode: F2F Interview on monday - Notice Period Preference: Immediate to 30 DaysMandatory Skills Matrix :Skill Mandatory/Good to Have1 .Python Mandatory2 .GCP Mandatory3.RESTful APIs or FastAPI Mandatory4.GitHub...

  • Lead Data Engineer

    1 week ago

    New Delhi, India Cimpress Full time

    Our Team: Enterprise Business SolutionsVista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain, and HR functions. The cross-functional team includes product owners, analysts, technologists, data engineers and more – all focused on providing Vista with...

  • Lead Data Engineer

    4 weeks ago

    New Delhi, India People Prime Worldwide Full time

    We’re Hiring: Senior / Lead Data Engineer – Python & GCP | Hyderabad (Hybrid)Are you someone who loves building scalable data pipelines, designing cloud-native solutions, and solving complex data challenges?Here’s your chance to join a high-performing team working on cutting-edge Data Engineering projects on Google Cloud Platform (GCP)!Role: Senior /...

  • Data Analytics Lead

    2 weeks ago

    Delhi, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Analytics Lead to join our team in Delhi, Delhi (IN-DL), India (IN). Experience: 8+ Years Location: Delhi NCR...

  • Lead Data Engineer

    4 days ago

    New Delhi, India MakeMyTrip Full time

    Role:Lead Data Engineer Location:Bangalore Years of Experience:6 -8 Years About the function: At MakeMyTrip (MMT), technology is at the heart of everything we do. As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructure to create seamless and innovative travel experiences. We...