Lead Data Engineer
18 hours ago
Lead Data EngineerLocation: Banglore/Pune (Hybrid)Mode: HybridShift Timing: 2 PM to 11 PMExperience: 7-12 years. 3+ years in cloud data platforms and Databricks.Purpose:We are seeking a hands-on Technical Lead to drive the ingestion of high-volume mainframe RPC data into Databricks , enabling scalable machine learning workflows. This role is critical to building a robust data foundation for training thousands of AI models that detect anomalous behavior across applications, services, and functions.Key ResponsibilitiesMainframe Data Ingestion:Design and implement scalable pipelines to extract, parse, and ingest RPC logs and technical attributes from mainframe systems into Delta Lake on Databricks.ML-Ready Data Engineering:Transform and structure data for time-series modelling and anomaly detection across thousands of models.ML Workflow Integration:Collaborate with ML engineers to ensure data pipelines support SARIMA, ANN, and other model types; enable automated retraining and scoring.Performance Optimization:Tune Spark jobs, Delta Lake storage, and cluster configurations for billions of records and real-time aggregation.FinOps & Cost Control:Monitor and optimize Databricks resource usage; implement auto-scaling and cost-aware job scheduling.Monitoring & Alerting:Integrate Databricks-native alerting for pipeline health, data anomalies, and job failures.Required SkillsStrong hands-on experience with Databricks , Apache Spark , Delta Lake , and MLflowProven expertise in mainframe data integration (e.g., SMF, RPC logs, VSAM, DB2)Strong Python and PySpark programming skillsPreferred SkillsDatabricks experience with CI/CD tools GitHub ActionsKnowledge of FinOps principles for cloud cost optimization
-
Data Analytics Lead
2 days ago
delhi, India NTT DATA Full timeBuild, manage, and foster a high-functioning team of data engineers and Data analysts. Collaborate with business and technical teams to capture and prioritize platform ingestion requirements. Experience of working with manufacturing industry in building a centralized data platform for self service reporting. Lead the data analytics team members, providing...
-
Data Analytics Lead
2 weeks ago
Delhi, India NTT Data Full timeJob Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Analytics Lead to join our team in Delhi, Delhi (IN-DL), India (IN). Experience: 8+ Years Location: Delhi NCR...
-
Operations Data Lead
1 week ago
Delhi, India Data Unveil Full timePosition Title: Operations Data LeadExperience:5 Years to 6 YearsLocation:Hyderabad, TelanganaHire Type:Full Time, On-siteStart Date:ImmediateOverview:The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations and delivery processes are...
-
Operations Data Lead
1 week ago
New Delhi, India Data Unveil Full timePosition Title: Operations Data LeadExperience:5 Years to 6 Years Location:Hyderabad, Telangana Hire Type:Full Time, On-site Start Date:ImmediateOverview: The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations and delivery processes are...
-
Data Analytics Lead
2 weeks ago
Delhi, India NTT DATA North America Full timeJob Description Req ID: 341331 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Analytics Lead to join our team in Delhi, Delhi (IN-DL), India (IN). Experience: 8+ Years...
-
Lead Data Engineer
1 week ago
Delhi, India AideWiser SolTek Full timeJob Title: Lead Data Engineer / Database Administrator (DBA)Location: RemoteExperience Required: 5–10 YearsJob Summary:The Lead Data Engineer / Database Administrator (DBA) is a senior technical leader responsible for owningthe design, performance, and scalability of both the internal data warehouse and production databases.This role will lead the data...
-
Sr Operations Data Lead
1 week ago
Delhi, India Data Unveil Full timeJOB DESCRIPTION:Position Title: Sr Operations Data LeadExperience: 4 Years to 6 YearsLocation: Hyderabad, TelanganaHire Type: Full Time, On-siteStart Date: ImmediateOverview:The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations and delivery...
-
lead Data Engineer
3 weeks ago
Delhi, India Cozzera Full timeJob Title: Lead Data EngineerExperience: 8–10 YearsLocation: Remote ( 1 week from noida office then remote)Job Overview:We are looking for an accomplished Lead Data Engineer with 8–10 years of experience inarchitecting, building, and managing complex data ecosystems using Python, Databricks(Delta Lake, Spark, MLflow), and modern orchestration frameworks....
-
Lead data engineer
3 weeks ago
Delhi, India Cozzera Full timeJob Title: Lead Data EngineerExperience: 8–10 YearsLocation: Remote ( 1 week from noida office then remote)Job Overview:We are looking for an accomplished Lead Data Engineer with 8–10 years of experience inarchitecting, building, and managing complex data ecosystems using Python, Databricks(Delta Lake, Spark, MLflow), and modern orchestration frameworks....
-
Lead Data Engineer
3 days ago
Delhi, India People Prime Worldwide Full timeSenior & Lead Data EngineerJob Details:Client: EgenRole: Senior & lead Data EngineerExperience: 7-12 YearsLocation: HyderabadInterview Mode: F2F Interview on mondayNotice Period Preference: Immediate to 30 DaysMandatory Skills Matrix :Skill Mandatory/Good to Have1 .Python Mandatory2 .GCP Mandatory3.RESTful APIs or FastAPI Mandatory4.GitHub...
