Lead Data Engineer

3 days ago

India ITC Infotech Full time

Lead Data Engineer Location: Banglore/Pune (Hybrid) Mode: Hybrid Shift Timing: 2 PM to 11 PM Experience: 7-12 years. 3+ years in cloud data platforms and Databricks. Purpose: We are seeking a hands-on Technical Lead to drive the ingestion of high-volume mainframe RPC data into Databricks , enabling scalable machine learning workflows. This role is critical to building a robust data foundation for training thousands of AI models that detect anomalous behavior across applications, services, and functions. Key Responsibilities Mainframe Data Ingestion: Design and implement scalable pipelines to extract, parse, and ingest RPC logs and technical attributes from mainframe systems into Delta Lake on Databricks. ML-Ready Data Engineering: Transform and structure data for time-series modelling and anomaly detection across thousands of models. ML Workflow Integration: Collaborate with ML engineers to ensure data pipelines support SARIMA, ANN, and other model types; enable automated retraining and scoring. Performance Optimization: Tune Spark jobs, Delta Lake storage, and cluster configurations for billions of records and real-time aggregation. FinOps & Cost Control: Monitor and optimize Databricks resource usage; implement auto-scaling and cost-aware job scheduling. Monitoring & Alerting: Integrate Databricks-native alerting for pipeline health, data anomalies, and job failures. Required Skills Strong hands-on experience with Databricks , Apache Spark , Delta Lake , and MLflow Proven expertise in mainframe data integration (e.g., SMF, RPC logs, VSAM, DB2) Strong Python and PySpark programming skills Preferred Skills Databricks experience with CI/CD tools GitHub Actions Knowledge of FinOps principles for cloud cost optimization

  • Data & AI Engineer Lead

    2 weeks ago

    India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 344686NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data & AI Engineer Lead to join our team in Remote, Karnātaka (IN-KA), India (IN). "Job Duties: Role Overview The...

  • Lead Data Engineer

    2 weeks ago

    Hyderabad, Telangana, , India The Modern Data Company Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Role Overview:The Lead Data Engineer is a senior technical leader responsible for architecting end -to -end data flow solutions and guiding the engineering team to deliver complex data projects. In this role, you will design data flow architectures that solve complex business problems, ensuring that all components (ingestion, processing, storage, and access)...

  • Lead Data Engineer

    2 weeks ago

    India Data Science Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    MUST HAVE• Minimum of 4+ years of Azure DE experience • In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...

  • Data Engineer

    2 days ago

    India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Req ID: 343254NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Remote, Karnātaka (IN-KA), India (IN). "Key Responsibilities: Design and implement...

  • Data Engineer

    2 weeks ago

    India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job DescriptionData Engineer – ChennaiBuild the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights.Location: Chennai, IndiaExperience: 2–3 years in data engineering or data-driven product developmentRole OverviewAs a Data Engineer, you will be responsible for building and maintaining scalable...

  • Data Analytics Lead

    3 weeks ago

    Delhi, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Analytics Lead to join our team in Delhi, Delhi (IN-DL), India (IN). Experience: 8+ Years Location: Delhi NCR...

  • Data Engineer

    2 weeks ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: Snowflake - working experience...

  • Data Engineer

    3 weeks ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: . Design...

  • Data Engineer

    3 weeks ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: . Design...

  • Data Analytics Lead

    2 weeks ago

    Delhi, India NTT DATA North America Full time

    Job Description Req ID: 341331 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Analytics Lead to join our team in Delhi, Delhi (IN-DL), India (IN). Experience: 8+ Years...