Lead Data Engineer
1 week ago
Role : Lead Data Engineer
Location : Bangalore
Experience : 9 Yrs
Employment Type : Full Time, Permanent
Working mode : Regular
Job Description :
A Senior Data Engineer designs and oversees the entire data infrastructure, data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective.
Key Responsibilities :
- Mentor junior data engineers within the organization.
- Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric).
- Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage).
- Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.
- Optimize data pipelines in the Azure environment for performance, scalability, and reliability.
- Ensure data quality and integrity through data validation techniques and frameworks.
- Develop and maintain documentation for data processes, configurations, and best practices.
- Monitor and troubleshoot data pipeline issues to ensure timely resolution.
- Stay current with industry trends and emerging technologies to ensure our data solutions
remain cutting-edge.
- Manage the CI/CD process for deploying and maintaining data solutions.
-
Technical Lead- Data Engineer
1 week ago
Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearKindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...
-
Data & AI Engineer Lead
1 week ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearFramework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...
-
Data Entry Operator
1 week ago
Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per yearWe are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...
-
Data Engineer
7 hours ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAs a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...
-
Data Engineer
13 hours ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 8,00,000 - ₹ 16,00,000 per yearBuild scalable data pipelines from structured and unstructured sources Design ontologies that model business entities, relationships, and process flows Collaborate with domain SMEs and ML engineers to structure agent inputs and outputs Implement transformation, validation, and enrichment logic across diverse datasets Maintain and optimize cloud data...
-
Data Engineer
11 hours ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per yearMigrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....
-
Data Engineer
11 hours ago
Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 6,00,000 - ₹ 18,00,000 per yearReq ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - DBT to join our team in Bangalore, Karnātaka (IN-KA), India (IN)."Job Duties: We are seeking an Engineer to...
-
Lead Data Engineer
1 week ago
Bengaluru, Karnataka, India Infogain Full time ₹ 15,00,000 - ₹ 25,00,000 per yearThe Azure Data Engineer (Lead) is a management-level role responsible for leading a team of data engineers to design, develop, and maintain data processing systems on the Azure platform. They work with data architects, data scientists, and other stakeholders to ensure data solutions meet business requirements.Core SkillsMastery of Azure data services such as...
-
Sr Data Engineer
3 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per yearReq ID: 340286NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: At...
-
Lead Data Engineer
2 days ago
Bengaluru, Karnataka, India Infiniti Research Full timeLead Engineer MarTech/Digital Engineering (Customer Data Management)We are seeking a Lead Data Engineer to serve as the technical lead for the team responsible for managing and engineering customer data across Catalyst Brands.The ideal candidate will have a strong background in data engineering and software development, with hands-on experience building...