Data Engineer
6 days ago
Data EngineerLocation -New Delhi Exp -3 -5 years - Design, develop, and maintain robust data pipelinesusing Azure Data Factory (ADF). - Build ETL/ELT processes that ingest,transform, and load data from various sources into data lakes, warehouses, or databases. - Implement both batch and near real -time data flows. - Create, schedule, and monitor ADF pipelines. -Implement complex data workflows, including dependency management,parameterization, and dynamic pipeline design. - Integrate ADF with otherAzure services (Blob Storage, Synapse, Databricks, Key Vault, etc.). -Implement logging, alerting, and retry logic for production stability. - Analyze large datasets to identify trends, issues, andtransformation needs. - Write performant SQL queries and transformations. -Collaborate with data analysts to understand data requirements and structuretransformations accordingly. - Ensure data is accurate, consistent, and alignedwith business logic. - Quickly diagnose and resolve data quality issues,pipeline failures, or performance bottlenecks. - Perform root cause analysisfor pipeline errors and implement long -term fixes. - Debug and optimize Sparkor SQL transformations in environments like Databricks. - Implement data validation and quality checks within pipelines. - Perform reconciliation and sanity checks across data sources. - Maintain datadictionaries and metadata repositories. - Work closely with data architects, analysts, BIdevelopers, and business users. - Translate business data needs into technical implementations. - Document pipeline logic, data flows, and troubleshooting procedures. - Work closely with data architects, analysts, BIdevelopers, and business users. - Translate business data needs into technical implementations. - Document pipeline logic, data flows, and troubleshooting procedures. - Optimize ADF pipeline execution time and cost. -Improve query performance using indexing, partitioning, and efficienttransformation logic. - Recommend improvements in data infrastructure andtooling. Benefits What a Consulting role at Thoucentric will offer you? Opportunity to define your career path and not as enforced by a manager A great consulting environment with a chance to work with Fortune 500 companies and startups alike. A dynamic but relaxed and supportive working environment that encourages personal development. Be part of One Extended Family. We bond beyond work - sports, get -togethers, common interests etc. Work in a very enriching environment with Open Culture, Flat Organization and Excellent Peer Group. Be part of the exciting Growth Story of Thoucentric
-
Data Entry Operator
1 week ago
Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per yearWe are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...
-
Data Engineer
2 hours ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 8,00,000 - ₹ 16,00,000 per yearBuild scalable data pipelines from structured and unstructured sources Design ontologies that model business entities, relationships, and process flows Collaborate with domain SMEs and ML engineers to structure agent inputs and outputs Implement transformation, validation, and enrichment logic across diverse datasets Maintain and optimize cloud data...
-
Technical Lead- Data Engineer
1 week ago
Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearKindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...
-
Data & AI Engineer Lead
1 week ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearFramework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 10,00,000 - ₹ 25,00,000 per yearJob Duties:Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix...
-
Sr Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per yearAt least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution. Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must. Complete development, configuration, test cases and unit testing Perform code reviews and ensure standards...
-
Sr Data Engineer
2 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per yearReq ID: 340286NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: At...
-
Data Engineer Senior Consultant
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,20,000 - ₹ 3,00,000 per yearReq ID: 341131NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Location: | Experience:...
-
Data Engineer
7 days ago
Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 25,00,000 per yearReq ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Hands-on experience in building and managing data...
-
AWS Sr Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per yearReq ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Sr Data Engineer to join our team in Bangalore or Remote, Karnātaka (IN-KA), India (IN). Position Location:OUS with...