Professional Data Engineer
5 days ago
Job Title: Data Engineering ProfessionalWe are seeking a skilled Data Engineer to join our team and contribute to the development of robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake).The ideal candidate will have experience in designing, building, and deploying scalable data pipelines to ingest, transform, and curate governance and operational metadata from multiple sources.The selected individual will be responsible for:Designing and implementing profiling logic to capture issue-level metadata (source table, column, timestamp, severity, rule type) to support drill-down from dashboards into specific records.Developing data pipelines to generate metrics for dashboards covering data quality, lineage, job monitoring, access & permissions, query cost, usage & consumption, retention & lifecycle, policy enforcement, sensitive data mapping, and governance KPIs.Automating asset onboarding, metadata enrichment, classification tagging, and lineage extraction for integration into governance reporting.Implementing logic for retention tracking and policy compliance monitoring (masking, RLS, exceptions).Building pipelines to track job performance, SLA adherence, and query costs for cost and performance optimization.Maintaining curated Delta tables for governance metrics, structured for efficient dashboard consumption.Monitoring pipeline execution, optimizing performance, and resolving issues quickly.The successful candidate will work closely with the lead engineer, QA, and reporting teams to validate metrics and resolve data quality issues.They will also ensure that all pipelines meet organizational governance, privacy, and security standards.
-
Data Engineer
2 weeks ago
Chennai, India NTT DATA Full timeJob Description Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Job Duties: As a data...
-
Lead Data Engineer
3 hours ago
Chennai, Tamil Nadu, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearEucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support the development of data infrastructure for our clients by participating in activities that may include starting from upstream and downstream technology selection to designing and building different components....
-
Data Engineer
3 hours ago
Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per yearHiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...
-
Data Engineer
9 hours ago
Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 9,00,000 - ₹ 12,00,000 per yearHiRole - Azure Data engineerLocation - Chennai, GurugramWork from officeFull timeImmediate joiner Only (15days Notice period only)Candidates with Certification in Databricks is good to haveTechnical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o...
-
chennai, India beBeeData Full timeJob OpportunityWe are seeking a highly skilled professional to fill the role of Senior Data Engineer. This is a permanent position with our organization.The ideal candidate will have experience working with large datasets and possess strong analytical skills.Key Responsibilities:Design and develop data pipelines using PySpark, Databricks, and...
-
Senior Data Engineer
3 weeks ago
Chennai, India Eucloid Data Solutions Full timeJob Description: Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Senior Data Engineer
3 weeks ago
Chennai, India Eucloid Data Solutions Full timeJob Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Senior Data Engineer
3 weeks ago
Chennai, India Eucloid Data Solutions Full timeJob Description: Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Senior Data Engineer
2 weeks ago
Chennai, India Eucloid Data Solutions Full timeJob Description: Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Senior Data Engineer
2 weeks ago
Chennai, India Eucloid Data Solutions Full timeJob Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
