Current jobs related to Data Catalog Engineer - Navi Mumbai, Maharashtra - Coders Brain Technology Private Limited

Azure Data Engineer

2 weeks ago

Navi Mumbai, Maharashtra, India Celebal Technologies Full time

Job Title: Azure Data Engineer Duration: Fulltime Positions: Multiple Experience Required: 3-5 Years & 6-8 Years Job Summary: We are looking for a highly skilled Azure Data Engineer with a strong background in real-time and batch data ingestion and big data processing, particularly using Kafka and Databricks. The ideal candidate will have a deep...
Azure Data Engineer

2 weeks ago

Navi Mumbai, Maharashtra, India Celebal Technologies Full time

Job Title: Azure Data Engineer Duration: Fulltime Positions: Multiple Experience Required: 3-5 Years & 6-8 Years Job Summary: We are looking for a highly skilled Azure Data Engineer with a strong background in real-time and batch data ingestion and big data processing, particularly using Kafka and Databricks. The ideal candidate will have a deep...
Senior Data Engineer

17 hours ago

Mumbai, Maharashtra, India beBeeData Full time US$ 1,04,000 - US$ 1,30,878

Job Title: Azure Databricks LeadAs a senior data engineer, you will play a crucial role in designing and developing scalable data pipelines using Azure Databricks and PySpark/Scala.Our ideal candidate has experience architecting and building data platforms on Azure and is proficient in Azure Databricks, PySpark, and SQL. You will work closely with data...
Data Quality Engineer

4 weeks ago

Navi Mumbai, Maharashtra, India QualityKiosk Technologies Pvt. Ltd. Full time

About QualityKiosk Technologies QualityKiosk Technologies is a leading independent Quality Engineering (QE) and digital transformation provider, helping businesses deliver high-performing, user-friendly applications. Founded in 2000, the company offers services in QA automation, performance assurance, intelligent automation (IA), robotic process automation...
Data Quality Engineer

3 weeks ago

Navi Mumbai, Maharashtra, India QualityKiosk Technologies Pvt. Ltd. Full time

About QualityKiosk TechnologiesQualityKiosk Technologies is a leading independent Quality Engineering (QE) and digital transformation provider, helping businesses deliver high-performing, user-friendly applications. Founded in 2000, the company offers services in QA automation, performance assurance, intelligent automation (IA), robotic process automation...
Electrical Engineering Lead

13 hours ago

Navi Mumbai, Maharashtra, India BDx Data Centers Full time

To lead the development of all aspects of research in Electrical Power Systems Engineering specifically in the space of software defined power ie managing stranded power in a DC. # Collaborate with Design and Engineering (D&E) core teams to develop, implement, and manage the DC electrical designs for new development, infrastructure upgrades and...
Chief Data Architect

2 hours ago

Mumbai, Maharashtra, India beBeeData Full time ₹ 12,60,000 - ₹ 2,01,60,000

Job Overview:">Our ideal candidate will have a strong background in designing and implementing large-scale data solutions using Azure Databricks, PySpark, and Delta Lake.They should be proficient in Unity Catalog for centralized data governance, access control, and data lineage tracking.The role involves working across scrum teams to develop data solutions...
Mechanical Design Engineer

4 weeks ago

Navi Mumbai, Maharashtra, India BDx Data Centers Full time

Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...
Urgent Data Engineer

4 weeks ago

Mumbai, Maharashtra, India Godrej Properties Full time

Job DescriptionJob Responsibilities:Data Pipeline Development: Design, develop, and optimize data pipelines to ingest, process, and transform data from various sources (e.g., APIs, databases, into the data warehouse.Data Integration:Integrate data from various structured and unstructured sources into the Databricks Lakehouse environment, ensuring data...
Mechanical Design Engineer

4 weeks ago

Navi Mumbai, Maharashtra, India BDx Data Centers Full time

Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

Data Catalog Engineer

4 weeks ago

Navi Mumbai, Maharashtra, India Coders Brain Technology Private Limited Full time

Job Title : Data Catalog Engineer AWS Data Lake/Data Warehouse

Location : HDB Financial Services Limited. MBP Office Navi Mumbai.

Experience : 78 Years or More

Employment Type : Full-Time

Job Summary :

HDB Financial Services Limited is seeking an experienced and motivated Data Catalog Engineer to join our Data Engineering team. The ideal candidate will have extensive experience designing and implementing metadata and data catalog solutions in AWS-centric data lake/data warehouse environments. This role is pivotal in enhancing data discoverability, governance, and lineage across our enterprise data assets.

Key Responsibilities :

- Lead the end-to-end implementation of a data cataloging solution within AWS (preferably AWS Glue Data Catalog or third-party tools like Apache Atlas, Alation, Collibra, etc.).

- Establish and manage metadata frameworks for structured and unstructured data assets in the data lake and data warehouse

environments.

- Integrate the data catalog with AWS-based storage solutions such as S3, Redshift, Athena, Glue, and EMR.

- Collaborate with data Governance/BPRG/IT projects teams to define metadata standards, data classifications, and stewardship processes.

- Develop automation scripts for catalog ingestion, lineage tracking, and metadata updates using Python, Lambda, Pyspark or Glue/EMR customs jobs.

- Work closely with data engineers, data architects, and analysts to ensure metadata is accurate, relevant, and up to date.

- Implement role-based access controls and ensure compliance with data privacy and regulatory standards.

- Create detailed documentation and deliver training/workshops for internal stakeholders on using the data catalog.

Required Skills and Qualifications :

- 78+ years of experience in data engineering or metadata management roles.

- Proven expertise in implementing and managing data catalog solutions within AWS environments.

- Strong knowledge of AWS Glue, S3, Athena, Redshift, EMR, Data Catalog and Lake Formation.

- Hands-on experience with metadata ingestion, data lineage, and classification processes.

- Proficiency in Python, SQL, and automation scripting for metadata pipelines.

- Familiarity with data governance and compliance standards (e.g., GDPR, RBI guidelines).

- Experience integrating with BI tools (e.g., Tableau, Power BI) and third-party catalog tools is a plus.

- Strong communication,

- Problem-solving, and stakeholder management skills.

Preferred Qualifications :

- AWS Certifications (e.g., AWS Certified Data Analytics, AWS Solutions Architect).

- Experience with data catalog tools like Alation, Collibra, or Informatica EDC. Or open sources tools hand-on experience.

- Exposure to data quality frameworks and stewardship practices.

- Knowledge of data migration with data catalog and data-mart is plus