Collibra Integration Engg

**Requisition No**
- VN358

**Employment Type**
- Permanent

**Location Country**
- India

**Location Region**

**Location City**
- Hyderabad

**Job Details**

**Locations**: India
- **Type**: Full-time
- **Experience**: 8-10 years
- **Functions**: Consulting, Finance, Information Technology, Data Governance
- **Industries**: Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Business Travel Healthcare
- **Job Duties**
- Work with business and requirement teams to formulate **_Collibra integration design_** with **_external metadata repositories_** (such as Informatica Metadata Manager, Apache Atlas, AWS Glue etc.), **_authoritative data sources_** (Oracle, Teradata, AWS, Snowflake etc. and other **_ETL_** tools (Ab Initio, Informatica) and **_programming languages_** (Python, Java, SQL)
- As per requirements (functional/non-functional/operational) **_design & build scalable, generic integration solution using Python_** with Collibra as centralized Data Governance platform for use cases such as **_technical metadata, lineage, Data Quality, reference data_** etc.
- Design **_metamodel of assets and their characteristics_** on DGC as per workflow requirements
- Configure JSON in order to customize **_Asset relationship/lineage diagrams_** on DGC
- Design **_Collibra community and domains_** and modularize the asset residence hierarchy as per business requirements
- Build integration solutions using **_Collibra Core, Import & Catalog APIs_** in Python or core Java
- Design and build generic utilities to export/Import metadata to/from Collibra DGC using Python or core Java
- ** Extensive Knowledge of **_Python_** internals, deployment and execution methodologies**:

- Build **_low-latency compute-intensive integrations_** leveraging several Python modules (requests, flask, pandas, subprocess, logging, os etc)
- Build generic utilities to **_perform full CDC_** on incoming data and while importing assets into DGC
- Perform Collibra **_DGC and Console integrations _**with**_ Identity & Access Management_** systems (SSO/LDAP)
- Onboard **_technical & business stewards on DGC_** as per the predefined roles and responsibilities
- Build Collibra **_asset monitoring & lifecycle dashboards_** on DGC
- Perform capacity planning and **_avoid scaling and performance issues_** of the designed solution
- Develop source code, **_unit test, participate in code reviews, deploy code_** to multiple environments
- Lead onsite and offshore teams and **_enable developers with clear and precise designs_** and planning to implement the design
- Perform **_capacity planning and avoid scaling and performance_** issues of the designed solutions
- **_ Voice the opinions to multiple teams_** and thus driving the entire initiative with strong leadership

**Key Responsibilities**
- Bachelor’s Degree or equivalent in computer science/related and minimum 8+ years experience
- Certified as Level 3 expert from Collibra
- Require Collibra DGC meta model design/customization experience with creation/configuration of DGC meta model assets and their relationships within and across domains/communities
- Require experience in building API based integration middleware for Collibra DGC, compatible with Collibra integration standards supporting Collibra assets onboarding, maturity lifecycle
- Require hands-on experience in operating on Collibra Core, Import & Catalog APIs
- Require hands-on experience in operating on Output Module of Collibra Core APIs
- Require hands-on expertise in payload manipulation, aggregation, data type conversion using Python or Java
- Require hands-on expertise in building scanners for parsing SQL constructs
- Require integration experience with other metadata tools such as Informatica, Ab Initio, Apache Atlas, Cloudera Navigator etc.
- Require expertise in load management using real-time or batch-based integration approach
- Require hands-on experience using RAML, REST API, SOAP, JSON, XML etc.
- Require hand-on experience on Collibra Marketplace connectors in integration architecture
- Preferred Mule 4.* runtime exposure.
- Preferred Collibra BPMN workflow development & Help Desk, Data Catalog exposure
- Require to be part of Production Rollouts of successful implementation of Collibra integrations
- Require expertise on Performance Analysis and perform code reviews and designs in order to improve performance
- Require expertise on capacity planning based on data volumes, processing complexity and SLAs
- Require Technical Coordination skills to drive requirements, design with multiple teams
- Financial services and Healthcare industry experience preferred
- Requires aptitude to help build skillset within organization

**Education Level**
- Bachelor's Degree

**Experience Level**
- 7 - 9 years