Azure Databricks Engineer with Azure Synapse

Position: Azure/Data Bricks - Data Engineer

Job Summary/ Job Opportunity:

Xceedance has a talent pool of industry-savvy data scientists and insurance-expert specialists that strive to provide the best solutions to our clients.

As a Data Engineer, you will assist re/insurers, agents, and brokers accelerate their data-to-insights lifecycles by using a robust proprietary data warehousing framework and leading-edge data enrichment and ingestion systems.

This is an excellent opportunity for a highly efficient individual to secure the opportunity to work alongside a team of experts. If you possess a passion for what you do, we await your innovation at Xceedance.

Key Objectives and Major Responsibilities:

1. The purpose of this role is to develop and construct data products and services, and integrate them into systems and business processes.

2. The individual will play an essential role in implementing these projects from the prospect of our insurance domain.

3. Major responsibilities include utilising CRUD operations and creating databases as per the data model design and database views and materialised views. 4. Comparing data warehouses, RDBM, data lakes and their implementation scenarios, normalisation and denormalization processes and identifying essential characteristics of those projects. 5. Leveraging visualisation tools as guided to create and design data visuals / reports / dashboards and selecting appropriate techniques to engage with the target audience and prototype and further refine it. 6. Performing protocols and processes to be followed towards data accessibility, retrievability, security and protection.

4. Assisting the development and implementation of data pipelines and data stores and carrying out routine data quality checks and remediation.

5. Representing the logical structure of the database using tables and graphical relationships in selected programs and analysing source and target systems.

6. Creating mapping documents. ETL/ELT code (scripts) to perform ETL/ELT operations to integrate data from disparate systems into Data lake/DWH or any other target database.

7. Conducting an initial assessment along with a senior architect to identify gaps in technology, platform, data quality standards, and capturing business/data quality rules & quality thresholds.

8. Documenting as-is/current architecture/data landscape details and assisting in building fit-gap analysis documents.

9. Contributing to the organisational values by actively engaging in the larger learning and development process.

10. Preparing complex documentation, proposals and presentations to advance business objectives.

11. Driving concise, structured, and effective communication with peers and clients.

Key Capabilities and Competencies

Knowledge

1. Knowledge and experience of essential data warehousing terminologies and processes applied to facilitate operations.

2. Thorough with the data life cycle and various risks associated with data management.

3. Awareness of the standard data modelling principles and techniques pertaining to data warehousing.

4. In-depth understanding of scrum values and agile knowledge.

5. Cognizant of Xceedance's key offerings and capabilities.

6. Recognizes various concepts, jargon, and products employed in the insurance industry.

Skills

1. Working knowledge of ETL design, and ETL coding through tools such as SSIS, ADF and Azure Data Stack

2. Working knowledge of DataBricks/Spark framework

3. Experience in programming languages including SQL and Python/Scala.

4. Understanding/working knowledge of data warehouse, star schema/data vault

5. Understanding of Cloud Platforms, especially Azure cloud

6. Professional writing style with the ability to formulate emails, presentations, and documents.

7. Competent to work in an active and diverse environment.

8. Excellent interpersonal and communication skills.

Qualification and Experience

1. Recognized with a Bachelor of Engineering/Technology in computer science/information technology.

2. Recognizable domain knowledge wherein the individual has awareness of insurance concepts, products, and jargon within the basic and regulatory frameworks.

We Offer / What We Offer You

At Xceedance, you will discover the possibility to Xceed yourself and grow persistently with us. We offer career development opportunities to our members for well-rounded development throughout their journey with us.