Data Engineer

Job Description

Project Description:

You'll be working in the GM Business Analytics team located in Pune. The successful candidate will be a member of the global Distribution team, which has team members in London and Pune.

We work as part of a global team providing analytical solutions for IB distribution/sales people. Solutions deployed should be extensible globally with minimal localization.

Responsibilities:

Are you passionate about data and analytics? Are you keen to be part of the journey to modernize a data warehouse/ analytics suite of application(s). Do you take pride in the quality of software delivered for each development iteration?

We're looking for someone like that to join us and

• be a part of a high-performing team on a high-profile project.

• solve challenging problems in an elegant way

• master state-of-the-art technologies

• build a highly responsive and fast updating application in an Agile & Lean environment

• apply best development practices and effectively utilize technologies

• work across the full delivery cycle to ensure high-quality delivery

• write high-quality code and adhere to coding standards

• work collaboratively with diverse team(s) of technologists

You are:

• Curious and collaborative, comfortable working independently, as well as in a team

• Focused on delivery to the business

• Strong in analytical skills. For example, the candidate must understand the key dependencies among existing systems in terms of the flow of data among them. It is essential that the candidate learns to understand the 'big picture' of how IB industry/business functions.

• Able to quickly absorb new terminology and business requirements

• Already strong in analytical tools, technologies, platforms, etc. The candidate must also demonstrate a strong desire for learning and self-improvement.

• Open to learning home-grown technologies, support current state infrastructure and help drive future state migrations. imaginative and creative with newer technologies

• Able to accurately and pragmatically estimate the development effort required for specific objectives

You will have the opportunity to work under minimal supervision to understand local and global system requirements, design and implement the required functionality/bug fixes/enhancements. You will be responsible for components that are developed across the whole team and deployed globally.

You will also have the opportunity to provide third-line support to the application's global user community, which will include assisting dedicated support staff and liaising with the members of other development teams directly, some of which will be local and some remote.

Mandatory Skills Description:

• A bachelor's or master's degree, preferably in Information Technology or a related field (computer science, mathematics, etc.), focusing on data engineering.

• 5+ years of relevant experience as a data engineer in Big Data is required.

• Strong Knowledge of programming languages (Python / Scala) and Big Data technologies (Spark, Databricks or equivalent) is required.

• Strong experience in executing complex data analysis and running complex SQL/Spark queries.

• Strong experience in building complex data transformations in SQL/Spark.

• Strong knowledge of Database technologies is required.

• Strong knowledge of Azure Cloud is advantageous.

• Good understanding and experience with Agile methodologies and delivery.

• Strong communication skills with the ability to build partnerships with stakeholders.

• Strong analytical, data management and problem-solving skills.