Lead Data Engineer

About The Team
You will be joining the newly formed AI, Data & Analytics team, primarily responsible as a Data Engineer leading various projects within the new Data Platform team. The new team is focused on driving increased value from the data InvestCloud captures to enable a smarter financial future for our clients, in particular focused on "enhanced intelligence". Ensuring we have fit-for-purpose modern capabilities is a key goal for the team.

We are seeking a Senior
Data Engineer
with strong expertise in building and maintaining robust data pipelines, optimizing data architecture, and integrating cloud data solutions. The ideal candidate should have hands-on experience with
AWS Data services
,
Oracle
,
Snowflake
and/or
Databricks
, and a passion for developing scalable data systems that drive business insights and innovation as well as driving data platform modernization.

We will be developing and implementing a new data platform leveraging AWS and analytics tools. Helping the business to modernize its end-to-end tech stack and drive AI and analytics business objectives.

Key Responsibilities

• Implement, manage and maintain data platforms such as Oracle, Snowflake, and/or Databricks, ensuring high availability and performance, whilst optimizing for cost.
• Assist in the Design, development, and maintenance of scalable data pipelines to support diverse analytics and machine learning needs.
• Optimize and manage data architectures for reliability, scalability, and performance.
• Implement and support data integration solutions from our data partners, including ETL/ELT processes, ensuring seamless data flow across platforms.
• Collaborate with Data Scientists, Analysts, and Product Teams to define and support data requirements.
• Ensure data security and compliance with company policies and relevant regulations.
• Monitor and troubleshoot data systems to identify and resolve performance issues.
• Develop and maintain datasets and data pipelines to support Machine Learning model training and deployment
• Analyze large datasets to identify patterns, trends, and insights that can inform business decisions.
• Work with 3rd party providers of Data and Data Platform products to evaluate and implement solutions achieving Investcloud's business objectives.

Required Skills

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
• Minimum of 10 years of professional experience in data engineering or a related role.
• Proficiency in database technologies, including Oracle and PostgreSQL.
• Hands-on experience with Snowflake and/or Databricks, with a solid understanding of their ecosystems.
• Expertise in programming languages such as Python or SQL.
• Familiarity with ETL/ELT tools and data integration frameworks.
• Experience with cloud platforms such as AWS, GCP, or Azure.
• Familiarity with containerization and CI/CD tools (e.g., Docker, Git).
• Excellent problem-solving skills and the ability to handle complex datasets.
• Outstanding communication skills to collaborate with technical and non-technical stakeholders globally.
• Knowledge of data preprocessing, feature engineering, and model evaluation metrics
• Excellent proficiency in English
• Ability to work in a fast-paced environment across multiple projects simultaneously
• Ability to collaborate effectively as a team player, fostering a culture of open communication and mutual respect.

Preferred Skills

• Knowledge of data warehousing and data lake architectures.
• Familiarity with governance frameworks for data management and security.
• Knowledge of Machine Learning frameworks (TensorFlow, PyTorch, Scikit-learn) and LLM frameworks (e.g. Langchain)

What Do We Offer
Join our diverse and international cross-functional team, comprising data scientists, product managers, business analyst and software engineers. As a key member of our team, you will have the opportunity to implement cutting-edge technology to create a next-generation advisor and client experience.

Location and Travel
The ideal candidate will be expected to work from the London office (with some flexibility). Occasional travel may be required.

Compensation
The salary range will be competitive and determined based on experience and skills.

Equal Opportunity Employer
InvestCloud is committed to fostering an inclusive workplace and welcomes applicants from all backgrounds.