Senior Data Engineer

Senior Data EngineerTitle Senior Data Engineer Department ISS Location Bengaluru Reports To Data Engineers – Lead Level 4,5,6We share a commitment to making things better for clients and each other. We continually explore new technology and different ways of working to put our clients first. So, bring your boldest ideas to our (name of team/business area) team and feel like you are making progress.About your team ISS Data Engineering Chapter is an engineering group comprised of three sub-chapters - Data Engineers, Data Platform and Data Visualisation – that supports the ISS Department.A leading Asset Management firm is embarking on several strategic programmes of work that will create a data platform to support the next evolutionary stage of our Investment Process. These programmes span across asset classes and include Portfolio and Risk Management, Fundamental and Quantitative Research and Trading.About your role This role sits within the ISS Data Engineering. The Data Engineering team is responsible for building and maintaining the data applications and platform that enables the ISS business to operate.This role is appropriate for a senior data engineer capable of taking ownership and a delivering a subsection of the wider data platform or data applications.As a Senior Data Engineer, you will directly contribute to our key organizational objectives of Accelerated Innovation, Cost Optimization, Risk Mitigation, and Business EnablementKey Responsibilities • Design, develop and maintain scalable data pipelines and architectures to support data ingestion, integration and analytics • Be accountable for technical delivery and take ownership of solutions • Lead a team of senior and junior developers providing mentorship and guidance • Collaborate with enterprise architects, business analysts and stakeholders to understand data requirements, validate designs and communicate progress • Drive technical innovation within the department to increase code reusability, code quality and developer productivity • Challenge the status quo by bringing the very latest data engineering practices and techniquesAbout you Core Technical Skills • Cloud Platforms: Expert in leveraging cloud-based data platforms (Snowflake, data lakehouse architecture) to create enterprise lake houses • AWS Ecosystem: Advanced expertise with AWS services including Lambda, EMR, MSK, Glue, and S3 • Streaming Architecture: Experience designing event-based or streaming data architectures using Kafka • Programming: Advanced expertise in Python and SQL (Java/Scala experience welcomed) • DevOps: Expert in CI/CD pipelines to deploy infrastructure (Terraform) with test automation • Data Security: Experience implementing data access controls to meet regulatory requirements • Database Systems: Experience with both RDBMS (Oracle, Postgres, MSSQL) and NoSQL (Dynamo, OpenSearch, Redis) • Data Integration: Experience implementing CDC ingestion techniques • Orchestration: Experience using workflow tools (Airflow, Control-M, etc.) • Engineering Practices: Significant experience with GitHub, code verification, validation, and AI-assisted development • Domain Knowledge: Knowledge of investment management industry concepts, particularly security reference data, fund reference data, transactions, orders, holdings, and fund accountingBonus technical Skills: • Strong experience in containerization and deploying applications to Kubernetes • Strong experience in API development using Python-based frameworks like FastAPI • Familiarity with Asset Management data domains (Security Reference, Trades, Orders Holdings, Funds, Accounting, Index etc)Key Soft Skills: • Problem-Solving: Leadership experience in problem-solving and technical decision-making • Communication: Strong in strategic communication and stakeholder engagement • Project Management: Experienced in overseeing project lifecycles and managing resources alongside Project Managers