Senior It Officer, Business Solutions I

Senior IT Officer Business Solutions I Senior Data Engineer Job req34539 Organization World Bank Sector Information Technology Grade GG Term Duration 2 years 0 months Recruitment Type Local Recruitment Location Chennai India Required Language s English Preferred Language s English Closing Date 10 20 2025 MM DD YYYY at 11 59pm UTC Description Do you want to build a career that is truly worthwhile The World Bank Group is a unique global partnership of five institutions driven by a bold vision to create a world free of poverty on a livable planet As one of the largest sources of funding and knowledge for developing countries we help solve the world s greatest development challenges When you join the World Bank Group you become part of a dynamic diverse organization with 189 member countries and more than 120 offices worldwide We work with public and private sector partners invest in groundbreaking projects and use data research and technology to bring tangible and transformative change around the globe For more information visit www worldbank org VPU Context The mission of the Information and Technology Solutions ITS Vice Presidential Unit VPU is to leverage information and technology as a force multiplier to accelerate deepen and sustain development impact Their vision is to harness information and technology for a world free of poverty on a livable planet For more information on ITS check this video https www youtube com watch reload 9 v VTFGffa1Y7w Unit Context The ITS Operations Products unit ITSOP enables digital enablement of the Bank s business processes through a modern flexible and user-friendly digital platform that integrates and optimizes critical functions for thousands of front-line staff It also drives the delivery of AI-powered business solutions to support business priorities and accelerate data-driven decision-making across the institution The World Bank is seeking a Senior Data Engineer to join its Information Technology Solutions ITS department in Chennai India Senior Data Engineer typically works on multiple projects in the World Bank Operations portfolio ensuring that the data pipelines and architectures supporting the unit s initiatives are successfully delivered to Operations Staff He she will provide technical leadership and guidance for complex data projects that require knowledge of data engineering domains and business segments From a work program perspective he she will be responsible for data pipeline delivery responsibilities providing guidance and work program oversight to a team of staff and a large team of data engineers from vendors located on-premises and off-shore to ensure effective and efficient delivery of data solutions From a technical perspective he she will be responsible for leading the design and modeling of data architectures for structured and unstructured data component identification quality reviews and adherence to enterprise standards and guidelines Responsibilities Responsibilities include but may not be limited to the following - Assume role of Technical Lead contributing to the implementation maintenance and operation of data pipelines and platforms supporting the World Bank s Operations lines of business - This includes managing structured data e g relational databases and unstructured data e g documents logs images in operations eco-systems related to Operations Workspace Environmental and Social Management Systems and Fiduciary systems - Architect and lead the implementation of data workflows and pipelines supporting various applications in the unit with a focus on scalable handling of structured and unstructured data - Lead implementation of data lakes warehouses using Databricks and Azure Data Factory for processing large-scale datasets including container-based solutions for data storage and analytics - Implement and maintain data quality frameworks to monitor data pipelines detect anomalies and ensure data integrity and reliability across structured and unstructured datasets - Provide guidance to and work with key stakeholders to support the discussion on the technical features of data solutions including ensuring the readiness of each release - Apply technical and business knowledge to architect and supervise the implementation of data solutions - Effectively document and communicate technical analyses designs and specifications - Work with the Information Security Team to satisfy its requirements recommendations and support related security testing - Identifies and evaluates overall systemic issues and analyzes complex data issues Apply scientific principles and best practices to design develop and support data products services and solutions ensuring efficiency scalability and reliability - Coordinate with vendors and consultants overseeing their deliverables to ensure that they satisfy requirements and meet World Bank standards - Coordinate with project team members Mentor junior staff assist with IT resource management Selection Criteria Master s degree in computer science data science or Mathematics with 8 years relevant experience or bachelor s degree in computer science data science or related field with a minimum of 10 years relevant experience Proven ability to independently manage large complex deliverables in an environment of shifting priorities multi-layered governance structures complex IT landscapes and diverse client bases Knowledge of the institution s technical and operational infrastructure relevant institutional policies and procedures ability to effectively liaise with stakeholders on policy and technical issues A solid understanding of data engineering principles including ETL ELT processes big data technologies and tools such as Apache Spark Delta Lake Azure Data Factory and cloud-based data platforms Minimum of 7 years of experience in developing and maintaining large-scale data solutions using Databricks for processing structured and unstructured data At least 5 years of experience in architecting Databricks-based solutions and integrations with cloud resources such as Azure AWS including data lakes warehouses and streaming pipelines Thorough exposure to core features of Databricks including data modeling job orchestration and performance tuning for structured and unstructured data Azure Data Factory features such as data flows triggers and monitoring and Power BI features like report sharing real-time dashboards and workspace management Experience with Unity Catalog for data governance within Databricks Hands-on experience in developing and deploying solutions in Azure AWS e g Data Lake Storage Synapse Analytics S3 EMR Azure Data Factory Power BI Embedded etc Minimum of 5 years of experience in designing and implementing ETL ELT pipelines using Azure Data Factory including data integration orchestration and transformation for structured and unstructured data sources Experience in implementing and maintaining data quality frameworks using tools like Monte Carlo Ataccama or similar Hands-on expertise in custom development with languages like Python Scala or SQL to build and optimize data pipelines in Databricks and Azure Data Factory Strong experience with authenticating and authorizing data apps using Azure AD or similar including B2B and B2E scenarios Proven experience in maintaining development best practices including version control using Git logging and monitoring using Databricks Jobs AppInsights or Splunk Hands-on experience in DevOps for data pipelines e g CI CD with Azure DevOps or GitHub Actions A good understanding of data governance tools experience with Collibra for data cataloging lineage and quality management is a plus Experience in managing large teams both offshore and onsite - staffing skills development organizing and operationalizing teams to deliver value is a must Good presentation and facilitation skills are highly desired Ability to learn new technologies quickly self-starters and motivated and able to work with others and communicate effectively Able to take personal responsibility and accountability for timely response to client queries requests or needs working to remove obstacles that may impede execution or overall success Core Competencies Deliver Results for Clients Proactively addresses clients stated and unstated needs Adds value by constantly looking for a better way to get more impactful results sets challenging stretch goals for oneself Immerses oneself in client experiences and perspective by asking probing questions to understand unmet needs Demonstrates accountability for achieving results that have a development impact and financial environmental and social sustainability Identifies and proposes solutions to mitigate and manage risks Collaborate Within Teams and Across Boundaries Collaborates across boundaries gives own perspective and willingly receives diverse perspectives Appropriately involves others in decision making and communicates with key stakeholders Approaches conflicts as common problems to be solved Actively seeks and considers diverse ideas and approaches displaying a sense of mutuality and respect Integrates WBG perspective into work Lead and Innovate Develops innovative solutions Contributes new insights to understand situations and develops solutions to resolve complex problems Adapts as circumstances require and manages impact of own behavior on others in context of WBG s values and mission Identifies and pursues innovative approaches to resolve issues Create Apply and Share Knowledge Applies knowledge across WBG to strengthen solutions for internal and or external clients Leverages department s expertise and body of knowledge across WBG to strengthen internal and or external client solutions Seeks to learn from more experienced staff to deepen or strengthen their professional knowledge and helps others to learn Builds personal and professional networks inside and outside the department unit Learning Orientation Stays abreast of new trends and developments in own specialty area as well as what is occurring in the broader industry Experiments with new approaches and alters normal procedures Tracks developments in the field through readily available sources and by maintaining active involvement with relevant industry user and vendor associations Sees the applicability of current or emerging technological solutions to current business needs WBG Culture Attributes 1 Sense of Urgency - Anticipating and quickly reacting to the needs of internal and external stakeholders 2 Thoughtful Risk Taking - Taking informed and thoughtful risks and making courageous decisions to push boundaries for greater impact 3 Empowerment and Accountability - Engaging with others in an empowered and accountable manner for impactful results WBG Culture Attributes 1 Sense of urgency Anticipate and quickly respond to the needs of internal and external stakeholders 2 Thoughtful risk-taking Challenge the status quo and push boundaries to achieve greater impact 3 Empowerment and accountability Empower yourself and others to act and hold each other accountable for results The World Bank Group offers comprehensive benefits including a retirement plan medical life and disability insurance and paid leave including parental leave as well as reasonable accommodations for individuals with disabilities We are proud to be an equal opportunity and inclusive employer with a dedicated and committed workforce and do not discriminate based on gender gender identity religion race ethnicity sexual orientation or disability Learn more about working at the and including our values and inspiring stories