IT engineer Data

Job Description Ensure stable, scalable, and secure operation of the Azure-based Data & Analytics platform, including Databricks, Azure-native components, Power BI, and CI/CD infrastructure Offload operational workload from platform architects by taking ownership of infrastructure, deployment automation, and pipeline reliability Enable smooth execution and troubleshooting of data pipelines written in Scala and PySpark, including hybrid integration scenarios such as Power BI with gateway infrastructure Reports to: Head of Data & Analytics IT Competence Center Collaborates with: Platform Architects, Data Engineers, ML Engineers, Power BI Developers Geography: Global (stakeholders in Germany, India, Manila) Operational Scope: Azure services, Databricks workspaces, CI/CD toolchains, Power BI service (incl. gateways), and Spark-based data pipelines Main Tasks - Operate and optimize Azure resources (ADF, Key Vault, Monitor, Event Hub)- Administer Databricks workspace access and cluster configs - Apply Infrastructure-as-Code (Terraform/Bicep) - Manage CI/CD pipelines for Scala and PySpark-based pipelines - Integrate build steps (, Maven/SBT, Python wheels) into automated deployments - Enforce DevSecOps and IaC standards - Monitor Spark job execution, analyze failures and stage-level issues using Spark UI and logs - Configure alerts, metrics, and dashboards for pipelines and infrastructure - Lead post-incident reviews and reliability improvements - Administer Power BI tenant configuration, workspace access, and usage monitoring - Operate and monitor on-premises or VM-hosted enterprise gateways - Troubleshoot dataset refreshes and hybrid data integration - Support runtime execution of production pipelines and ensure SLA adherence - Collaborate with engineers to resolve Spark performance issues or deployment errors - Participate in schema evolution and environment transitions - Enforce platform policies (tagging, RBAC, audit logging) - Maintain credential and secrets security using Key Vault and managed identity - Conduct audits across Azure, Databricks, and Power BI environments Qualifications Education / Certification: Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or related field. Preferred: Azure DevOps Engineer Expert, Power BI Admin, or Databricks Admin certifications Professional Experience: Minimum 5 years in cloud platform engineering, DevOps, or SRE roles within data or analytics platforms Hands-on experience with Spark (Databricks), PySpark, and CI/CD for JVM-based data applications Project or Process Experience: Proven ability to deploy and operate complex data pipeline ecosystems using Scala and PySpark Experience in managing Power BI service in enterprise setups, including hybrid gateway environments Leadership Experience: No formal people leadership required; expected to lead through technical authority and cross-team collaboration Intercultural / International Experience: Experience working in distributed teams across time zones and cultures; strong communication skills and resilience Additional Information The well-being of our employees is important to us. That's why we offer exciting career prospects and support you in achieving a good work-life balance with additional benefits such as: Training opportunities Mobile and flexible working models Sabbaticals and much more... Sounds interesting for you? are important to us and make our company strong and successful. We offer equal opportunities to everyone - regardless of age, gender, nationality, cultural background, disability, religion, ideology or sexual orientation.