Senior Data Platform Engineer
6 days ago
What we offer:
Our Client, believes in rewarding our employees for their hard work. We offer competitive salaries, company pensions and performance related benefits. Our people can also take advantage of our extensive flexible benefits package and more.
How we work:
Our people are key to our success. Our core objective is to provide them with a supportive and entrepreneurial work environment that fosters collaboration. This allows our people to take responsibility and make optimal use of their skills. Together, we want to shape the future of energy.
About Us
We're a leading European energy company committed to powering the energy transition with speed, innovation, and resilience. Our Platform Engineering team is pivotal, providing the secure, scalable infrastructure, platforms, and tooling that enable rapid, high-quality software delivery for both our Advanced Solution Delivery team and Trading Citizen Developers across the trading organization.
Position Summary
As the (Senior) Data Platform Engineer (Azure Databricks), you will be responsible for building, maintaining, and evolving our Azure Databricks platform, ensuring it is secure, reliable, scalable, and cost-efficient. This role is pivotal in empowering our Data- & AIOps team by providing a robust, automated, and well-governed data environment. The ideal candidate will drive a "platform-as-a-product" mindset, continuously improving our architecture, operations, and user experience.
Your Responsibilities
Platform Architecture & Engineering:
Design and implement architectural improvements, including workspace migrations and robust disaster recovery (DR) strategies. Enhance and maintain the platform's security posture, focusing on data governance, data and compute isolation at logical and physical levels. Drive the evolution of the platform by researching, prototyping, and integrating new tools and features to enhance performance and scalability.Data Governance & Security:
Lead the expansion and utilization of Databricks Unity Catalog for granular data governance, including row/column-level security, data lineage tracking, and metadata tagging. Conduct regular security and compliance checks to ensure the platform adheres to internal policies and industry standards.Automation & Operations (DevOps & GitOps):
Build and maintain resilient CI/CD pipelines using GitHub Actions to automate infrastructure (Terraform) and application deployments. Implement and manage a comprehensive observability stack (logging, monitoring, tracing, alerting) to ensure high availability and proactive issue resolution. Apply FinOps principles to monitor, analyze, and optimize platform costs. Manage day-to-day platform administration, including onboarding projects, managing clusters, and configuring jobs.User Enablement & Self-Service:
Develop and integrate user-friendly interfaces (e.g., via ServiceNow or Backstage) to enable self-service for access requests and resource provisioning. Create and maintain clear documentation, including architecture diagrams, runbooks, and best-practice guides. Coach and train other colleagues, championing a "platform-as-a-product" mindset focused on delivering value to internal users.Your profile
Essential Qualifications:
Bachelor's or Master's degree in Computer Science, Mathematics, Engineering, or a related discipline. 5+ years of professional experience in a platform engineering, DevOps, or SRE role with a focus on data-intensive platforms. Deep expertise in Microsoft Azure, including ADLSGen2, Private Endpoints, Azure Key Vault, Azure Log Analytics, and EntraID. Extensive hands-on experience with Azure Databricks administration, operations, security, and performance tuning. Strong proficiency with Terraform and a solid understanding of GitOps principles. Advanced skills in shell scripting and experience with a scripting language like Python. Demonstrable experience building CI/CD pipelines with GitHub Actions. Familiarity with Databricks Asset Bundles is a plus. Proficient with Linux administration and troubleshooting. Practical experience implementing data governance solutions for data lakes, especially with Unity Catalog. Solid understanding of Kubernetes (k8s) concepts and architecture.Preferred Qualifications:
Understanding of MLOps principles (e.g., feature stores, model deployment strategies) to support ML engineering teams. Experience integrating with or building plugins for platforms like Backstage or ServiceNow.Soft Skills and Cultural Fit:
Excellent communication and collaboration skills to work effectively with technical teams and business stakeholders. Strong analytical thinking, problem-solving abilities. Demonstrated high level of initiative, self-motivation, and a proactive, self-starter mindset, with a strong drive to independently identify and solve challenges. A focus on treating the platform as a product, prioritizing the user experience and delivering tangible value to internal customers. A passion for continuous learning, innovation, knowledge sharing, and driving excellence in data engineering. Ability to work effectively in a cross-functional, fast-paced environment.Check Your Resume for Match
Upload your resume and our tool will compare it to the requirements for this job like recruiters do.
-
Senior Automation Platform Engineer
7 days ago
Bengaluru, Karnataka, India NTT DATA Full time US$ 1,04,000 - US$ 1,30,878 per yearReq ID: 340459NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Automation Platform Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Summary: The...
-
Bengaluru, Karnataka, India NTT DATA Full timeReq ID 340459 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Senior Automation Platform Engineer to join our team in Bangalore Karn taka IN-KA India IN Job Summary The...
-
Senior Platform Engineer – Data Store
2 weeks ago
Bengaluru, Karnataka, India Ness Digital Engineering Full time US$ 1,50,000 - US$ 2,00,000 per yearSenior Platform Engineer – Data Store (DWH + CMS + APIs) Experience: 10+ YearsLocation: OffshoreEmployment Type: Full-TimeAbout the Role We are hiring a Senior Platform Engineer to lead the design and implementation of a unified Platform Data Store comprising data warehouse systems, content management, and API services. This role demands deep experience in...
-
Senior Data Engineer Platform
2 weeks ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,74,00,000 - ₹ 2,16,00,000Are you ready to take on a challenging role that will allow you to grow professionally and make a significant impact on the organization?We are seeking an experienced Senior Data Engineer - Platform to join our team. This individual will play a key role in the development of data pipelines, frameworks, and models to support the understanding of our users and...
-
Senior Security Platform Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 13,08,780 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior...
-
Senior Platform Engineer – Data Store
2 weeks ago
Bengaluru, Karnataka, India Ness Digital Engineering Full time US$ 1,50,000 - US$ 2,00,000 per yearSenior Platform Engineer – Data Store (DWH + CMS + APIs)Experience: 10+ YearsLocation: OffshoreEmployment Type: Full-TimeAbout the RoleWe are hiring a Senior Platform Engineer to lead the design and implementation of a unified Platform Data Store comprising data warehouse systems, content management, and API services. This role demands deep experience in...
-
Senior Data Platform Developer
2 weeks ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000Job Title: Senior Data EngineerAbout the OpportunityWe are seeking a highly skilled Senior Data Engineer to contribute to the development of our data platform. This is an exciting opportunity for a talented individual to enhance our Investment Process and support key organizational objectives.
-
Senior Data Platform Developer
2 weeks ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000About Us">Career Opportunity for a Senior Data Engineer:We are seeking an experienced Senior Data Engineer to join our team and play a pivotal role in designing and implementing cutting-edge data engineering solutions. As a Senior Data Engineer, you will be responsible for leading the design and implementation of scalable and efficient data engineering...
-
Senior Data Engineer
6 days ago
Bengaluru, Karnataka, India beBeeDatabricks Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: Senior ETL DeveloperAbout the Role:We are seeking an experienced data engineer to lead our big data project. The ideal candidate will have a strong background in data processing and experience with cloud platforms.Develop and maintain scalable data pipelines using Databricks.Collaborate with stakeholders to understand data requirements and...
-
Data Senior Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per yearReq ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...
