Specialist DevOps Engineer- Databricks
2 weeks ago
Nasdaq is continuously revolutionizing markets and undergoing transformations while we adopt new technologies to develop innovative solutions, constantly aiming to rewrite tomorrow. We are seeking a Specialist DevOps engineer, focusing on enhancing our data and analytics infrastructure and supporting continuous integration and delivery pipelines. This role will play a pivotal role in managing a variety of platforms, including Databricks, Microsoft Power BI, Microsoft SQL Server, Informatica, Azure, AWS, and Windows Server environments. Familiarity with Profisee MDM is a plus.
We are looking for candidates with a genuine desire and drive to deliver top technology solutions to today's markets.
With this position we offer
Join the DevOps organization as a DevOps support engineer, with the primary objective of designing, implementing, and managing DevOps processes to support our Data & Insights initiatives.
Your role and responsibilities:
As a Specialist DevOps Engineer, your focus will be developing and implementing software solutions. Besides working closely with your colleagues in Bangalore location, you will also work closely with Nasdaq teams in other countries.
CI/CD Pipeline and Configuration Management:
Design, implement, and handle CI/CD pipelines using GitHub/GitLab and JIRA for detailed development, testing, and deployment.
Be responsible for configuration management and automation frameworks, ensuring consistent and reliable deployment processes.
Data Platform and Infrastructure Management:
Help handle and optimize infrastructure for Microsoft Power BI, SQL Server, Databricks, and Informatica to ensure scalability and performance.
Collaborate with data engineering and analytics teams to deploy and maintain robust data pipelines and analytics solutions.
Provide Windows Server administration, ensuring high availability, security, and stability.
Cloud and Hybrid Infrastructure:
Lead all aspects of deployments on both Azure and AWS platforms, with a focus on hybrid cloud solutions and standard processes for scalability and cost optimization.
Monitoring and Incident Response:
Establish and maintain supervising frameworks to ensure system health, performance, and reliability across all platforms.
Initiate incident response and root cause analysis, developing solutions to prevent future occurrences and reduce downtime.
Teamwork and Process Improvement:
Work closely with multi-functional teams, including data engineering, application development, and business analytics, to support and optimize DevOps processes.
Identify and implement standard processes in DevOps, infrastructure management, and data platform operations.
Governance and Compliance:
Ensure data governance, access control, and security compliance for all data environments, both on-premises and in the cloud.
Work with the Data Governance team on data quality, lineage, and master data management (preferably with Profisee MDM).
We expect you to have:
- At least 6+ years of experience in DevOps or related roles, with a strong focus on Databricks, Microsoft Power BI, Microsoft SQL Server and Informatica.
- Hands-on experience with Databricks & Terraform is must to have.
- Proficiency with CI/CD tools such as GitHub, GitLab, JIRA, and related automation tools.
- Hands-on experience with cloud platforms, specifically Microsoft Azure and AWS, and expertise in hybrid cloud deployments.
- Familiarity with monitoring and alerting tools and frameworks to supervise performance and system health.
- Should be familiar in scripting language – Python & Notebooks.
- Strong understanding of Windows Server management and administration.
- Knowledge of SAAS Profisee MDM (preferred but not required).
- Understanding of SQL & database concepts.
Soft Skills:
- Consistent track record to lead, mentor, and develop high-performance teams.
- Excellent communication and social skills to work efficiently with both technical and non-technical collaborators.
- Strong analytical skills, problem-solving abilities, and attention to detail.
- Proven experience in incident management, root cause analysis, and implementing preventive measures.
We expect you to have:
- Bachelor/Master in computer science Information Technology, or a related field.
- Relevant certifications in DevOps, cloud platforms (Azure, AWS), or related technologies are a plus.
It would be great if you
- Experience with Master Data Management (MDM) platforms, ideally Profisee.
- Certifications such as Azure DevOps Engineer, AWS Certified DevOps Engineer, or similar.
Does it sound like you?
As the selection process is ongoing, please submit your application in English as soon as possible. We will get back to you in 2-3 weeks.
Come as you are
Nasdaq is an equal opportunity employer. We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and/or expression, veteran status, genetic information or any other status protected by applicable law.
Nasdaq is a leading global provider of trading, clearing, exchange technology, listing, information, and public company services. As the creator of the world's first electronic stock market, its technology powers more than 100 marketplaces in 50 countries. Nasdaq is home to over 4,000 total listings with a market value of approximately $12 trillion.
To learn more, about our business visit Check out more about our Life at Nasdaq.
Come as You Are
Nasdaq is an equal opportunity employer. We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and/or expression, veteran status, genetic information, or any other status protected by applicable law.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request an accommodation.
-
Databricks Engineer
1 week ago
Ahmedabad, Bengaluru / Bangalore, India beBeeDatabricksAdmin Full time US$ 80,000 - US$ 1,50,000We are seeking a skilled professional to manage and maintain Databricks infrastructure at scale. This role requires expertise in administration, deployment, and troubleshooting within the Databricks environment.Key Responsibilities:Databricks Infrastructure Management: Oversee and optimize Databricks clusters to ensure high availability and...
-
Senior Data Engineer
19 hours ago
Chennai, Bengaluru / Bangalore, Pune, India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878Senior Data Engineer - Databricks ExpertWe are seeking a highly skilled Senior Data Engineer with expertise in Databricks to design, build and optimize large-scale data pipelines and processing solutions.This role focuses on leveraging big data frameworks, distributed computing and cloud platforms to deliver robust data solutions.The ideal candidate will...
-
DevOps Infrastructure Specialist
5 hours ago
Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore, India beBeeInfrastructure Full time ₹ 8,00,000 - ₹ 12,00,000Job TitleDevOps Infrastructure SpecialistOverview: We are seeking a highly skilled DevOps Infrastructure Specialist to join our team. The successful candidate will be responsible for designing, implementing, and maintaining our infrastructure using cutting-edge technologies.Key Responsibilities:Design and implement scalable and secure infrastructure...
-
Cloud Data Engineer
3 days ago
Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore, India beBeeData Full time ₹ 8,00,000 - ₹ 20,00,000Databricks ExpertThis role focuses on leveraging Databricks as a cloud-based data and AI platform to drive business growth and innovation. Key responsibilities include:Workspace Optimization: Streamline Databricks workspace management, ensuring seamless collaboration and efficient resource allocation.User Identity Management: Develop and implement robust...
-
Databricks Scala/Spark Data Engineer
2 days ago
Pune, Mumbai, Bengaluru / Bangalore, India beBeeDataEngineer Full time ₹ 80,000 - ₹ 2,00,000Job Title: Databricks Scala/Spark DeveloperJob Description: As a Databricks Scala/Spark developer, you will be responsible for designing and implementing scalable data processing systems using Spark and Scala. The ideal candidate will have strong programming skills and experience with complex objects and datasets.Required Skills:Strong knowledge of Spark and...
-
Platform Engineer
4 days ago
Chennai, Tamil Nadu Bangalore, Karnataka, India Diverse Lynx Full timeHiring for Platform Engineer - Bangalore Chennai We are seeking a skilled Platform Engineer to design implement and maintain scalable data platforms leveraging Azure Synapse Databricks Cloudera and Terraform The ideal candidate will have strong cloud infrastructure experience hands-on expertise in data platform services and proficiency in...
-
Data Architecture Specialist
3 days ago
Gurgaon / Gurugram, Bengaluru / Bangalore, India beBeeData Full timeJob Title: Data Architecture Specialist">Design and develop scalable data architectures to meet business requirements.Implement and manage big data solutions using Azure Data Lake Storage (ADLS) and Azure Databricks.Collaborate with cross-functional teams to understand data needs and deliver robust solutions.Optimize data workflows for performance,...
-
Azure Devops
4 days ago
Bangalore, India PradeepIT Consulting Services Pvt Ltd Full timeAzure Devops Experience: 6+ Years Mode: Hybrid (2-3 days/week) Location: Remote (Need to visit 1 day in a month - Gurugram)Required Skills and ExperienceStrong hands-on experience with Azure DevOps Services (Repos, Pipelines, Boards, Artifacts).Experience with Infrastructure as Code using TerraformProficiency in scripting languages like PowerShell, Bash,...
-
Azure DevOps Infrastructure Specialist
2 days ago
Chennai, Bengaluru / Bangalore, Delhi, India beBeeAzureDevOps Full time ₹ 9,00,000 - ₹ 12,00,000Job DescriptionWe are seeking an experienced professional to fill the role of Azure DevOps Engineer. This individual will be responsible for designing, implementing, and maintaining Azure DevOps infrastructure and services.
-
Chief DevOps Specialist
24 hours ago
Hyderabad / Secunderabad, Telangana, Chennai, Bengaluru / Bangalore, India beBeeCloud Full time US$ 1,04,000 - US$ 1,30,878DevOps Engineer OpportunityWe are seeking a highly skilled DevOps Engineer to join our team. As a key member of our engineering organization, you will be responsible for designing, implementing, and maintaining our CI/CD pipelines, ensuring seamless deployment and scalability of our applications.Key Responsibilities:Architect and implement CI/CD pipelines in...