Data Modernization Lead– Databricks Expert
3 weeks ago
About the job
Job description
Job Title: Senior Data Modernization Lead– Databricks Expert (Contract)
Location: Remote
Experience Level: 15+ Years
Role Overview
We are looking for an experienced Data Modernization Lead to spearhead our team’s transition to modern data engineering practices . This role will focus on migrating data assets and workflows from a Microsoft on-premise ecosystem to Databricks, along with modernizing development practices. The successful candidate will play a key role in migrating from Team Foundation Server (TFS) to Bitbucket for version control, establishing a Data Development Lifecycle (DDLC), and leading the transformation with Databricks expertise. This role requires a hands-on approach, strong leadership abilities , and a passion for coaching and mentoring through workshops and process design.
Key Responsibilities
Lead the strategy and execution for migrating data systems from Microsoft on-premise platforms to Databricks.
Evaluate and implement best practices for data pipelines, governance, and quality assurance within the Databricks environment.
Guide the team in transitioning from Team Foundation Server (TFS) to Bitbucket , ensuring effective branching, merging, and release management practices.
Establish a scalable Data Development Lifecycle (DDLC), including strategies for environments, testing frameworks, CI/CD for data pipelines, and deployment best practices.
Facilitate workshops and training sessions to develop Databricks skills and modern data engineering competencies within the team.
Mentor team members on version control workflows (Git) and data DevOps practices.
Collaborate with data architects, business stakeholders , and IT infrastructure teams to ensure alignment of modernization efforts with organizational goals.
Keep abreast of new data engineering technologies and propose strategies to improve team productivity and system reliability.
Required Skills and Experience
Proven experience leading data platform migrations, preferably from Microsoft on-premise systems to cloud-based platforms such as Databricks.
Expertise in Databricks, including Spark, Delta Lake, Python/Scala/SQL, MLFlow, and Lakehouse architecture .
Strong knowledge of version control migration and practices, particularly moving from TFS to Git/Bitbucket.
Experience in designing and implementing data DevOps processes, including building CI/CD pipelines for data solutions.
Familiarity with data governance, quality frameworks, and lifecycle management.
Exceptional facilitation and coaching skills, with a proven ability to lead practical, engaging workshops that drive results.
Strong communication and stakeholder management skills to align technical strategy with business objectives.
Preferred Qualifications
Experience in leading large-scale enterprise data modernization initiatives.
Hands-on experience with Azure Data Services, AWS, or GCP alongside Databricks.
Familiarity with Agile methodologies within data and analytics teams.
Leadership experience in defining team processes and standards for modern data engineering practices
Why Work With Us?
Flexible, remote work with a Full time commitment.
Opportunity to drive Databricks architecture and practices across data initiatives.
Collaborate with a smart, agile, and inclusive team.
Contribute to impactful enterprise-level data solutions.
How to Apply:
Send your updated resume to ( ) with the subject line:
“Full time Databricks Expert ”
or connect with us via ’s Easy Apply option.
Let’s build intelligent data solutions together
-
Data Engineer
7 days ago
Anantapur, India Keasis Full timeWe are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have hands-on experience with modern data lakehouse architectures and will play a...
-
Senior Data Scientist
1 week ago
Anantapur, India Recro Full timeRole : Senior Data Scientist (AI & Data)Location: Remote (Work from Home)We’re hiring a Senior Data Scientist to build the next generation of intelligentdecision systems that power pricing, supply optimization, ranking, and personalizationin our global B2B hotel marketplace.This is a high-impact role at the intersection of machine learning, optimization,...
-
Data Engineer
4 weeks ago
Anantapur, India SolarSquare Full timeJob Description: Data EngineerAs a Data Engineer, you will own the end-to-end lifecycle of our data infrastructure. You willdesign and implement robust, scalable data pipelines and architect modern data solutionsusing a best-in-class technology stack. Your work will transform raw, messy data into clean,reliable, and actionable data products that power...
-
Mern, data observability and ai tech lead
5 days ago
Anantapur, India Seosaph-infotech Full timeCompany DescriptionSeosaph-infotech is a growing company in the field of customized software development, offering a range of tech solutions to businesses in different verticals. Within just two years, Seosaph-infotech has delivered exceptional solutions to industries such as Finance, Healthcare, and E-commerce. Our vision is to help our clients become...
-
sap abap
1 week ago
Anantapur, Andhra Pradesh, India NTT DATA Full time ₹ 5,00,000 - ₹ 15,00,000 per yearCompany DescriptionNTT DATA, a part of NTT Group, is headquartered in Tokyo and provides IT and business services globally. We help clients transform through consulting, industry solutions, business process services, digital and IT modernization, and managed services. Our commitment to our clients' long-term success allows us to enable not only them but...
-
Lead aem
4 weeks ago
Anantapur, India Destm Technologies Full timeCompany DescriptionDestm Technologies is a software consulting company specializing in e-commerce solutions, AI-powered automation, and custom software development. With over 12 years of experience, we partner with businesses to drive growth, optimize operations, and enhance customer experiences. Our services include E-commerce Platform Development &...
-
Data Architect
4 weeks ago
Anantapur, India ThoughtFocus Full timeONLY IMMEDIATE JOINERS (0-10 days)Data Architect / Data ModelerPosition Overview Experienced Data Architect / Data Modeler with strong expertise in Financial Services, and preferably exposure to Private Equity. The role involves designing enterprise-level data models, defining data architecture standards, and ensuring the scalability, performance, and...
-
Designer and AI code expert Lovable, base 44
2 days ago
Anantapur, India Learn with Leaders Full timeCompany DescriptionLearn with Leaders (LWL) connects middle and high school students with world-class faculty, thought leaders, and college students globally. LWL empowers young learners to explore new interests, develop global networks, and nurture their creativity through a variety of year-round events and programs — from short-term workshops to mid-term...
-
Backend and data pipeline engineer
4 weeks ago
Anantapur, India JRD Systems Full timeJob Role: Backend and Data Pipeline Engineer - PythonLocation: RemoteJob Type : Fulltime** Only Immediate Joiners **Job Summary:The Team:We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda. These include new data integration, advanced analytics, and modern applications that address new...
-
Data Analyst
1 week ago
Anantapur, Andhra Pradesh, India FMGC food products Full time ₹ 6,00,000 - ₹ 12,00,000 per yearCompany DescriptionFMGC food products is a food production company based near Varanarayana Temple in Kulashekara, Mangalore, Karnataka, India. The company is known for its high-quality food products that cater to a wide market. FMGC food products emphasizes innovation and quality in all aspects of its production processes to ensure customer satisfaction....