
Data Modernization Lead– Databricks Expert
2 days ago
About the job
Job description
Job Title: Senior Data Modernization Lead– Databricks Expert (Contract)
Location: Remote
Experience Level: 15+ Years
Role Overview
We are looking for an experienced Data Modernization Lead to spearhead our team’s transition to modern data engineering practices . This role will focus on migrating data assets and workflows from a Microsoft on-premise ecosystem to Databricks, along with modernizing development practices. The successful candidate will play a key role in migrating from Team Foundation Server (TFS) to Bitbucket for version control, establishing a Data Development Lifecycle (DDLC), and leading the transformation with Databricks expertise. This role requires a hands-on approach, strong leadership abilities , and a passion for coaching and mentoring through workshops and process design.
Key Responsibilities
Lead the strategy and execution for migrating data systems from Microsoft on-premise platforms to Databricks.
Evaluate and implement best practices for data pipelines, governance, and quality assurance within the Databricks environment.
Guide the team in transitioning from Team Foundation Server (TFS) to Bitbucket , ensuring effective branching, merging, and release management practices.
Establish a scalable Data Development Lifecycle (DDLC), including strategies for environments, testing frameworks, CI/CD for data pipelines, and deployment best practices.
Facilitate workshops and training sessions to develop Databricks skills and modern data engineering competencies within the team.
Mentor team members on version control workflows (Git) and data DevOps practices.
Collaborate with data architects, business stakeholders , and IT infrastructure teams to ensure alignment of modernization efforts with organizational goals.
Keep abreast of new data engineering technologies and propose strategies to improve team productivity and system reliability.
Required Skills and Experience
Proven experience leading data platform migrations, preferably from Microsoft on-premise systems to cloud-based platforms such as Databricks.
Expertise in Databricks, including Spark, Delta Lake, Python/Scala/SQL, MLFlow, and Lakehouse architecture .
Strong knowledge of version control migration and practices, particularly moving from TFS to Git/Bitbucket.
Experience in designing and implementing data DevOps processes, including building CI/CD pipelines for data solutions.
Familiarity with data governance, quality frameworks, and lifecycle management.
Exceptional facilitation and coaching skills, with a proven ability to lead practical, engaging workshops that drive results.
Strong communication and stakeholder management skills to align technical strategy with business objectives.
Preferred Qualifications
Experience in leading large-scale enterprise data modernization initiatives.
Hands-on experience with Azure Data Services, AWS, or GCP alongside Databricks.
Familiarity with Agile methodologies within data and analytics teams.
Leadership experience in defining team processes and standards for modern data engineering practices
Why Work With Us?
Flexible, remote work with a Full time commitment.
Opportunity to drive Databricks architecture and practices across data initiatives.
Collaborate with a smart, agile, and inclusive team.
Contribute to impactful enterprise-level data solutions.
How to Apply:
Send your updated resume to ( ) with the subject line:
“Full time Databricks Expert ”
or connect with us via ’s Easy Apply option.
Let’s build intelligent data solutions together
-
Data Engineer
4 weeks ago
Anantapur, Andhra Pradesh, India Innodata Inc. Full timeWe are looking for a Data Engineer with strong experience in CI/CD practices, Databricks (Spark), Python, Github and SQL. The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.Key ResponsibilitiesDesign, implement, and...
-
Anantapur, Andhra Pradesh, India Blue Cloud Softech Solutions Limited Full timeAbout the CompanyAt BCSS we strongly believe that data and analytics are strategic drivers for future success.We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business.The Analytics team at BCSS is part of the Organization and...
-
Azure data engineer
3 weeks ago
Anantapur, Andhra Pradesh, India People Prime Worldwide Full timeOur client is a global technology company headquartered in Santa Clara, California. it focuses on helping organisations harness the power of data to drive digital transformation, enhance operational efficiency, and achieve sustainability. over 100 years of experience in operational technology (OT) and more than 60 years in IT to unlock the power of data from...
-
Azure data engineer
3 weeks ago
Anantapur, Andhra Pradesh, India LTIMindtree Full timeRole: Azure Data Bricks DeveloperLocation: Nagpur/Bhubaneshwar/KolkataAbout LTIMindtree: LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more...
-
Data Engineer
6 days ago
Anantapur, India SolarSquare Full timeJob Description: Data EngineerAs a Data Engineer, you will own the end-to-end lifecycle of our data infrastructure. You willdesign and implement robust, scalable data pipelines and architect modern data solutionsusing a best-in-class technology stack. Your work will transform raw, messy data into clean,reliable, and actionable data products that power...
-
Data Engineer
3 weeks ago
Anantapur, Andhra Pradesh, India Apidel Technologies Full timeJob Responsibilities: E2E support of Data project Lifecycle (Acquire, Organize, Analyze and Deliver).Define, innovate and shape the architecture for new data products / features.Seeing through a project from conception to finished product.Hands on work on core Data platforms and toolsAnalyze & translate functional specifications /user stories into technical...
-
Hindi linguistics expert
2 weeks ago
Anantapur, India Innodata Inc. Full timeInnodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine.By...
-
Lead aem
4 days ago
Anantapur, India Destm Technologies Full timeCompany DescriptionDestm Technologies is a software consulting company specializing in e-commerce solutions, AI-powered automation, and custom software development. With over 12 years of experience, we partner with businesses to drive growth, optimize operations, and enhance customer experiences. Our services include E-commerce Platform Development &...
-
Data Architect
6 days ago
Anantapur, India ThoughtFocus Full timeONLY IMMEDIATE JOINERS (0-10 days)Data Architect / Data ModelerPosition Overview Experienced Data Architect / Data Modeler with strong expertise in Financial Services, and preferably exposure to Private Equity. The role involves designing enterprise-level data models, defining data architecture standards, and ensuring the scalability, performance, and...
-
Lead Back End Developer
3 weeks ago
Anantapur, Andhra Pradesh, India MResult Full timeJob Title: Lead Backend DeveloperLocation: Bengaluru / MangaluruJob Type: Full-TimeExperience: 7-8 Years in Python, FastAPI, AWS, Lambda, DynamoDB, S3, CloudFormation, SQS, GitHub, CI/CD, experience working on GenAI projects. Certification good to have-AWS Associate/Professional Solution Architect.Why MResult?Founded in 2004, MResult is a global digital...