Data Modernization Lead– Databricks Expert

2 weeks ago

Madurai, India Saradysol Tech Ventures Private Limited Full time

About the job


Job description


Job Title: Senior Data Modernization Lead– Databricks Expert (Contract) 


Location: Remote


Experience Level: 15+ Years


Role Overview


We are looking for an experienced Data Modernization Lead to spearhead our team’s transition to modern data engineering practices. This role will focus on migrating data assets and workflows from a Microsoft on-premise ecosystem to Databricks, along with modernizing development practices. The successful candidate will play a key role in migrating from Team Foundation Server (TFS) to Bitbucket for version control, establishing a Data Development Lifecycle (DDLC), and leading the transformation with Databricks expertise. This role requires a hands-on approach, strong leadership abilities, and a passion for coaching and mentoring through workshops and process design.


Key Responsibilities


Lead the strategy and execution for migrating data systems from Microsoft on-premise platforms to Databricks.

Evaluate and implement best practices for data pipelines, governance, and quality assurance within the Databricks environment.

Guide the team in transitioning from Team Foundation Server (TFS) to Bitbucket, ensuring effective branching, merging, and release management practices.

Establish a scalable Data Development Lifecycle (DDLC), including strategies for environments, testing frameworks, CI/CD for data pipelines, and deployment best practices.

Facilitate workshops and training sessions to develop Databricks skills and modern data engineering competencies within the team.

Mentor team members on version control workflows (Git) and data DevOps practices.

Collaborate with data architects, business stakeholders, and IT infrastructure teams to ensure alignment of modernization efforts with organizational goals.

Keep abreast of new data engineering technologies and propose strategies to improve team productivity and system reliability.


Required Skills and Experience


Proven experience leading data platform migrations, preferably from Microsoft on-premise systems to cloud-based platforms such as Databricks.

Expertise in Databricks, including Spark, Delta Lake, Python/Scala/SQL, MLFlow, and Lakehouse architecture.

Strong knowledge of version control migration and practices, particularly moving from TFS to Git/Bitbucket.

Experience in designing and implementing data DevOps processes, including building CI/CD pipelines for data solutions.

Familiarity with data governance, quality frameworks, and lifecycle management.

Exceptional facilitation and coaching skills, with a proven ability to lead practical, engaging workshops that drive results.

Strong communication and stakeholder management skills to align technical strategy with business objectives.


Preferred Qualifications


Experience in leading large-scale enterprise data modernization initiatives.

Hands-on experience with Azure Data Services, AWS, or GCP alongside Databricks.

Familiarity with Agile methodologies within data and analytics teams.

Leadership experience in defining team processes and standards for modern data engineering practices


Why Work With Us?


Flexible, remote work with a Full time commitment.


Opportunity to drive Databricks architecture and practices across data initiatives.


Collaborate with a smart, agile, and inclusive team.


Contribute to impactful enterprise-level data solutions.


How to Apply:


Send your updated resume to [careers@saradysol.com] with the subject line:


“Full time Databricks Expert ”


or connect with us via ’s Easy Apply option.


Let’s build intelligent data solutions together 🚀

  • Data Engineer

    2 weeks ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks, Job Summary The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business...

  • Data Engineer

    2 weeks ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks, Job Summary The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business...

  • Data Engineer

    2 weeks ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...

  • Data Engineer

    1 week ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks, Job Summary The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business...

  • Data Engineer

    2 weeks ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...

  • Lead Data Engineer

    7 days ago

    Madurai, India Guidanz Inc Full time

    About BI ConnectorBI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL. Our Data Architecture and Reporting Solutions team extends this mission by helping enterprises unlock the full value of their Oracle Fusion ERP, SCM, HCM data...

  • Data Engineer

    3 weeks ago

    Madurai, India HCLTech Full time

    Azure Senior Data Engineer with Azure Data Factory (ADF), Azure Databricks, SQL, PythonLocation: MaduraiExperience: 3 to 8 yearsJob SummaryThe Senior Developer will be responsible for developing and maintaining solutions using Azure Data Factory (ADF), Azure Databricks, SQL, and Python. The primary objectives includes building and optimizing data pipelines...

  • Data Engineer

    5 days ago

    Madurai, Tamil Nadu, India, Tamil Nadu HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...

  • Senior Data Scientist

    3 weeks ago

    Madurai, India Sapphire Software Solutions Inc Full time

    HI FolksPlease check the JD and share your updated resume to my email naresh@sapphiresoftwaresolutions.com and ping me on whatsapp (+91 970-529-6474) along with your resumeData Scientist100% RemoteWorking hours: 1PM to 10 PM ISTJDWe are seeking a highly skilled and motivated Data Science / Machine Learning Engineer to join our team. The ideal candidate will...

  • Data Engineer

    3 weeks ago

    Greater Madurai Area, India HCLTech Full time

    Azure Senior Data Engineer with Azure Data Factory (ADF), Azure Databricks, SQL, PythonLocation: MaduraiExperience: 3 to 8 yearsJob SummaryThe Senior Developer will be responsible for developing and maintaining solutions using Azure Data Factory (ADF), Azure Databricks, SQL, and Python. The primary objectives includes building and optimizing data pipelines...