Databricks Implementation Lead

3 weeks ago

Hyderabad India Rubis Software Solutions Pvt Ltd Full time

Job Description - Experience needed:8-12 years - Type:Full-Time - Mode:WFO - Shift:IST - Location:Hyderabad, India - Notice Period:Immediate to 15 days About the Role We are seeking an experiencedDatabricks Implementation Leadto spearhead end-to-end delivery of a large-scaledata engineering and analytics projectbuilt on theDatabricks Lakehouse platform. The ideal candidate will have deep expertise indata architecture, hands-on experience withDatabricks (SQL, PySpark, Delta Lake, MLflow), and the ability to lead teams throughsolution design, migration, optimization, and production rollout. Key Responsibilities 1. Project Leadership - Own the completeDatabricks implementation lifecyclefrom requirement gathering, architecture design, and environment setup to production deployment and handover. - Act as the primarytechnical liaisonbetween business stakeholders, data engineering teams, and cloud platform teams. - Ensure alignment with project goals, timelines, and compliance standards (data governance, security, cost optimization). 2. Architecture & Design - Design scalable and securedata pipelinesleveragingDatabricks, Delta Lake, andcloud-native services (Azure, AWS, or GCP). - Define thedata ingestion, transformation, and consumption architecture, integrating multiple data sources (APIs, databases, files, streaming). - EstablishCI/CD pipelinesfor Databricks notebooks and jobs, enabling automation and version control (using Git / Azure DevOps). 3. Technical Implementation - Lead and mentor a team ofdata engineersto developETL/ELT pipelinesusingPySpark, SQL, and Databricks workflows. - Configure clusters, jobs, andLakehouse storagefollowing best practices. - OptimizeDatabricks compute and query performancefor cost and efficiency. - Implementdata quality frameworks, monitoring dashboards, and error-handling logic. 4. Governance & Operations - Set upaccess control, role-based security, and data lineage trackinginUnity Catalog. - Collaborate with theCloudOps teamfor environment setup, monitoring, and cost governance. - Drivedocumentation, training, and knowledge transferto ensure sustainability and handover readiness. Required Skills & Experience - 8+ years of experience indata engineering or big data projects. - 3+ years ofhands-on Databricks experience(SQL, PySpark, Delta Lake, MLflow). - Strong experience withETL/ELT pipeline design,data modeling, anddata warehousing. - Experience withAzure Data Factory, AWS Glue, or similar orchestration tools. - Proficiency inPython, SQL, andSpark optimization techniques. - Experience implementingDevOps practices (CI/CD, Git, Databricks Repos). - Familiarity withdata governance frameworks, Unity Catalog, and RBAC. - Proven track record inleading multi-member implementation teams. Preferred Qualifications - Databricks Certified Data Engineer ProfessionalorSolution Architect certification. - Experience withAI/ML workflowsand model management usingMLflow. - Exposure toPower BI, Tableau, or Lookerfor downstream visualization. - Strong communication skills and experience inclient-facing roles. Soft Skills - Excellentproblem-solving and analytical skills. - Strongleadership and mentoringcapabilities. - Ability to work in afast-paced, cross-functional environment. - Cleardocumentation and presentationskills.

  • Databricks Implementation Lead

    1 day ago

    Hyderabad, Telangana, India Rubis Software Solutions Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience needed: yearsType:  Full-TimeMode:  WFOShift: ISTLocation:  Hyderabad, IndiaNotice Period:  Immediate to 15 daysAbout the RoleWe are seeking an experiencedDatabricks Implementation Lead to spearhead end-to-end delivery of a large-scale data engineering and analytics project built on the Databricks Lakehouse platform.The ideal...

  • Program Lead, AI Tooling

    22 hours ago

    India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    CSQ426R284The Databricks Professional Services team accelerates our customers' outcomes and platform adoption through expert delivery, enablement, and innovation. As our customers scale their use of the Databricks Data Intelligence Platform, our mission is to guide them through the evolving data and AI landscape with speed, precision, and strategic insight....

  • Resident Solutions Architect

    22 hours ago

    India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    CSQ326R400As a Resident Solutions Architect in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Big Data Manager, Professional Services

    1 day ago

    Remote - India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    CSQ426R227As a Big Data Manager in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks...

  • ▷ [Apply in 3 Minutes] Sr. Business Systems Analyst

    3 weeks ago

    Bengaluru, India Databricks Full time

    Job Description GAQ426R340 About IT At Databricks At Databricks, the IT team's vision is to empower every Brickster with AI-driven tools that anticipate needs, amplify productivity, and secure our future at scale. Our mission is to deliver intelligent automation that makes work frictionless, accelerates innovation, and upholds Databricks gold standards in...

  • Databricks & AWS Lead

    3 days ago

    Bengaluru, Chennai, Hyderabad, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled Databricks & AWS Lead with 7-14 years of experience to join our team in Pune, Mumbai, Chennai, Hyderabad, Bangalore, and Noida. The ideal candidate will have expertise in Databricks and AWS, Unity Catalog, Spark, SQL, and Python.Roles and ResponsibilityDesign and implement data pipelines using Databricks and AWS.Develop and...

  • Databricks Architect

    6 days ago

    Hyderabad, India Jio Full time

    Job Description Skills: Data Engineering, Azure Databricks, Data Modeling, architecture, pyspark, scala, SQL, About The Role We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion,...

  • Databricks Architect

    3 weeks ago

    Hyderabad, India Jio Full time

    Job Description Skills: Databricks, Apache Spark, SQL, Python, Big Data, Azure, Data Modeling, Azure Data Services, Title: Senior Databricks Architect Location: Mumbai, Gurgaon, Hyderabad About The Role We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using...

  • Testing Lead with Databricks

    1 week ago

    India PureSoftware Pvt Ltd Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are seeking a skilled LeadTester with experience in Databricks to join our QA team. The ideal candidate will be responsible for creating and executing test cases, identifying bugs, and ensuring data accuracy in analytics platforms. Hands-on experience with data validation, ETL testing, and SQL is essential. Familiarity with Databricks workflows and...

  • Staff Technical Trainer

    1 week ago

    Bengaluru, India; Mumbai, India Databricks Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Staff Technical Instructor CSQ426R319 The Staff Technical Trainer at Databricks will be a member of the Learning and Enablement organization. This role is integral to enhancing the technical skills and knowledge of the Databricks community, which includes internal teams, partners, and customers. The Staff Technical Trainer will primarily be responsible...