Databricks Implementation Lead

1 day ago

Hyderabad India Rubis Software Solutions Pvt Ltd Full time

Job Description - Experience needed:8-12 years - Type:Full-Time - Mode:WFO - Shift:IST - Location:Hyderabad, India - Notice Period:Immediate to 15 days About the Role We are seeking an experiencedDatabricks Implementation Leadto spearhead end-to-end delivery of a large-scaledata engineering and analytics projectbuilt on theDatabricks Lakehouse platform. The ideal candidate will have deep expertise indata architecture, hands-on experience withDatabricks (SQL, PySpark, Delta Lake, MLflow), and the ability to lead teams throughsolution design, migration, optimization, and production rollout. Key Responsibilities 1. Project Leadership - Own the completeDatabricks implementation lifecyclefrom requirement gathering, architecture design, and environment setup to production deployment and handover. - Act as the primarytechnical liaisonbetween business stakeholders, data engineering teams, and cloud platform teams. - Ensure alignment with project goals, timelines, and compliance standards (data governance, security, cost optimization). 2. Architecture & Design - Design scalable and securedata pipelinesleveragingDatabricks, Delta Lake, andcloud-native services (Azure, AWS, or GCP). - Define thedata ingestion, transformation, and consumption architecture, integrating multiple data sources (APIs, databases, files, streaming). - EstablishCI/CD pipelinesfor Databricks notebooks and jobs, enabling automation and version control (using Git / Azure DevOps). 3. Technical Implementation - Lead and mentor a team ofdata engineersto developETL/ELT pipelinesusingPySpark, SQL, and Databricks workflows. - Configure clusters, jobs, andLakehouse storagefollowing best practices. - OptimizeDatabricks compute and query performancefor cost and efficiency. - Implementdata quality frameworks, monitoring dashboards, and error-handling logic. 4. Governance & Operations - Set upaccess control, role-based security, and data lineage trackinginUnity Catalog. - Collaborate with theCloudOps teamfor environment setup, monitoring, and cost governance. - Drivedocumentation, training, and knowledge transferto ensure sustainability and handover readiness. Required Skills & Experience - 8+ years of experience indata engineering or big data projects. - 3+ years ofhands-on Databricks experience(SQL, PySpark, Delta Lake, MLflow). - Strong experience withETL/ELT pipeline design,data modeling, anddata warehousing. - Experience withAzure Data Factory, AWS Glue, or similar orchestration tools. - Proficiency inPython, SQL, andSpark optimization techniques. - Experience implementingDevOps practices (CI/CD, Git, Databricks Repos). - Familiarity withdata governance frameworks, Unity Catalog, and RBAC. - Proven track record inleading multi-member implementation teams. Preferred Qualifications - Databricks Certified Data Engineer ProfessionalorSolution Architect certification. - Experience withAI/ML workflowsand model management usingMLflow. - Exposure toPower BI, Tableau, or Lookerfor downstream visualization. - Strong communication skills and experience inclient-facing roles. Soft Skills - Excellentproblem-solving and analytical skills. - Strongleadership and mentoringcapabilities. - Ability to work in afast-paced, cross-functional environment. - Cleardocumentation and presentationskills.

  • Databricks Implementation Lead

    2 days ago

    Hyderabad, Telangana, India Rubis Software Solutions Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience needed: yearsType:  Full-TimeMode:  WFOShift: ISTLocation:  Hyderabad, IndiaNotice Period:  Immediate to 15 daysAbout the RoleWe are seeking an experiencedDatabricks Implementation Lead to spearhead end-to-end delivery of a large-scale data engineering and analytics project built on the Databricks Lakehouse platform.The ideal...

  • Director of Engineering

    2 weeks ago

    Bengaluru, India Databricks Full time

    Job Description (P-1384) About The Team At Databricks, we are passionate about enabling data teams to solve the world's toughest problems from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. Ingesting data into the Lakehouse is a strategic area of investment for Databricks and a key enabler for Data...

  • Lead Consultant-Databricks developer

    4 weeks ago

    Hyderabad, India Genpact Full time

    Job Description Inviting applications for the role of Lead Consultant- Databricks Developer ! In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. Responsibilities - Design and develop scalable data pipelines using Databricks (PySpark/SQL/Delta Live...

  • Sr. Solutions Architect

    2 weeks ago

    Bengaluru, India Databricks Full time

    Job Description FEQ426R101 As a Senior Solutions Architect, you will shape the future of the Data & AI landscape by working with the most sophisticated data engineering and data science teams in the world. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will...

  • Lead Consultant-databricks

    4 weeks ago

    Hyderabad, Telangana, India GENPACT Full time

    Ready to shape the future of work At Genpact we don t just adapt to change we drive it AI and digital innovation are redefining industries and we re leading the charge Genpact s our industry-first accelerator is an example of how we re scaling advanced technology solutions to help global enterprises work smarter grow faster and transform at scale ...

  • Urgent! Sr. Product Security Engineer

    3 weeks ago

    Bengaluru, India Databricks Full time

    Job Description RDQ326R107 About The Team The Product Security Team at Databricks is responsible for embedding security throughout the Software Development Lifecycle (SDLC). Our mission is to left-shift securityensuring that all code, whether powering customer-facing features or supporting internal infrastructure, is developed with security in mind from...

  • Databricks Architect

    3 days ago

    Hyderabad, India Jio Full time

    Job Description Skills: Databricks, Apache Spark, SQL, Python, Big Data, Azure, Data Modeling, Azure Data Services, Title: Senior Databricks Architect Location: Mumbai, Gurgaon, Hyderabad About The Role We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using...

  • Databricks & AWS Lead

    4 days ago

    Bengaluru, Chennai, Hyderabad, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled Databricks & AWS Lead with 7-14 years of experience to join our team in Pune, Mumbai, Chennai, Hyderabad, Bangalore, and Noida. The ideal candidate will have expertise in Databricks and AWS, Unity Catalog, Spark, SQL, and Python.Roles and ResponsibilityDesign and implement data pipelines using Databricks and AWS.Develop and...

  • Testing Lead with Databricks

    4 weeks ago

    India PureSoftware Pvt Ltd Full time

    We are seeking a skilled LeadTester with experience in Databricks to join our QA team. The ideal candidate will be responsible for creating and executing test cases, identifying bugs, and ensuring data accuracy in analytics platforms. Hands-on experience with data validation, ETL testing, and SQL is essential. Familiarity with Databricks workflows and...

  • Testing Lead with Databricks

    1 week ago

    India PureSoftware Pvt Ltd Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are seeking a skilled LeadTester with experience in Databricks to join our QA team. The ideal candidate will be responsible for creating and executing test cases, identifying bugs, and ensuring data accuracy in analytics platforms. Hands-on experience with data validation, ETL testing, and SQL is essential. Familiarity with Databricks workflows and...