Lead Consultant-Databricks developer

2 days ago

Hyderabad, India Genpact Full time

Job Description

Inviting applications for the role of Lead Consultant- Databricks Developer

In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements.

Responsibilities

- Design and develop scalable data pipelines using Databricks (PySpark/SQL/Delta Live Tables).

- Implement ETL/ELT frameworks leveraging the Lakehouse (Bronze, Silver, Gold) architecture.

- Implement and manage data governance using Unity Catalog to ensure secure access, compliance, and centralized management of data, users, and permissions across the Databricks Lakehouse.

- Optimize data models, queries, and workflows for scalability, cost, and performance.

- Act as Databricks SME and provide guidance on best practices, governance, and security.

- Mentor junior developers, review code, and enforce coding standards.

- Integrate Databricks with cloud storage, APIs, warehouses, and BI tools.

- Implement orchestration using ADF, Airflow, Step Functions, or Databricks Workflows.

- Build reusable accelerators and frameworks for ingestion, transformation, and monitoring.

- Enable data quality, validation, and reconciliation (using tools like Great Expectations or custom).

- Set up monitoring, logging, and alerting dashboards for pipeline health.

- Collaborate with business stakeholders, architects, and analysts to deliver solutions.

- Support migration of legacy pipelines into Databricks Lakehouse.

- Contribute to architectural decisions, POCs, and innovation initiatives.

Qualifications we seek in you

Minimum qualifications

- Bachelor's degree (CS, CE, CIS, IS, MIS, Engineering) or equivalent work experience.

- Experience in data engineering with at least Databricks experience.

- End-to-end implementation of at least 2 Databricks projects(migration/integration).

- Strong background in batch and streaming data pipelines.

- Proficiency in Python (preferred) or Scala for Spark-based development.

- Expertise in SQL & Spark-SQL, data structures, and algorithms.

- Deep knowledge of Databricks components: Delta Lake, DLT, dbConnect, REST API 2.0, Workflows orchestration.

- Strong in performance optimization for pipelines (efficiency, scalability, cost reduction).

- Hands-on experience with Apache Spark, Hive, and Lakehouse architecture.

- Cloud expertise (Azure/AWS) includes storage (ADLS/S3), messaging (ASB/SQS), compute (ADF/Lambda), and databases (CosmosDB/DynamoDB/Cloud SQL).

- Experience writing unit tests and integration tests for data pipelines.

- Ability to work with architects and lead engineers to design solutions meeting functional & non-functional requirements.

- Team player with experience in teams of 5+ engineers.

- Strong communication and client-facing skills.

- Keeps updated with emerging technologies and industry trends.

- Strong analytical and problem-solving abilities.

- Positive attitude towards continuous learning and upskilling

- Good to have Databricks SQL Endpoint understanding.

- Good to have understanding on LakeflowConnect, Lakeflow Declarative Pipelines

- Good To have CI/CD experience to build the pipeline for Databricks jobs.

- Good to have if worked on migration project to build Unified data platform.

- Good to have knowledge of DBT.

- Good to have knowledge of docker and Kubernetes.

- Certification on Databricks Associate level.

- Any one Cloud Certification (AWS/Azure) Practitioner or Associate Level

  • Lead Consultant-Databricks

    7 days ago

    Hyderabad, Telangana, India Genpact Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    {E131AB7B-750D-4D85-AC7A-88463F2B8DE8}&file=Non-Tech-Lead Consultant- Databricks Developer .docx&action=default&mobileredirect=trueJobLead ConsultantPrimary LocationIndia-HyderabadScheduleFull-timeEducation LevelBachelor's / Graduation / EquivalentJob PostingSep 9, 2025, 1:38:46 AMUnposting DateMar 8, 2026, 6:38:46 AMMaster Skills ListDigitalJob CategoryFull...

  • Lead Consultant-databricks

    47 minutes ago

    Hyderabad, Telangana, India GENPACT Full time

    Ready to shape the future of work At Genpact we don t just adapt to change we drive it AI and digital innovation are redefining industries and we re leading the charge Genpact s our industry-first accelerator is an example of how we re scaling advanced technology solutions to help global enterprises work smarter grow faster and transform at scale ...

  • Consultant-Databricks

    4 days ago

    Hyderabad, India Genpact Full time

    Job Description Inviting applications for the role of Consultant-Databricks! We are on the lookout for an Analytics Engineer to join our team, tasked with integrating Putnam analytics solutions into FT systems. The ideal candidate should have a genuine passion for maintaining, optimizing, and enhancing analytics solutions. Responsibilities Develop and...

  • Principal Consultant- Databricks Lead Developer

    2 weeks ago

    Hyderabad, Telangana, India Genpact Full time US$ 1,04,000 - US$ 1,30,878 per year

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Principal Consultant- Databricks Lead Developer

    2 days ago

    Hyderabad, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Consultant- Data Engineer- Databricks!

    2 days ago

    Hyderabad, India Genpact Full time

    Job Description Inviting applications for the role of Consultant- Data Engineer- Databricks! In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. You would be part of the data integrity/analysis team in the Banking and financial domain. You will be...

  • Databricks Developer

    2 weeks ago

    Hyderabad, Telangana, India Zetamicron Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Title:Databricks DeveloperLocation:Bangalore, Chennai, Hyderabad, PuneExperience:5–7 YearsAbout the RoleWe are seeking an experiencedDatabricks Developerwith 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience inApache Spark, Databricks, PySpark, and cloud platforms such...

  • Databricks Developer

    2 days ago

    Hyderabad, India Zetamicron Full time

    Job Title:Databricks Developer Location:Bangalore, Chennai, Hyderabad, Pune Experience:5–7 Years About the Role We are seeking an experiencedDatabricks Developerwith 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience inApache Spark, Databricks, PySpark, and cloud platforms such...

  • Databricks Visionary

    2 weeks ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 17,50,000

    Senior Databricks ArchitectWe are seeking a highly skilled Senior Databricks Architect to drive technical excellence and deliver high-impact data solutions.Key ResponsibilitiesDevelop and enhance Databricks-based offerings, accelerators, and reusable frameworks.Lead solution architecture for proposals, RFPs, and strategic pursuits.Provide technical oversight...

  • Databricks Lead Engineer

    1 week ago

    Bengaluru, Chennai, Hyderabad, India Rhohyve Ai Labs Full time US$ 1,25,000 - US$ 1,75,000 per year

    Required Skills & Experience6-9 years of experience in Consulting, Data, and Analytics, with a strong background in Databricks solutions.Hands-on experience in designing and implementing big data solutions, including data pipelines for large and complex datasets.Expertise in Python, PySpark, and orchestration frameworks such as Airflow, Oozie, Luigi,...