Lead Consultant-Databricks developer

4 weeks ago

Hyderabad, India Genpact Full time

Job Description

Inviting applications for the role of Lead Consultant- Databricks Developer

In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements.

Responsibilities

- Design and develop scalable data pipelines using Databricks (PySpark/SQL/Delta Live Tables).

- Implement ETL/ELT frameworks leveraging the Lakehouse (Bronze, Silver, Gold) architecture.

- Implement and manage data governance using Unity Catalog to ensure secure access, compliance, and centralized management of data, users, and permissions across the Databricks Lakehouse.

- Optimize data models, queries, and workflows for scalability, cost, and performance.

- Act as Databricks SME and provide guidance on best practices, governance, and security.

- Mentor junior developers, review code, and enforce coding standards.

- Integrate Databricks with cloud storage, APIs, warehouses, and BI tools.

- Implement orchestration using ADF, Airflow, Step Functions, or Databricks Workflows.

- Build reusable accelerators and frameworks for ingestion, transformation, and monitoring.

- Enable data quality, validation, and reconciliation (using tools like Great Expectations or custom).

- Set up monitoring, logging, and alerting dashboards for pipeline health.

- Collaborate with business stakeholders, architects, and analysts to deliver solutions.

- Support migration of legacy pipelines into Databricks Lakehouse.

- Contribute to architectural decisions, POCs, and innovation initiatives.

Qualifications we seek in you

Minimum qualifications

- Bachelor's degree (CS, CE, CIS, IS, MIS, Engineering) or equivalent work experience.

- Experience in data engineering with at least Databricks experience.

- End-to-end implementation of at least 2 Databricks projects(migration/integration).

- Strong background in batch and streaming data pipelines.

- Proficiency in Python (preferred) or Scala for Spark-based development.

- Expertise in SQL & Spark-SQL, data structures, and algorithms.

- Deep knowledge of Databricks components: Delta Lake, DLT, dbConnect, REST API 2.0, Workflows orchestration.

- Strong in performance optimization for pipelines (efficiency, scalability, cost reduction).

- Hands-on experience with Apache Spark, Hive, and Lakehouse architecture.

- Cloud expertise (Azure/AWS) includes storage (ADLS/S3), messaging (ASB/SQS), compute (ADF/Lambda), and databases (CosmosDB/DynamoDB/Cloud SQL).

- Experience writing unit tests and integration tests for data pipelines.

- Ability to work with architects and lead engineers to design solutions meeting functional & non-functional requirements.

- Team player with experience in teams of 5+ engineers.

- Strong communication and client-facing skills.

- Keeps updated with emerging technologies and industry trends.

- Strong analytical and problem-solving abilities.

- Positive attitude towards continuous learning and upskilling

- Good to have Databricks SQL Endpoint understanding.

- Good to have understanding on LakeflowConnect, Lakeflow Declarative Pipelines

- Good To have CI/CD experience to build the pipeline for Databricks jobs.

- Good to have if worked on migration project to build Unified data platform.

- Good to have knowledge of DBT.

- Good to have knowledge of docker and Kubernetes.

- Certification on Databricks Associate level.

- Any one Cloud Certification (AWS/Azure) Practitioner or Associate Level

  • Lead Consultant- Databricks Developer!

    2 weeks ago

    Hyderabad, India Genpact Full time

    Ready to shape the future of work? At Genpact, we don’t just adapt to change—we drive it. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster,...

  • Lead Consultant- Databricks Developer!

    2 weeks ago

    Hyderabad, India Genpact Full time

    Ready to shape the future of work? At Genpact, we don’t just adapt to change—we drive it. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow...

  • Lead Consultant-Databricks

    1 week ago

    Hyderabad, Telangana, India Genpact Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    {E131AB7B-750D-4D85-AC7A-88463F2B8DE8}&file=Non-Tech-Lead Consultant- Databricks Developer .docx&action=default&mobileredirect=trueJobLead ConsultantPrimary LocationIndia-HyderabadScheduleFull-timeEducation LevelBachelor's / Graduation / EquivalentJob PostingSep 9, 2025, 1:38:46 AMUnposting DateMar 8, 2026, 6:38:46 AMMaster Skills ListDigitalJob CategoryFull...

  • Lead Consultant-databricks

    3 weeks ago

    Hyderabad, Telangana, India GENPACT Full time

    Ready to shape the future of work At Genpact we don t just adapt to change we drive it AI and digital innovation are redefining industries and we re leading the charge Genpact s our industry-first accelerator is an example of how we re scaling advanced technology solutions to help global enterprises work smarter grow faster and transform at scale ...

  • Consultant-Databricks

    4 weeks ago

    Hyderabad, India Genpact Full time

    Job Description Inviting applications for the role of Consultant-Databricks! We are on the lookout for an Analytics Engineer to join our team, tasked with integrating Putnam analytics solutions into FT systems. The ideal candidate should have a genuine passion for maintaining, optimizing, and enhancing analytics solutions. Responsibilities Develop and...

  • Principal Consultant- Databricks Lead Developer

    4 weeks ago

    Hyderabad, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Principal Consultant, Sr. Databricks Developer!

    1 week ago

    Hyderabad, India Genpact Full time

    Job Description Inviting applications for the role of Principal Consultant, Sr. Databricks Developer! In this role, the Sr. Databricks developer is responsible for solving real world cutting edgeproblem andmentor a team of one or more junior developer to address the goal. Responsibilities - Design and develop end-to-end data pipelines using PySpark,...

  • Principal Consultant- Databricks Lead Developer!

    2 weeks ago

    Hyderabad, India Genpact Full time

    Ready to shape the future of work? At Genpact, we don’t just adapt to change—we drive it. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster,...

  • Consultant- Databricks

    7 days ago

    Hyderabad, Telangana, India GENPACT Full time

    Ready to shape the future of work At Genpact we don t just adapt to change we drive it AI and digital innovation are redefining industries and we re leading the charge Genpact s our industry-first accelerator is an example of how we re scaling advanced technology solutions to help global enterprises work smarter grow faster and transform at scale From...

  • Consultant- Data Engineer- Databricks!

    4 weeks ago

    Hyderabad, India Genpact Full time

    Job Description Inviting applications for the role of Consultant- Data Engineer- Databricks! In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. You would be part of the data integrity/analysis team in the Banking and financial domain. You will be...