Databricks Developer

1 week ago

Chennai, Tamil Nadu, India Genpact Full time

About Genpact

Genpact is a global professional services and solutions firm that delivers outcomes shaping the future. Our team of 125,000+ people across 30+ countries is driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients.

We serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI.

Job Title: Databricks Developer - Driving Enterprise Data Transformation

Location: To be determined based on your location and preferences

Salary Range: $120,000 - $180,000 per annum, depending on your experience and qualifications

About the Role

In this role, you will be responsible for solving real-world cutting-edge problems to meet both functional and non-functional requirements as a Databricks Developer at Genpact.

You will work closely with architects and lead engineers to develop innovative solutions that drive enterprise data transformation.

Your Responsibilities Will Include:

  • Maintaining close awareness of new and emerging technologies and their potential application for service offerings and products.
  • Working with architect and lead engineers for solutions to meet functional and non-functional requirements.
  • Demonstrating knowledge of relevant industry trends and standards.
  • Demonstrating strong analytical and technical problem-solving skills.
  • Holding experience in Data Engineering domain.

Qualifications We Seek in You

To excel in this role, you should have the following qualifications:

  • Bachelor's Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.
  • Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
  • Work with architect and lead engineers for solutions to meet functional and non-functional requirements.
  • Demonstrated knowledge of relevant industry trends and standards.
  • Demonstrate strong analytical and technical problem-solving skills.
  • Must have excellent coding skills either Python or Scala, preferably Python.
  • Must have experience in Data Engineering domain.
  • Must have implemented at least 2 project end-to-end in Databricks.
  • Must have at least experience on databricks which consists of various components as below
    o Delta lake
    o dbConnect
    o db API 2.0
    o Databricks workflows orchestration
  • Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.
  • Must have good understanding to create complex data pipeline
  • Must have good knowledge of Data structure & algorithms.
  • Must be strong in SQL and sprak-sql.
  • Must have strong performance optimization skills to improve efficiency and reduce cost.
  • Must have worked on both Batch and streaming data pipeline.
  • Must have extensive knowledge of Spark and Hive data processing framework.
  • Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.
  • Must be strong in writing unit test case and integration test
  • Must have strong communication skills and have worked on the team of size 5 plus
  • Must have great attitude towards learning new skills and upskilling the existing skills.

Preferred Qualifications

The following qualifications are preferred but not required:

  • Good to have Unity catalog and basic governance knowledge.
  • Good to have Databricks SQL Endpoint understanding.
  • Good To have CI/CD experience to build the pipeline for Databricks jobs.
  • Good to have if worked on migration project to build Unified data platform.
  • Good to have knowledge of DBT.
  • Good to have knowledge of docker and Kubernetes.

  • Big Data Migration Strategist

    3 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    We are seeking an experienced Big Data Migration Strategist to join our team at Databricks. As a key member of our Professional Services team, you will work with customers on short to medium-term engagements to help them overcome their big data challenges using the Databricks platform.Job DescriptionIn this role, you will provide data engineering, data...

  • Data Engineering Lead

    2 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    About the RoleWe are seeking an experienced Data Engineering Lead to join our Professional Services team at Databricks. In this role, you will work with customers on short to medium-term engagements to help them overcome their big data challenges using the Databricks platform.Key ResponsibilitiesDesign and implement data engineering solutions that integrate...

  • Director of Databricks Engineering

    6 days ago

    Chennai, Tamil Nadu, India LatentView Analytics Full time

    At LatentView Analytics, we are seeking an experienced Director of Databricks Engineering to lead our data engineering team and drive the design, implementation, and optimization of our Databricks platform. This role requires a strong technical background in Databricks, Python, Big Data, Apache Spark, SQL, and Spark SQL.The ideal candidate will have at least...

  • Databricks Test Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India BSRI Solutions Full time

    We are looking for a highly skilled Databricks Test Engineer to join our team at BSRI Solutions.Estimated Salary: 5,000,000 - 18,000,000 INR per annumJob Overview:The Databricks Test Engineer will be responsible for maintaining technology expertise and staying up-to-date with evolving testing tools, techniques, and strategies to improve overall testing...

  • Azure Databricks Engineering Team Lead Opportunity

    2 weeks ago

    Chennai, Tamil Nadu, India Perficient India Full time

    Job SummaryWe are seeking a highly skilled Azure Databricks Engineer to lead our team in Chennai. As a key member of our organization, you will be responsible for driving the development and implementation of data engineering solutions using Azure Databricks.This is a full-time opportunity that requires immediate availability. The ideal candidate will have...

  • Cloud Data Engineering Expert for Databricks and Azure

    2 weeks ago

    Chennai, Tamil Nadu, India Hirist Full time

    Seeking an experienced Cloud Data Engineering Expert to join our team at Hirist. In this role, you will design, develop, and maintain robust data pipelines using Databricks and Azure Data Factory (ADF).The ideal candidate will have extensive expertise in Databricks and ADF, as well as a good understanding of Azure Synapse Analytics, ADLS, Azure SQL Server,...

  • **Cloud Data Engineer

    1 month ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Title: Azure Databricks SQL Snowflake SpecialistJob Summary: We are seeking a highly skilled Azure Databricks SQL Snowflake Specialist to join our team at Risk Resources LLP. The successful candidate will play a key role in designing, developing, and maintaining data solutions using Azure Databricks SQL and Snowflake. Key Responsibilities:Design and...

  • Azure Databricks Solutions Architect

    6 days ago

    Chennai, Tamil Nadu, India Perficient Full time

    Job DescriptionWe are seeking an experienced Azure Databricks Solutions Architect to join our team at Perficient.About the Role:Design and implement large-scale data lakes and warehouses on Azure.Develop and maintain data models, including structured, semi-structured, and unstructured data.Work with cross-functional teams to ensure data governance, security,...

  • Senior Big Data Developer

    1 week ago

    Chennai, Tamil Nadu, India Invent Health Full time

    About Invent HealthInvent Health harnesses the power of data analytics and machine learning to create actionable insights for our clients. Our innovative solutions empower businesses to optimize their outcomes and make a tangible difference in people's lives.Job Overview:We're seeking an experienced Senior Big Data Developer to join our team in Chennai. As a...

  • "Cloud Data Architect", "Data Warehousing Expert", "Azure Databricks Solutions Architect", "Big Data Engineer", "Data Platform Specialist", "Cloud Computing Professional", "Data Science Developer", "Data Solutions Architect", "Cloud Data Solutions Engineer", "Data Engineering Specialist"

    4 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Title: Azure Databricks Solutions ArchitectAbout the Role:Tata Consultancy Services is seeking an experienced Azure Databricks Solutions Architect to join our team. The successful candidate will be responsible for designing and implementing data platform architecture, deployment, and data migration on Microsoft Azure platform.Strong design and...

  • Data Architect

    3 weeks ago

    Chennai, Tamil Nadu, India Nuviso Networks Full time

    Data Engineering at Nuviso NetworksAs a Data Engineer at Nuviso Networks, you will be responsible for designing, developing, and maintaining scalable data pipelines using Azure Databricks. Your primary goal will be to implement ETL processes to ingest and transform data from various sources, ensuring data quality and integrity through rigorous testing and...

  • Cloud Data Architect and Engineer

    1 week ago

    Chennai, Tamil Nadu, India IT Source Global Full time

    We are seeking a highly skilled Cloud Data Architect and Engineer to join our team at IT Source Global. This role is responsible for designing and developing scalable, high-performance data processing and transformation pipelines using Apache Spark within Databricks.About the RoleThis is an exceptional opportunity to lead big data pipeline design and...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Colan Infotech Pvt Ltd Full time

    **Company Overview:**Colan Infotech Pvt Ltd is a leading technology company that specializes in providing innovative solutions to its clients. Our team of experts works collaboratively to deliver high-quality projects that meet the evolving needs of our customers.**Estimated Salary:** ₹1,200,000 - ₹1,800,000 per annum**Job Description:**We are seeking an...

  • Senior Data Pipeline Developer

    2 weeks ago

    Chennai, Tamil Nadu, India U-Set Consultancy Private Limited Full time

    U-Set Consultancy Private Limited is seeking a skilled Senior Data Pipeline Developer to join our team. This role involves designing, executing, and maintaining test cases for ETL pipelines and data transformations. The ideal candidate will have experience working with one or more combinations of ETL tools, cloud platforms, and programming languages.Job...

  • Senior Data Analyst Position

    2 days ago

    Chennai, Tamil Nadu, India Revature Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Revature. This is an exciting opportunity for an individual with expertise in data integration, transformation, and analysis.This role involves designing, developing, and optimizing ETL pipelines using PySpark and Azure Databricks. You will work closely with cross-functional...

  • Senior Data Engineering Specialist

    4 weeks ago

    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time

    We are seeking an experienced Senior Data Engineering Specialist to join our team at Colan Infotech Private Limited. The ideal candidate will have a strong background in data engineering and experience working with cloud-based technologies.The primary responsibility of this role is to design, develop, and maintain scalable data pipelines using Pyspark /...

  • Data Engineering Analyst

    3 weeks ago

    Chennai, Tamil Nadu, India Revature Full time

    About RevatureWe are a technology company that empowers individuals to succeed in the world of tech. Our goal is to provide opportunities for people to learn and grow as developers.Salary Range$120,000 - $180,000 per yearData Engineer RoleWe are looking for a skilled Data Engineer Analyst with expertise in PySpark, Python, Hadoop, and Azure Databricks to...

  • Data Engineer for Scalable Data Pipelines

    2 weeks ago

    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time

    Job DescriptionWe are seeking an experienced Data Engineer to join our team at Colan Infotech Private Limited. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines using Pyspark / Scala Spark, Databricks, Python, and SQL.The ideal candidate will have strong programming skills...

  • Cloud Data Architect for Azure Infrastructure

    2 weeks ago

    Chennai, Tamil Nadu, India Resource Tree Global Services Full time

    Are you looking for a challenging role as a Cloud Data Architect where you can utilize your expertise in Azure infrastructure to create scalable and efficient data platforms? Resource Tree Global Services is seeking an experienced Senior Data Engineer to join our team. The ideal candidate will have extensive knowledge of cloud-based data engineering...

  • Big Data Lead

    3 weeks ago

    Chennai, Tamil Nadu, India Hexaware Technologies Full time

    Job Title: Big Data Lead - Senior Data Engineering ProfessionalAbout Us:Hexaware Technologies is a leading global provider of IT services and consulting. We deliver innovative solutions to our clients across various industries.Job Summary:We are seeking an experienced Big Data Lead to join our team in London. The successful candidate will be responsible for...