DE&A - Core - Data Engineer – Databricks

1 week ago


India Zensar Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year
Description

Job Title: Offshore Data Engineer – Databricks

Experience: 6+ Years

Location: India 

Employment Type: Full-Time 

About the Role:

We are seeking an experienced Data Engineer (Databricks) to join our offshore data engineering team. The ideal candidate will have strong expertise in Azure Databricks, data lake architecture, and ETL/ELT pipeline development. This role involves building, optimizing, and maintaining large-scale data pipelines, collaborating with onshore teams, and ensuring seamless data integration and availability across platforms.

Key Responsibilities:

Design, develop, and optimize data ingestion, transformation, and loading (ETL/ELT) pipelines using Azure Databricks and PySpark.

Implement data engineering solutions that support analytics, BI, and data science use cases.

Integrate data from various sources such as SAP, APIs, Azure Data Lake, SQL databases, and streaming platforms (Kafka, Event Hubs).

Work closely with onshore architecture, analytics, and business teams to translate requirements into scalable data models.

Optimize Databricks clusters, Spark jobs, and Delta Lake performance.

Develop reusable components, frameworks, and standard practices for data pipelines and workflows.

Ensure data governance, security, and compliance best practices are followed.

Participate in code reviews, testing, and deployment automation using CI/CD tools.

Troubleshoot data issues and ensure data quality and integrity.

Required Skills & Experience:

6+ years of hands-on experience in data engineering.

Strong working experience with Azure Databricks, PySpark, and Spark SQL.

Experience with Azure Data Factory (ADF), Azure Synapse, or Azure Data Lake Storage (ADLS).

Solid understanding of Delta Lake, Lakehouse architecture, and data partitioning strategies.

Proficiency in SQL and experience working with relational and non-relational databases.

Hands-on experience in CI/CD pipelines, Git, DevOps, and data versioning.

Experience with data modeling, schema design, and performance tuning.

Familiarity with ETL frameworks, data governance, and monitoring tools.

Excellent communication and collaboration skills to work effectively with distributed teams.

Preferred / Nice-to-Have Skills:

Knowledge of Airflow or Databricks Workflows for orchestration.

Exposure to streaming data (Kafka, Spark Streaming).

Experience with Python libraries for data processing and automation.

Familiarity with Power BI or other visualization tools for data validation and reporting.

Education:

Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

Relevant certifications (e.g., Azure Data Engineer Associate, Databricks Certified Data Engineer) are a plus.



  • India Zensar Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Title: Offshore Data Engineer – DatabricksExperience: 6+ YearsLocation: IndiaEmployment Type: Full-TimeAbout the Role:We are seeking an experienced Data Engineer (Databricks) to join our offshore data engineering team. The ideal candidate will have strong expertise in Azure Databricks , data lake architecture , and ETL/ELT pipeline development . This...

  • Sr. Big Data Engineer

    2 weeks ago


    Remote - India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    CSQ326R34As a Sr. Big Data Engineer in our Professional Services team, you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks Platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and other technical...


  • Hyderabad, India Tiger Analytics Full time

    Job Description Role Overview: SDE/DE We are seeking technically strong Senior Data Engineers / Leads who can take ownership of designing and developing cutting-edge data and AI platforms using big data and cloud technologies on Microsoft Azure. You will play a critical role in building scalable data pipelines, modern data architectures, and intelligent...


  • Bengaluru, India Databricks Full time

    Job Description P- 1430 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data...


  • India Crisil Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job SummaryCrisil Risk Technology group is seeking a strong Python/Pyspark Developer. He/she will be responsible for designing, developing and maintaining scalable data pipeline and ETL process using Azure cloud platform and Azure Databricks.SCOPEA key focus of this role is to build and manage advanced data pipelines, perform large-scale data processing, and...

  • Databricks Engineer

    6 days ago


    India Cozzera Full time

    Databricks Engineer Experience: 7–12 years Location-Remote Overview We are looking for an experienced Databricks Engineer with deep expertise in designing, building, and optimizing modern data platforms on Azure and Databricks . The ideal candidate will serve as the go-to expert for Databricks platform architecture, Unity Catalog, and emerging Databricks...


  • India Hello World Tech Consulting Full time

    Job SummaryWe are seeking a highly skilled Data Engineer with Databricks certifications andextensive practical experience working with the Databricks Lakehouse platform and itssupporting capabilities. The ideal candidate will possess a robust understanding of AWSservices relevant to data engineering and demonstrate proficiency in data pipelinedevelopment,...


  • India Hello World Tech Consulting Full time

    Job Summary We are seeking a highly skilled Data Engineer with Databricks certifications and extensive practical experience working with the Databricks Lakehouse platform and its supporting capabilities. The ideal candidate will possess a robust understanding of AWS services relevant to data engineering and demonstrate proficiency in data pipeline...


  • India Hello World Tech Consulting Full time

    Job Summary We are seeking a highly skilled Data Engineer with Databricks certifications and extensive practical experience working with the Databricks Lakehouse platform and its supporting capabilities. The ideal candidate will possess a robust understanding of AWS services relevant to data engineering and demonstrate proficiency in data pipeline...

  • Databricks Engineer

    22 hours ago


    India TTC Group Full time

    Role: Databricks EngineerPosition: RemoteType: ContractDuration: 3 - 6 months (extendable) Role OverviewWe are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform. The ideal candidate will be comfortable working with distributed data processing,...