Databricks Engineer

2 hours ago

Hyderabad, Telangana, India Patch Infotech Pvt Ltd Full time ₹ 12,00,000 - ₹ 2,50,00,000 per year

Responsibilities

  • Design, develop, and maintain data pipelines and ETL processes using Databricks and PySpark.
  • Work extensively with Apache Hive for data querying, transformations, and integration with big data systems.
  • Write and optimise complex SQL queries for data extraction, transformation, and reporting.
  • Implement data ingestion and transformation workflows across multiple data sources.
  • Collaborate with data analysts, data scientists, and business teams to deliver reliable and scalable data solutions.
  • Develop and optimise data models for analytics, reporting, and machine learning use cases.
  • Ensure data quality, performance, and governance across all data pipelines.
  • Monitor, troubleshoot, and optimise existing data processes for performance and reliability.
  • Work with cloud-based data platforms (Azure / AWS / GCP) and integrate Databricks environments.
  • Document technical designs, data flows, and architecture for ongoing maintenance.

Requirements

  • 5+ years of hands-on experience as a Data Engineer in enterprise-scale data environments.
  • Databricks - Must Have (Expert Level).
  • PySpark - Must Have (Expert Level).
  • SQL (especially for Apache Hive) - Must Have (Expert Level).
  • Apache Hive - Must Have (Basic Knowledge).
  • Hadoop - Good to Have.
  • Data Modelling - Good to Have.
  • Strong understanding of ETL/ELT pipelines, data warehousing, and distributed computing frameworks.
  • Familiarity with version control (Git) and CI/CD for data workflows.
  • Good understanding of cloud data architectures (Azure Data Lake, AWS S3 etc. ).
  • Excellent problem-solving, debugging, and communication skills.
  • Experience with Airflow, Azure Data Factory, or similar orchestration tools.
  • Exposure to machine learning pipelines or real-time data streaming (Kafka, Spark Streaming).
  • Understanding of data governance, lineage, and cataloguing tools.

This job was posted by Ganesh Singh from Patch Infotech.

  • Databricks Engineer

    7 days ago

    Hyderabad, Telangana, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Design, build, and maintain robust ETL/ELT data pipelines using Apache Spark on Databricks. Implement data Lakehouse architecture using Delta Lake for cost-effective data storage and analytics. Use Databricks Workflows for orchestrating batch and streaming pipelines. Develop and maintain CI/CD pipelines for data applications using tools such as Azure DevOps,...

  • Databricks Engineer

    2 weeks ago

    Hyderabad, Telangana, India ValueMomentum Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionValueMomentum is a leading solutions provider for the global property and casualty insurance industry, backed by deep domain and technology capabilities. Our mission is to help insurers achieve sustained growth and high performance by enhancing stakeholder value and building resilient societies. Trusted by over 100 insurers globally, we...

  • AWS-Databricks Engineer

    2 weeks ago

    Hyderabad, Telangana, India Coforge Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    We are seeking an experiencedAWS Databricks Developerto design, develop, and maintain scalable data processing and analytics solutions on theAWS and Databricksplatform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.Key...

  • Databricks Data Engineer

    10 hours ago

    Hyderabad, Telangana, India 0a25a867-bc4f-4695-874f-220f58eab329 Full time ₹ 8,00,00,000 - ₹ 16,14,56,748 per year

    Company DescriptionzRanga is a specialized staffing and talent solutions provider helping enterprises scale quickly with high-quality technology and business professionals. With a team backed by 50+ years of combined industry experience, we connect companies with top-tier talent across CRM, data, cloud, software development, product management, and digital...

  • Senior Databricks Engineer

    1 week ago

    Hyderabad, Telangana, India SID Information Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Senior Data Engineer (Python, Spark/Databricks, SQL, AWS)Experience:6–12 yearsLocation:HyderabadWork Mode:Hybrid (3 days/week in-office)Join Time:ImmediateMust-Have Technical Skills:Strong programming skills in Python, DatabricksHands-on experience with Apache Spark & Databricks for big data processing on AWS cloudProficiency with AWS services ...

  • Databricks+spark

    1 week ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. Experience in Sales & Marketing domains is a plus. The role involves developing and optimizing data solutions to...

  • DataBricks - Data Engineering

    5 days ago

    Hyderabad, Telangana, India Wipro Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest...

  • Databricks + Pyspark

    1 week ago

    Hyderabad, Telangana, India Cognizant Full time ₹ 1,00,00,000 - ₹ 3,00,00,000 per year

    Skills- Databricks+ PysparkExperience: 4 to 13 yearsLocation: AIA-PuneWe are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.Key Responsibilities:Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on...

  • Databricks Engineer

    2 weeks ago

    Hyderabad, Telangana, India Anblicks Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role & responsibilities5+ years of experience in data engineering roles.• Proficiency in programming languages such as Scala or Python, or Java.• Expertise in distributed data processing frameworks like Apache Spark or Flink.• Strong knowledge of cloud platforms (e.g., AWS) and cloud-native data platforms like Databricks or Redshift.• Solid...

  • Senior Azure Databricks Engineer

    1 week ago

    Hyderabad, Telangana, India Innova AM Tech Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    About the Role We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team. As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform. You will be responsible for building and maintaining...