Senior Data Engineer – Databricks

2 days ago

Hyderabad, Telangana, India S2Integrators Full time

Job Title:
Senior Data Engineer – Databricks

Experience:
6–10 Years

Work Mode:
Hybrid

Shift Timing:
4:00 PM – 1:00 AM IST

Role Overview
We are looking for an experienced
Senior Data Engineer
with strong hands-on exposure to
Databricks
to design, build, and optimize scalable data pipelines and analytics platforms. The role involves working closely with cross-functional teams to support data-driven decision making in a hybrid work environment.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using Databricks.
  • Build and optimize ETL/ELT workflows for structured and unstructured data.
  • Develop data transformations using PySpark / Spark SQL.
  • Ensure data quality, reliability, and performance across pipelines.
  • Work with large-scale datasets and implement best practices for data modeling.
  • Collaborate with data scientists, analysts, and stakeholders.
  • Monitor and troubleshoot data workflows and production issues.
  • Participate in code reviews, performance tuning, and optimization.
  • Support deployments and maintenance during the evening shift (4 PM – 1 AM).

Mandatory Skills

  • Strong hands-on experience with Databricks.
  • Expertise in Apache Spark (PySpark / Spark SQL).
  • Solid experience in building data pipelines and data lakes.
  • Strong SQL skills and experience with data modeling.
  • Experience with cloud platforms (AWS / Azure / GCP).
  • Knowledge of workflow orchestration tools (Airflow, ADF, etc.).
  • Strong debugging and performance tuning skills.

Good to Have

  • Experience with Delta Lake and Databricks optimization techniques.
  • Exposure to real-time or streaming data processing.
  • Experience working with large-scale enterprise data platforms.
  • Knowledge of CI/CD for data pipelines.
  • Understanding of data governance and security best practices.

Soft Skills

  • Strong problem-solving and analytical skills.
  • Good communication and stakeholder management.
  • Ability to work independently in a fast-paced environment.
  • Mentoring junior engineers.

Education

  • BE / BTech / MCA / MSc in Computer Science, Data Engineering, or related field.

  • Databricks Engineer

    5 days ago

    Hyderabad, Telangana, India NTT DATA Full time

    Design, build, and maintain robust ETL/ELT data pipelines using Apache Spark on Databricks. Implement data Lakehouse architecture using Delta Lake for cost-effective data storage and analytics. Use Databricks Workflows for orchestrating batch and streaming pipelines. Develop and maintain CI/CD pipelines for data applications using tools such as Azure DevOps,...

  • Senior Databricks Engineer

    1 week ago

    Hyderabad, Telangana, India SID Information Technologies Full time

    Role: Senior Data Engineer (Python, Spark/Databricks, SQL, AWS)Experience:6–12 yearsLocation:HyderabadWork Mode:Hybrid (3 days/week in-office)Join Time:ImmediateMust-Have Technical Skills:Strong programming skills in Python, DatabricksHands-on experience with Apache Spark & Databricks for big data processing on AWS cloudProficiency with AWS services ...

  • Senior Azure Databricks Engineer

    7 days ago

    Hyderabad, Telangana, India Innova AM Tech Full time

    About the Role We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team. As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform. You will be responsible for building and maintaining...

  • Data Engineer with Databricks

    2 days ago

    Hyderabad, Telangana, India ZScale LLC Full time

    Share your resume:Title:Data Engineer with DatabricksOverall Experience:5 – 7 yearsDatabricks Experience:2+ yearsNotice Period:Immediate to 30 DaysLocation:Hyderabad, Telangana, IndiaPAN CARD:MandatoryCore skills:* Azure Cloud, Databricks workflows, DLT, Notebooks, Python, SQL, PySpark, ADLS Gen2, ADF, GitHub, PL/SQL, ORACLE, ETL experience, Understanding...

  • Data Engineer – Azure Databricks

    2 days ago

    Hyderabad, Telangana, India Ratna Global Technologies Private Limited Full time

    Data Engineer – Azure DatabricksExperience: 5–10 YearsRole OverviewWe are seeking an experienced Data Engineer specialized in Azure Databricks to design, build, and maintain scalable data pipelines and analytics platforms on Microsoft Azure. The role focuses on building production-grade data pipelines with strong emphasis on performance, data quality,...

  • Senior Databricks Engineer

    7 days ago

    Hyderabad, Telangana, India Xenon7 Full time

    About us:Where elite tech talent meets world-class opportunitiesAt Xenon7, we work with leading enterprises and innovative startups on exciting, cutting-edge projects that leverage the latest technologies across various domains of IT including Data, Web, Infrastructure, AI, and many others. Our expertise in IT solutions development and on-demand resources...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Valzo Soft Solutions Full time

    Job Description– Senior Data EngineerExperience:5–7 YearsLocation:Hyderabad, Telangana, IndiaEmployment Type:Full-TimeJoining:Immediate HiringPosition OverviewWe are hiring a Senior Data Engineer to lead the development and optimization of scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and PySpark. The role involves managing Data Lake...

  • Sr. Data Engineer – AWS Databricks

    2 weeks ago

    Hyderabad, Telangana, India Gravity Infosolutions, Inc. Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Sr. Data Engineer – AWS Databricks / Data Tech LeadType: ContractLocation : Chennai / HydExperience: 5+ yearsDuration: 3 Months+ ExtendableKey ResponsibilitiesData Pipeline Development: Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently.Manage job orchestration,...

  • Databricks Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India, Telangana zRanga LLC Full time

    Company DescriptionzRanga is a specialized staffing and talent solutions provider helping enterprises scale quickly with high-quality technology and business professionals. With a team backed by 50+ years of combined industry experience, we connect companies with top-tier talent across CRM, data, cloud, software development, product management, and digital...

  • AVP - Databricks Architect

    1 week ago

    Hyderabad, Telangana, India Impetus Career Consultants Full time

    Job Title:AVP – Databricks ArchitectLocation:HyderabadExperience:14+ YearsAbout the RoleWe are seeking a senior Databricks Architect to lead the design and delivery of next-generation data platforms. This role requires deep technical authority in Databricks, Unity Catalog, and modern data engineering patterns, with the ability to define enterprise-scale...