Senior Azure Databricks Engineer

3 days ago

Hyderabad, Telangana, India Innova AM Tech Full time ₹ 12,00,000 - ₹ 24,00,000 per year

About the Role

  • We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team.

  • As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform.

  • You will be responsible for building and maintaining high-performance data pipelines, transforming raw data into valuable insights, and ensuring data quality and reliability.

Key Responsibilities

  • Design, develop, and implement data pipelines and ETL/ELT processes using Azure Databricks.

  • Develop and optimize Spark applications using Scala or Python for data ingestion, transformation, and analysis.

  • Leverage Delta Lake for data versioning, ACID transactions, and data sharing.

  • Utilize Delta Live Tables for building robust and reliable data pipelines.

  • Design and implement data models for data warehousing and data lakes.

  • Optimize data structures and schemas for performance and query efficiency.

  • Ensure data quality and integrity throughout the data lifecycle.

  • Integrate Azure Databricks with other Azure services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure Blob Storage).

  • Leverage cloud-based data services to enhance data processing and analysis capabilities.

Performance Optimization & Troubleshooting

  • Monitor and analyze data pipeline performance.

  • Identify and troubleshoot performance bottlenecks.

  • Optimize data processing jobs for speed and efficiency.

  • Collaborate effectively with data engineers, data scientists, data analysts, and other stakeholders.

  • Communicate technical information clearly and concisely.

  • Participate in code reviews and contribute to the improvement of development processes.

Qualifications

Essential

  • 5+ years of experience in data engineering, with at least 2 years of hands-on experience with Azure Databricks.

  • Strong proficiency in Python and SQL.

  • Expertise in Apache Spark and its core concepts (RDDs, DataFrames, Datasets).

  • In-depth knowledge of Delta Lake and its features (e.g., ACID transactions, time travel).

  • Experience with data warehousing concepts and ETL/ELT processes.

  • Strong analytical and problem-solving skills.

  • Excellent communication and interpersonal skills.

  • Bachelor's degree in Computer Science, Computer Engineering, or a related field.

  • Azure Databricks Engineer

    1 week ago

    Hyderabad, Telangana, India Tekskills Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Role: Azure Databricks EngineerJob Location: Pune, MH / Chennai, TN / Hyderabad. TG / Indore, MP / Kolkata, WB / Bangalore, TNWork Mode: (WFO)Skills Required: Digital: DatabricksExperience: 6-8 Years(5+ yrs)Job Description:Should build Databricks Notebook developed in spark sql/pysparkShould be able to create unity catalog tablesShould have good hands on...

  • Azure Databricks/Senior Business Analyst

    4 days ago

    Hyderabad, Telangana, India HSBC Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job descriptionSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest...

  • Wissen - Senior Azure Data Engineer - ETL/Databricks

    1 week ago

    Hyderabad, Telangana, India hirist Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Note : If shortlisted, you will be invited for initial rounds on 8th November'25 (Saturday) in Hyderabad Description : - Senior Azure Data engineer - Databricks, Azure, SQL, Python, PySpark. - Operations and Application Support background Key Responsibilities : - Designing and Implementing Data Solutions: Architecting and building...

  • Azure Databricks Data Engineer

    1 week ago

    Hyderabad, Telangana, India Innova ESI Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role: Azure Databricks Data EngineerExperience: 5+ YearsLocation: Hyderabad | BangaloreNotice Period: Immediate Joiners OnlyJob Description:Minimum of 4 yrs of experience on Azure cloud environment.Experience on ADLS, Azure Databricks, Azure SQL DB, Cosmos DB, Azure Data Factory and Datawarehouse.Strong working experience in Implementation of Azure cloud...

  • Azure Databricks Professional

    3 days ago

    Hyderabad, Telangana, India Apex One Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Power Bi and AAS expert (Strong SC or Specialist Senior) Should have hands-on experience of Data Modelling in Azure SQL Data Warehouse and Azure Analysis ServiceShould be able to write and test Dex queries.Should be able generate Paginated Reports in Power BIShould have minimum 3 Years working experience in delivering projects in Power BiMust Have:-3 to 8...

  • Databricks Engineer

    2 weeks ago

    Hyderabad, Telangana, India Oblytech Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Databricks Engineer (PySpark Developer)Employment Type:Full-Time | Permanent | Remote (Work From Home)Industry:IT Services & Consulting | Software Development | Data Engineering | Cloud ServicesFunctional Area:Data Engineering | Big Data | Cloud Platforms | AnalyticsAbout Oblytech:Oblytech is a fast-growing IT consulting and software services firm,...

  • Azure Databricks Engineer

    1 week ago

    Hyderabad, Telangana, India Tech Mahindra Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Summary• 6+ yrs. of total exp. and 5+ yrs. in Azure Databricks technologies. • Good understanding of ETL , BI and DW technologies. • Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure. • Work together with data scientists and analysts to understand the needs for data and create effective...

  • Senior Azure Data Engineer

    2 days ago

    Hyderabad, Telangana, India Ensar Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a highly skilled Senior Azure Data Engineer with strong experience in integrating SAP systems with Azure cloud data platforms. The ideal candidate should be proficient in Azure Data Factory (ADF), Azure Databricks, and Azure Logic Apps, and have a deep understanding of building and maintaining robust, scalable, and secure data...

  • Databricks Engineer

    24 hours ago

    Hyderabad, Telangana, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Design, build, and maintain robust ETL/ELT data pipelines using Apache Spark on Databricks. Implement data Lakehouse architecture using Delta Lake for cost-effective data storage and analytics. Use Databricks Workflows for orchestrating batch and streaming pipelines. Develop and maintain CI/CD pipelines for data applications using tools such as Azure DevOps,...

  • Senior Engineer – EIM – Azure/Databricks

    1 week ago

    Hyderabad, Telangana, India The TJX Companies, Inc. Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    TJX CompaniesAt TJX Companies, every day brings new opportunities for growth, exploration, and achievement. You'll be part of our vibrant team that embraces diversity, fosters collaboration, and prioritizes your development. Whether you're working in our four global Home Offices, Distribution Centers or Retail Stores—TJ Maxx, Marshalls, Homegoods,...