Senior Azure Databricks Engineer

2 weeks ago

Hyderabad, Telangana, India Innova ESI Full time

About the Role :

- We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team.

- As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform.

- You will be responsible for building and maintaining high-performance data pipelines, transforming raw data into valuable insights, and ensuring data quality and reliability.

Key Responsibilities :

- Design, develop, and implement data pipelines and ETL/ELT processes using Azure Databricks.

- Develop and optimize Spark applications using Scala or Python for data ingestion, transformation, and analysis.

- Leverage Delta Lake for data versioning, ACID transactions, and data sharing.

- Utilize Delta Live Tables for building robust and reliable data pipelines.

- Design and implement data models for data warehousing and data lakes.

- Optimize data structures and schemas for performance and query efficiency.

- Ensure data quality and integrity throughout the data lifecycle.

- Integrate Azure Databricks with other Azure services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure Blob Storage).

- Leverage cloud-based data services to enhance data processing and analysis capabilities.

Performance Optimization & Troubleshooting :

- Monitor and analyze data pipeline performance.

- Identify and troubleshoot performance bottlenecks.

- Optimize data processing jobs for speed and efficiency.

- Collaborate effectively with data engineers, data scientists, data analysts, and other stakeholders.

- Communicate technical information clearly and concisely.

- Participate in code reviews and contribute to the improvement of development processes.

Qualifications :

Essential :

- 5+ years of experience in data engineering, with at least 2 years of hands-on experience with Azure Databricks.

- Strong proficiency in Python and SQL.

- Expertise in Apache Spark and its core concepts (RDDs, DataFrames, Datasets).

- In-depth knowledge of Delta Lake and its features (e.g., ACID transactions, time travel).

- Experience with data warehousing concepts and ETL/ELT processes.

- Strong analytical and problem-solving skills.

- Excellent communication and interpersonal skills.

- Bachelor's degree in Computer Science, Computer Engineering, or a related field.

(ref:hirist.tech)

  • Azure Databricks Engineer

    3 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Position:Azure Databricks EngineerExperience: 6-8 yearsLocation: New Delhi, HyderabadJob Description:Required Technical Skill Set** Azure DatabricksDesired Competencies (Technical/Behavioral Competency)Must-Have**• Qualifications:· 2-5 years of relevant IT experience with good exposure to Cloud technologies.· Experience using Databricks and proficiency...

  • Azure Databricks/PySpark Engineer

    2 weeks ago

    Hyderabad, Telangana, India IT & Services Full time

    Job Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...

  • Azure Databricks/PySpark Engineer

    2 weeks ago

    Hyderabad, Telangana, India IT & Services Full time

    Job Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...

  • MSRcosmos - Senior Data Engineer - Azure Databricks

    2 weeks ago

    Hyderabad, Telangana, India MSR IT Services Full time

    About the Role :We are seeking a highly experienced Senior Data Engineer with over 10 years of expertise in the big data domain. The ideal candidate will have strong proficiency in Azure Databricks, Spark Streaming, Python, PySpark, and SQL, along with a proven track record in designing and implementing robust data pipelines and data lake solutions.Key...

  • MSRcosmos - Senior Data Engineer - Azure Databricks

    1 week ago

    Hyderabad, Telangana, India MSR IT Services Full time

    About the Role :We are seeking a highly experienced Senior Data Engineer with over 10 years of expertise in the big data domain. The ideal candidate will have strong proficiency in Azure Databricks, Spark Streaming, Python, PySpark, and SQL, along with a proven track record in designing and implementing robust data pipelines and data lake solutions.Key...

  • Azure Databricks Engineer

    2 weeks ago

    Hyderabad, Telangana, India Leuwint Technologies Full time

    Job Description :- Minimum 4 years of experience in relevant field.- Hands on experience in Databricks, SQL, Azure Data Factory, Azure DevOps- Strong expertise in Microsoft Azure cloud platform services (Azure Data Factory, Azure Data Bricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse Analytics).- Proficient in CI-CD pipelines in Azure DevOps...

  • Azure Databricks Engineer

    2 weeks ago

    Hyderabad, Telangana, India Leuwint Technologies Full time

    Job Description :- Minimum 4 years of experience in relevant field.- Hands on experience in Databricks, SQL, Azure Data Factory, Azure DevOps- Strong expertise in Microsoft Azure cloud platform services (Azure Data Factory, Azure Data Bricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse Analytics).- Proficient in CI-CD pipelines in Azure DevOps...

  • Cloud Data Engineer for Azure Databricks

    2 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Company Overview: Tata Consultancy Services is a global leader in IT services and consulting. Our team of experts provides innovative solutions to clients across various industries.As an Azure Databricks Engineer, you will play a crucial role in designing, developing, and maintaining large-scale data pipelines using Azure Databricks and Spark. Your expertise...

  • Digital : Microsoft Azure / Databricks

    2 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Role: Databricks DeveloperKey Skills: Pyspark, Azure databricks, Azure datafactory, Azure Datalake, Azure synapse.Must-Have:1. Azure Databricks – E22. Pyspark – E23. Python – E24. SQL - E25. Effective Communication – L2Responsibility of / Expectations from the Role:- Designing and implementing efficient data ingestion pipelines from multiple sources...

  • Digital : Microsoft Azure / Databricks

    3 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Role: Databricks Developer Key Skills: Pyspark, Azure databricks, Azure datafactory, Azure Datalake, Azure synapse.Must-Have:Azure Databricks – E2 Pyspark – E2 Python – E2 SQL - E2 Effective Communication – L2 Responsibility of / Expectations from the Role:Designing and implementing efficient data ingestion pipelines from multiple sources...

  • Azure Databricks Developer

    3 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Dear Candidate,Greetings from TATA CONSULTANCY SERVICES LIMITEDTCS is Hiring for Data Engineer Please find the required details below.Role: Azure Data EngineerExperience Range: 5 to 8 yearsLocation: Pan IndiaExperience as a data engineer or as a ETL developerExcellent Technical expertise with data modeling, data mining, and database designExcellent skills in...

  • Azure Databricks Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor Reviews If you are...

  • Databricks

    4 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    TCS HIRING Skill - Databricks Experience : 4+ Years Location : PAN INDIA Job Description: Experience with Azure cloud data engineering tools (Azure Data Factory, Data Lake storage, data bricks, Data Explorer, Azure Synapse, Azure Blob Storage, ADLS and SQL database.). Build and maintain the technology platform for both on premise and cloud-based solutions....

  • Azure Databricks Developer

    2 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Dear Candidate, Greetings from TATA CONSULTANCY SERVICES LIMITED TCS is Hiring for Data Engineer Please find the required details below. Role: Azure Data Engineer Experience Range: 5 to 8 years Location: Pan India Experience as a data engineer or as a ETL developer Excellent Technical expertise with data modeling, data mining, and database design ...

  • Databricks

    3 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    TCS HIRINGSkill - DatabricksExperience : 4+ YearsLocation : PAN INDIAJob Description:Experience with Azure cloud data engineering tools (Azure Data Factory, Data Lake storage, data bricks, Data Explorer, Azure Synapse, Azure Blob Storage, ADLS and SQL database.).Build and maintain the technology platform for both on premise and cloud-based...

  • Databricks

    3 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    TCS HIRINGSkill- DatabricksExperience: 4+ YearsLocation: PAN INDIAJob Description:Experience with Azure cloud data engineering tools (Azure Data Factory, Data Lake storage, data bricks, Data Explorer, Azure Synapse, Azure Blob Storage, ADLS and SQL database.).Build and maintain the technology platform for both on premise and cloud-based solutions.Responsible...

  • Azure Databricks Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Description Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor...

  • Digital: Databricks

    3 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Experience: 5-9yearsLocation: Hyderabad, Delhi Required Technical Skill Set: Azure Data Factory, Pyspark, Scala, Azure Data Engineer+Azure Python Pyspark5+ years experienced senior data engineer with sound ADF, Databricks and Pyspark knowledge and able to interact independently with customer technical team/leadsResponsibilities:Assure that data is cleansed,...

  • Digital: Databricks

    3 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Experience: 5-9yearsLocation: Hyderabad, Delhi Required Technical Skill Set: Azure Data Factory, Pyspark, Scala, Azure Data Engineer+Azure Python Pyspark5+ years experienced senior data engineer with sound ADF, Databricks and Pyspark knowledge and able to interact independently with customer technical team/leadsResponsibilities:Assure that data is cleansed,...

  • Senior Databricks Engineer

    4 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Company OverviewTata Consultancy Services (TCS) is a leading global technology services company that empowers its clients to succeed in an increasingly complex and interdependent world. Job Description:We are seeking a highly skilled Senior Databricks Engineer to join our team in building and maintaining a cutting-edge cloud data...