Current jobs related to Senior Azure Databricks Engineer - Hyderabad, Telangana - Innova ESI
-
Azure Databricks Engineer
4 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timePosition:Azure Databricks EngineerExperience: 6-8 yearsLocation: New Delhi, HyderabadJob Description:Required Technical Skill Set** Azure DatabricksDesired Competencies (Technical/Behavioral Competency)Must-Have**• Qualifications:· 2-5 years of relevant IT experience with good exposure to Cloud technologies.· Experience using Databricks and proficiency...
-
Hyderabad, Telangana, India MSR IT Services Full timeAbout the Role : We are seeking a highly experienced Senior Data Engineer with over 10 years of expertise in the big data domain. The ideal candidate will have strong proficiency in Azure Databricks, Spark Streaming, Python, PySpark, and SQL, along with a proven track record in designing and implementing robust data pipelines and data lake solutions. Key...
-
Azure Databricks/PySpark Engineer
3 weeks ago
Hyderabad, Telangana, India IT & Services Full timeJob Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...
-
Azure Databricks/PySpark Engineer
2 weeks ago
Hyderabad, Telangana, India IT & Services Full timeJob Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...
-
Azure Databricks Engineer
3 weeks ago
Hyderabad, Telangana, India Leuwint Technologies Full timeJob Description :- Minimum 4 years of experience in relevant field.- Hands on experience in Databricks, SQL, Azure Data Factory, Azure DevOps- Strong expertise in Microsoft Azure cloud platform services (Azure Data Factory, Azure Data Bricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse Analytics).- Proficient in CI-CD pipelines in Azure DevOps...
-
Azure Databricks Engineer
2 weeks ago
Hyderabad, Telangana, India Leuwint Technologies Full timeJob Description :- Minimum 4 years of experience in relevant field.- Hands on experience in Databricks, SQL, Azure Data Factory, Azure DevOps- Strong expertise in Microsoft Azure cloud platform services (Azure Data Factory, Azure Data Bricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse Analytics).- Proficient in CI-CD pipelines in Azure DevOps...
-
Hyderabad, Telangana, India MSR IT Services Full timeAbout the Role :We are seeking a highly experienced Senior Data Engineer with over 10 years of expertise in the big data domain. The ideal candidate will have strong proficiency in Azure Databricks, Spark Streaming, Python, PySpark, and SQL, along with a proven track record in designing and implementing robust data pipelines and data lake solutions.Key...
-
Hyderabad, Telangana, India MSR IT Services Full timeAbout the Role :We are seeking a highly experienced Senior Data Engineer with over 10 years of expertise in the big data domain. The ideal candidate will have strong proficiency in Azure Databricks, Spark Streaming, Python, PySpark, and SQL, along with a proven track record in designing and implementing robust data pipelines and data lake solutions.Key...
-
Azure Databricks
5 hours ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeAzure Databricks (scala/pyspark)Azure Databricks (scala/pyspark)Location:Hyderabad, Kolkata, Delhi, ChennaiExperience: 4 years to 12 yearsInterview Mode: Online DriveInterview Date: 13th March 2025 (Thursday)Interview Time: 10: 00 AM to 5: 00 PMMust Have:4 or more years of experience working onAzure Databricks using Scala, PySpark4 or more years of...
-
Cloud Data Engineer for Azure Databricks
6 days ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeCompany Overview: Tata Consultancy Services is a global leader in IT services and consulting. Our team of experts provides innovative solutions to clients across various industries.As an Azure Databricks Engineer, you will play a crucial role in designing, developing, and maintaining large-scale data pipelines using Azure Databricks and Spark. Your expertise...
-
Digital : Microsoft Azure / Databricks
2 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeRole: Databricks DeveloperKey Skills: Pyspark, Azure databricks, Azure datafactory, Azure Datalake, Azure synapse.Must-Have:1. Azure Databricks – E22. Pyspark – E23. Python – E24. SQL - E25. Effective Communication – L2Responsibility of / Expectations from the Role:- Designing and implementing efficient data ingestion pipelines from multiple sources...
-
Digital : Microsoft Azure / Databricks
3 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeRole: Databricks Developer Key Skills: Pyspark, Azure databricks, Azure datafactory, Azure Datalake, Azure synapse.Must-Have:Azure Databricks – E2 Pyspark – E2 Python – E2 SQL - E2 Effective Communication – L2 Responsibility of / Expectations from the Role:Designing and implementing efficient data ingestion pipelines from multiple sources...
-
Azure Databricks Developer
3 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeDear Candidate,Greetings from TATA CONSULTANCY SERVICES LIMITEDTCS is Hiring for Data Engineer Please find the required details below.Role: Azure Data EngineerExperience Range: 5 to 8 yearsLocation: Pan IndiaExperience as a data engineer or as a ETL developerExcellent Technical expertise with data modeling, data mining, and database designExcellent skills in...
-
Azure Databricks Data Engineer
3 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeDo you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor Reviews If you are...
-
Senior Big Data Architect
2 days ago
Hyderabad, Telangana, India MSR IT Services Full time**Role Overview:**We are seeking a seasoned Senior Data Engineer with over 10 years of expertise in big data domain to lead our data engineering efforts.The successful candidate will have a deep understanding of Azure Databricks, Spark Streaming, Python, PySpark, and SQL, and be able to design and implement robust data pipelines and data lake solutions.Key...
-
Databricks
1 week ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeTCS HIRING Skill - Databricks Experience : 4+ Years Location : PAN INDIA Job Description: Experience with Azure cloud data engineering tools (Azure Data Factory, Data Lake storage, data bricks, Data Explorer, Azure Synapse, Azure Blob Storage, ADLS and SQL database.). Build and maintain the technology platform for both on premise and cloud-based solutions....
-
Azure Databricks Developer
6 days ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeDear Candidate, Greetings from TATA CONSULTANCY SERVICES LIMITED TCS is Hiring for Data Engineer Please find the required details below. Role: Azure Data Engineer Experience Range: 5 to 8 years Location: Pan India Experience as a data engineer or as a ETL developer Excellent Technical expertise with data modeling, data mining, and database design ...
-
Databricks
3 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeTCS HIRINGSkill - DatabricksExperience : 4+ YearsLocation : PAN INDIAJob Description:Experience with Azure cloud data engineering tools (Azure Data Factory, Data Lake storage, data bricks, Data Explorer, Azure Synapse, Azure Blob Storage, ADLS and SQL database.).Build and maintain the technology platform for both on premise and cloud-based...
-
Databricks
3 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeTCS HIRINGSkill- DatabricksExperience: 4+ YearsLocation: PAN INDIAJob Description:Experience with Azure cloud data engineering tools (Azure Data Factory, Data Lake storage, data bricks, Data Explorer, Azure Synapse, Azure Blob Storage, ADLS and SQL database.).Build and maintain the technology platform for both on premise and cloud-based solutions.Responsible...
-
Azure Databricks Data Engineer
3 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeJob Description Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor...
Senior Azure Databricks Engineer
4 weeks ago
About the Role :
- We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team.
- As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform.
- You will be responsible for building and maintaining high-performance data pipelines, transforming raw data into valuable insights, and ensuring data quality and reliability.
Key Responsibilities :
- Design, develop, and implement data pipelines and ETL/ELT processes using Azure Databricks.
- Develop and optimize Spark applications using Scala or Python for data ingestion, transformation, and analysis.
- Leverage Delta Lake for data versioning, ACID transactions, and data sharing.
- Utilize Delta Live Tables for building robust and reliable data pipelines.
- Design and implement data models for data warehousing and data lakes.
- Optimize data structures and schemas for performance and query efficiency.
- Ensure data quality and integrity throughout the data lifecycle.
- Integrate Azure Databricks with other Azure services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure Blob Storage).
- Leverage cloud-based data services to enhance data processing and analysis capabilities.
Performance Optimization & Troubleshooting :
- Monitor and analyze data pipeline performance.
- Identify and troubleshoot performance bottlenecks.
- Optimize data processing jobs for speed and efficiency.
- Collaborate effectively with data engineers, data scientists, data analysts, and other stakeholders.
- Communicate technical information clearly and concisely.
- Participate in code reviews and contribute to the improvement of development processes.
Qualifications :
Essential :
- 5+ years of experience in data engineering, with at least 2 years of hands-on experience with Azure Databricks.
- Strong proficiency in Python and SQL.
- Expertise in Apache Spark and its core concepts (RDDs, DataFrames, Datasets).
- In-depth knowledge of Delta Lake and its features (e.g., ACID transactions, time travel).
- Experience with data warehousing concepts and ETL/ELT processes.
- Strong analytical and problem-solving skills.
- Excellent communication and interpersonal skills.
- Bachelor's degree in Computer Science, Computer Engineering, or a related field.
