Sr Data Engineer, Azure Databricks, Python, PySpark
3 days ago
Job Description Job Responsibilities: - Design, develop, and implement robust and scalable data pipelines using Azure Data Factory (ADF). - Efficiently extract, transform, and load (ETL) data from various disparate sources into Azure Data Lake Storage (ADLS). - Utilize Azure Databricks for advanced data processing, transformation, and analytics. - Develop complex data solutions and scripts primarily using Python and PySpark. - Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver high-quality data solutions. - Monitor, optimize, and troubleshoot data pipelines to ensure performance, reliability, and data integrity. - Implement best practices for data governance, security, and quality within the Azure ecosystem. Required Skills: - Proficiency in designing, developing, and implementing data pipelines using Azure Data Factory. - Strong experience in extracting, transforming, and loading data from various sources into Azure Data Lake Storage (ADLS). Good to have skills : - Hands-on experience with Azure Databricks. - Strong programming skills in Python. - Expertise in PySpark for big data processing.
-
Hyderabad, India Fusion Plus Solutions Full timeJob Description Skill Set:Azure Data Factory, Azure Databricks, Python/Pyspark - Joining time ( Notice period) Immediate joiners only - AnAzure Data Factory, Azure Databricks, Python/PySpark Professional for Testingplays a vital role in ensuring the accuracy, performance, and reliability of data workflows that involve Azure Data Factory (ADF), Azure...
-
Senior Azure Data Engineer
4 weeks ago
Hyderabad, India knowledge Artisan Full timeAbout the Role :We are looking for Sr. Azure Data Engineers to design, develop, and optimize data engineering pipelines on Azure. You will work hands-on with Azure Data Factory, Databricks (PySpark), Azure Synapse, and ADLS Gen2, ensuring scalable, high-performance solutions and collaborating with BI teams for analytics.Key Responsibilities :- Design and...
-
Azure Databricks/PySpark Developer
2 weeks ago
Hyderabad, India JRD Systems Private Ltd Full timeKey Responsibilities :- Design, develop, and maintain scalable data pipelines and ETL/ELT processes using PySpark, SQL, and Python.- Build and manage data workflows on Azure Data Lake, Azure Data Factory (ADF), and Databricks.- Collaborate with data scientists, analysts, and other stakeholders to understand data needs and ensure data quality and...
-
Azure Databricks with Pyspark
6 days ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeTCS Hiring !!! Role: Azure databricks with Pyspark Exp: 4-8 Yr Location: Hyd JD - Total 4to 7 years of IT development experience - Minimum 4 years of experience on data warehouse or ETL platforms(including data mapping, ETL, data load and transformation) - Minimum 2 years of experience working as Azure engineer on AzureCloud platform. - Good hands-on...
-
Azure Data Engineer
2 weeks ago
Hyderabad, India Apex One Full timeJob Description Key Responsibilities - Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse. - Implement data lake solutions and work with structured and unstructured datasets in Azure Data Lake Storage (ADLS). - Collaborate with data scientists, analysts, and engineering teams to design and...
-
Databricks, SQL, PySpark, Python
3 days ago
Hyderabad, India Fusion Plus Solutions Full timeJob Description Roles and Responsibilities - 5+ years of experience on IT industry in Data Engineering & Data Analyst role. - 5 years of development experience using tool Databricks and PySpark, Python, SQL - Proficient in writing SQL queries including writing of windows functions - Good communication skills with analytical abilities in doing problem solving...
-
Databricks QA Engineer – Python, PySpark
7 days ago
Hyderabad, India ValueMomentum Full timeJob Title: Data QA Engineer – Databricks & PythonExperience: 3 – 8 YearsLocation: Hyderabad / Pune / CoimbatoreNotice Period: Immediate to 30 DaysAbout The JobWe are seeking a Data QA Engineer with strong experience in Databricks and Python to ensure the quality, reliability, and accuracy of data pipelines and analytical solutions. The ideal candidate...
-
Databricks QA Engineer – Python, PySpark
7 days ago
hyderabad, India ValueMomentum Full timeJob Title: Data QA Engineer – Databricks & PythonExperience: 3 – 8 YearsLocation: Hyderabad / Pune / CoimbatoreNotice Period: Immediate to 30 DaysAbout The JobWe are seeking a Data QA Engineer with strong experience in Databricks and Python to ensure the quality, reliability, and accuracy of data pipelines and analytical solutions. The ideal candidate...
-
Databricks QA Engineer – Python, PySpark
6 days ago
Hyderabad, India ValueMomentum Full timeJob Title: Data QA Engineer – Databricks & PythonExperience: 3 – 8 YearsLocation: Hyderabad / Pune / CoimbatoreNotice Period: Immediate to 30 DaysAbout The JobWe are seeking a Data QA Engineer with strong experience in Databricks and Python to ensure the quality, reliability, and accuracy of data pipelines and analytical solutions. The ideal candidate...
-
Azure Databricks Data Engineer
3 days ago
Hyderabad, Telangana, India Innova ESI Full time ₹ 15,00,000 - ₹ 20,00,000 per yearRole: Azure Databricks Data EngineerExperience: 5+ YearsLocation: Hyderabad | BangaloreNotice Period: Immediate Joiners OnlyJob Description:Minimum of 4 yrs of experience on Azure cloud environment.Experience on ADLS, Azure Databricks, Azure SQL DB, Cosmos DB, Azure Data Factory and Datawarehouse.Strong working experience in Implementation of Azure cloud...