Azure Databricks/PySpark Developer
2 weeks ago
Key Responsibilities :- Design, develop, and maintain scalable data pipelines and ETL/ELT processes using PySpark, SQL, and Python.- Build and manage data workflows on Azure Data Lake, Azure Data Factory (ADF), and Databricks.- Collaborate with data scientists, analysts, and other stakeholders to understand data needs and ensure data quality and availability.- Implement data modeling, transformation, and integration solutions from various structured and unstructured data sources.- Design and implement CI/CD pipelines for data engineering projects using industry best practices.- Monitor and optimize performance of data systems, ensuring high availability and reliability.- Document data workflows, schemas, and architectures to support knowledge sharing and maintenance.- Actively participate in code reviews and contribute to a culture of continuous improvement.- Communicate effectively with technical and non-technical stakeholders, translating business requirements into technical Qualifications :- 6+ years of hands-on experience in Data Engineering.- Proficiency in SQL, Python, and PySpark for data processing and transformation.- Experience working with Azure Data Lake Storage, Azure Data Factory, and Databricks.- Solid understanding of data warehousing concepts, data modeling, and data integration.- Experience with CI/CD tools and deployment practices (e.g., Azure DevOps, Git, Jenkins).- Strong analytical, problem-solving, and debugging skills.- Excellent verbal and written communication skills.- Strong team player with the ability to work independently when needed (ref:hirist.tech)
-
Azure Databricks with Pyspark
6 days ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeTCS Hiring !!! Role: Azure databricks with Pyspark Exp: 4-8 Yr Location: Hyd JD - Total 4to 7 years of IT development experience - Minimum 4 years of experience on data warehouse or ETL platforms(including data mapping, ETL, data load and transformation) - Minimum 2 years of experience working as Azure engineer on AzureCloud platform. - Good hands-on...
-
Azure Databricks Developer
1 week ago
Hyderabad, Telangana, India Kushal Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Title:Azure Databricks Developer (SQL + PySpark) – C2HCompany:Kushal Technologies (Hiring for a Leading Analytics Company)Location:HyderabadExperience:5 – 7 YearsJob Type:Contract-to-Hire (C2H)Immediate Joiners PreferredJob Overview:Kushal Technologies is hiring Azure Databricks Developersfor a leading analytics client. We are staffing10–15...
-
Hyderabad, India Fusion Plus Solutions Full timeJob Description Job Responsibilities: - Design, develop, and implement robust and scalable data pipelines using Azure Data Factory (ADF). - Efficiently extract, transform, and load (ETL) data from various disparate sources into Azure Data Lake Storage (ADLS). - Utilize Azure Databricks for advanced data processing, transformation, and analytics. - Develop...
-
Hyderabad, India Fusion Plus Solutions Full timeJob Description Skill Set:Azure Data Factory, Azure Databricks, Python/Pyspark - Joining time ( Notice period) Immediate joiners only - AnAzure Data Factory, Azure Databricks, Python/PySpark Professional for Testingplays a vital role in ensuring the accuracy, performance, and reliability of data workflows that involve Azure Data Factory (ADF), Azure...
-
Hyderabad, Telangana, India Tech Mahindra Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob Summary5 8 years proven experience as a data engineer with a focus on Azure data services. · Hands on experience with Azure Data Factory, Azure Synapse Analytics, Azure Databricks, PySpark, and SQL. · Should have experience on Databricks services like Unity Catalog and should be able to demonstrate the expertise on spark optimization are mandatory,...
-
Azure Databricks Engineer
4 days ago
Hyderabad, Telangana, India Tekskills Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Role: Azure Databricks EngineerJob Location: Pune, MH / Chennai, TN / Hyderabad. TG / Indore, MP / Kolkata, WB / Bangalore, TNWork Mode: (WFO)Skills Required: Digital: DatabricksExperience: 6-8 Years(5+ yrs)Job Description:Should build Databricks Notebook developed in spark sql/pysparkShould be able to create unity catalog tablesShould have good hands on...
-
ML Engineer
3 weeks ago
Hyderabad, India Tiger Analytics Full timeJob Description ML Engineer (Databricks + PySpark) Locations: Chennai / Hyderabad / Bangalore Tiger Analytics is a global leader in AI and analytics, helping Fortune companies solve their toughest challenges. We are on a mission to push the boundaries of what AI and analytics can do to help enterprises navigate uncertainty and move forward...
-
Databricks Pyspark
3 days ago
Hyderabad, India Fusion Plus Solutions Full timeJob Description - Develop and optimize data processing jobs using PySpark to handle complex data transformations and aggregations efficiently. - Design and implement robust data pipelines on the AWS platform, ensuring scalability and efficiency. - Leverage AWS services such as EC2, S3 for comprehensive data processing and storage solutions. - Manage SQL...
-
Azure Databricks Developer
4 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreeting from TCS!TCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Make sure you have a valid EP number before interview. To create an EP...
-
Hyderabad, India Fusion Plus Solutions Full timeJob Description - Total Yrs. of Experience6+Relevant Yrs. of experience5+Detailed JD (Roles and Responsibilities)5+ years of hands-on Python development experience with excellent programming skills, 3+ years of experience with cloud-based platform, ideally Microsoft Azure, working experience and skills on big data technologies such as PySpark, Databricks,...