Data Bricks Developer
1 week ago
Responsibilities:
- Design, develop, and maintain data processing pipelines using Databricks on the Azure platform.
- Collaborate with data engineers, data scientists, and other stakeholders to optimize workflows and ensure data quality.
- Implement ETL processes to extract, transform, and load data from various sources.
- Work with Spark SQL and Databricks notebooks to analyze and transform data.
- Ensure efficient data flow across diverse systems.
- Provide technical guidance to teams and anchor proof-of-concept projects.
- Responsible to assemble large, complex sets of data that meet non-functional and functional business requirements.
- Responsible to identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
- Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using Azure, Databricks and SQL technologies
- Working with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues
- Understanding of Cognos DB and Synapse.
Requirements:
- Bachelors degree in computer science, Engineering, or related field.
- 3 to 5 years of hands-on experience as a Databricks
- Strong proficiency in Apache Spark and Databricks.
- Strong knowledge on PySpark
- Experience with Scala and/or Python programming languages.
- Solid understanding of data warehousing concepts and ETL processes.
- Familiarity with cloud platforms - Azure
- Version control tools knowledge (e.g., Git).
-
Azure data Brick Engineer
5 days ago
Pune, Maharashtra, India Tata Consultancy Services Full time ₹ 20,00,000 - ₹ 25,00,000 per yearRole: Azure data brick EngineerExperience: 6Location: Pune/GurgaonMust-Have6+ years of hands-on experience in development.Azure – cloud technology – Function Apps, AWS, Python, PySpark , Databricks, Azure DevOps, Synapse, API.Strong knowledge Incident, problem, Change management, service management, service request.Must have hands on experience code...
-
Azure data Brick Engineer
4 weeks ago
Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full timeRole: Azure data brick EngineerExperience: 6Location: Pune/GurgaonMust-Have6+ years of hands-on experience in development.Azure – cloud technology – Function Apps, AWS, Python, PySpark , Databricks, Azure DevOps, Synapse, API.Strong knowledge Incident, problem, Change management, service management, service request.Must have hands on experience code...
-
Technical Data Analyst
23 hours ago
Pune, Maharashtra, India Ben Hr Consultants Full time ₹ 9,00,000 - ₹ 12,00,000 per yearSeeking a Technical Data Analyst in Pune to support BI & Analytics platform development. Must be skilled in Python, SQL, Tableau/Power BI, AWS, Snowflake/Data bricks, DW with strong analytical, communication, and Agile Product team experience 6-9yrs.
-
Data Bricks Lead
2 weeks ago
Pune, Maharashtra, India Tata Technologies Full time ₹ 8,00,000 - ₹ 12,00,000 per yearResponsibilities:Design, develop, and maintain data processing pipelines using Databricks on the Azure platform.Collaborate with data engineers, data scientists, and other stakeholders to optimize workflows and ensure data quality.Implement ETL processes to extract, transform, and load data from various sources.Work with Spark SQL and Databricks notebooks to...
-
Azure Data Bricks
15 hours ago
Pune, Maharashtra, India Hexaware Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per yearOpen & Direct Walk-in Drive event | Hexaware technologies - Azure Data Engineer/Architect in Pune , on 8th Nov [Saturday] Azure Databricks/ Data factory/ SQL & Pyspark or Spark/Synapse/MS FabricsDear Candidate,I hope this email finds you well. We are thrilled to announce an exciting opportunity for talented professionals like yourself to join our team as an...
-
Senior Data Engineer
1 day ago
Pune, Maharashtra, India Allata Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAllata is a global consulting and technology services firm with offices in the US, India, and Argentina. We help organizations accelerate growth, drive innovation, and solve complex challenges by combining strategy, design, and advanced technology. Our expertise covers defining business vision, optimizing processes, and creating engaging digital experiences....
-
Data Automation Engineer
15 hours ago
Pune, Maharashtra, India Parkar Digital Full time ₹ 12,00,000 - ₹ 36,00,000 per yearRole OverviewWe are seeking a Data Automation Engineer to join our global Architecture & Technology team. This role is critical to advancing our Common Data Platform (CDP) beyond harmonizing the data estate, enabling the next level of automation and agentic capabilities to solve challenging business use cases.The ideal candidate combines strong engineering...
-
Sr. Spark Big Data Developer
20 hours ago
Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full time ₹ 5,00,000 - ₹ 15,00,000 per yearSr. Spark Big Data DeveloperPFB the detailed JD:�� Experience: 5 to 7+ years (Hands-on)�� Notice Period: 0-30 DaysMust Have: Proficiency in at least one of the following programming languages:Java/Scala/Python Good understanding of SQL Experience of development and deployment of at least one end-to-end datastorage/processing pipeline...
-
Azure Data QA Engineer
1 week ago
Pune, Maharashtra, India Weekday AI Full time ₹ 1,32,00,000 - ₹ 1,63,20,000 per yearThis role is for one of Weekday's clientsMin Experience: 4 yearsLocation: Pune, BangaloreJobType: full-timeRequirementsWe are looking for a highly skilled Azure Data QA Engineer to join our team on a contractual basis (1 year). This role is based in Pune or Bangalore (Hybrid working), and we are seeking candidates who can join immediately or within a short...
-
Data QA Engineer
2 weeks ago
Pune, Maharashtra, India Luxoft Full time ₹ 6,00,000 - ₹ 18,00,000 per yearProject descriptionWorking within the client's test and government framework, you will be responsible for creating the automation framework to support all data warehousing progression and regression testing and fix the defects.ResponsibilitiesAnalyze and document test data, results, and recommendations.Perform functional and non-functional testing for data...