Senior Databricks Engineer
3 months ago
Role : Senior Databricks Engineer
Job Description :
- Lead the design and development of big data pipelines and ETL/ELT workflows using Databricks and Azure Data Factory (ADF).
- Develop scalable, high-performance data processing and transformation pipelines using Apache Spark within Databricks.
- Create, schedule, and orchestrate data workflows and pipelines in Azure Data Factory to automate and optimize data movement and transformation processes.
- Collaborate with data architects to design and implement data lakes, data warehouses, and data marts on Azure.
- Build data integration solutions between on-premise and cloud systems, ensuring the secure transfer and transformation of data.
- Optimize data pipelines for performance, ensuring low-latency, fault tolerance, and scalability.
- Implement data quality and governance standards, ensuring data accuracy, consistency, and compliance with organizational policies.
- Collaborate with data scientists and analytics teams to provision and prepare data for advanced analytics, machine learning, and reporting needs.
- Ensure data security, encryption, and access control policies are enforced in the Azure environment.
- Troubleshoot and resolve issues related to data ingestion, transformation, and workflow failures in Databricks and ADF.
- Monitor and manage job execution and pipeline performance in Databricks and ADF, ensuring availability and efficiency.
- Mentor junior engineers and provide guidance on best practices for Databricks, ADF, and Azure cloud services.
-
Senior Databricks Engineer
1 month ago
Chennai, India IT Source Global Full timeJob Title: Senior Databricks EngineerAt IT Source Global, we are seeking a highly skilled Senior Databricks Engineer to lead the design and development of big data pipelines and ETL/ELT workflows using Databricks and Azure Data Factory (ADF).Key Responsibilities:Design and develop scalable, high-performance data processing and transformation pipelines using...
-
Senior Databricks Engineer
4 weeks ago
Chennai, Tamil Nadu, India Finding Candidates Full timeJob Title: Senior Databricks EngineerAbout the Role:We are seeking a highly skilled Senior Databricks Engineer to join our team at Vidpro Consultancy Services. As a Senior Databricks Engineer, you will be responsible for designing and implementing modern data warehouse solutions using Databricks and AWS/Azure Stack. You will work closely with our DW/BI leads...
-
Senior Big Data Migration Engineer
3 weeks ago
Chennai, Tamil Nadu, India Databricks Full timeAbout the RoleAs a Senior Big Data Migration Engineer at Databricks, you will work closely with customers on short to medium-term engagements on their big data challenges using our platform. Your expertise will be invaluable in providing data engineering, data science, and cloud technology projects that require integrating with client systems, training, and...
-
Senior Security Engineer
3 weeks ago
Chennai, Tamil Nadu, India Databricks Full timeThe Incident Response team at Databricks is dedicated to protecting our customers, employees, and enterprise data from security threats. We're looking for a skilled Senior Security Engineer who will lead our incident response efforts and help us scale our security capabilities.Key Responsibilities:Lead incidents, investigations, and security initiatives from...
-
Senior Security Specialist
4 weeks ago
Chennai, Tamil Nadu, India Databricks Full timeThe Incident Response team at Databricks is looking for a Senior Security Specialist to join our team. As a key member of our security group, you will be responsible for leading incidents, investigations, and security initiatives. You will be a security multiplier, helping the team scale security incident response at Databricks.Responsibilities...
-
Senior Databricks Engineer
4 weeks ago
Chennai, Tamil Nadu, India Breezy Talent Full timeBreezy Talent is seeking a Senior Databricks Engineer / Data Architect with 510 years of experience.Location: Hybrid Work Type: Mandatory Skills: Python/ PySpark / Spark with Azure/ Azure Databricks / AzureDataFactoryPrimary Roles and Responsibilities:• Creating Modern Data Warehouse solutions using Databricks and AWS/Azure Stack• Providing...
-
Senior Security Engineer
3 months ago
Chennai, India Databricks Full timeRDQ324R4The Incident Response team's mission is to respond to security threats, incidents and investigations to protect our customers, employees and enterprise data in an efficient and standardised manner. We're a tight-knit team of security incident responders and incident handlers doing "Security for Databricks on Databricks", using our own platform to...
-
Data Engineering Lead
3 weeks ago
Chennai, Tamil Nadu, India Databricks Full timeWe are seeking an experienced Data Engineering Lead to join our Professional Services team at Databricks. As a key member of our team, you will work closely with customers to deliver short to medium-term customer engagements on their big data challenges using the Databricks platform.Your responsibilities will include providing data engineering, data science,...
-
Senior Databricks Engineer
4 weeks ago
Chennai, India IT Source Global Full timeRole : Senior Databricks Engineer Job Description :- Lead the design and development of big data pipelines and ETL/ELT workflows using Databricks and Azure Data Factory (ADF).- Develop scalable, high-performance data processing and transformation pipelines using Apache Spark within Databricks.- Create, schedule, and orchestrate data workflows and pipelines...
-
Senior Databricks Engineer
2 months ago
Chennai, Tamil Nadu, India IT Source Global Full timeRole : Senior Databricks Engineer Job Description :- Lead the design and development of big data pipelines and ETL/ELT workflows using Databricks and Azure Data Factory (ADF).- Develop scalable, high-performance data processing and transformation pipelines using Apache Spark within Databricks.- Create, schedule, and orchestrate data workflows and pipelines...
-
Senior Security Specialist
4 weeks ago
Chennai, Tamil Nadu, India Databricks Full timeThe Incident Response team at Databricks is responsible for responding to security threats, incidents, and investigations to protect our customers, employees, and enterprise data in an efficient and standardized manner. We're a tight-knit team of security incident responders and handlers using our own platform to create near-real-time log analytics,...
-
Senior Databricks Engineer
3 weeks ago
Chennai, Tamil Nadu, India Find Next Hire Full timeSought after by Vidpro Consultancy Services is a talented Data Architect who will lead the development of modern data warehouse solutions. Key responsibilities include:Designing and implementing data pipelines using Databricks and AWS/Azure StackProviding forward-thinking solutions in data engineering and analyticsCollaborating with DW/BI leads for new ETL...
-
Big Data Migration Specialist
4 weeks ago
Chennai, Tamil Nadu, India Databricks Full timeJob SummaryAs a Migrations Architect at Databricks, you will work with customers on short to medium-term engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and other technical tasks to help customers get...
-
Data Engineering Lead
15 hours ago
Chennai, Tamil Nadu, India Databricks Full timeAbout the RoleWe are seeking an experienced Data Engineering Lead to join our Professional Services team at Databricks. In this role, you will work with customers on short to medium-term engagements to help them overcome their big data challenges using the Databricks platform.Key ResponsibilitiesDesign and implement data engineering solutions that integrate...
-
Senior Data Engineer
3 weeks ago
Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time**Job Title:** Senior Data Engineer - Databricks Expert**About Eucloid Data Solutions Pvt Ltd**Eucloid Data Solutions Pvt Ltd is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning, and Data engineering. Our team supports various business applications by developing data...
-
Migrations Architect
2 months ago
Chennai, India Databricks Full timeFEQ225R141As a Migrations Architect (Big data) in our Professional Services team, you will work with customers on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and...
-
Solutions Architect
2 months ago
Chennai, India Databricks Full timeFEQ225R141As a Solution Architect (Big data) in our Professional Services team, you will work with customers on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and other...
-
Big Data Migration Strategist
4 weeks ago
Chennai, Tamil Nadu, India Databricks Full timeJob SummaryWe are seeking a skilled Big Data Migration Strategist to join our team at Databricks. As a key member of our Professional Services team, you will work closely with customers to deliver complex big data projects using the Databricks platform.About the RoleKey ResponsibilitiesDesign and implement data migration strategies for customers moving to...
-
Data Migration Specialist
3 weeks ago
Chennai, Tamil Nadu, India Databricks Full timeJob DescriptionMigrations ArchitectJob SummaryWe are seeking an experienced Migrations Architect to join our Professional Services team. As a Migrations Architect (Big data), you will work with customers on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science,...
-
Resident Solution Architect, Migrations Specialist
2 months ago
Chennai, India Databricks Full timeFEQ225R141As a Migrations Architect (Resident Solutions Architect) in our Professional Services team, you will work with customers on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client...