Lead - Azure Databricks Data Engineer
2 days ago
Company Overview
We are PradeepIT Consulting Services Pvt Ltd, a leading consulting services firm with a strong presence in Bengaluru and Hyderabad. We specialize in providing cutting-edge IT solutions to our clients.
Salary:
The estimated annual salary for this position is ₹20-35 lakhs (₹1.67-2.92 lakhs per month), depending on experience.
Job Description
We are seeking an experienced Lead - Azure Databricks Data Engineer to join our team. As a Lead, you will be responsible for designing and implementing data warehousing and ETL processes using Azure Databricks and other big data technologies.
In this role, you will work closely with our development team to deliver high-quality solutions that meet our clients' needs.
Required Skills and Qualifications
To be successful in this role, you should have:
- Experience in building ETL/data warehouse transformation processes
- Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks)
- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
- Evaluating the performance and applicability of multiple tools against customer requirements
- Working within an Agile delivery/DevOps methodology to deliver proof of concept and production implementation in iterative sprints
- Coding complex U-SQL, Spark (Scala or Python)
- T-SQL Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks)
Benefits
We offer a competitive salary package, including benefits such as medical insurance, retirement plan, and paid time off.
Others
This is a full-time position based in Bengaluru or Hyderabad.
-
Data Engineering Expert for Databricks and Azure
2 weeks ago
Bengaluru, Karnataka, India L&T Technology Services Full timeAbout the RoleWe are seeking a highly skilled Data Engineer with expertise in Databricks and Azure cloud to join our team at L&T Technology Services. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Databricks and Azure services.With 5+ years of experience in...
-
Azure Databricks Data Engineer
1 month ago
Bengaluru, Karnataka, India JRD Systems Full time**Key Responsibilities:**As an ETL Automation Specialist at JRD Systems, you will be responsible for creating test automation using an existing data automation framework to validate business rules for audience creation across multiple social media channels.The ideal candidate will have experience in Azure Databricks, building automation tests using...
-
Azure Data Engineer
3 weeks ago
Bengaluru, Karnataka, India Covenant Consultants Full timeJob OverviewCovenant Consultants is a leading data analytics company based in the US, offering hybrid work opportunities with general shifts.We are seeking an experienced Data Engineer to join our team, with a strong background in Azure Cloud and Databricks.
-
Data Engineer for Databricks and Azure Solutions
2 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeThe Data Engineer role at Tata Consultancy Services is an exciting opportunity to work on designing, implementing, and maintaining large-scale data processing systems on Azure.We are seeking a highly skilled Data Engineer to join our team in this key position. As a Data Engineer, you will be responsible for building scalable data pipelines using Azure Data...
-
Azure Databricks Lead
3 days ago
Bengaluru, Karnataka, India GyanSys Inc. Full timeWe are seeking a highly skilled Azure Databricks Lead to join our team at GyanSys Inc. in Bengaluru, Hyderabad India.Job Summary:GyanSys Inc. is looking for an experienced professional to lead the development of data warehouse transformation processes using Azure Databricks and other big data products.About the Role:This role involves building ETL / data...
-
Data Engineering Innovator
3 weeks ago
Bengaluru, Karnataka, India Diagonal Consulting Full time**Overview of Diagonal Consulting**We are a data analytics company that aims to create lasting outcomes for our customers. Our team is passionate about designing and executing innovative data strategies that enhance business efficiency.About the JobThis is a full-time hybrid role for a Practice Lead - Databricks at Diagonal consulting. As a key member of our...
-
Enterprise Data Engineer
4 days ago
Bengaluru, Karnataka, India Xander Talent Full timeXander Talent is seeking an experienced Enterprise Data Engineer with a specialization in Azure Databricks to lead data modeling, architecture design, and performance optimization for enterprise projects.Job Description**Key Responsibilities:**
-
Bengaluru, Karnataka, India Tata Consultancy Services Full timeJob DescriptionWe are seeking an experienced Data Scientist to join our team as an Azure Data Engineer (Databricks). This role requires a strong understanding of cloud technology, data engineering, and programming skills in Python, SQL, and SPARK.Key ResponsibilitiesDesign and develop scalable data pipelines using Databricks and Azure services.Analyze and...
-
Technical Director
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeAt Databricks, we are seeking a seasoned Technical Director to lead our Pre-Sales team in India. This is an exciting opportunity for you to shape the future of data engineering and drive business growth.We are looking for an expert with 6+ years of experience in pre-sales/consulting/customer-facing managerial roles, specifically in Big Data Architecture...
-
Data Engineer for Databricks Migration
3 days ago
Bengaluru, Karnataka, India GyanSys Inc. Full timeWe are seeking a highly skilled Data Engineer with 6-8 years of experience in Databricks, Python, and SQL to lead our migration efforts to the Databricks environment. The ideal candidate will have a strong background in data migration projects and be proficient in transforming ETL pipelines to Databricks.The successful candidate will have excellent...
-
Highly Skilled Azure Databricks Engineer
1 week ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeTata Consultancy Services is currently seeking an experienced Azure Databricks Data Engineer to join their team.About the Role:We are looking for a skilled professional with expertise in Python, PySpark ETL notebook development and User Defined Functions. The successful candidate will be responsible for designing, implementing and maintaining data...
-
Data Engineering Practice Lead
1 month ago
Bengaluru, Karnataka, India Diagonal Consulting Full timeAbout Diagonal ConsultingDiagonal Consulting is a trusted solution partner for organizations looking to enhance their business efficiency through data analytics. Our mission is to create a lasting outcome for our customers by harnessing our collective passion for data engineering.Job DescriptionThis is a full-time hybrid role for a Practice Lead - Databricks...
-
Bengaluru, Karnataka, India Tredence Inc. Full timeAbout TredenceTredence focuses on delivering actionable insights to clients across industries. Headquartered in the San Francisco Bay Area, we provide services globally.Job OverviewWe are seeking an experienced Senior Databricks Engineer Lead with expertise in data architecture and engineering. The ideal candidate will have a deep understanding of modern...
-
Data Engineering Lead
1 week ago
Bengaluru, Karnataka, India Arthya Tech Solutions Full timeJob Overview: Arthya Tech Solutions seeks an experienced Data Engineering Lead to spearhead our Azure Databricks projects. About the Role:We are looking for a highly skilled Senior Developer to lead our Agile Teams in building and implementing scalable data pipelines using Azure's Data Factory and data lake. As a Senior Developer, you will work closely with...
-
Data Engineering Lead
2 weeks ago
Bengaluru, Karnataka, India Altimetrik Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Lead to join our team at Altimetrik. As a key member of our engineering team, you will be responsible for designing and implementing data analytics solutions using Azure stack.ResponsibilitiesLead the design and implementation of data analytics solutions using Azure Data Lake, Azure Data Factory,...
-
Bengaluru, Karnataka, India Tata Consultancy Services Full timeWe are seeking a highly skilled Senior Azure Databricks Engineer to join our team at Tata Consultancy Services. This role offers a unique opportunity to leverage your expertise in designing and developing innovative data pipelines using Microsoft Azure services.The ideal candidate will have 5-9 years of experience in senior data engineering roles, with a...
-
Lead Data Engineer
4 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob Description:We are seeking a skilled Lead Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will be responsible for designing and implementing high-level design documents, building ETL code in Databricks, and performing unit and system integration testing.Responsibilities:Design and implement high-level...
-
Big Data Analytics Solutions Specialist
2 weeks ago
Bengaluru, Karnataka, India Databricks Full timeAbout the Role:We are seeking a highly skilled Big Data Analytics Solutions Specialist to join our team at Databricks. As a key member of our sales engineering group, you will work closely with clients to provide technical and business value through hands-on evaluation and programming.The Impact You Will Have:Establish strong relationships with clients...
-
Senior Distributed Systems Architect Lead
3 weeks ago
Bengaluru, Karnataka, India Databricks Full timeAbout DatabricksDatabricks is a leading cloud-based data and AI platform that enables customers to solve complex problems and make data-driven decisions. As an Engineering Manager at Databricks, you will be part of a talented team that builds scalable infrastructure and products for the Databricks platform.Job DescriptionWe are seeking an experienced Senior...
-
Azure Data Engineer Lead
3 days ago
Bengaluru, Karnataka, India Wall Street Consulting Services LLC Full timeWe are seeking an experienced Azure Data Engineer Lead to join our team at Wall Street Consulting Services LLC.The successful candidate will have a strong background in data engineering, with experience in Azure services such as ADF, Databricks, and DP200/DP201 certification. They will also possess excellent coding skills in Python and PySpark, as well as...