Azure Databricks Lead/Architect
1 month ago
Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.
Position: Lead /Architect - Azure Databricks
Overall IT experience: 8 to 13 years
Primary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse
Secondary Skills: U-SQL, Spark, Scala, Python
Work Location: Bengaluru, Hyderabad
Notice Period: 0 to 30 Days
Essential experience:
- Overall 10+ years of experience Cloud data engineering, out of which minimum of 7+ years’ experience in Azure Databricks, PySpark.
- Proficient in SQL and must worked on complex joins, Subqueries, functions, procedure. and able to perform SQL tunning and query optimization without support. Ideally 5 to 6 years of solid experience in SQL queries
- Design, develop, and maintain ETL pipelines using Databricks, PySpark and ADF to extract, transform, and load data from various sources.
- Experience in implementing large & complex hosted solution using Azure (ADF, Azure Data Lake Storage and databricks).
- Optimize and fine-tune existing ETL workflows for performance and scalability.
- Must have experience on working with large data set
- Experience working with batch and streaming data processing (Good to have).
- Ability to develop reliable, secure, compliant data processing systems.
- Work closely with cross-functional teams to support data analytics, reporting, and business intelligence initiatives.
One should be self-driven and work independently without support.
-
Azure Databricks Lead/Architect
3 weeks ago
Bengaluru, India Recmatrix Consulting Full timeOverview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure DatabricksOverall...
-
Azure Databricks Lead/Architect
2 weeks ago
Bengaluru, India Recmatrix Consulting Full timeOverview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure...
-
Azure Databricks Lead/Architect
1 month ago
Bengaluru, India Recmatrix Consulting Full timeOverview: Role ofLead/Architect - Azure Databricksfocusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position:Lead /Architect - Azure DatabricksOverall IT...
-
Azure Databricks Lead/Architect
1 month ago
Bengaluru, India Recmatrix Consulting Full timeOverview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures. Position: Lead /Architect - Azure Databricks...
-
Azure Databricks Lead/Architect
1 month ago
Bengaluru, India Recmatrix Consulting Full timeOverview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure DatabricksOverall...
-
Azure Databricks Lead Architect
4 weeks ago
Bengaluru, Karnataka, India GyanSys Inc. Full timeDear Candidate,GyanSys Inc. is seeking an experienced professional to fill the role of Lead/Architect - Azure Databricks for our overseas customers consulting Projects based in various regions. Key responsibilities include building ETL/data warehouse transformation processes and evaluating the performance and applicability of multiple tools against customer...
-
Azure Databricks Lead/Architect Position
2 weeks ago
Bengaluru, Karnataka, India Recmatrix Consulting Full timeJob Title: Azure Databricks Lead/Architect Position
-
Azure Databricks Lead
1 month ago
Bengaluru, Karnataka, India GyanSys Inc. Full timeGyanSys Inc. is seeking a highly skilled Lead/Architect - Azure Databricks to join our team. This role is responsible for designing and implementing data warehouse transformation processes using Azure Data Factory and Apache Spark.Key Responsibilities:Design and develop ETL/data warehouse transformation processes using Azure Data Factory and Apache...
-
Data Architect
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeUnlock the Power of Data ScienceDatabricks is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing and implementing data architectures that enable our customers to make informed decisions. You will work closely with our customers to understand their data needs and develop solutions that meet...
-
Azure Databricks ML Architect
3 months ago
Bengaluru, India NR Consulting - India Full timeJob Description:- Hands on experience on working in Azure cloud platform Experience in designing and implementing scalable and secure Azure cloud solutions using Data Bricks Client platform. Understanding of implementation of architecture within Azure Big Data Analytics Al tools. Expert level in Designing and Architect solutions in Azure Data factory, Azure...
-
Data Architect
3 weeks ago
Bengaluru, Karnataka, India Databricks Full timeData Engineering Lead PositionWe are seeking a skilled Data Engineering Lead to join our team at Databricks, where our core values of proactiveness and customer-centric mindset drive us to create a unified platform for data science and analytics. As a Data Engineering Lead, you will be instrumental in helping our customers solve complex data challenges using...
-
Resident Solutions Architect
3 months ago
Bengaluru, Karnataka, India Databricks Full time**FEQ225R141** **Resident Solutions Architect - Migrations Architect L5** As a Migrations Architect (Resident Solutions Architect) in our Professional Services team, you will work with customers on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud...
-
Azure Databricks Lead
3 weeks ago
Bengaluru, Karnataka, India Ahvi Infotech Full timeAbout the roleAs a Lead for Azure Databricks, you will be responsible for building ETL / data warehouse transformation processes and data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).Key Responsibilities:Developing complex U-SQL, Spark (Scala or Python) solutionsEvaluating the performance and applicability of multiple tools...
-
Azure Databricks Lead
4 weeks ago
Bengaluru, Karnataka, India Ahvi Infotech Full timeAbout the JobAt Ahvi Infotech, we are seeking an experienced Lead - Azure Databricks to join our team of data professionals.Key Responsibilities:Design and develop ETL/data warehouse transformation processesBuild data pipelines using Azure Data Factory and Apache Spark (Databricks)Evaluate performance and applicability of multiple tools against customer...
-
Big Data Architect
5 months ago
Bengaluru, India Databricks Full timeAs a** Resident Solutions Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...
-
Senior Software Architect
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeKey Role in Databricks' Central Engineering TeamAs one of the first engineers for the Money team at Databricks India, you will play a crucial part in building a foundation for one of Databricks' most critical engineering teams. Your role will involve owning critical components that form the backbone of our products, starting with Databricks' resource...
-
Azure Databricks
1 month ago
Bengaluru, India Ahvi Infotech Full timeAbout the job Azure DatabricksPosition: Lead - Azure DatabricksOverall IT experience: 8 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouseSecondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, HyderabadEssential experience:Experience in building ETL / data warehouse transformation processes Direct...
-
Lead - Azure Databricks Developer
4 weeks ago
Bengaluru, Karnataka, India PradeepIT Consulting Services Pvt Ltd Full time**Job Title:** Lead - Azure Databricks Developer**Job Summary:** We are seeking a highly skilled Lead - Azure Databricks Developer to join our team at PradeepIT Consulting Services Pvt Ltd. The ideal candidate will have experience in building ETL/data warehouse transformation processes and direct experience of building data pipelines using Azure Data Factory...
-
Senior Solutions Architect
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeFEQ425R196As a Senior Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to...
-
Azure Databricks
1 week ago
Bengaluru, Karnataka, India PradeepIT Consulting Services Full time**About the job Azure Databricks**: **Position**: Lead - Azure Databricks **Overall IT experience**:8 to 13 years **Primary Skills**:Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse **Secondary Skills**:U-SQL, Spark, Scala, Python **Work Location**:Bengaluru, Hyderabad **Notice Period**:0 to 30 Days **Essential experience**: Experience...