Azure Databricks Lead/Architect
3 weeks ago
Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.
Position: Lead /Architect - Azure Databricks
Overall IT experience: 8 to 13 years
Primary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse
Secondary Skills: U-SQL, Spark, Scala, Python
Work Location: Bengaluru, Hyderabad
Notice Period: 0 to 30 Days
Essential experience:
- Overall 10+ years of experience Cloud data engineering, out of which minimum of 7+ years’ experience in Azure Databricks, PySpark.
- Proficient in SQL and must worked on complex joins, Subqueries, functions, procedure. and able to perform SQL tunning and query optimization without support. Ideally 5 to 6 years of solid experience in SQL queries
- Design, develop, and maintain ETL pipelines using Databricks, PySpark and ADF to extract, transform, and load data from various sources.
- Experience in implementing large & complex hosted solution using Azure (ADF, Azure Data Lake Storage and databricks).
- Optimize and fine-tune existing ETL workflows for performance and scalability.
- Must have experience on working with large data set
- Experience working with batch and streaming data processing (Good to have).
- Ability to develop reliable, secure, compliant data processing systems.
- Work closely with cross-functional teams to support data analytics, reporting, and business intelligence initiatives.
One should be self-driven and work independently without support.
-
Azure Databricks Lead/Architect
4 days ago
Bengaluru, India Recmatrix Consulting Full timeOverview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure DatabricksOverall...
-
Azure Databricks Lead/Architect
3 weeks ago
Bengaluru, India Recmatrix Consulting Full timeOverview: Role ofLead/Architect - Azure Databricksfocusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position:Lead /Architect - Azure DatabricksOverall IT...
-
Azure Databricks Lead/Architect
3 weeks ago
Bengaluru, India Recmatrix Consulting Full timeOverview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure DatabricksOverall...
-
Azure Databricks Lead/Architect
3 weeks ago
Bengaluru, India Recmatrix Consulting Full timeOverview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures. Position: Lead /Architect - Azure Databricks...
-
Azure Databricks Lead Architect
1 week ago
Bengaluru, Karnataka, India GyanSys Inc. Full timeDear Candidate,GyanSys Inc. is seeking an experienced professional to fill the role of Lead/Architect - Azure Databricks for our overseas customers consulting Projects based in various regions. Key responsibilities include building ETL/data warehouse transformation processes and evaluating the performance and applicability of multiple tools against customer...
-
Azure Databricks Lead
3 weeks ago
Bengaluru, Karnataka, India GyanSys Inc. Full timeGyanSys Inc. is seeking a highly skilled Lead/Architect - Azure Databricks to join our team. This role is responsible for designing and implementing data warehouse transformation processes using Azure Data Factory and Apache Spark.Key Responsibilities:Design and develop ETL/data warehouse transformation processes using Azure Data Factory and Apache...
-
Data Architect
2 weeks ago
Bengaluru, Karnataka, India Databricks Full timeUnlock the Power of Data ScienceDatabricks is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing and implementing data architectures that enable our customers to make informed decisions. You will work closely with our customers to understand their data needs and develop solutions that meet...
-
Azure Databricks ML Architect
2 months ago
Bengaluru, India NR Consulting - India Full timeJob Description:- Hands on experience on working in Azure cloud platform Experience in designing and implementing scalable and secure Azure cloud solutions using Data Bricks Client platform. Understanding of implementation of architecture within Azure Big Data Analytics Al tools. Expert level in Designing and Architect solutions in Azure Data factory, Azure...
-
Data Architect
4 days ago
Bengaluru, Karnataka, India Databricks Full timeData Engineering Lead PositionWe are seeking a skilled Data Engineering Lead to join our team at Databricks, where our core values of proactiveness and customer-centric mindset drive us to create a unified platform for data science and analytics. As a Data Engineering Lead, you will be instrumental in helping our customers solve complex data challenges using...
-
Azure Databricks Lead
4 days ago
Bengaluru, Karnataka, India Ahvi Infotech Full timeAbout the roleAs a Lead for Azure Databricks, you will be responsible for building ETL / data warehouse transformation processes and data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).Key Responsibilities:Developing complex U-SQL, Spark (Scala or Python) solutionsEvaluating the performance and applicability of multiple tools...
-
Resident Solutions Architect
2 months ago
Bengaluru, Karnataka, India Databricks Full time**FEQ225R141** **Resident Solutions Architect - Migrations Architect L5** As a Migrations Architect (Resident Solutions Architect) in our Professional Services team, you will work with customers on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud...
-
Azure Databricks ML Architect
2 weeks ago
Bengaluru, Karnataka, India NR Consulting - India Full timeJob Title: Cloud Data Architect - AI and Machine LearningJob Summary: We are seeking a highly skilled Cloud Data Architect to lead the design and implementation of AI and machine learning solutions on Azure cloud platform. The ideal candidate will have hands-on experience with Azure cloud services, including Azure Databricks, Azure Data Factory, and Azure...
-
Senior Software Architect
2 weeks ago
Bengaluru, Karnataka, India Databricks Full timeUnlock the Power of Data GovernanceDatabricks is seeking a highly skilled Senior Software Architect to join our Money team in Bengaluru, India. As a key member of our engineering team, you will be responsible for designing and managing critical components of our products, including resource admission control and usage governance infrastructure.Your...
-
Azure Databricks Lead
2 weeks ago
Bengaluru, Karnataka, India Ahvi Infotech Full timeAbout the JobAt Ahvi Infotech, we are seeking an experienced Lead - Azure Databricks to join our team of data professionals.Key Responsibilities:Design and develop ETL/data warehouse transformation processesBuild data pipelines using Azure Data Factory and Apache Spark (Databricks)Evaluate performance and applicability of multiple tools against customer...
-
Big Data Architect
5 months ago
Bengaluru, India Databricks Full timeAs a** Resident Solutions Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...
-
Senior Software Architect
2 weeks ago
Bengaluru, Karnataka, India Databricks Full timeKey Role in Databricks' Central Engineering TeamAs one of the first engineers for the Money team at Databricks India, you will play a crucial part in building a foundation for one of Databricks' most critical engineering teams. Your role will involve owning critical components that form the backbone of our products, starting with Databricks' resource...
-
Azure Databricks Lead
2 weeks ago
Bengaluru, Karnataka, India Ahvi Infotech Full timeAbout the RoleAt Ahvi Infotech, we are seeking a highly skilled Azure Databricks Lead to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines using Azure Databricks.Key ResponsibilitiesDesign and implement data transformation processes using Azure...
-
Senior Solutions Architect
2 weeks ago
Bengaluru, Karnataka, India Databricks Full timeFEQ425R196As a Senior Solutions Architect, you will lead the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible data-driven outcomes through...
-
Architect : Digital Natives (Data & Ai)
5 months ago
Bengaluru, India Databricks Full timeAs a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...
-
Azure Databricks
3 weeks ago
Bengaluru, India Ahvi Infotech Full timeAbout the job Azure DatabricksPosition: Lead - Azure DatabricksOverall IT experience: 8 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouseSecondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, HyderabadEssential experience:Experience in building ETL / data warehouse transformation processes Direct...