Azure Databricks Lead/Architect

3 days ago


Bengaluru, India Recmatrix Consulting Full time
Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.

Position: Lead /Architect - Azure Databricks

Overall IT experience: 8 to 13 years

Primary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse

Secondary Skills: U-SQL, Spark, Scala, Python

Work Location: Bengaluru, Hyderabad

Notice Period: 0 to 30 Days

Essential experience:

- Overall 10+ years of experience Cloud data engineering, out of which minimum of 7+ years’ experience in Azure Databricks, PySpark.- Proficient in SQL and must worked on complex joins, Subqueries, functions, procedure. and able to perform SQL tunning and query optimization without support. Ideally 5 to 6 years of solid experience in SQL queries- Design, develop, and maintain ETL pipelines using Databricks, PySpark and ADF to extract, transform, and load data from various sources.- Experience in implementing large & complex hosted solution using Azure (ADF, Azure Data Lake Storage and databricks).- Optimize and fine-tune existing ETL workflows for performance and scalability.- Must have experience on working with large data set- Experience working with batch and streaming data processing (Good to have).- Ability to develop reliable, secure, compliant data processing systems.- Work closely with cross-functional teams to support data analytics, reporting, and business intelligence initiatives.

One should be self-driven and work independently without support.

  • Bengaluru, India Recmatrix Consulting Full time

    Overview: Role ofLead/Architect - Azure Databricksfocusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position:Lead /Architect - Azure DatabricksOverall IT...


  • Bengaluru, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures. Position: Lead /Architect - Azure Databricks...


  • Bengaluru, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure DatabricksOverall...


  • Bengaluru, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure DatabricksOverall...


  • Bengaluru, Karnataka, India GyanSys Inc. Full time

    Dear Candidate,GyanSys Inc. is seeking an experienced professional to fill the role of Lead/Architect - Azure Databricks for our overseas customers consulting Projects based in various regions. Key responsibilities include building ETL/data warehouse transformation processes and evaluating the performance and applicability of multiple tools against customer...

  • Azure Databricks Lead

    3 weeks ago


    Bengaluru, Karnataka, India GyanSys Inc. Full time

    GyanSys Inc. is seeking a highly skilled Lead/Architect - Azure Databricks to join our team. This role is responsible for designing and implementing data warehouse transformation processes using Azure Data Factory and Apache Spark.Key Responsibilities:Design and develop ETL/data warehouse transformation processes using Azure Data Factory and Apache...

  • Data Architect

    2 weeks ago


    Bengaluru, Karnataka, India Databricks Full time

    Unlock the Power of Data ScienceDatabricks is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing and implementing data architectures that enable our customers to make informed decisions. You will work closely with our customers to understand their data needs and develop solutions that meet...


  • Bengaluru, India NR Consulting - India Full time

    Job Description:- Hands on experience on working in Azure cloud platform Experience in designing and implementing scalable and secure Azure cloud solutions using Data Bricks Client platform. Understanding of implementation of architecture within Azure Big Data Analytics Al tools. Expert level in Designing and Architect solutions in Azure Data factory, Azure...

  • Data Architect

    3 days ago


    Bengaluru, Karnataka, India Databricks Full time

    Data Engineering Lead PositionWe are seeking a skilled Data Engineering Lead to join our team at Databricks, where our core values of proactiveness and customer-centric mindset drive us to create a unified platform for data science and analytics. As a Data Engineering Lead, you will be instrumental in helping our customers solve complex data challenges using...


  • Bengaluru, Karnataka, India Ahvi Infotech Full time

    About the roleAs a Lead for Azure Databricks, you will be responsible for building ETL / data warehouse transformation processes and data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).Key Responsibilities:Developing complex U-SQL, Spark (Scala or Python) solutionsEvaluating the performance and applicability of multiple tools...


  • Bengaluru, Karnataka, India Databricks Full time

    **FEQ225R141** **Resident Solutions Architect - Migrations Architect L5** As a Migrations Architect (Resident Solutions Architect) in our Professional Services team, you will work with customers on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud...


  • Bengaluru, Karnataka, India NR Consulting - India Full time

    Job Title: Cloud Data Architect - AI and Machine LearningJob Summary: We are seeking a highly skilled Cloud Data Architect to lead the design and implementation of AI and machine learning solutions on Azure cloud platform. The ideal candidate will have hands-on experience with Azure cloud services, including Azure Databricks, Azure Data Factory, and Azure...


  • Bengaluru, Karnataka, India Databricks Full time

    Unlock the Power of Data GovernanceDatabricks is seeking a highly skilled Senior Software Architect to join our Money team in Bengaluru, India. As a key member of our engineering team, you will be responsible for designing and managing critical components of our products, including resource admission control and usage governance infrastructure.Your...

  • Azure Databricks Lead

    2 weeks ago


    Bengaluru, Karnataka, India Ahvi Infotech Full time

    About the JobAt Ahvi Infotech, we are seeking an experienced Lead - Azure Databricks to join our team of data professionals.Key Responsibilities:Design and develop ETL/data warehouse transformation processesBuild data pipelines using Azure Data Factory and Apache Spark (Databricks)Evaluate performance and applicability of multiple tools against customer...

  • Big Data Architect

    5 months ago


    Bengaluru, India Databricks Full time

    As a** Resident Solutions Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...


  • Bengaluru, Karnataka, India Databricks Full time

    Key Role in Databricks' Central Engineering TeamAs one of the first engineers for the Money team at Databricks India, you will play a crucial part in building a foundation for one of Databricks' most critical engineering teams. Your role will involve owning critical components that form the backbone of our products, starting with Databricks' resource...

  • Azure Databricks Lead

    2 weeks ago


    Bengaluru, Karnataka, India Ahvi Infotech Full time

    About the RoleAt Ahvi Infotech, we are seeking a highly skilled Azure Databricks Lead to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines using Azure Databricks.Key ResponsibilitiesDesign and implement data transformation processes using Azure...


  • Bengaluru, Karnataka, India Databricks Full time

    FEQ425R196As a Senior Solutions Architect, you will lead the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible data-driven outcomes through...


  • Bengaluru, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Azure Databricks

    3 weeks ago


    Bengaluru, India Ahvi Infotech Full time

    About the job Azure DatabricksPosition: Lead - Azure DatabricksOverall IT experience: 8 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouseSecondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, HyderabadEssential experience:Experience in building ETL / data warehouse transformation processes Direct...