Azure Databricks with Pyspark

2 days ago


Hinjawadi Pune Maharashtra, India BirlaSoft Full time

Country/Region: IN
- Requisition ID: 20387
- Work Model:

- Position Type:

- Salary Range:

- Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI

**Title**:Azure Databricks with Pyspark**:

- Description:

**Area(s) of responsibility**:
Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a multibillion-dollar enterprise, we boast a 12,500+ professional team committed to upholding the Group's 162-year legacy. Our core values prioritize Diversity, Equity, and Inclusion (DEI) initiatives, along with Corporate Sustainable Responsibility (CSR) activities, demonstrating our dedication to building inclusive and sustainable communities. Join us in shaping a future where technology seamlessly aligns with purpose.

**Azure Data Engineer with Databricks and PySpark**

**Years of experience 8 to 10 Years**
- Experience in Perform Design, Development & Deployment using Azure Services (**Databricks, PySpark**, SQL, Data Factory,)
- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.
- Experience in creating **Technical Specification Design**, Application Interface Design.
- Developing Modern Data Warehouse solutions using Azure Stack (**Azure Data Lake**, **Azure Databricks) and PySpark**:

- Develop batch processing and integration solutions and process Structured and Non-Structured Data
- Demonstrated in-depth skills with **Azure Databricks and PySpark,** and SQL
- Collaborate and engage with BI & analytics and the business team.
- Minimum 2 to 3 year of Project experience in Azure Databricks
- Minimum 2-3 years of experience in ADF
- Minimum 2+ years of experience in PySpark

**Location: Mumbai, Pune, Noida, Bangalore



  • Hinjawadi, Pune, Maharashtra, India BirlaSoft Full time

    Country/Region: IN- Requisition ID: 19901- Work Model: - Position Type: - Salary Range: - Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI**Title**:Azure Databricks with Pyspark**: - Description: **Area(s) of responsibility**: Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business...


  • Pune, India Hoonar Tekwurks Private Limited Full time

    Job Title : Azure Databricks LeadJob Overview :As an Azure Databricks Lead/Specialist, you will play a critical role in designing, implementing, and optimizing data solutions using Azure Databricks. Your expertise will contribute to building robust data pipelines, ensuring data quality, and enhancing overall performance. You'll collaborate with...


  • Pune, Maharashtra, India Hoonar Tekwurks Private Limited Full time

    Job Title: Azure Databricks Technical LeadThe ideal candidate for this role will have a minimum of 5 years of experience architecting and building data platforms on Azure. With expertise in Azure Databricks, PySpark, and SQL, the selected individual will play a critical role in designing, implementing, and optimizing data solutions using Azure Databricks.Our...

  • Azure Data Architect

    2 weeks ago


    Hinjawadi, Pune, Maharashtra, India BirlaSoft Full time

    Country/Region: IN- Requisition ID: 19799- Work Model: - Position Type: - Salary Range: - Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI**Title**:Azure Data Architect**: - Description: **Short Description**: **About Birlasoft**: Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine...


  • Pune, Maharashtra, India Hoonar Tekwurks Private Limited Full time

    Job Title: Lead Data Engineer for Azure DatabricksWe are seeking an experienced Lead Data Engineer to join our team at Hoonar Tekwurks Private Limited. The ideal candidate will have a strong background in designing and implementing data solutions using Azure Databricks and a minimum of 5 years of experience working with data platforms on Azure.Our estimated...

  • Data Engineer

    2 weeks ago


    Pune/Hyderabad, India EDGESOFT Full time

    Job Description : The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...


  • Pune, India ACL Digital Full time

    Technical skills and competenciesWe are looking for a Machine Learning Engineer to focus on training and retraining existing ML models using Databricks, hosted entirely on the Azure cloud platform. The role involves creating and managing automated workflows for model retraining and integrating with BigQuery for data extraction and preprocessing. The ideal...

  • Azure Databricks

    4 weeks ago


    Mumbai, Maharashtra, India Virtusa Full time

    Key Responsibilities: Azure Data Engineering: Design, develop, and maintain data pipelines and data workflows using Azure Databricks, ADLS Gen2, and Pyspark for data processing and transformation. Business Analysis & Requirements Gathering: Collaborate with clients to understand their business requirements and translate them into technical solutions. Work...

  • Data Engineer

    3 weeks ago


    Pune, Maharashtra, India Tata Consultancy Services Full time

    Welcome to this exciting opportunity at Tata Consultancy Services! As a seasoned Data Engineer, you will play a pivotal role in shaping our client's data strategy using cutting-edge technologies.Job Title: Data Engineer - Azure Databricks ExpertEstimated Salary: ₹1,200,000 - ₹2,400,000 per annumLocation: Bangalore and PuneWe are looking for an...


  • Pune, Maharashtra, India ACL Digital Full time

    ACL Digital is seeking a highly skilled Data Science Engineer to lead the development of machine learning models on Azure Databricks. With a strong background in data engineering and machine learning, this individual will design, implement, and maintain large-scale data pipelines using Databricks on Azure.About the Role:We are looking for an experienced...


  • Pune, India ACL Digital Full time

    Technical skills and competenciesWe are looking for a Machine Learning Engineer to focus on training and retraining existing ML models using Databricks, hosted entirely on the Azure cloud platform. The role involves creating and managing automated workflows for model retraining and integrating with BigQuery for data extraction and preprocessing. The ideal...


  • Pune, India ACL Digital Full time

    Technical skills and competenciesWe are looking for a Machine Learning Engineer to focus on training and retraining existing ML models using Databricks, hosted entirely on the Azure cloud platform. The role involves creating and managing automated workflows for model retraining and integrating with BigQuery for data extraction and preprocessing. The ideal...


  • Pune, India ACL Digital Full time

    Technical skills and competencies We are looking for a Machine Learning Engineer to focus on training and retraining existing ML models using Databricks, hosted entirely on the Azure cloud platform. The role involves creating and managing automated workflows for model retraining and integrating with BigQuery for data extraction and preprocessing. The ideal...

  • Azure databricks

    6 days ago


    Pune, India LTIMindtree Full time

    LTIMindtree is looking for Databricks-Spark SQL-Scala/Python/Java Total Experience- 12 to 16 Years Job Location- Pan India MANDATORY Azure Databricks Experts with Python and Time series processing experience Design construct install test and maintain highly scalable data management systems using Azure Databricks Develop data processing pipelines...

  • Azure Databricks

    4 weeks ago


    Pune, India LTIMindtree Full time

    LTIMindtree is looking for Databricks-SparkSQL-Scala/Python/JavaTotal Experience- 12 to 16 YearsJob Location- Pan IndiaMANDATORY Azure Databricks Experts with Python and Time series processing experienceDesign construct install test and maintain highly scalable data management systems using Azure DatabricksDevelop data processing pipelines using Databricks...

  • Solution Architect

    6 months ago


    Hinjawadi, Pune, Maharashtra, India BirlaSoft Full time

    Country/Region: IN- Requisition ID: 7975- Work Model: - Position Type: - Salary Range: - Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI**Title**:Solution Architect**: - Description: - Azure Data Architect Experience: 14 to 16 Years, 3+ Years of experience in Azure Data Architect - Cloud Architect with experience in Azure ADF, Databricks, PySpark -...

  • Solution Architect

    6 months ago


    Hinjawadi, Pune, Maharashtra, India BirlaSoft Full time

    Country/Region: IN- Requisition ID: 13410- Work Model: - Position Type: - Salary Range: - Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI**Title**:Solution Architect**: - Description: - Azure Data Architect Experience: 14 to 16 Years, 3+ Years of experience in Azure Data Architect - Cloud Architect with experience in Azure ADF, Databricks, PySpark...

  • Azure databricks

    3 weeks ago


    Pune, India LTIMindtree Full time

    LTIMindtree is looking for Databricks-Spark SQL-Scala/Python/JavaTotal Experience- 12 to 16 YearsJob Location- Pan IndiaMANDATORY Azure Databricks Experts with Python and Time series processing experienceDesign construct install test and maintain highly scalable data management systems using Azure DatabricksDevelop data processing pipelines using Databricks...


  • Pune, India Evnek Technologies Full time

    Job Description : Data Engineer. Location : Pune, India (Work from Office). Experience : 5+ Years. Notice Period : Immediate Joiner. Job Type : Contract. Role Overview : We are seeking an experienced Data Engineer with over 5 years of experience to join our team in Pune. The ideal candidate will be an expert in SQL, with at least 3 years of hands-on...

  • Azure Databricks

    4 weeks ago


    Pune, India LTIMindtree Full time

    LTIMindtree is looking for Databricks-SparkSQL-Scala/Python/Java Total Experience- 12 to 16 Years Job Location- Pan India MANDATORY Azure Databricks Experts with Python and Time series processing experience Design construct install test and maintain highly scalable data management systems using Azure Databricks Develop data processing pipelines...