Azure Databricks with Pyspark

2 weeks ago

Hinjawadi Pune Maharashtra, India BirlaSoft Full time

Country/Region: IN
- Requisition ID: 20387
- Work Model:

- Position Type:

- Salary Range:

- Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI

**Title**:Azure Databricks with Pyspark**:

- Description:

**Area(s) of responsibility**:
Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a multibillion-dollar enterprise, we boast a 12,500+ professional team committed to upholding the Group's 162-year legacy. Our core values prioritize Diversity, Equity, and Inclusion (DEI) initiatives, along with Corporate Sustainable Responsibility (CSR) activities, demonstrating our dedication to building inclusive and sustainable communities. Join us in shaping a future where technology seamlessly aligns with purpose.

**Azure Data Engineer with Databricks and PySpark**

**Years of experience 8 to 10 Years**
- Experience in Perform Design, Development & Deployment using Azure Services (**Databricks, PySpark**, SQL, Data Factory,)
- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.
- Experience in creating **Technical Specification Design**, Application Interface Design.
- Developing Modern Data Warehouse solutions using Azure Stack (**Azure Data Lake**, **Azure Databricks) and PySpark**:

- Develop batch processing and integration solutions and process Structured and Non-Structured Data
- Demonstrated in-depth skills with **Azure Databricks and PySpark,** and SQL
- Collaborate and engage with BI & analytics and the business team.
- Minimum 2 to 3 year of Project experience in Azure Databricks
- Minimum 2-3 years of experience in ADF
- Minimum 2+ years of experience in PySpark

**Location: Mumbai, Pune, Noida, Bangalore

  • PySpark, Azure Databricks, ADF, Azure Synapse

    2 weeks ago

    Pune, India Amazure Technologies Pvt Ltd Full time

    Detailed JD (Roles and Responsibilities) Design and develop scalable ETL pipelines using Azure Databricks, PySpark, and Azure Data Factory to ingest, transform, and integrate data from multiple internal and external sources.Ensure data quality, consistency, and reliability across complex data workflows and large-scale datasets.Collaborate with data...

  • PySpark, Azure Databricks, ADF, Azure Synapse

    2 weeks ago

    Pune, India Amazure Technologies Pvt Ltd Full time

    Detailed JD (Roles and Responsibilities)   Design and develop scalable ETL pipelines using Azure Databricks, PySpark, and Azure Data Factory to ingest, transform, and integrate data from multiple internal and external sources. Ensure data quality, consistency, and reliability across complex data workflows and large-scale datasets. Collaborate with data...

  • PySpark, Azure Databricks, ADF, Azure Synapse

    2 weeks ago

    Pune, India Amazure Technologies Pvt Ltd Full time

    Detailed JD (Roles and Responsibilities)   Design and develop scalable ETL pipelines using Azure Databricks, PySpark, and Azure Data Factory to ingest, transform, and integrate data from multiple internal and external sources. Ensure data quality, consistency, and reliability across complex data workflows and large-scale datasets. Collaborate with data...

  • PySpark, Azure Databricks, ADF, Azure Synapse

    2 weeks ago

    Pune, India Amazure Technologies Pvt Ltd Full time

    Detailed JD (Roles and Responsibilities)   Design and develop scalable ETL pipelines using Azure Databricks, PySpark, and Azure Data Factory to ingest, transform, and integrate data from multiple internal and external sources. Ensure data quality, consistency, and reliability across complex data workflows and large-scale datasets. Collaborate with data...

  • PySpark, Azure Databricks, ADF, Azure Synapse

    2 weeks ago

    Pune, India Amazure Technologies Pvt Ltd Full time

    Detailed JD (Roles and Responsibilities) - Design and develop scalable ETL pipelines using Azure Databricks, PySpark, and Azure Data Factory to ingest, transform, and integrate data from multiple internal and external sources. - Ensure data quality, consistency, and reliability across complex data workflows and large-scale datasets. - Collaborate with data...

  • PySpark, Azure Databricks, ADF, Azure Synapse

    2 weeks ago

    Pune, India Amazure Technologies Pvt Ltd Full time

    Detailed JD (Roles and Responsibilities)- Design and develop scalable ETL pipelines using Azure Databricks, PySpark, and Azure Data Factory to ingest, transform, and integrate data from multiple internal and external sources.- Ensure data quality, consistency, and reliability across complex data workflows and large-scale datasets.- Collaborate with data...

  • PySpark, Azure Databricks, ADF, Azure Synapse

    2 weeks ago

    Pune, India Amazure Technologies Pvt Ltd Full time

    Detailed JD (Roles and Responsibilities)- Design and develop scalable ETL pipelines using Azure Databricks, PySpark, and Azure Data Factory to ingest, transform, and integrate data from multiple internal and external sources.- Ensure data quality, consistency, and reliability across complex data workflows and large-scale datasets.- Collaborate with data...

  • Azure Databricks

    4 days ago

    Pune, Maharashtra, India Cognizant Technology Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Description - ExternalJob Title: - Azure DatabricksLocation: AIA-CoimbatoreMinimum 3 to 6 years of experienceMandatory Skills: Azure Databricksstrong experience in Azure Databricks and PysparkProficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources.Good experience in SQL or native SQL query...

  • Azure Databricks Engineer

    2 weeks ago

    Pune, Maharashtra, India Savi Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Opening: Azure Databricks EngineerLocation: Pune, Maharashtra (Onsite)Experience Range: 5-6 YearsApply at: -Required Skills:Azure Data Factory (ADF)PySparkAzure Databricks (ADB)SQLJob Description:We're looking for an experienced Azure Databricks Engineer with a background in financial crime analytics and hands-on expertise in:Databricks engineering &...

  • Azure Databricks

    2 days ago

    Pune, Maharashtra, India Cognizant Full time

    AIA-Pune **Job Summary** **Responsibilities** - Develop and maintain scalable data processing systems using Python and PySpark to enhance data analytics capabilities. - Collaborate with cross-functional teams to design and implement Databricks Workflows that streamline data operations. - Optimize Databricks SQL queries to improve data retrieval...