Azure Databricks with Pyspark

5 hours ago


Hinjawadi Pune Maharashtra, India BirlaSoft Full time

Country/Region: IN- Requisition ID: 19901- Work Model:
- Position Type:
- Salary Range:
- Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI**Title**:Azure Databricks with Pyspark**:

- Description:

**Area(s) of responsibility**:
Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a multibillion-dollar enterprise, we boast a 12,500+ professional team committed to upholding the Group's 162-year legacy. Our core values prioritize Diversity, Equity, and Inclusion (DEI) initiatives, along with Corporate Sustainable Responsibility (CSR) activities, demonstrating our dedication to building inclusive and sustainable communities. Join us in shaping a future where technology seamlessly aligns with purpose.

**Azure Data Engineer with Databricks and PySpark**

**Years of experience 8 to 10 Years**
- Experience in Perform Design, Development & Deployment using Azure Services (**Databricks, PySpark**, SQL, Data Factory,)
- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.
- Experience in creating **Technical Specification Design**, Application Interface Design.
- Developing Modern Data Warehouse solutions using Azure Stack (**Azure Data Lake**, **Azure Databricks) and PySpark**:

- Develop batch processing and integration solutions and process Structured and Non-Structured Data
- Demonstrated in-depth skills with **Azure Databricks and PySpark,** and SQL
- Collaborate and engage with BI & analytics and the business team.
- Minimum 2 to 3 year of Project experience in Azure Databricks
- Minimum 2-3 years of experience in ADF
- Minimum 2+ years of experience in PySpark

**Location: Mumbai, Pune, Noida, Bangalore



  • Pune, Maharashtra, India Avertis Infotech Pvt. Ltd. Full time US$ 90,000 - US$ 1,20,000 per year

    Company DescriptionAvertis Infotech Pvt. Ltd. is an IT services company that began as an application development company specializing in integrating high-tech healthcare machinery. Today, we have expanded our expertise to various industries, adapting to the evolving business landscape. Our goal is to provide innovative solutions and exceptional services to...


  • Noida, Mumbai, Pune, India Birlasoft Limited Full time

    Job DescriptionYears of experience 8 to 10 Years- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in creating Technical Specification Design,...


  • Pune, Maharashtra, India Wipro Full time US$ 1,00,000 - US$ 1,50,000 per year

    Role OverviewWe are looking for a seasoned Azure Data Engineer with strong experience in building and optimizing data pipelines, preferably on Azure. The candidate should be proficient in Databricks, Spark, and Python, and capable of designing scalable data solutions for big data analytics.Key ResponsibilitiesDesign, develop, and maintain ETL pipelines using...


  • Pune, Maharashtra, India IDESLABS PRIVATE LIMITED Full time US$ 1,20,000 - US$ 2,00,000 per year

    Responsibilities:designing, developing, and maintaining scalable data pipelines using Databricks, PySpark, Spark SQL, and Delta Live Tables.Collaborate with cross-functional teams to understand data requirements and translate them into efficient data models and pipelines.Implement best practices for data engineering, including data quality, and data...

  • Databricks-PySpark

    4 days ago


    Bengaluru, Kolkata, Pune, India Artech Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We are looking for a Senior Data Engineer with 6+ years of experience to design, build, and optimize scalable data solutions. The ideal candidate will have deep expertise in Databricks, Azure, Python, PySpark, Scala, ETL, and data governance. You will lead the development of efficient data pipelines and mentor junior engineers, ensuring operational...


  • Pune, Maharashtra, India Artech Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Role & responsibilitiesExpected to perform independently and become an SME.- Required active participation/contribution in team discussions.- Contribute in providing solutions to work related problems.- Assist in the documentation of application processes and workflows.- Engage in continuous learning to stay updated with the latest technologies and best...

  • Azure Databricks

    23 hours ago


    Pune, India Braincranx IT solutions Full time

    **Job description** Sr. Data Engineer (Spark / Pyspark & Azure Data Bricks) Skills - Data Engineering experience along with 2yrs Experience on Spark / Pyspark & Azure Data Bricks. Roles and Responsibilities Minimum 4+ years of Data Engineering experience. Experience as Data Engineer in PySpark/ Spark with Azure Dataricks Stream Analytics Experience with...

  • Azure Data Architect

    5 hours ago


    Hinjawadi, Pune, Maharashtra, India BirlaSoft Full time

    Country/Region: IN- Requisition ID: 19799- Work Model: - Position Type: - Salary Range: - Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI**Title**:Azure Data Architect**: - Description: **Short Description**: **About Birlasoft**: Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine...


  • Pune, Maharashtra, India People Prime World Wide Full time

    About Client :Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.7 Billion USD, with Global work force of 3,50,000 and Listed in NASDAQ, It is one of the leading IT services firms globally, known for its work in digital transformation, technology consulting, and business process outsourcing, Business Focus...

  • PySpark Developer

    7 days ago


    Bengaluru / Bangalore, Chennai, Pune, India beBeeData Full time US$ 1,04,000 - US$ 1,30,878

    Job SummaryWe are seeking a highly skilled PySpark expert with hands-on experience in Databricks to join our data engineering team. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform.Key Responsibilities:Develop and manage data pipelines using PySpark on...