Azure Databricks

4 weeks ago

Pune, Maharashtra, India People Prime Worldwide Full time
Our client is a global technology company headquartered in Santa Clara, California. it focuses on helping organisations harness the power of data to drive digital transformation, enhance operational efficiency, and achieve sustainability. over 100 years of experience in operational technology (OT) and more than 60 years in IT to unlock the power of data from your business, your people and your machines. We help enterprises store, enrich, activate and monetise their data to improve their customers' experiences, develop new revenue streams and lower their business costs. Over 80% of the Fortune 100 trust our client for data solutions.

The company's consolidated revenues for fiscal 2024 (ended March 31, 2024). approximately $57.5 billion USD., and the company has approximately 296,000 employees worldwide. It delivers digital solutions utilising Lumada in five sectors, including Mobility, Smart Life, Industry, Energy and IT, to increase our customers' social, environmental and economic value.

Job Title: Azure Databricks

Location: Pune

Experience: 4-9Years

Job Type : Contract to hire.

Notice Period: Immediate joiners.

Mandatory Skills: Azure Functionapp, Azure Databricks,pyspark.

JD : Primary Skill- Azure Functionapp, Azure Databricks (pyspark) good experience.

Secondary skill- SQL,T-sql, Data Lake Storage, Synapse, Event Hubs, Key Vault

Key Responsibilities:

• Design and implement scalable data pipelines using Azure Databricks (PySpark/Scala).

• Develop and deploy Azure Function Apps for event-driven data processing and automation.

• Integrate Databricks with other Azure services like Data Lake Storage, Synapse, Event Hubs, Key Vault, etc.

• Optimize Spark jobs for performance and cost-efficiency.

• Implement CI/CD pipelines using Azure DevOps for Databricks notebooks and Function Apps.

• Monitor and troubleshoot production workloads, ensuring high availability and reliability.

• Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions.

Required Skills & Qualifications:

• Strong experience with Azure Databricks and Apache Spark (PySpark or Scala).

• Proficiency in developing Azure Function Apps using C#, Python, or JavaScript.

• Solid understanding of Azure Data Lake, Event Hubs, Blob Storage, and Key Vault.

• Experience with CI/CD pipelines, Git, and Infrastructure as Code (ARM/Bicep/Terraform).

• Familiarity with data modeling, ETL/ELT processes, and data governance.

• Strong problem-solving skills and ability to work in an agile environment.

Preferred Qualifications:

• Microsoft Certified: Azure Data Engineer Associate or similar certifications.

• Experience with Delta Lake, MLflow, or Unity Catalog.

-
• Knowledge of monitoring tools like Azure Monitor, Log Analytics, and Application Insights.

  • Azure Databricks

    3 weeks ago

    Pune, Maharashtra, India Phygital Insights Private Limited Full time

    Job DescriptionDescriptionWe are seeking an experienced Azure Databricks professional to join our team in India. The ideal candidate will have a strong background in data engineering and be proficient in leveraging Azure Databricks to build robust data solutions.Responsibilities- Design and implement data pipelines using Azure Databricks to process large...

  • Azure Databricks Developer

    3 weeks ago

    Pune, Maharashtra, India People Prime World Wide Full time

    About Client :Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.7 Billion USD, with Global work force of 3,50,000 and Listed in NASDAQ, It is one of the leading IT services firms globally, known for its work in digital transformation, technology consulting, and business process outsourcing, Business Focus...

  • Pyspark Azure Databricks

    4 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from Tata Consulting ServicesTCS is Hiring for Pyspark DatabricksExperience : 6- 10 Years Location: Pune onlyPlease find the JD belowRequired Technical Skill - Pyspark DatabricksData Engineer with professional experience on Databricks, managing data pipelines and infrastructure within Databricks Lake house Platform.Proven expertise in Databricks,...

  • Azure Databricks Architect

    4 weeks ago

    Pune, Maharashtra, India Persistent Systems Full time

    About Position:We are hiring for skilled Azure Databrick Architect with 12 to 17 Years of experience in python, sql.- Role: Azure Databricks Architect- Location: All Persistent Locations- Experience: 12 to 17 years- Job Type: Full Time EmploymentWhat You'll Do:- 12+ years of experience in data architecture, data engineering, or analytics.- 5+ years of...

  • Azure Databricks Architect

    4 weeks ago

    Pune, Maharashtra, India Persistent Systems Full time

    About Position: We are hiring for skilled Azure Databrick Architect with 12 to 17 Years of experience in python, sql. Role: Azure Databricks Architect Location: All Persistent Locations Experience: 12 to 17 years Job Type: Full Time Employment What You'll Do: 12+ years of experience in data architecture, data engineering, or analytics. 5+ years of...

  • Azure Databricks Architect

    1 day ago

    Pune, Maharashtra, India Persistent Systems Full time

    About Position: We are hiring for skilled Azure Databrick Architect with 12 to 17 Years of experience in python, sql. Role: Azure Databricks Architect Location: All Persistent Locations Experience: 12 to 17 years Job Type: Full Time Employment What You'll Do: 12+ years of experience in data architecture, data engineering, or analytics. 5+ years of...

  • Big Data Engineer

    3 hours ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Data Engineer PositionWe are seeking a highly skilled data engineer to spearhead the development of robust data solutions using Azure Databricks. The ideal candidate will possess a strong background in data engineering and be proficient in leveraging Apache Spark to build efficient data pipelines.Responsibilities include:Data Pipeline Development: Design,...

  • Data Architectuur specialist Databricks/Azure

    24 hours ago

    Pune, Maharashtra, India beBeeDatabriksspecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    Wij zoeken een expert in data engineering die ervaring heeft met Databricks en Azure. Deze professional zal onze organisatie helpen bij het ontwerpen van gegevensarchitecturen die de behoeften van klanten voldoen.Verantwoordelijkheden:Ontwerp en implementeer gegevensarchitecturen voor grote datasetsImplementeer data pipelines voor automatische...

  • Azure Databricks Data Ingestion Expert

    1 day ago

    Pune, Maharashtra, India beBeeDataIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Overview:Azure Databricks Data Ingestion SpecialistWe are seeking a highly skilled Data Ingestion Specialist with expertise in CI/CD and Kubernetes to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.Design, develop, and optimize data ingestion pipelines for...

  • Databricks Lead

    2 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Senior Databricks Engineer OpportunityWe're seeking a seasoned Databricks expert to lead our Azure data engineering projects.Develop scalable data pipelines with Databricks, PySpark & Spark SQLImplement & manage Delta Lake & modern data lakehouse architectureConfigure & administer Databricks (Workspace, Jobs, DLT, Unity Catalog)Design CI/CD pipelines using...