Azure Data bricks

1 week ago

Pune, Maharashtra, India Cognizant Full time ₹ 15,00,000 - ₹ 28,00,000 per year

Job Summary

We are seeking a highly skilled Sr. Developer with 7 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks Unity Catalog Azure Data Lake Store Azure DevOps Python Databricks SQL Databricks Workflows and PySpark. Experience in Data Management Hedge Fund Accounting and Account Management is a plus. This hybrid role requires working during the day shift with no travel obligations.

Responsibilities

  • Develop and maintain scalable data solutions using Databricks Unity Catalog and Azure Data Lake Store to enhance data accessibility and security.
  • Collaborate with cross-functional teams to integrate Azure DevOps into the development lifecycle ensuring seamless deployment and continuous integration.
  • Utilize Python and PySpark to design and implement efficient data processing pipelines optimizing performance and reliability.
  • Create and manage Databricks SQL queries to extract transform and load data supporting business intelligence and analytics initiatives.
  • Oversee the execution of Databricks Workflows ensuring timely and accurate data processing to meet project deadlines.
  • Provide technical expertise and support to team members fostering a collaborative and innovative work environment.
  • Analyze complex data sets to identify trends and insights contributing to data-driven decision-making processes.
  • Ensure data quality and integrity by implementing robust validation and error-handling mechanisms.
  • Stay updated with the latest industry trends and technologies applying new knowledge to improve existing systems and processes.
  • Collaborate with stakeholders to understand business requirements and translate them into technical specifications.
  • Document technical designs processes and procedures to facilitate knowledge sharing and future reference.
  • Support the development of data management strategies aligning with organizational goals and objectives.
  • Contribute to the continuous improvement of development practices enhancing efficiency and effectiveness.

Qualifications

  • Demonstrate proficiency in Databricks Unity Catalog Azure Data Lake Store and Azure DevOps.
  • Exhibit strong programming skills in Python and PySpark for data processing and analysis.
  • Possess experience in Databricks SQL and Workflows for data management and analytics.
  • Have a background in Data Management Hedge Fund Accounting or Account Management as a plus.
  • Show ability to work in a hybrid model with excellent communication and collaboration skills.

Certifications Required

  • Databricks Certified Data Engineer Associate Microsoft Certified: Azure Data Engineer Associate

  • Azure Data Engineer

    7 days ago

    Pune, Maharashtra, India Innovative Information Technologies, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Position: Azure Data EngineerExperience: 5+ YearsLocations:    Pune, India ( Onsite )Job Description:We are looking for a seasonal Azure Cloud EngineerBanking domain expertise is a good to haveDevelop data ingestion & enrichment and model development/execution on Azure cloudHelp us build state of the art solutions that underpin monitoring &...

  • Azure Data Engineer

    1 week ago

    Pune, Maharashtra, India airisDATA Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Position: Azure Data EngineerExperience: 5+ YearsLocations:    PuneNotice: Immediate to 30 daysJob Description:We are looking for a seasonal Azure Cloud Engineer· Develop data ingestion & enrichment and model development/execution onAzure cloud· Help us build state of the art solutions that underpin monitoring & surveillance models and alert...

  • Azure Data Engineer

    2 weeks ago

    Pune, Maharashtra, India GC Technologies Pvt Ltd Full time

    Data Engineer Location: Pune -WFONP :15days Experience : 5+yrs Budget: Max 12 LPAPayroll: Prontoex Consulting Services Pvt Ltd End Clinet: Comsense Technologies Private Limited , 7th Floor Property bearing No.465/E1, Park Plaza, Indi Qube, CTS-1085, Ganeshkhind Rd, Shivajinagar, Pune, Maharashtra 411005 JD : Minimum Qualification Bachelor's degree in...

  • Azure Data QA Engineer

    4 days ago

    Pune, Maharashtra, India Weekday AI Full time

    This role is for one of Weekday's clientsMin Experience: 4 yearsLocation: Pune, BangaloreJobType: full-timeRequirementsWe are looking for a highly skilled Azure Data QA Engineer to join our team on a contractual basis (1 year). This role is based in Pune or Bangalore (Hybrid working), and we are seeking candidates who can join immediately or within a short...

  • Quick joiners-Microsoft Azure Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Quick joiners for Digital : Microsoft Azure Data Engineer.Experience: 5-8yearsLocation: PuneMust have: Fabric/ADF & SQL, Azure Data Fabric, PySpark, data bricks.

  • Quick joiners-Microsoft Azure Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Quick joiners for Digital : Microsoft Azure Data Engineer. Experience: 5-8years Location: Pune Must have: Fabric/ADF & SQL, Azure Data Fabric, PySpark, data bricks.

  • Quick joiners-Microsoft Azure Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Quick joiners for Digital : Microsoft Azure Data Engineer.Experience: 5-8yearsLocation: PuneMust have: Fabric/ADF & SQL, Azure Data Fabric, PySpark, data bricks.

  • Azure Data Engineer

    2 weeks ago

    Pune, Maharashtra, India GC Technologies Pvt Ltd Full time

    Data EngineerLocation: Pune -WFONP :15daysExperience : 5+yrsBudget: Max 12 LPAPayroll: Prontoex Consulting Services Pvt LtdEnd Clinet: Comsense Technologies Private Limited , 7th Floor Property bearing No.465/E1, Park Plaza, IndiQube, CTS-1085, Ganeshkhind Rd, Shivajinagar, Pune, Maharashtra 411005JD :Minimum Qualification- Bachelor's degree in Computer...

  • Azure Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Fusion Plus Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    JD:a bachelors degree or higher in Computer Science/ Engineering/ Science data engineer with 10+ years of experience, having 4+ experience in Azure cloud native services. Experience in Azure Data Bricks (Scala/Python), ADLS Gen2, Azure SQL Database, SQL/T-SQL, Azure Services like Azure Data Factory Understanding on different monitoring and logging solutions...

  • Azure Data Quality Expert

    4 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,32,000

    Job Title: Data Quality Engineer for Azure EcosystemRole Description:This role is centered around validating and ensuring the quality of mission-critical data systems. As a seasoned Data Quality Assurance professional, you will play a crucial part in delivering enterprise-scale data solutions while collaborating closely with engineering, product, and...