Azure Databricks Engineer

1 week ago


pune, India RapidBraiins Full time

No. of openings - 10+

Primary Skill : SQL, Azure Databricks

Secondary Skills : PySpark, Azure Data Factory

Responsibilities :

As an Azure Data Engineer, your day-to-day work activities will be as follows :

- Design & develop the ETL

- Good experience in writing SQL, Python and PySpark programming

- Create the Pipelines (simple and complex) using ADF.

- Work with other Azure stack modules like Azure Data Lakes, SQL DW

- Must be extremely well versed with handling large volume of data.

- Understand the business requirements for Data flow process needs.

- Understand requirements, functional and technical specification documents.

- Development of mapping document and transformation business rules as per scope and requirements/Source to target.

- Responsible for continuous formal and informal communication on project status

- Good understanding of JIRA stories process for SQL development activities

Requirements :

Educational qualifications : Bachelor's/Master's

Candidates are required to have these mandatory skills :

- Overall, 6+ years of developer skills with SQL, Python with Spark (PySpark)

- Experience in Azure Data Factory, Data Sets, Data Frame, Azure Blob & Storage Explorer

- Implement data ingestion pipelines from multiple data sources using ADF, ADB (Azure data bricks)

- Experience in creating Data Factory Pipelines, custom Azure development, deployment, troubleshoot data load / extraction using ADF.

- Extensive experience on SQL, python, PySpark in Azure Databricks

- Able to write Python code in PySpark frame by using Dataframes

- Have good understanding on Agile/Scrum methodologies.

Location : Pune/Hyderabad

(ref:hirist.tech)

  • Pune, Maharashtra, India manogna it services private limited Full time

    Job Description :Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies. Expertise to Implementing Data warehousing Solutions.Experience as Data Engineer in Azure Data Bricks with design and solutioning. Strong Programming experience in Python, SQL Must have Strong technical experience in Azure...


  • Pune, Maharashtra, India Persistent Systems Full time

    About PositionPersistent is looking for Azure Databricks engineer who has strong experience in Cloud technologies and infra set up.Able to able data warehousing models.Role: Azure Databricks engineerLocation: All PSLExperience: 3- 6 yearsJob Type :FTEWhat You'll DoCloud technologies (Azure data services Azure ADLS SHIR ADF Integration with Active directory...


  • Pune, Maharashtra, India Persistent Systems Full time

    About PositionPersistent is looking for Azure Databricks engineer who has strong experience in Cloud technologies and infra set up. Able to able data warehousing models.Role: Azure Databricks engineerLocation: All PSLExperience: 3- 6 yearsJob Type: FTEWhat You'll DoCloud technologies (Azure data services Azure ADLS SHIR ADF Integration with Active directory...

  • Azure Databrick

    2 weeks ago


    Pune, Maharashtra, India Braincranx IT solutions Full time

    Job description Develop Azure Data Factory Objects ADF pipeline, configuration, parameters, variables, Integration services runtime Handson knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other servicesAzure Databricks: Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB...

  • Azure Databricks

    3 weeks ago


    Pune, India Nityo Infotech Full time

    17 hours ago **Job Code**: JD-19482 **JOB DESCRIPTION**: Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux **Experience Required**: 5 - 9 Years **Industry Type**: IT **Employment Type**: Permanent **Location**: India

  • Azure Databricks

    4 weeks ago


    Pune, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,LinuxExperience Required5 - 9 YearsIndustry TypeITEmployment TypePermanentLocationIndia

  • Azure Databricks

    2 weeks ago


    Pune, Maharashtra, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,LinuxExperience Required 9 YearsIndustry TypeITEmployment TypePermanentLocationIndia


  • Pune, India Persistent Systems Full time

    About PositionPersistent is looking for Azure Databricks engineer who has strong experience in Cloud technologies and infra set up. Able to able data warehousing models.Role: Azure Databricks engineerLocation: All PSLExperience: 3- 6 yearsJob Type: FTEWhat You'll DoCloud technologies (Azure data services Azure ADLS SHIR ADF Integration with Active directory...


  • Pune, India Persistent Systems Full time

    About PositionPersistent is looking for Azure Databricks engineer who has strong experience in Cloud technologies and infra set up. Able to able data warehousing models.Role: Azure Databricks engineerLocation: All PSLExperience: 3- 6 yearsJob Type: FTEWhat You'll DoCloud technologies (Azure data services Azure ADLS SHIR ADF Integration with Active directory...


  • pune, India Persistent Systems Full time

    About Position Persistent is looking for Azure Databricks engineer who has strong experience in Cloud technologies and infra set up. Able to able data warehousing models. Role: Azure Databricks engineer Location: All PSL Experience: 3- 6 years Job Type : FTE What You'll Do Cloud technologies (Azure data services Azure ADLS SHIR ADF Integration with...

  • Azure Databricks

    3 months ago


    Pune, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux Experience Required 5 - 9 Years Industry Type IT Employment Type Permanent Location India

  • Azure Databricks

    4 weeks ago


    Pune, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux Experience Required 5 - 9 Years Industry Type IT Employment Type Permanent Location India


  • Pune, India Fusemachines Full time

    About Fusemachines Fusemachines is a leading AI strategy, talent, and education services and products provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 400...

  • Azure Databricks

    3 months ago


    pune, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux Experience Required 5 - 9 Years Industry Type IT Employment Type Permanent Location India

  • Azure Databricks

    4 weeks ago


    pune, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux Experience Required 5 - 9 Years Industry Type IT Employment Type Permanent Location India

  • Data Engineer

    4 weeks ago


    Pune/Hyderabad, India HuQuo Full time

    Must-Have :- 4+ years of experience in Data Engineering experience on Azure and Databricks- Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required- Experience Developing and tuning Spark Application and SparkSQL queries-- Expertise to Implementing Data warehousing Solutions - Good understanding of Azure Databricks platform...

  • Data Engineer

    3 months ago


    Pune,Hyderabad, India HuQuo Full time

    Must-Have :- 4+ years of experience in Data Engineering experience on Azure and Databricks- Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required- Experience Developing and tuning Spark Application and SparkSQL queries-- Expertise to Implementing Data warehousing Solutions - Good understanding of Azure Databricks platform...


  • Pune, Maharashtra, India Fusemachines Full time

    About Fusemachines Fusemachines is a leading AI strategy, talent, and education services and products provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 400...


  • Pune, India Persistent Systems Full time

    About PositionPersistent is looking for Azure Databricks engineer who has strong experience in Cloud technologies and infra set up. Able to able data warehousing models.Role: Azure Databricks engineerLocation: All PSLExperience: 3- 6 yearsJob Type: FTEWhat You'll Do- Cloud technologies (Azure data services Azure ADLS SHIR ADF Integration with Active...

  • Azure Databricks

    2 weeks ago


    Pune, Maharashtra, India Nityo Infotech Full time

    17 hours agoJob Code:JD-19482JOB DESCRIPTION:Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,LinuxExperience Required:9 YearsIndustry Type:ITEmployment Type:PermanentLocation:India