Lead - Azure Databricks, Pyspark, SQL

2 months ago


india Infogain Full time

Position: Lead - Azure Databricks

Overall IT experience: 9 to 13 years

Primary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse

Secondary Skills: U-SQL, Spark, Scala, Python

Work Location: Bengaluru, Pune, Mumbai, Noida, Gurugram

Mode of work: Hybrid at Infogain office locations mentioned above

Notice Period: 0 to 30 Days


Essential experience:

Experience in building ETL / data warehouse transformation processes.

Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).

Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala).

Evaluating the performance and applicability of multiple tools against customer requirements. Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

Coding complex U-SQL, Spark (Scala or Python), T-SQL.

Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks).


  • Azure Data Lead

    2 months ago


    Anywhere in India/Multiple Locations, IN Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech LeadJob Description :- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in creating...

  • Azure Data Lead

    2 months ago


    Anywhere in India/Multiple Locations Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech Lead Job Description : - Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in...

  • Azure Data Lead

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech LeadJob Description :- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in creating...

  • Azure Data Lead

    3 weeks ago


    Anywhere in India/Multiple Locations Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech Lead Job Description : - Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in...

  • Databricks Engineer

    1 month ago


    india Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud. Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company : We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science...

  • Databricks Engineer

    5 days ago


    india Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud. Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company : We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science...


  • india Notus Full time

    Job Title : Azure Databricks Engineer Location : Pan India Job Type : Immediate to 15-Day Joiner Experience Level : 6+ Years Job Summary : We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory,...


  • Anywhere in India/Multiple Locations/Bangalore, IN Notus Full time

    Job Title : Azure Databricks EngineerLocation : Pan IndiaJob Type : Immediate to 15-Day JoinerExperience Level : 6+ YearsJob Summary :We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory, Azure...


  • Anywhere in India/Multiple Locations/Bangalore, IN Notus Full time

    Job Title : Azure Databricks EngineerLocation : Pan IndiaJob Type : Immediate to 15-Day JoinerExperience Level : 6+ YearsJob Summary :We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory, Azure...


  • Anywhere in India/Multiple Locations/Bangalore Notus Full time

    Job Title : Azure Databricks Engineer Location : Pan India Job Type : Immediate to 15-Day Joiner Experience Level : 6+ Years Job Summary : We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory,...


  • Anywhere in India/Multiple Locations/Bangalore Notus Full time

    Job Title : Azure Databricks Engineer Location : Pan India Job Type : Immediate to 15-Day Joiner Experience Level : 6+ Years Job Summary : We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory,...

  • Azure Data Lead

    6 days ago


    India Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech Lead Job Description : Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,) Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity. Experience in creating...


  • Anywhere in India/Multiple Locations, IN Optivalue tek consulting Full time

    Key Responsibilities :- Work on client projects to deliver AWS, PySpark, Databricks based Data engineering & Analytics solutions. - Build and operate very large data warehouses or data lakes. - ETL optimization, designing, coding, & tuning big data processes using Apache Spark. - Build data pipelines & applications to stream and process datasets at low...


  • Anywhere in India,Multiple Locations Optivalue tek consulting Full time

    Key Responsibilities :- Work on client projects to deliver AWS, PySpark, Databricks based Data engineering & Analytics solutions. - Build and operate very large data warehouses or data lakes. - ETL optimization, designing, coding, & tuning big data processes using Apache Spark. - Build data pipelines & applications to stream and process datasets at low...


  • Anywhere in India/Multiple Locations Optivalue tek consulting Full time

    Key Responsibilities :- Work on client projects to deliver AWS, PySpark, Databricks based Data engineering & Analytics solutions. - Build and operate very large data warehouses or data lakes. - ETL optimization, designing, coding, & tuning big data processes using Apache Spark. - Build data pipelines & applications to stream and process datasets at low...


  • Anywhere in India/Multiple Locations, IN Optivalue tek consulting Full time

    Key Responsibilities :- Work on client projects to deliver AWS, PySpark, Databricks based Data engineering & Analytics solutions. - Build and operate very large data warehouses or data lakes. - ETL optimization, designing, coding, & tuning big data processes using Apache Spark. - Build data pipelines & applications to stream and process datasets at low...

  • Data Engineer

    2 months ago


    india HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data...


  • Anywhere in India/Multiple Locations/Hyderabad/Bangalore/Pune/Mumbai/Chennai BRISKWIN IT SOLUTIONS PRIVATE LIMITED Full time

    Position/Role : Azure data bricks with Pyspark/Spark/Python and SQLExperience : 6-12 yrsLocation : Hyderabad/Bangalore/Pune/Mumbai/Chennai (Hybrid)Job Overview :Primary Skills : Databricks with Pyspark/Spark/ Python and SQLSecondary skills : ADF Job Description : 7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/...


  • india Tredence Inc. Full time

    MUST HAVE • Minimum of 4 to 8 years of Azure DE experience. • In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc. • Experience in collaborating with business stakeholders to identify and meet data requirements • Experience in using Azure services and tools to ingest, egress, and transform data...

  • Azure Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Vikisol Technologies Full time

    Azure Data Engineer Opportunity : Remote Exp : 5+ years Location : Remote Skills : - Azure Databricks- Azure ADF- PySpark- Python- SQL Responsibilities : - Collaborate on ETL data requirements.- Design and optimize data pipelines (Azure Databricks, ADF).- Develop PySpark scripts for efficient data processing.- Ensure ETL tasks' performance and...