Lead - Azure Databricks, Pyspark, Sql

3 weeks ago


Bangalore City, India Infogain Full time

Position: Lead Azure DatabricksOverall IT experience: 9 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: Hybrid at Infogain office locations mentioned aboveNotice Period: 0 to 30 DaysEssential experience:Experience in building ETL / data warehouse transformation processes. Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks). Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala). Evaluating the performance and applicability of multiple tools against customer requirements. Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints. Coding complex U-SQL, Spark (Scala or Python), T-SQL.Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks).


  • Databricks Engineer

    2 weeks ago


    Bangalore/Chennai/Delhi NCR/Pune/Kolkata, India Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud. Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company : We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science...

  • Databricks Engineer

    2 weeks ago


    Bangalore/Chennai/Delhi NCR/Pune/Kolkata, IN Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud.Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company :We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and...

  • ETL Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • ETL Data Engineer

    4 weeks ago


    Bangalore, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...


  • bangalore, India Horigine Consulting Pvt. Ltd Full time

    Description We are seeking a highly skilled and experienced Azure Databricks Developer with expertise in PySpark and SparkSQL. As an Azure Databricks Developer, you will be responsible for designing, developing, and implementing data processing solutions using PySpark and SparkSQL. You will work closely with our team to understand business requirements and...


  • Anywhere in India/Multiple Locations/Bangalore, IN Notus Full time

    Job Title : Azure Databricks EngineerLocation : Pan IndiaJob Type : Immediate to 15-Day JoinerExperience Level : 6+ YearsJob Summary :We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory, Azure...


  • Anywhere in India/Multiple Locations/Bangalore Notus Full time

    Job Title : Azure Databricks Engineer Location : Pan India Job Type : Immediate to 15-Day Joiner Experience Level : 6+ Years Job Summary : We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory,...

  • Data Engineer

    2 months ago


    Bangalore, India Career Soft Solutions Full time

    Job Description : - 3+ years of relevant experience in Pyspark and Azure Databricks.- Proficiency in integrating, transforming and consolidating data from various structured and -unstructured data sources.- Good experience in SQL or native SQL query languages.- Strong experience in implementing Databricks notebooks using Python.- Good experience in Azure...


  • Bangalore, India codersbrain Full time

    We have an opening for Azure Databricks.Experience : 6 to 12 yrsLocation : BangaloreInterview : Face to face interview on 2nd and 3rd MarchMandatory Skills :- Azure Data Factory- Python- Pyspark- SQL- Azure Data LakeJob Description :- Around 7 to 9 yrs of IT experience with at least 5 yrs in ETL/Pipeline Development using tools such as Azure...


  • Bangalore, India VIDPRO CONSULTANCY SERVICES Full time

    Primary Roles and Responsibilities :- Developing Modern Data Warehouse solutions using Databricks and AWS/ AzureStack.- Ability to provide solutions that are forward-thinking in data engineering and analytics space.- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix...

  • Azure Data Engineer

    2 months ago


    Bangalore, India Rocket Consulting Full time

    Total Experience : 6+ yrsWork Location : BangaloreRole : Lead ConsultantShift: UK ShiftJob Description :- Relevant experience in Azure data engineering: 4 + years.- Relevant experience in SQL : 4 years.- Mandatory Skills : Databricks, PySpark/Scala/SparkSQL ,Azure Synapse, Data Factory, Azure Data Lake Storage, Azure SQL databases,Azure analysis services-...

  • Data Scientist

    1 month ago


    bangalore, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...

  • Azure Data Engineer

    2 weeks ago


    bangalore, India Manvision Technologies Full time

    PySpark Development experience, especially in Spark SQL and Complex Transformations Python development experience Experience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Databases Azure Skills Must have working experience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL Databases Azure DevOps Azure AD Integration,...

  • Data Scientist

    4 weeks ago


    Bangalore, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...


  • bangalore, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...


  • bangalore, India Alp Consulting Limited Full time

    Detailed JD *(Roles and Responsibilities) Senior ETL tester having good experience working on SQL queries. Knowledge in DWH concepts, Agile, Azure data factory, Databricks, Pyspark Mandatory skills* ETL testing, SQL, Agile, Azure, Pyspark Desired skills* Functional testing, Automation, BI Reports testing Job Title: Hi...


  • bangalore, India Smart Consulting - Creating Future Leaders Full time

    Big 4 MNC Hiring for "Azure Databricks+Pyspark+Kubernetes" Location - Bangalore CTC - Upto 24 LPA Experience - 5+ Yrs Mandatory Skill - Azure, Databricks, Pyspark Good to Have - Kubernetes

  • Data Engineer

    2 weeks ago


    Bangalore, India WIZSTAFFING PRIVATE LIMITED Full time

    Job Description : We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer. Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver the fastest harvest-to-fork in the industry. Our endeavor is to leverage...

  • Data Engineer

    2 weeks ago


    bangalore, India WIZSTAFFING PRIVATE LIMITED Full time

    Job Description : We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer. Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver the fastest harvest-to-fork in the industry. Our endeavor is to leverage...

  • Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India WIZSTAFFING PRIVATE LIMITED Full time

    Job Description :We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer.Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver the fastest harvest-to-fork in the industry. Our endeavor is to leverage experience...