Lead - Azure Databricks, Pyspark, Sql

1 week ago


Bengaluru, Karnataka, India Infogain Full time

Position:
Lead - Azure Databricks Overall IT experience: 9 to 13 years

Primary Skills:
Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse

Secondary Skills:
U-SQL, Spark, Scala,

Python Work Location:
Bengaluru, Pune, Mumbai, Noida, Gurugram Mode of work: Hybrid at Infogain office locations mentioned above
Notice Period: 0 to 30 Days Essential experience: Experience in building ETL / data warehouse transformation processes.

Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).

Experience with other Open-Source big data products Hadoop (incl.

Hive, Pig, Impala).

Evaluating the performance and applicability of multiple tools against customer requirements.


Working within an Agile delivery / Dev Ops methodology to deliver proof of concept and production implementation in iterative sprints.

Coding complex U-SQL, Spark (Scala or Python), T-SQL.

Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks).

  • Bengaluru, Karnataka, India Infogain Full time

    Job Title: Lead - Azure DatabricksCompany: InfogainYears of IT Experience: 9 to 13 yearsPrimary Skills:Azure DatabricksHadoopHivePigImpalaETLData warehouseSecondary Skills:U-SQLSparkScalaPythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of Work: Hybrid at Infogain office locations mentioned aboveNotice Period: 0 to 30 DaysKey...


  • Bengaluru, Karnataka, India Infogain Full time

    Position:Lead - Azure DatabricksOverall IT experience:9 to 13 yearsPrimary Skills:Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouseSecondary Skills:U-SQL, Spark, Scala, PythonWork Location:Bengaluru, Pune, Mumbai, Noida, GurugramMode of work:Hybrid at Infogain office locations mentioned aboveNotice Period:0 to 30 DaysEssential...


  • Bengaluru, Karnataka, India ARR Recruitment Solutions Full time

    Azure Databricks Engineer About the Role : We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines. This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for largescale data...


  • Bengaluru, Karnataka, India Visara Full time

    Role: Azure ETL Tester., Databricks tester Experienced in endtoend of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources.Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes. Well versed in Databricks, SQL Database, Azure Data...


  • Bengaluru, Karnataka, India PradeepIT Consulting Services Pvt Ltd Full time

    Job Title: Senior Data Engineer Location: Remote Experience Level: 5-7 Years Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, particularly with Azure Databricks, Pyspark, Medallion Architecture, and Data Lakes. If you are...


  • Bengaluru, Karnataka, India Smart Consulting - Creating Future Leaders Full time

    Big 4 MNC Hiring for "Azure Databricks+Pyspark+Kubernetes" Location - Bangalore CTC - Upto 24 LPA Experience - 5+ Yrs Mandatory Skill - Azure, Databricks, Pyspark Good to Have - Kubernetes


  • Bengaluru, Karnataka, India PradeepIT Consulting Services Pvt Ltd Full time

    Job Title:Senior Data EngineerLocation:RemoteExperience Level:57YearsJobDescription:We are seeking ahighly skilled and experienced Senior Data Engineer to join ourdynamic team. The ideal candidate will have a strong background indata engineering particularly with Azure Databricks PysparkMedallion Architecture and Data Lakes. If you are passionate...


  • Bengaluru, Karnataka, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...


  • Bengaluru, Karnataka, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 3-12 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest...


  • Bengaluru, Karnataka, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead Experience: 5-10 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across...


  • Bengaluru, Karnataka, India Smart Consulting - Creating Future Leaders Full time

    Big 4 MNC Hiring for "Azure Databricks+Pyspark+Kubernetes"Location - BangaloreCTC - Upto 24 LPAExperience - 5+ YrsMandatory Skill - Azure, Databricks, PysparkGood to Have - Kubernetes


  • Bengaluru, Karnataka, India Tredence Inc. Full time

    Job Title: Azure Data Engineer Company: Cutting-edge Tech Solutions MUST HAVE Minimum of 4 to 8 years of experience working with Azure Data Engineering. In-depth technical proficiency in tools such as Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS, etc. Experience collaborating with business stakeholders to understand and fulfill data...


  • Bengaluru, Karnataka, India codersbrain Full time

    We have an opening for Azure Databricks.Experience : 6 to 12 yrsLocation : BangaloreInterview : Face to face interview on 2nd and 3rd MarchMandatory Skills : Azure Data Factory Python Pyspark SQL Azure Data LakeJob Description : Around 7 to 9 yrs of IT experience with at least 5 yrs in ETL/Pipeline Development using tools such as Azure Databricks/Apache...


  • Bengaluru, Karnataka, India Impetus Technologies Full time

    Job Tittle Lead Databricks EngineerDatabricks Engineers with 2 6 years of hand on experience in Pyspark, Cloud Platform and SQL.Proven experience in designing and implementing data solutions on the Databricks platform with hands on experience in setting up Databricks cluster, working in Databricks modules, data pipelines for ingesting and transforming data...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory,Minimum 3 years' experience on Apache Spark or Azure...


  • Bengaluru, Karnataka, India Cognizant Full time

    JD: Experience level : 5+ years Total relevant experience in Azure Databricks : 2+ Years Must have skills: Azure Databricks along with Scala/Pyspark. Preferably Scala. Azure Data Factory Experience working with streaming data, Structured Streaming API Performance tuning Secondary skills: Azure Cosmos, Azure Data Explorer, Azure Kuberentes, JavaEmployee...


  • Bengaluru, Karnataka, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical LeadExperience: 5-10 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on Apache Spark or...


  • Bengaluru, Karnataka, India Anicalls (Pty) Ltd Full time

    Candidate should have:Background in processing and managing large data setsStrong knowledge of Structured Query Language (SQL)Experience building data pipelines using Azure Databricks and Azure Data FactoryKnowledge of analytics platform including Azure store, Azure Data Lake, Azure SQL DW/Synapse, Azure Stream AnalyticsExperience with Databricks Delta...

  • Azure

    1 week ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Role: Azure Databricks & Data Factory Exp : 3-10yearsGood to have:Azure Data Factory, Data Lake, Synapse DB, Azure Databricks, Python, pyspark, SQL / RDBMS Data base development Domain : Manufacturing domain experience Azure Ecosystem - Azure Functions, Cosmos DB, RDBMS Development, App Insights and Log Analytics etc., DevOps Qualifications :BACHELOR OF...