See more Collapse

Azure Databricks + Pyspark

2 months ago

Bengaluru, India Cognizant Technology Solutions Full time

Azure Data Bricks JD:
1. Hands on experience in MS Azure Data bricks and Hadoop ecosystem components like DBFS, Parquet, Delta Tables, HDFS, Map Reduce programming, Kafka, Spark & Event Hub.
2. In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.
3. Hands on experience in Scripting languages like Scala & Python.
4. Hands on experience in Analysis, Design, Coding & Testing phases of SDLC with best practices.
5. Expertise in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair.
6. Experience in creating tables, partitioning, bucketing, loading and aggregating data using Spark SQL/Scala.
7. Migrating the code from Traditional DW Environments to Apache Spark and Scala using Spark SQL, RDD.
8. Experience in transferring data from RDBMS/BLOB/ADLS to Data bricks using ADF.
9. Experience in Azure Database (PaaS) OR Azure SQL Data warehouse.
10. Experience in orchestrating the E2E data loads using the Azure Data Factory V2 / Logic Apps.
11. Experience in Cosmos DB.
12. Good knowledge on SQL Queries & Stored Procedures.

1. Hands on experience in MS Azure Data bricks and Hadoop ecosystem components like DBFS, Parquet, Delta Tables, HDFS, Map Reduce programming, Kafka, Spark & Event Hub.
2. In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.
3. Hands on experience in Scripting languages like Scala & Python.
4. Hands on experience in Analysis, Design, Coding & Testing phases of SDLC with best practices.
5. Expertise in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair.
6. Experience in creating tables, partitioning, bucketing, loading and aggregating data using Spark SQL/Scala.
7. Migrating the code from Traditional DW Environments to Apache Spark and Scala using Spark SQL, RDD.
8. Experience in transferring data from RDBMS/BLOB/ADLS to Data bricks using ADF.
9. Experience in Azure Database (PaaS) OR Azure SQL Data warehouse.
10. Experience in orchestrating the E2E data loads using the Azure Data Factory V2 / Logic Apps.
11. Experience in Cosmos DB.
12. Good knowledge on SQL Queries & Stored Procedures.

**Employee Status **:Full Time Employee

**Shift **:Day Job

**Travel **:No

**Job Posting **:Jun 26 2023

**About Cognizant

We have other current jobs related to this field that you can find below

  • Software Delivery Analyst

    4 weeks ago

    Bengaluru, India Horigine Consulting Pvt. Ltd Full time

    DescriptionWe are seeking a highly skilled and experienced Azure Databricks Developer with expertise in PySpark and SparkSQL. As an Azure Databricks Developer, you will be responsible for designing, developing, and implementing data processing solutions using PySpark and SparkSQL. You will work closely with our team to understand business requirements and...

  • ETL Data Engineer

    2 months ago

    Bengaluru, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • ETL Data Engineer

    3 weeks ago

    Bengaluru, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • Big 4 MNC Hiring for "Azure Databricks+Pyspark+Kubernetes"

    1 week ago

    Bengaluru, Karnataka, India Smart Consulting - Creating Future Leaders Full time

    Big 4 MNC Hiring for "Azure Databricks+Pyspark+Kubernetes" Location - Bangalore CTC - Upto 24 LPA Experience - 5+ Yrs Mandatory Skill - Azure, Databricks, Pyspark Good to Have - Kubernetes

  • Big 4 MNC Hiring for "Azure Databricks+Pyspark+Kubernetes"

    1 week ago

    Bengaluru, Karnataka, India Smart Consulting - Creating Future Leaders Full time

    Big 4 MNC Hiring for "Azure Databricks+Pyspark+Kubernetes"Location - BangaloreCTC - Upto 24 LPAExperience - 5+ YrsMandatory Skill - Azure, Databricks, PysparkGood to Have - Kubernetes

  • Big 4 MNC Hiring for "Azure Databricks+Pyspark+Kubernetes"

    1 month ago

    Greater Bengaluru Area, India Smart Consulting - Creating Future Leaders Full time

    Big 4 MNC Hiring for "Azure Databricks+Pyspark+Kubernetes"Location - BangaloreCTC - Upto 24 LPAExperience - 5+ YrsMandatory Skill - Azure, Databricks, PysparkGood to Have - Kubernetes

  • Azure Databricks Engineer

    1 week ago

    Bengaluru, Karnataka, India ARR Recruitment Solutions Full time

    Azure Databricks Engineer About the Role : We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines. This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for largescale data...

  • Azure Databricks

    2 weeks ago

    Bengaluru, India CIEL HR Services Full time

    Work experience-Above 6 years Notice period-Immediate to 15 days Work Mode-Hybrid Must have 5+ years of hands on experience in Azure Cloud development (ADF + DataBricks) Strong in Azure SQL and good to have knowledge on Synapse / Analytics Experience in working on Agile Project and familiar with Scrum/SAFe ceremonies Expertise in Azure Data Bricks, ADF,...

  • Azure Databricks Engineer

    1 week ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Pvt Ltd Full time

    Job Title: Senior Data Engineer Location: Remote Experience Level: 5-7 Years Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, particularly with Azure Databricks, Pyspark, Medallion Architecture, and Data Lakes. If you are...

  • Data Engineer

    1 month ago

    Bengaluru, India WIZSTAFFING PRIVATE LIMITED Full time

    Job Description :We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer.Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver the fastest harvest-to-fork in the industry. Our endeavor is to leverage experience...

  • Azure Databricks Engineer

    1 week ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Pvt Ltd Full time

    Job Title:Senior Data EngineerLocation:RemoteExperience Level:57YearsJobDescription:We are seeking ahighly skilled and experienced Senior Data Engineer to join ourdynamic team. The ideal candidate will have a strong background indata engineering particularly with Azure Databricks PysparkMedallion Architecture and Data Lakes. If you are passionate...

  • Azure DataBricks Quality Assurance

    1 week ago

    Bengaluru, Karnataka, India Visara Full time

    Role: Azure ETL Tester., Databricks tester Experienced in endtoend of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources.Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes. Well versed in Databricks, SQL Database, Azure Data...

  • Is Hiring for Azure Databricks

    1 week ago

    Bengaluru, Karnataka, India Cognizant Full time

    JD: Experience level : 5+ years Total relevant experience in Azure Databricks : 2+ Years Must have skills: Azure Databricks along with Scala/Pyspark. Preferably Scala. Azure Data Factory Experience working with streaming data, Structured Streaming API Performance tuning Secondary skills: Azure Cosmos, Azure Data Explorer, Azure Kuberentes, JavaEmployee...

  • Azure Databricks

    2 months ago

    Bengaluru, India CIEL HR Services Full time

    Work experience-Above 6 years Notice period-Immediate to 15 days Work Mode-Hybrid Must have 5+ years of hands on experience in Azure Cloud development (ADF + DataBricks) Strong in Azure SQL and good to have knowledge on Synapse / Analytics Experience in working on Agile Project and familiar with Scrum/SAFe ceremonies Expertise in Azure Data Bricks, ADF,...

  • Azure Databricks

    3 weeks ago

    Bengaluru, India CIEL HR Services Full time

    Work experience-Above 6 years Notice period-Immediate to 15 days Work Mode-Hybrid Must have 5+ years of hands on experience in Azure Cloud development (ADF + DataBricks) Strong in Azure SQL and good to have knowledge on Synapse / Analytics Experience in working on Agile Project and familiar with Scrum/SAFe ceremonies Expertise in Azure Data Bricks, ADF,...

  • Azure Databricks Engineer

    1 month ago

    Bengaluru, India Notus Full time

    Job Title : Azure Databricks EngineerLocation : Pan IndiaJob Type : Immediate to 15-Day JoinerExperience Level : 6+ YearsJob Summary :We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory, Azure...

  • Azure Databricks Engineer

    3 weeks ago

    Bengaluru, India Notus Full time

    Job Title : Azure Databricks EngineerLocation : Pan IndiaJob Type : Immediate to 15-Day JoinerExperience Level : 6+ YearsJob Summary :We are seeking an experienced Azure Databricks Engineer to join our team in Pan India. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Azure Databricks, Azure Data Factory, Azure...

  • Colan Infotech

    2 months ago

    Bengaluru, India Colan Infotech Pvt Ltd Full time

    Skill Set : Pyspark / Scala Spark, Data Factory, Databricks, Python, SQL.Job Description :Roles And Responsibilities :- Must have cloud knowledge in Azure- Should have programming skills with the ability to write optimized and reusable high-quality code.- Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks, Python,...

  • Azure Databricks Engineer

    1 week ago

    Bengaluru, Karnataka, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...

  • Azure Databricks Engineer

    1 week ago

    Bengaluru, Karnataka, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 3-12 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest...