Azure Data Bricks, Spark, Scala

7 days ago


Mumbai, India 3minds e solutions pvt ltd Full time

**Experience - 4-6 Years**

**Location - **(Mumbai,Chennai, Pune, Bangalore)

**MUST HAVE - Azure Databricks, Spark, Scala**

**Scala/Python Standalone**:

- For processes such as SFTP, S3 Data Transfer or any process standing outside Spark Based Runs

**Databricks**:

- Notebook Development for Data Ingestion, Data Transformation and Enhancements using Spark with Scala/Pyspark.
- Delta table utilization for DataWarehousing
- Compute Instance Utilization
- Databricks Job Utilization for ETL Pipeline stages

**Airflow**:

- Automation of Data Processing Pipelines, with knowledge of Connectors to SSH, SFTP, Databricks

**Azure Log Analytics**:

- Logging tool to capture Logging from Applications

**Elastic Search**:

- Utilization for Log Analytics and Dashboard to support Pipeline Stage View based on Logs in Azure Log Analytics

**Azure**:

- Comfortable with services setup and management such as Azure Storage Containers, Virtual Machines, Key Vault, Identity Access Management.

**Terraform**:

- Utilize Terraform for automated Infrastructure Setup

Schedule:

- Day shift
- Morning shift

**Education**:

- Bachelor's (preferred)

**Experience**:

- total work: 6 years (preferred)
- Azure databricks: 4 years (preferred)



  • Mumbai, Maharashtra, India Tata Consultancy Services Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Please find below JD for the same as requested. Technical Skills:"Pyspark" "Azure data bricks" "Azure Data Factory"Experienced level - 5 yearsShould have hands-on experience in writing PySpark code on Databricks and expertise in Spark-Sql and Python coding as well. Should have worked on Azure Data lake Gen2 storage or good to have knowledgeHands-on exp in...


  • Mumbai, India CARBYNETECH Full time

    Azure Data Factory: Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other services Azure Databricks: Experience in Big Data components such as Kafka,...


  • Mumbai, Maharashtra, India CARBYNETECH Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Azure Data Factory: Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other services Azure Databricks: Experience in Big Data components such as Kafka, Spark SQL,...

  • Azure Data Bricks

    7 days ago


    Mumbai, Maharashtra, India Capgemini Full time

    **Job Description**: - Experience with Azure Data Bricks, Data Factory - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics - Experience in Python/ Pyspark Programming. - Experience with Azure Databricks/ADB - Experience with building CI/CD pipelines in Data environments **Primary Skills**: - Azure...

  • Azure Data Engineer

    2 days ago


    Mumbai, India Zensar Technologies Full time

    Excellent communication and presentation skills. Extensive experience in Azure stack Azure Data bricks, Azure Synapse, ADLS, Azure SQL DB, Azure Data Factory, CosmoDB, Analysis Services, Event Hub etc.. Excellent experience in data processing using Azure Data bricks, complex data transformation using Pyspark or Python and building end to end data pipeline...


  • Mumbai, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Spark Scala DeveloperExperience: 3–8 yearsLocation: BengaluruEmployment Type: Full-time⸻What We're Looking ForWe're hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and/or in the cloud. You should know how to write production-grade Spark applications, fine-tune performance, and work...


  • Bengaluru, Mumbai, India AVE-Promagne Business Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Must have 3+ years of experience with Apache Spark in Scala Must have Deep understanding of Spark internalsDAG, stages, tasks, caching, joins, partitioning Hands-on experience with performance tuning in production Spark jobs Must have Proficiency in Scala functional programming (e.g. immutability, higher-order functions, Option/Either) Must have...

  • Scala Developer

    3 days ago


    Mumbai, Maharashtra, India ALIQAN Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Greetings From ALIQAN TechnologiesWe are hiring  Scala Developer for one of our esteemed Client MNC.Job Title: Scala DeveloperLocation: Onsite Bangalore / MumbaiExperience Required: 7+ YearsNotice Period: ImmediateJob Type: Contract Job Summary:We are seeking an experienced Scala Developer with 7+ years of expertise in building high-performance,...


  • Mumbai, India Tata Consultancy Services Full time

    Role-Senior Scala DeveloperExperience-7-14 YearsLocation-Mumbai (Powai)Skills- Scala, Spark, UNIXMinimum 5+ years of experience in development of Spark ScalaExperience in designing and development of solutions for Big Data using Hadoop ecosystem technologies such as with Hadoop Bigdata components like HDFS, Spark, Hive Parquet File format, YARN, MapReduce,...


  • Mumbai, India Anicalls (Pty) Ltd Full time

    • Azure Data Factory • Azure Databricks • Python, Scala, PySpark, Spark • HIVE / HIVE LLAP / HBASE / CosmoDb • Azure Active Directory Domain Services • Apache Ranger / Apache Ambari • Azure Key Vault • Expertise in HDInsight ( Minimum 2 -3 years ’ experience with multiple implementations ) • Expertise in Cloud Native and Open Cloud...