
Azure Data Bricks, Spark, Scala
7 days ago
**Experience - 4-6 Years**
**Location - **(Mumbai,Chennai, Pune, Bangalore)
**MUST HAVE - Azure Databricks, Spark, Scala**
**Scala/Python Standalone**:
- For processes such as SFTP, S3 Data Transfer or any process standing outside Spark Based Runs
**Databricks**:
- Notebook Development for Data Ingestion, Data Transformation and Enhancements using Spark with Scala/Pyspark.
- Delta table utilization for DataWarehousing
- Compute Instance Utilization
- Databricks Job Utilization for ETL Pipeline stages
**Airflow**:
- Automation of Data Processing Pipelines, with knowledge of Connectors to SSH, SFTP, Databricks
**Azure Log Analytics**:
- Logging tool to capture Logging from Applications
**Elastic Search**:
- Utilization for Log Analytics and Dashboard to support Pipeline Stage View based on Logs in Azure Log Analytics
**Azure**:
- Comfortable with services setup and management such as Azure Storage Containers, Virtual Machines, Key Vault, Identity Access Management.
**Terraform**:
- Utilize Terraform for automated Infrastructure Setup
Schedule:
- Day shift
- Morning shift
**Education**:
- Bachelor's (preferred)
**Experience**:
- total work: 6 years (preferred)
- Azure databricks: 4 years (preferred)
-
Mumbai, Maharashtra, India Tata Consultancy Services Full time ₹ 8,00,000 - ₹ 12,00,000 per yearPlease find below JD for the same as requested. Technical Skills:"Pyspark" "Azure data bricks" "Azure Data Factory"Experienced level - 5 yearsShould have hands-on experience in writing PySpark code on Databricks and expertise in Spark-Sql and Python coding as well. Should have worked on Azure Data lake Gen2 storage or good to have knowledgeHands-on exp in...
-
Azure Data Bricks Engineer
2 weeks ago
Mumbai, India CARBYNETECH Full timeAzure Data Factory: Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other services Azure Databricks: Experience in Big Data components such as Kafka,...
-
Azure Data Bricks Engineer
7 days ago
Mumbai, Maharashtra, India CARBYNETECH Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAzure Data Factory: Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other services Azure Databricks: Experience in Big Data components such as Kafka, Spark SQL,...
-
Azure Data Bricks
7 days ago
Mumbai, Maharashtra, India Capgemini Full time**Job Description**: - Experience with Azure Data Bricks, Data Factory - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics - Experience in Python/ Pyspark Programming. - Experience with Azure Databricks/ADB - Experience with building CI/CD pipelines in Data environments **Primary Skills**: - Azure...
-
Azure Data Engineer
2 days ago
Mumbai, India Zensar Technologies Full timeExcellent communication and presentation skills. Extensive experience in Azure stack Azure Data bricks, Azure Synapse, ADLS, Azure SQL DB, Azure Data Factory, CosmoDB, Analysis Services, Event Hub etc.. Excellent experience in data processing using Azure Data bricks, complex data transformation using Pyspark or Python and building end to end data pipeline...
-
PySpark Scala Developer
4 days ago
Mumbai, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole: Spark Scala DeveloperExperience: 3–8 yearsLocation: BengaluruEmployment Type: Full-time⸻What We're Looking ForWe're hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and/or in the cloud. You should know how to write production-grade Spark applications, fine-tune performance, and work...
-
Scala Senior Big Data Engineer
1 day ago
Bengaluru, Mumbai, India AVE-Promagne Business Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per yearMust have 3+ years of experience with Apache Spark in Scala Must have Deep understanding of Spark internalsDAG, stages, tasks, caching, joins, partitioning Hands-on experience with performance tuning in production Spark jobs Must have Proficiency in Scala functional programming (e.g. immutability, higher-order functions, Option/Either) Must have...
-
Scala Developer
3 days ago
Mumbai, Maharashtra, India ALIQAN Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per yearGreetings From ALIQAN TechnologiesWe are hiring Scala Developer for one of our esteemed Client MNC.Job Title: Scala DeveloperLocation: Onsite Bangalore / MumbaiExperience Required: 7+ YearsNotice Period: ImmediateJob Type: Contract Job Summary:We are seeking an experienced Scala Developer with 7+ years of expertise in building high-performance,...
-
Senior Scala Developer_Mumbai
4 days ago
Mumbai, India Tata Consultancy Services Full timeRole-Senior Scala DeveloperExperience-7-14 YearsLocation-Mumbai (Powai)Skills- Scala, Spark, UNIXMinimum 5+ years of experience in development of Spark ScalaExperience in designing and development of solutions for Big Data using Hadoop ecosystem technologies such as with Hadoop Bigdata components like HDFS, Spark, Hive Parquet File format, YARN, MapReduce,...
-
▷ [3 Days Left] Azure Big Data
2 days ago
Mumbai, India Anicalls (Pty) Ltd Full time• Azure Data Factory • Azure Databricks • Python, Scala, PySpark, Spark • HIVE / HIVE LLAP / HBASE / CosmoDb • Azure Active Directory Domain Services • Apache Ranger / Apache Ambari • Azure Key Vault • Expertise in HDInsight ( Minimum 2 -3 years ’ experience with multiple implementations ) • Expertise in Cloud Native and Open Cloud...