Azure Data Bricks, Spark, Scala

2 weeks ago

Mumbai, India 3minds e solutions pvt ltd Full time

**Experience - 4-6 Years**

**Location - **(Mumbai,Chennai, Pune, Bangalore)

**MUST HAVE - Azure Databricks, Spark, Scala**

**Scala/Python Standalone**:

- For processes such as SFTP, S3 Data Transfer or any process standing outside Spark Based Runs

**Databricks**:

- Notebook Development for Data Ingestion, Data Transformation and Enhancements using Spark with Scala/Pyspark.
- Delta table utilization for DataWarehousing
- Compute Instance Utilization
- Databricks Job Utilization for ETL Pipeline stages

**Airflow**:

- Automation of Data Processing Pipelines, with knowledge of Connectors to SSH, SFTP, Databricks

**Azure Log Analytics**:

- Logging tool to capture Logging from Applications

**Elastic Search**:

- Utilization for Log Analytics and Dashboard to support Pipeline Stage View based on Logs in Azure Log Analytics

**Azure**:

- Comfortable with services setup and management such as Azure Storage Containers, Virtual Machines, Key Vault, Identity Access Management.

**Terraform**:

- Utilize Terraform for automated Infrastructure Setup

Schedule:

- Day shift
- Morning shift

**Education**:

- Bachelor's (preferred)

**Experience**:

- total work: 6 years (preferred)
- Azure databricks: 4 years (preferred)

  • Azure Data Bricks Engineer

    2 days ago

    Mumbai, India Carbynetech Full time

    Job Description Job description Azure Data Factory: - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows - ADF data Ingestion and Integration with other services Azure Databricks: - Experience in Big Data...

  • Big Data Engineer

    3 weeks ago

    Mumbai, India Strategic HR Solutions Full time

    Spark Scala DeveloperLocation : Bengaluru, MumbaiEmployment Type : Full-timeWhat Were Looking ForWere hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and/or in the cloud. You should know how to write production-grade Spark applications, fine-tune performance, and work fluently with Scalas functional...

  • Big Data Engineer

    4 weeks ago

    Mumbai, India Strategic HR Solutions Full time

    Job Description Spark Scala Developer Location : Bengaluru, Mumbai Employment Type : Full-time What Were Looking For Were hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and/or in the cloud. You should know how to write production-grade Spark applications, fine-tune performance, and work fluently...

  • Azure Data Bricks

    2 weeks ago

    Mumbai, Maharashtra, India ScatterPie Analytics Full time

    **Role Overview**: As a Data Engineer specializing in Databricks and AWS Glue, you will play a key role in designing, developing, and maintaining data pipelines and analytics solutions for our clients. You will collaborate with cross-functional teams to understand business requirements, architect scalable solutions, and ensure data reliability and...

  • Azure Data Bricks

    2 weeks ago

    Mumbai, Maharashtra, India Capgemini Full time

    **Job Description**: - Experience with Azure Data Bricks, Data Factory - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics - Experience in Python/ Pyspark Programming. - Experience with Azure Databricks/ADB - Experience with building CI/CD pipelines in Data environments **Primary Skills**: - Azure...

  • Data Bricks Developer

    14 hours ago

    Mumbai, India Tata Technologies Full time

    Purpose of the Role: We are seeking a skilled Databricks with 4 to 6 years of experience in data engineering and cloud platforms. Designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modelling, and cloud integration, ensuring high performance, security, and reliability. Job...

  • Data Bricks Developer

    12 hours ago

    Mumbai, India Tata Technologies Full time

    Purpose of the Role:We are seeking a skilled Databricks with 4 to 6 years of experience in data engineering and cloud platforms. Designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modelling, and cloud integration, ensuring high performance, security, and reliability.Job...

  • Data Bricks Developer

    6 hours ago

    mumbai, India Tata Technologies Full time

    Purpose of the Role: We are seeking a skilled Databricks with 4 to 6 years of experience in data engineering and cloud platforms. Designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modelling, and cloud integration, ensuring high performance, security, and reliability. Job...

  • Data Bricks Developer

    20 hours ago

    mumbai, India Tata Technologies Full time

    Purpose of the Role: We are seeking a skilled Databricks with 4 to 6 years of experience in data engineering and cloud platforms. Designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modelling, and cloud integration, ensuring high performance, security, and reliability.Job...

  • Data Bricks Developer

    19 hours ago

    Mumbai, India Tata Technologies Full time

    Purpose of the Role: We are seeking a skilled Databricks with 4 to 6 years of experience in data engineering and cloud platforms. Designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modelling, and cloud integration, ensuring high performance, security, and reliability.Job...