Azure -big Data Architect - Scala/spark/hadoop

7 days ago

Bengaluru, India resourcetree Full time

We are looking for a Data Architect with good experience in MS Azure and Hadoop.
- 10+ years of technical experience with at-least 2 years on MS Azure and 2 years on Hadoop (CDH/HDP).
- With hands-on experience/exposure to NoSQL Database and Data Modelling

This role involves a combination of hands-on contribution, customer engagement, and technical team management.

**As a Data Architect**, **you will**:

- Design, Architect, Deploy and maintain solutions on MS Azure using different Cloud & Big Data Technologies.
- Manage the full life-cycle of a Data Lake / Modern DWH solution from requirement gathering and analysis to Platform selection, design of the architecture, and deployment be responsible for implementing solutions that can scale on Cloud.
- Explore and learn new technologies for creative business problem-solving and mentor a team of Data Engineers.

**Required Experience, Skills & Competencies**:

- Strong Hands-on experience in implementing Data Lake/DWH with technologies like - Data Factory (ADF), Data Lake Storage (ADLS), Azure Databricks, App Services, Azure Synapse Analytics / SQL DWH, Event Hub, Streaming Analytics, Cosmos DB and Purview
- Experience in using big data technologies like Hadoop, Spark, Kafka, Hive, NoSQL - HBase / MongoDB / Cassandra, Impala, Sqoop, etc.
- Strong programming experience either in Python or Scala / Java
- Experience in supporting BI and Data Science teams in consuming the data in a secure and governed manner.
- Very Good understanding and Experience of using CI/CD with Git, Jenkins / Azure DevOps.
- Experience in setting up cloud-computing infrastructure solutions.
- Excellent communication skills
- Problem-solving aptitude
- Organizational and leadership skills

**Salary**: ₹4,500,000.00 - ₹5,200,000.00 per year

Application Question(s):

- Are you having 10+ years of technical experience with at-least 2 years on MS Azure and 2 years on Hadoop (CDH/HDP) along with hands-on experience with NoSQL Database and Data Modelling ?
- Do you hold experience in using big data technologies like Hadoop, Spark, Kafka, Hive, NoSQL - HBase / MongoDB / Cassandra, Impala, Sqoop, etc.
- Do you have strong programming experience either in Python or Scala / Java ?
- Do you have hands-on experience in implementing Data Lake/DWH with technologies like - Data Factory (ADF), Data Lake Storage (ADLS), Azure Databricks, App Services, Azure Synapse Analytics ?
- Do you have hands-on experience in SQL- DWH, Event Hub, Streaming Analytics, Cosmos DB and Purview ?
- Do you have experience in setting up cloud-computing infrastructure solutions & understanding and experience of using CI/CD with Git, Jenkins / Azure DevOps ?
- Are you having experience in supporting BI and Data Science teams in consuming the data in a secure and governed manner ?

**Experience**:

- Technical: 10 years (required)

**Speak with the employer**
+91 9810299440

  • Big Data

    7 hours ago

    Bengaluru, India Riverforest Connections Full time

    **Job Description**: **Strong proficiency Scala + Spark (Hadoop) with Java (mandatory)** Database experience preferably with DB2, Sybase, or Oracle - Complete SDLC process and Agile Methodology (Scrum) - Version control - Git - Spring Skill Desired: - Previous experience in Trade Surveillance or working with data from the order lifecycle - High quality...

  • Scala Big Data Engineer

    1 day ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Big Data Hadoop Scala DeveloperWe are seeking a seasoned big data professional to spearhead our team's efforts in developing and enhancing scalable data processing pipelines.Key Responsibilities:Leverage your expertise in Scala, Spark, Hive, and Hadoop tools to craft efficient solutions for complex data challenges.Collaborate with cross-functional teams to...

  • Scala Big Data Lead Engineer

    4 weeks ago

    Bengaluru, Karnataka, India UST Full time

    If you are highly interested and available immediately, please submit your resume along with your total experience, current CTC, notice period, and current location details to Nitin.patil@ust.comKey Responsibilities:- Design, develop, and optimize data pipelines and ETL workflows.- Work with Apache Hadoop, Airflow, Kubernetes, and Containers to streamline...

  • Big Data Engineer

    1 day ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Senior Data ArchitectDevelop and implement large-scale data architectures using Scala and Spark to drive business growth and efficiency.Key Responsibilities:Design and develop complex data processing systems using Scala, Spark, and distributed computing frameworks.Collaborate with cross-functional teams to integrate data processing systems with existing...

  • Big Data Architect

    5 days ago

    Bengaluru, Karnataka, India Unison Consulting Full time

    **Responsibilities**: Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • Mainly Scala+spark

    3 weeks ago

    Bengaluru, Karnataka, India TapTalent Full time

    Primary Skills Mainly Scala Spark OR Java SparkNotice period immediate to 30 days Above 45 days notice period do not share profiles Location Pune Chennai Bangalore Hyderabad Mumbai GurgoanExp - 4-10 yrs Mainly Scala Spark OR Java Spark experience needed 5 years of experience Expertise in Data Engineering Hands-on experience in design and development...

  • Scala Big Data Lead Engineer

    2 weeks ago

    Bengaluru, Karnataka, India UST Full time

    If you are highly interested and available immediately, please submit your resume along with your total experience, current CTC, notice period, and current location details to Nitin.patil@ust.comKey Responsibilities:Design, develop, and optimize data pipelines and ETL workflows.Work with Apache Hadoop, Airflow, Kubernetes, and Containers to streamline data...

  • Scala Big Data Lead Engineer

    5 days ago

    Bengaluru, Karnataka, India UST Full time

    If you are highly interested and available immediately, please submit your resume along with your total experience, current CTC, notice period, and current location details to Key Responsibilities: Design, develop, and optimize data pipelines and ETL workflows. Work with Apache Hadoop, Airflow, Kubernetes, and Containers to streamline data processing....

  • Scala Big Data Lead Engineer

    10 hours ago

    Bengaluru, Karnataka, India UST Full time

    immediately , please submit your resume along with your total experience, current CTC, notice period, and current location details to data pipelines and ETL workflows .Apache Hadoop, Airflow, Kubernetes, and Containers to streamline data processing.data analytics and mining techniques cloud-based big data solutions multiple data processing engines for...

  • Big Data

    1 week ago

    Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore, India beBeeData Full time ₹ 12,00,000 - ₹ 30,00,000

    Lead Data Engineer - Big Data & HadoopWe are seeking a highly skilled Lead Data Engineer to join our team and lead the design, implementation, and maintenance of large-scale data processing systems.Key Responsibilities:• Design and implement robust, scalable, and secure data pipelines using Azure Databricks, Hadoop, and Spark.• Collaborate with...