Azure -big Data Architect - Scala/spark/hadoop

5 days ago

Bengaluru, India resourcetree Full time

We are looking for a Data Architect with good experience in MS Azure and Hadoop.
- 10+ years of technical experience with at-least 2 years on MS Azure and 2 years on Hadoop (CDH/HDP).
- With hands-on experience/exposure to NoSQL Database and Data Modelling

This role involves a combination of hands-on contribution, customer engagement, and technical team management.

**As a Data Architect**, **you will**:

- Design, Architect, Deploy and maintain solutions on MS Azure using different Cloud & Big Data Technologies.
- Manage the full life-cycle of a Data Lake / Modern DWH solution from requirement gathering and analysis to Platform selection, design of the architecture, and deployment be responsible for implementing solutions that can scale on Cloud.
- Explore and learn new technologies for creative business problem-solving and mentor a team of Data Engineers.

**Required Experience, Skills & Competencies**:

- Strong Hands-on experience in implementing Data Lake/DWH with technologies like - Data Factory (ADF), Data Lake Storage (ADLS), Azure Databricks, App Services, Azure Synapse Analytics / SQL DWH, Event Hub, Streaming Analytics, Cosmos DB and Purview
- Experience in using big data technologies like Hadoop, Spark, Kafka, Hive, NoSQL - HBase / MongoDB / Cassandra, Impala, Sqoop, etc.
- Strong programming experience either in Python or Scala / Java
- Experience in supporting BI and Data Science teams in consuming the data in a secure and governed manner.
- Very Good understanding and Experience of using CI/CD with Git, Jenkins / Azure DevOps.
- Experience in setting up cloud-computing infrastructure solutions.
- Excellent communication skills
- Problem-solving aptitude
- Organizational and leadership skills

**Salary**: ₹4,500,000.00 - ₹5,200,000.00 per year

Application Question(s):

- Are you having 10+ years of technical experience with at-least 2 years on MS Azure and 2 years on Hadoop (CDH/HDP) along with hands-on experience with NoSQL Database and Data Modelling ?
- Do you hold experience in using big data technologies like Hadoop, Spark, Kafka, Hive, NoSQL - HBase / MongoDB / Cassandra, Impala, Sqoop, etc.
- Do you have strong programming experience either in Python or Scala / Java ?
- Do you have hands-on experience in implementing Data Lake/DWH with technologies like - Data Factory (ADF), Data Lake Storage (ADLS), Azure Databricks, App Services, Azure Synapse Analytics ?
- Do you have hands-on experience in SQL- DWH, Event Hub, Streaming Analytics, Cosmos DB and Purview ?
- Do you have experience in setting up cloud-computing infrastructure solutions & understanding and experience of using CI/CD with Git, Jenkins / Azure DevOps ?
- Are you having experience in supporting BI and Data Science teams in consuming the data in a secure and governed manner ?

**Experience**:

- Technical: 10 years (required)

**Speak with the employer**
+91 9810299440

  • Senior Big Data Developer

    2 weeks ago

    Bengaluru, India Info Origin Inc Full time

    Job Title : Senior Big Data Developer.Required Experience : 6+ Years.Location : Bangalore.Employment Type : Full-time.Job Summary :Key Responsibilities :- Develop, test, and deploy high-performance data pipelines using Hadoop, Spark, Kudu, and HBase.- Implement ETL/ELT workflows and ensure data integrity and scalability.- Work closely with Data Architects...

  • Senior Big Data Engineer

    4 days ago

    Bengaluru, India SK HR Consultants Full time

    Service Mapping : Application Senior DeveloperLocation : Whitefield, BangaloreExperience : 6+ yearsRole Overview : Looking for a Senior Big Data Developer to design, build, and optimize data pipelines and analytics solutions. Candidates with prior exposure to the Ericsson Wallet Platform will be given preference.Key Responsibilities : - Develop, test, and...

  • Quantexa Data Engineer

    2 weeks ago

    Bengaluru, India Teamware Solutions Full time

    About the CompanyGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdAbout the RoleWe are hiring a Quantexa Data Engineer (Big Data | Spark | Hadoop | Scala)Location: BengaluruWork Model: HybridExperience: 4+ YearsNotice Period: Immediate - 15 daysDesignation ConsultantRole type Big Data EngineerJob Requirements Mandatory...

  • Quantexa Data Engineer

    2 weeks ago

    Bengaluru, India Teamware Solutions Full time

    About the CompanyGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdAbout the RoleWe are hiring aQuantexa Data Engineer (Big Data | Spark | Hadoop | Scala)Location: Bengaluru Work Model: HybridExperience: 4+ Years Notice Period: Immediate - 15 daysDesignation ConsultantRole type Big Data EngineerJob Requirements Mandatory Skills...

  • Quantexa Data Engineer

    2 weeks ago

    Bengaluru, India Teamware Solutions Full time

    About the Company Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd About the Role We are hiring aQuantexa Data Engineer (Big Data | Spark | Hadoop | Scala) Location: Bengaluru Work Model: Hybrid Experience: 4+ Years Notice Period: Immediate - 15 days Designation Consultant Role type Big Data Engineer Job Requirements Mandatory...

  • Quantexa Data Engineer

    7 days ago

    Bengaluru, India Teamware Solutions Full time

    About the CompanyGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdAbout the RoleWe are hiring a Quantexa Data Engineer (Big Data | Spark | Hadoop | Scala)Location: BengaluruWork Model: HybridExperience: 4+ YearsNotice Period: Immediate - 15 daysDesignation ConsultantRole type Big Data EngineerJob Requirements Mandatory...

  • Quantexa Data Engineer

    7 days ago

    Bengaluru, India Teamware Solutions Full time

    About the Company Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd About the Role We are hiring aQuantexa Data Engineer (Big Data | Spark | Hadoop | Scala) Location: Bengaluru Work Model: Hybrid Experience: 4+ Years Notice Period: Immediate - 15 days Designation Consultant Role type Big Data Engineer Job Requirements Mandatory...

  • Quantexa Data Engineer

    7 days ago

    Bengaluru, India Teamware Solutions Full time

    About the CompanyGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdAbout the RoleWe are hiring aQuantexa Data Engineer (Big Data | Spark | Hadoop | Scala)- Location: Bengaluru- Work Model: Hybrid- Experience: 4+ Years- Notice Period: Immediate - 15 daysDesignation ConsultantRole type Big Data EngineerJob Requirements Mandatory...

  • Quantexa data engineer

    7 days ago

    Bengaluru, India Teamware Solutions Full time

    About the CompanyGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdAbout the RoleWe are hiring a Quantexa Data Engineer (Big Data | Spark | Hadoop | Scala)- Location: Bengaluru- Work Model: Hybrid- Experience: 4+ Years- Notice Period: Immediate - 15 daysDesignation ConsultantRole type Big Data EngineerJob Requirements Mandatory...

  • Quantexa Data Engineer

    1 week ago

    Bengaluru, India Teamware Solutions Full time

    About the Company Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd About the Role We are hiring aQuantexa Data Engineer (Big Data | Spark | Hadoop | Scala) Location: Bengaluru Work Model: Hybrid Experience: 4+ Years Notice Period: Immediate - 15 days Designation Consultant Role type Big Data Engineer Job Requirements Mandatory...