Azure -big Data Architect - Scala/spark/hadoop

2 days ago

Bengaluru, India resourcetree Full time

We are looking for a Data Architect with good experience in MS Azure and Hadoop.
- 10+ years of technical experience with at-least 2 years on MS Azure and 2 years on Hadoop (CDH/HDP).
- With hands-on experience/exposure to NoSQL Database and Data Modelling

This role involves a combination of hands-on contribution, customer engagement, and technical team management.

**As a Data Architect**, **you will**:

- Design, Architect, Deploy and maintain solutions on MS Azure using different Cloud & Big Data Technologies.
- Manage the full life-cycle of a Data Lake / Modern DWH solution from requirement gathering and analysis to Platform selection, design of the architecture, and deployment be responsible for implementing solutions that can scale on Cloud.
- Explore and learn new technologies for creative business problem-solving and mentor a team of Data Engineers.

**Required Experience, Skills & Competencies**:

- Strong Hands-on experience in implementing Data Lake/DWH with technologies like - Data Factory (ADF), Data Lake Storage (ADLS), Azure Databricks, App Services, Azure Synapse Analytics / SQL DWH, Event Hub, Streaming Analytics, Cosmos DB and Purview
- Experience in using big data technologies like Hadoop, Spark, Kafka, Hive, NoSQL - HBase / MongoDB / Cassandra, Impala, Sqoop, etc.
- Strong programming experience either in Python or Scala / Java
- Experience in supporting BI and Data Science teams in consuming the data in a secure and governed manner.
- Very Good understanding and Experience of using CI/CD with Git, Jenkins / Azure DevOps.
- Experience in setting up cloud-computing infrastructure solutions.
- Excellent communication skills
- Problem-solving aptitude
- Organizational and leadership skills

**Salary**: ₹4,500,000.00 - ₹5,200,000.00 per year

Application Question(s):

- Are you having 10+ years of technical experience with at-least 2 years on MS Azure and 2 years on Hadoop (CDH/HDP) along with hands-on experience with NoSQL Database and Data Modelling ?
- Do you hold experience in using big data technologies like Hadoop, Spark, Kafka, Hive, NoSQL - HBase / MongoDB / Cassandra, Impala, Sqoop, etc.
- Do you have strong programming experience either in Python or Scala / Java ?
- Do you have hands-on experience in implementing Data Lake/DWH with technologies like - Data Factory (ADF), Data Lake Storage (ADLS), Azure Databricks, App Services, Azure Synapse Analytics ?
- Do you have hands-on experience in SQL- DWH, Event Hub, Streaming Analytics, Cosmos DB and Purview ?
- Do you have experience in setting up cloud-computing infrastructure solutions & understanding and experience of using CI/CD with Git, Jenkins / Azure DevOps ?
- Are you having experience in supporting BI and Data Science teams in consuming the data in a secure and governed manner ?

**Experience**:

- Technical: 10 years (required)

**Speak with the employer**
+91 9810299440

  • Senior Big Data Engineer

    1 week ago

    Bengaluru, India SK HR Consultants Full time

    Service Mapping : Application Senior DeveloperLocation : Whitefield, BangaloreExperience : 6+ yearsRole Overview : Looking for a Senior Big Data Developer to design, build, and optimize data pipelines and analytics solutions. Candidates with prior exposure to the Ericsson Wallet Platform will be given preference.Key Responsibilities : - Develop, test, and...

  • Azure Big Data Architect

    24 hours ago

    Bengaluru, India Tiger Analytics Full time

    Job Description Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset. Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work...

  • Azure Big Data Architect

    20 hours ago

    Bengaluru, India Tiger Analytics Full time

    Job Description Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset. Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work...

  • Big Data Architect

    12 hours ago

    Bengaluru, Karnataka, India Unison Consulting Full time

    **Responsibilities**: Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India True Talents Full time

    Job Title : Big Data EngineerLocation : Bangalore / PuneEmployment Type : Full TimeExperience : 4 to 8 yearsNotice Period : 15 daysAbout the Role :We are looking for a skilled Big Data Engineer to design, develop, and maintain large-scale data processing systems. The ideal candidate will have hands-on experience with big data technologies and a strong...

  • Scala Big Data Lead Engineer

    4 weeks ago

    Bengaluru, Karnataka, India UST Full time

    If you are highly interested and available immediately, please submit your resume along with your total experience, current CTC, notice period, and current location details to Key Responsibilities: Design, develop, and optimize data pipelines and ETL workflows. Work with Apache Hadoop, Airflow, Kubernetes, and Containers to streamline data processing....

  • Scala Big Data Lead Engineer

    3 weeks ago

    Bengaluru, Karnataka, India UST Full time

    If you are highly interested and available immediately, please submit your resume along with your total experience, current CTC, notice period, and current location details to Nitin.patil@ust.comKey Responsibilities:Design, develop, and optimize data pipelines and ETL workflows.Work with Apache Hadoop, Airflow, Kubernetes, and Containers to streamline data...

  • Sr. Spark/ Hadoop/Scala Engineer...

    1 day ago

    Bengaluru, India Anicalls (Pty) Ltd Full time

    Candidate should be able to: Coordinate Development, Integration, and Production deployments. Optimize Spark code, Impala queries, and Hive partitioning strategy for better scalability, reliability, and performance. Build applications using Maven, SBT and integrated with continuous integration servers like Jenkins to build jobs. Execute Hadoop ecosystem...

  • Data Engineer

    1 week ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill - Data Engineer (Spark Scala)Exp range – 5 yrs – 10 yrsLocation- Chennai /Pune/Bangalore/Hyderabad /DelhiNotice period – 30 daysPls find the Job Description below.- Big Data Hadoop - Hive and Spark/Scala solid experience- SQL advance knowledge - Been able to test changes and...

  • Data Engineer

    1 week ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill - Data Engineer (Spark Scala)Exp range – 5 yrs – 10 yrsLocation- Chennai /Pune/Bangalore/Hyderabad /DelhiNotice period – 30 daysPls find the Job Description below.- Big Data Hadoop - Hive and Spark/Scala solid experience- SQL advance knowledge - Been able to test changes and...