Azure -big Data Architect - Scala/spark/hadoop

2 months ago

Bengaluru, India resourcetree Full time

We are looking for a Data Architect with good experience in MS Azure and Hadoop.
- 10+ years of technical experience with at-least 2 years on MS Azure and 2 years on Hadoop (CDH/HDP).
- With hands-on experience/exposure to NoSQL Database and Data Modelling

This role involves a combination of hands-on contribution, customer engagement, and technical team management.

**As a Data Architect**, **you will**:

- Design, Architect, Deploy and maintain solutions on MS Azure using different Cloud & Big Data Technologies.
- Manage the full life-cycle of a Data Lake / Modern DWH solution from requirement gathering and analysis to Platform selection, design of the architecture, and deployment be responsible for implementing solutions that can scale on Cloud.
- Explore and learn new technologies for creative business problem-solving and mentor a team of Data Engineers.

**Required Experience, Skills & Competencies**:

- Strong Hands-on experience in implementing Data Lake/DWH with technologies like - Data Factory (ADF), Data Lake Storage (ADLS), Azure Databricks, App Services, Azure Synapse Analytics / SQL DWH, Event Hub, Streaming Analytics, Cosmos DB and Purview
- Experience in using big data technologies like Hadoop, Spark, Kafka, Hive, NoSQL - HBase / MongoDB / Cassandra, Impala, Sqoop, etc.
- Strong programming experience either in Python or Scala / Java
- Experience in supporting BI and Data Science teams in consuming the data in a secure and governed manner.
- Very Good understanding and Experience of using CI/CD with Git, Jenkins / Azure DevOps.
- Experience in setting up cloud-computing infrastructure solutions.
- Excellent communication skills
- Problem-solving aptitude
- Organizational and leadership skills

**Salary**: ₹4,500,000.00 - ₹5,200,000.00 per year

Application Question(s):

- Are you having 10+ years of technical experience with at-least 2 years on MS Azure and 2 years on Hadoop (CDH/HDP) along with hands-on experience with NoSQL Database and Data Modelling ?
- Do you hold experience in using big data technologies like Hadoop, Spark, Kafka, Hive, NoSQL - HBase / MongoDB / Cassandra, Impala, Sqoop, etc.
- Do you have strong programming experience either in Python or Scala / Java ?
- Do you have hands-on experience in implementing Data Lake/DWH with technologies like - Data Factory (ADF), Data Lake Storage (ADLS), Azure Databricks, App Services, Azure Synapse Analytics ?
- Do you have hands-on experience in SQL- DWH, Event Hub, Streaming Analytics, Cosmos DB and Purview ?
- Do you have experience in setting up cloud-computing infrastructure solutions & understanding and experience of using CI/CD with Git, Jenkins / Azure DevOps ?
- Are you having experience in supporting BI and Data Science teams in consuming the data in a secure and governed manner ?

**Experience**:

- Technical: 10 years (required)

**Speak with the employer**
+91 9810299440

  • Big Data

    2 months ago

    Bengaluru, India Riverforest Connections Full time

    **Job Description**: **Strong proficiency Scala + Spark (Hadoop) with Java (mandatory)** Database experience preferably with DB2, Sybase, or Oracle - Complete SDLC process and Agile Methodology (Scrum) - Version control - Git - Spring Skill Desired: - Previous experience in Trade Surveillance or working with data from the order lifecycle - High quality...

  • Big Data Consultant

    1 month ago

    Bengaluru, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

  • Big Data Consultant

    1 week ago

    Bengaluru, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

  • Big Data Architect

    2 months ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...

  • Azure Big Data Architect

    1 month ago

    Bengaluru, India Tiger Analytics Full time

    Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset. - Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work with teams that push the...

  • Azure Big Data Architect

    7 days ago

    Bengaluru, India Tiger Analytics Full time

    Job DescriptionTiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset.Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work with teams...

  • IQVIA - Big Data Developer - Hadoop/Spark

    2 months ago

    Bengaluru, India IQVIA RDS India Pvt Ltd Full time

    Job Title / Primary Skill : Big Data DeveloperManagement Level : G130Years of Experience : 2 to 5 yearsJob Location : Bangalore (Hybrid)Must Have Skills : Bigdata Developer, Hadoop, Hive, Scala, and Spark.Educational Qualification : BE/BTech/ MTech/ MCARole & responsibilities : - Minimum 3+ years of experience in Big Data development.- Good understanding of...

  • Principal Consultant

    1 month ago

    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Principal Consultant

    1 week ago

    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Big Data Developer

    4 days ago

    Bengaluru, India Xcelyst Full time

    Big Data + Scala developer Experience : 4-8 Yrs. experience overallMandatory Skills :Programming Languages : Scala (SCALA IS MAND)Big Data Frameworks : Spark, Hadoop/HDFS/Hive/Sqoop/Oozie, Kafka, HBase or any other NoSQL StoreGood to Have : Streaming with Spark/Kafka, Cloud knowledge (AWS/Azure)Scheduling and creatinLocation : Bangalore / PuneNotice Period :...

  • Azure Big Data Architect

    1 week ago

    Bengaluru, India Tiger Analytics Full time

    Job Description Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset. Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work with...

  • Big Data Architect

    2 months ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize...

  • Big Data Architect

    1 week ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize...

  • Principal Consultant

    1 month ago

    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Principal Consultant

    1 week ago

    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, India Coforge Full time

    Job DescriptionJob description Role and responsibilities : -Experience required- 4 to 10 YearsCreating Project Technical Documentation - Designing Solution architecture, and work on Data Ingestion, Preparation and Transformation.Debugging the production failures and identifying the solution.- Developing efficient frameworks for development and testing using...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Coforge Full time

    Job Description Job description Role and responsibilities : - Experience required- 4 to 10 Years Creating Project Technical Documentation - Designing Solution architecture, and work on Data Ingestion, Preparation and Transformation. Debugging the production failures and identifying the solution. - Developing efficient frameworks for...

  • Big Data Engineer

    1 month ago

    Bengaluru, India TalentPulse Consultant Full time

    Role : Big Data EngineerJob Description :We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis.The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala.This is an active position with a high priority, offering a competitive rate and the...

  • Senior Data Engineer

    2 months ago

    Bengaluru, India CliqHR Full time

    Job Description :Mandatory Skills : Microsoft Azure, Hadoop, Spark, Databricks, Airflow, Kafka, Py sparkRequirements :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python, Airflow, Scala, Kafka- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new...

  • Hadoop Developer

    1 month ago

    Bengaluru, India Andor Tech Full time

    Job Description :We are seeking a skilled Hadoop Developer with mandatory working experience in Elasticsearch to join our team. The ideal candidate should have a minimum of 2 years of experience in Hadoop and Spark development. This role will involve working with large datasets and implementing data processing solutions using Hadoop and Spark, with a...