Big Data Solutions Architect

4 days ago

Mumbai, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000
Job Description:

This role involves the design, development and implementation of end-to-end big data solutions using MapR, Apache Hadoop and associated ecosystem tools.

The incumbent will lead data platform modernization efforts including architecture reviews, platform upgrades and migrations.

A strong understanding of distributed systems, high availability and cluster management is essential for this position.

In addition, the ideal candidate should have experience with data ingestion, transformation and ETL pipelines.

Proficiency with big data tools such as Apache Spark, Kafka, Hive, HBase, Oozie, Sqoop and Flume is also required.

Key Responsibilities:

  • Design, architect and implement end-to-end big data solutions.
  • Lead data platform modernization efforts.
  • Collaborate with data engineers, data scientists and application teams to gather requirements and build scalable, secure data pipelines.
  • Define data governance, security and access control strategies in the MapR ecosystem.
  • Optimize performance of distributed systems.
  • Guide teams on best practices in big data development, deployment and maintenance.
  • Conduct code reviews and architecture assessments.
  • Provide mentorship to junior engineers and technical leadership across big data initiatives.
Qualifications and Requirements:
  • Bachelor's or Master's degree in Computer Science, Data Engineering or related field.
  • 6+ years of experience in data architecture, with at least 3 years working specifically on MapR and Hadoop ecosystems.
  • Expertise in MapR-DB, MapR Streams and MapR-FS.
  • Proficiency with big data tools: Apache Spark, Kafka, Hive, HBase, Oozie, Sqoop, Flume.
  • Strong programming skills in Java, Scala or Python.
  • Solid understanding of distributed systems, high availability and cluster management.
  • Experience with data ingestion, transformation and ETL pipelines.
  • Familiarity with security controls (Kerberos, Ranger, Knox, etc.) and data governance.
  • Experience with CI/CD, Docker, Kubernetes is a plus.
Desirable Skills and Certifications:
  • Certifications such as Cloudera Certified Professional (CCP), MapR Certified or Hortonworks HDP Certification.
  • Exposure to cloud-based big data platforms like AWS EMR, Azure HDInsight or GCP Dataproc.
  • Experience with NoSQL and real-time data streaming architectures.
  • Ability to communicate architectural concepts to both technical and non-technical stakeholders.

  • Emergy - Senior Solution Architect - Big Data

    4 weeks ago

    Mumbai, Maharashtra, India Emergys Software Private Limited Innovation for Ag Full time

    Responsibilities :- Evangelize, motivate, and enable our customers on their Enterprise Data Cloud journey.- Participate in the pre and post sales process, helping both the sales, professional services management and product teams to interpret customer use cases.- Use your deep domain, wide technical and business knowledge to assist customers in defining...

  • Big Data Developer

    4 weeks ago

    Mumbai, Maharashtra, India HirePower Staffing Solution Full time

    Position Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...

  • Big Data Developer

    3 weeks ago

    Mumbai, Maharashtra, India HirePower Staffing Solution Full time

    Position Overview: We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent. You...

  • Engineering Manager – Big Data, Azure

    4 weeks ago

    Mumbai, Maharashtra, India DataE2E Technologies Full time

    Job Title: Engineering Manager – Big Data, Azure & DatabricksLocation: RemoteEmployment Type: Full-timeDepartment: Data Engineering / TechnologyExperience: 8+ years (3+ years in a managerial role)About the Role:We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure, and Databricks....

  • Big Data Architecture Lead

    1 day ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Description">Data Architect and Engineer PositionWe are seeking a skilled Data Architect and Engineer to join our team. The ideal candidate will have experience in designing, building, and maintaining high-performance data pipelines that process large amounts of data.The successful candidate will work on optimizing our existing systems, identifying and...

  • AI & Data Architect

    2 days ago

    Mumbai, Maharashtra, India CloudFronts - AI First Microsoft Solutions Partner Full time

    AI & Data Architect Job Summary: AI & Data Architect will lead all aspects of AI, Business Intelligence, and Data Architecture with expertise in Azure services, including AI/ML solutions, data engineering, and analytics. The role involves designing, configuring, and managing BI services, aggregating data from multiple sources into a data warehouse,...

  • Big Data

    5 minutes ago

    Mumbai, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiNotice Period: 0 - 45 daysJob Description:-Must-HavePySparkHiveGood-to-HaveSparkHBaseDQ toolAgile Scrum experienceExposure in data ingestion from disparate sources onto Big Data platform

  • AI & Data Architect

    2 days ago

    Mumbai, Maharashtra, India CloudFronts - AI First Microsoft Solutions Partner Full time

    AI & Data ArchitectJob Summary:AI & Data Architect will lead all aspects of AI, Business Intelligence, and Data Architecture with expertise in Azure services, including AI/ML solutions, data engineering, and analytics. The role involves designing, configuring, and managing BI services, aggregating data from multiple sources into a data warehouse,...

  • Data Architect

    3 weeks ago

    Mumbai, Maharashtra, India Quantiphi Full time

    Role: Technical Architect - DataExperience Level: 10 to 15 YearsWork location: Mumbai, Bangalore, Trivandrum (Hybrid)Notice Period: AnyRole & Responsibilities:More than 8 years of experience in Technical, Solutioning, and Analytical roles.5+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and Business...

  • Senior Big Data Engineer

    1 day ago

    Mumbai, Maharashtra, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Scientist RoleJoin us in a challenging role that involves working with large datasets and developing scalable data processing solutions.Key Responsibilities:Develop and maintain big data pipelines using PySpark and AWS services.Work with cross-functional teams to design and implement data warehousing solutions.Analyze complex data sets to gain insights...