Big Data Architect(Lead)

7 hours ago

Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full time

Big Data Architect- Lead

Experience: 10-12 years

Key Responsibilities:

  • Data Architecture Design: Designing and implementing scalable and resilient data

architectures for both batch and streaming data processing.

  • Data Modeling: Developing data models and database structures to ensure efficient

data storage and retrieval.

  • Data Security and Governance: Ensuring data security, integrity, and compliance

with relevant regulations.

  • Data Integration: Integrating data from various sources, including legacy systems,

into the big data infrastructure.

  • Performance Optimization: Monitoring and optimizing the performance of the big

data infrastructure.

  • Collaboration: Working with data scientists, engineers, and business stakeholders

to understand requirements and translate them into technical solutions.

  • Technology Selection: Evaluating and recommending new technologies and tools

for data management and processing.

  • Mentorship: Provide guidance and mentorship to junior team members.
  • Problem Solving: Identifying and resolving complex data challenges.
  • Participate in the pre and post sales process, helping both the sales, professional.

Skills and Qualifications:

  • Bachelor's / Master's degree in computer science, computer engineering, or

relevant field.

  • Overall 10+ years of experience, at least 2 years of experience in Big Data

Architect.

  • Strong understanding of big data technologies: Hadoop, Spark, NoSQL databases,

cloud-based data services (AWS, Azure, GCP).

  • Experience with open-source ecosystem programming languages (i.e., Python,

Java, Scala, Spark etc.)

  • Proficiency in data modeling and database design: SQL, NoSQL.
  • Experience with ETL processes: Extracting, transforming, and loading data.
  • Strong analytical and problem-solving skills.
  • Good communication and collaboration skills.
  • Experience with data security and governance principles.
  • Knowledge of API design and development.
  • Understanding of data visualization techniques.
  • Strong understanding of authentication (i.e. LDAP , Active Directory, SAML,

Kerberos etc.) & authorization configuration for Hadoop based distributed systems.

  • Familiarity of DevOps methodology & toolsets and automation experience.

Job Types: Full-time, Permanent

Pay: ₹500, ₹1,800,000.00 per year

Benefits:

  • Provident Fund

Work Location: In person

  • Big Data Solution Architect

    2 weeks ago

    Pune, Maharashtra, India Emergys Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Work Location:PuneNotice Period:Immediate to 30 DaysExperience:8+ YearsMust Have Skills:Hadoop Ecosystem Expertise – Strong hands-on experience with core Hadoop components and related big data technologies.DevOps & Cloud (Preferably Azure) – Experience using DevOps tools and CI/CD processes on cloud platforms, with a preference for Microsoft...

  • Big Data Lead

    15 hours ago

    Pune, Maharashtra, India DemandMatrix Full time

    Company Description At DemandMatrix, our vision is to disrupt the $100 billion sales and marketing intelligence industry by using domain knowledge, machine learning and AI. Fortune 100 companies like Microsoft, Google, Adobe, Amazon, IBM trust us to identify their next customer. Job Description What will you do?To help us go to the next level we are looking...

  • Data Architect

    11 hours ago

    Pune, Maharashtra, India Calibo Full time

    About the Role:We are looking for a highly skilled Data Engineering Architect with strong Data Engineering pipeline implementation experience to serve as the lead Solution/Technical Architect and Subject Matter Expert for customer experience data solutions across multiple data sources. The ideal candidate will collaborate with the Enterprise Architect and...

  • Big Data Developer

    4 days ago

    Pune, Maharashtra, India Talent Worx Full time

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    5 days ago

    Pune, Maharashtra, India Talent Worx Full time

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Digital Solution Architect Lead Advisor

    4 days ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID: 342913NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Solution Architect Lead Advisor to join our team in Pune, Karnātaka (IN-KA), India (IN). We are currently...

  • Big Data Developer

    1 week ago

    Pune, Maharashtra, India airtel Full time

    Job Title:Big Data Developer (Manager)Location: PuneExperience: 3-5 yearsJob Description:Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...

  • Big Data Developer Lead

    3 days ago

    Pune, Maharashtra, India People Prime Worldwide Full time

    Our is Client is a largest Top 5 Software giant in India, with over 11.3 USD billion dollars revenue, Global work force 2,40,000 employees, It delivers end-to-end technology, consulting, and business process services to clients across the globe, Presence: 60+ countries and Publicly traded company NSE & BSE (India), NYSE (USA).· Job Title: Big Data Developer...

  • Lead Big Data Engineer Manager

    6 days ago

    Pune, Maharashtra, India CIRCANA Full time

    What will you be doing?As a part of this team, youll work alongside the brightest minds. As a Big Data Lead evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders.Design, develop, and maintain highly scalable data processing applications.Job Responsibilities:Write efficient, reusable and well documented...

  • AWS Big data developer_Manju_Capgemini

    2 days ago

    Pune, Maharashtra, India Coders Brain Technology Full time

    Location : Bangalore Mandatory : • Minimum of 4 to 6 years of relevant work experience as AWS Developer • Good knowledge of Hadoop Architecture and its ecosystem and possess experience in data storage HDFS, writing queries HQL or Spark SQL, data processing and analysis using Pyspark • Strong hands on Experience in AWS Big data tools EMR, Glue,...