AWS Big Data Lead

3 days ago

Bengaluru, Karnataka, India CODERS BRAIN TECHNOLOGY PRIVATE LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per year

About the Role

We are seeking a highly skilled AWS Big Data Lead & Technical Architect with over 10 years of experience in designing, implementing, and leading enterprise-grade Big Data solutions. The ideal candidate will combine deep technical expertise in AWS and Big Data technologies with strong leadership and architectural skills to drive large-scale data transformation initiatives.

Key ResponsibilitiesLeadership & Strategy

  • Lead and mentor cross-functional teams of Big Data engineers and solution architects.
  • Define and execute the data architecture strategy, roadmaps, and modernization initiatives.
  • Collaborate with business stakeholders, product managers, and data scientists to deliver scalable and impactful data solutions.
  • Provide technical thought leadership and guide clients in adopting AWS-based data platforms.

Technical Architecture

  • Architect and implement end-to-end Big Data solutions (data ingestion, storage, processing, and analytics) on AWS.
  • Design and optimize data lakes, data warehouses, and streaming architectures using AWS services (S3, Glue, Redshift, EMR, Athena, Kinesis, Lambda, DynamoDB).
  • Define best practices for scalability, security, data governance, and performance optimization.
  • Create architecture blueprints, high-level design documents, and technical specifications.
  • Ensure compliance with data security, privacy, and regulatory frameworks (GDPR, HIPAA, etc.).

Engineering & Delivery

  • Oversee the development of ETL/ELT pipelines, real-time streaming solutions, and advanced analytics platforms.
  • Optimize workloads for cost efficiency, reliability, and high availability.
  • Collaborate with DevOps teams to implement CI/CD pipelines, Infrastructure as Code (Terraform/CloudFormation), and monitoring solutions.
  • Evaluate emerging technologies and recommend innovative solutions for evolving business needs.

Required Skills & Qualifications

  • 10+ years of experience in Big Data engineering, solution architecture, and leadership.
  • Strong expertise in AWS cloud services (S3, EMR, Glue, Redshift, Kinesis, Athena, Lambda, DynamoDB).
  • Hands-on experience with Hadoop ecosystem, Spark, Kafka, Hive, and Presto.
  • Proficiency in Python, Java/Scala, and SQL for data processing.
  • Deep understanding of data modeling, metadata management, and governance frameworks.
  • Strong experience in technical architecture, system design, and integration.
  • Excellent leadership, stakeholder management, and communication skills.
  • AWS Certifications (e.g., AWS Certified Solutions Architect – Professional, AWS Data Analytics Specialty) preferred.

Job Type: Full-time

Work Location: In person

  • AWS Big Lead Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    About the Role :We are looking for an experienced AWS Big Data Lead Engineer to design, build, and manage scalable data solutions on AWS. The ideal candidate will have extensive hands-on experience in Big Data technologies, cloud-native architecture, and leadership to guide engineering teams in delivering enterprise-grade data pipelines and analytics...

  • AWS Big Data Engineer/Architect

    4 weeks ago

    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    About the Role :We are looking for an experienced AWS Big Data Engineer & Architect to design, implement, and manage large-scale data platforms on AWS. The ideal candidate will have strong expertise in Big Data technologies, cloud-native architecture, and hands-on experience building scalable, secure, and high-performance data solutions.Key Responsibilities...

  • AWS Big data Architect

    3 weeks ago

    Bengaluru, Karnataka, India Birlasoft Limited Full time

    Job DescriptionKey Responsibilities- Design and architect end to end solutions on AWS and create the HLD and LLD documents- Experience in real-time Data Ingestion and Processing- Hands-on experience in AWS S3, Kafka, Glue, PySpark, Python, Redshift, AWS Cloud best practices and optimization- Experience with integration of different data sources with Data...

  • Big Basket

    4 weeks ago

    Bengaluru, Karnataka, India big basket Full time

    What would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...

  • Big Basket

    4 weeks ago

    Bengaluru, Karnataka, India big basket Full time

    As a Software Engineer we are looking for developers who share our passion for building world class software. If you are excited about the prospect of changing the way India shops for groceries and being a pioneer then this a great home for you. Not to mention the thrill of building products that millions use daily and using cutting edge technology to make...

  • Big Data Developer

    3 days ago

    Bengaluru, Karnataka, India SP Software Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Preferred candidate profile - Currently serving Notice Period who can join with in days only 5+ Years of Experience is Mandate in AWS and BigdataRole & responsibilitiesExperience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)• Write SQL queries to validate the dashboard output• Working experience with database environment -...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Kezan Consulting Full time

    Position : Big Data Engineer (Immediate Joiner)Experience : 5+ YearsLocation : (Gurugram / Bangalore)Joining : Immediate JoinerJob Summary : We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala.The ideal candidate will...

  • Lead Architect AWS

    2 days ago

    Bengaluru, Karnataka, India Fractal Full time US$ 1,50,000 - US$ 2,00,000 per year

    It's fun to work in a company where people truly BELIEVE in what they are doingWe're committed to bringing passion and customer focus to the business.Job Description PositionAWS Lead ArchitectAWS Practice ResponsibilitiesConsult, Design, build and operationalize large scale enterprise data solutions using one or more of AWS data and analytics services in...

  • AWS Architect Lead

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Req ID: 327912NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Architect Lead to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Title: Digital Engineering Sr...

  • Technical Lead- Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...