AWS Big Data Lead

3 days ago

Bengaluru, Karnataka, India CODERS BRAIN TECHNOLOGY PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 20,00,000 per year

About the Role

We are seeking a highly skilled AWS Big Data Lead & Technical Architect with over 10 years of experience in designing, implementing, and leading enterprise-grade Big Data solutions. The ideal candidate will combine deep technical expertise in AWS and Big Data technologies with strong leadership and architectural skills to drive large-scale data transformation initiatives.

Key ResponsibilitiesLeadership & Strategy

  • Lead and mentor cross-functional teams of Big Data engineers and solution architects.
  • Define and execute the data architecture strategy, roadmaps, and modernization initiatives.
  • Collaborate with business stakeholders, product managers, and data scientists to deliver scalable and impactful data solutions.
  • Provide technical thought leadership and guide clients in adopting AWS-based data platforms.

Technical Architecture

  • Architect and implement end-to-end Big Data solutions (data ingestion, storage, processing, and analytics) on AWS.
  • Design and optimize data lakes, data warehouses, and streaming architectures using AWS services (S3, Glue, Redshift, EMR, Athena, Kinesis, Lambda, DynamoDB).
  • Define best practices for scalability, security, data governance, and performance optimization.
  • Create architecture blueprints, high-level design documents, and technical specifications.
  • Ensure compliance with data security, privacy, and regulatory frameworks (GDPR, HIPAA, etc.).

Engineering & Delivery

  • Oversee the development of ETL/ELT pipelines, real-time streaming solutions, and advanced analytics platforms.
  • Optimize workloads for cost efficiency, reliability, and high availability.
  • Collaborate with DevOps teams to implement CI/CD pipelines, Infrastructure as Code (Terraform/CloudFormation), and monitoring solutions.
  • Evaluate emerging technologies and recommend innovative solutions for evolving business needs.

Required Skills & Qualifications

  • 10+ years of experience in Big Data engineering, solution architecture, and leadership.
  • Strong expertise in AWS cloud services (S3, EMR, Glue, Redshift, Kinesis, Athena, Lambda, DynamoDB).
  • Hands-on experience with Hadoop ecosystem, Spark, Kafka, Hive, and Presto.
  • Proficiency in Python, Java/Scala, and SQL for data processing.
  • Deep understanding of data modeling, metadata management, and governance frameworks.
  • Strong experience in technical architecture, system design, and integration.
  • Excellent leadership, stakeholder management, and communication skills.
  • AWS Certifications (e.g., AWS Certified Solutions Architect – Professional, AWS Data Analytics Specialty) preferred.

Job Type: Full-time

Work Location: In person

  • AWS Big Lead Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    About the Role :We are looking for an experienced AWS Big Data Lead Engineer to design, build, and manage scalable data solutions on AWS. The ideal candidate will have extensive hands-on experience in Big Data technologies, cloud-native architecture, and leadership to guide engineering teams in delivering enterprise-grade data pipelines and analytics...

  • AWS Big Data Engineer/Architect

    4 days ago

    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    About the Role :We are looking for an experienced AWS Big Data Engineer & Architect to design, implement, and manage large-scale data platforms on AWS. The ideal candidate will have strong expertise in Big Data technologies, cloud-native architecture, and hands-on experience building scalable, secure, and high-performance data solutions.Key Responsibilities...

  • AWS Big data Architect

    3 days ago

    Bengaluru, Karnataka, India Birlasoft Limited Full time

    Job DescriptionKey Responsibilities- Design and architect end to end solutions on AWS and create the HLD and LLD documents- Experience in real-time Data Ingestion and Processing- Hands-on experience in AWS S3, Kafka, Glue, PySpark, Python, Redshift, AWS Cloud best practices and optimization- Experience with integration of different data sources with Data...

  • AWS Data Engineer

    4 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job OverviewWe are seeking a highly skilled data engineer to join our team. As a data engineer, you will be responsible for designing and implementing data pipelines using AWS services such as S3, Glue, PySpark and EMR.Key Responsibilities:Design and implement data pipelines using AWS services.Develop and maintain data processing and transformation scripts...

  • Big Basket

    4 days ago

    Bengaluru, Karnataka, India big basket Full time

    What would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...

  • Senior Big Data Architect

    1 week ago

    Bengaluru, Karnataka, India beBeeDataArchitect Full time ₹ 25,00,000 - ₹ 35,00,000

    Job SummaryWe are seeking a highly skilled Senior Big Data Architect to design and implement large-scale data architectures that drive business growth and innovation. The ideal candidate will have extensive experience in big data technologies, including data warehousing, ETL, and data visualization.Key ResponsibilitiesDesign and implement scalable data...

  • Senior AWS Data Architect

    4 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Design and Lead Data Solutions on AWSAbout this Role:We are seeking an experienced data engineer to lead the development of end-to-end Big Data solutions on AWS.Key Responsibilities:To design, implement and optimize data lakes, data warehouses and streaming pipelines.Build ETL/ELT pipelines for batch and real-time data processing.Ensure high performance,...

  • Lead Architect AWS

    3 days ago

    Bengaluru, Karnataka, India Fractal Full time US$ 1,50,000 - US$ 2,00,000 per year

    It's fun to work in a company where people truly BELIEVE in what they are doingWe're committed to bringing passion and customer focus to the business.Job Description PositionAWS Lead ArchitectAWS Practice ResponsibilitiesConsult, Design, build and operationalize large scale enterprise data solutions using one or more of AWS data and analytics services in...

  • Big Basket

    4 days ago

    Bengaluru, Karnataka, India big basket Full time

    As a Software Engineer we are looking for developers who share our passion for building world class software. If you are excited about the prospect of changing the way India shops for groceries and being a pioneer then this a great home for you. Not to mention the thrill of building products that millions use daily and using cutting edge technology to make...

  • Chief Big Data Strategist

    1 week ago

    Bengaluru, Karnataka, India beBeeDataLeader Full time

    Big Data LeaderThis role offers an exciting opportunity to lead a team of technical professionals in the design, development, and implementation of big data solutions and data analytics projects within the financial services domain.Key Responsibilities:Provide technical expertise and guidance on the selection, hands-on implementation, and optimization of big...