AWS Big Data Lead

1 day ago

Bengaluru, India CODERS BRAIN TECHNOLOGY PRIVATE LIMITED Full time

About the Role

We are seeking a highly skilled AWS Big Data Lead & Technical Architect with over 10 years of experience in designing, implementing, and leading enterprise-grade Big Data solutions. The ideal candidate will combine deep technical expertise in AWS and Big Data technologies with strong leadership and architectural skills to drive large-scale data transformation initiatives.

Key ResponsibilitiesLeadership & Strategy

  • Lead and mentor cross-functional teams of Big Data engineers and solution architects.
  • Define and execute the data architecture strategy, roadmaps, and modernization initiatives.
  • Collaborate with business stakeholders, product managers, and data scientists to deliver scalable and impactful data solutions.
  • Provide technical thought leadership and guide clients in adopting AWS-based data platforms.

Technical Architecture

  • Architect and implement end-to-end Big Data solutions (data ingestion, storage, processing, and analytics) on AWS.
  • Design and optimize data lakes, data warehouses, and streaming architectures using AWS services (S3, Glue, Redshift, EMR, Athena, Kinesis, Lambda, DynamoDB).
  • Define best practices for scalability, security, data governance, and performance optimization.
  • Create architecture blueprints, high-level design documents, and technical specifications.
  • Ensure compliance with data security, privacy, and regulatory frameworks (GDPR, HIPAA, etc.).

Engineering & Delivery

  • Oversee the development of ETL/ELT pipelines, real-time streaming solutions, and advanced analytics platforms.
  • Optimize workloads for cost efficiency, reliability, and high availability.
  • Collaborate with DevOps teams to implement CI/CD pipelines, Infrastructure as Code (Terraform/CloudFormation), and monitoring solutions.
  • Evaluate emerging technologies and recommend innovative solutions for evolving business needs.

Required Skills & Qualifications

  • 10+ years of experience in Big Data engineering, solution architecture, and leadership.
  • Strong expertise in AWS cloud services (S3, EMR, Glue, Redshift, Kinesis, Athena, Lambda, DynamoDB).
  • Hands-on experience with Hadoop ecosystem, Spark, Kafka, Hive, and Presto.
  • Proficiency in Python, Java/Scala, and SQL for data processing.
  • Deep understanding of data modeling, metadata management, and governance frameworks.
  • Strong experience in technical architecture, system design, and integration.
  • Excellent leadership, stakeholder management, and communication skills.
  • AWS Certifications (e.g., AWS Certified Solutions Architect – Professional, AWS Data Analytics Specialty) preferred.

Job Type: Full-time

Work Location: In person

  • AWS Big Data Lead

    2 weeks ago

    Bengaluru, Karnataka, India CODERS BRAIN TECHNOLOGY PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    About the RoleWe are seeking a highly skilled AWS Big Data Lead & Technical Architect with over 10 years of experience in designing, implementing, and leading enterprise-grade Big Data solutions. The ideal candidate will combine deep technical expertise in AWS and Big Data technologies with strong leadership and architectural skills to drive large-scale data...

  • AWS Big Lead Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    About the Role :We are looking for an experienced AWS Big Data Lead Engineer to design, build, and manage scalable data solutions on AWS. The ideal candidate will have extensive hands-on experience in Big Data technologies, cloud-native architecture, and leadership to guide engineering teams in delivering enterprise-grade data pipelines and analytics...

  • AWS Big Data Lead And Technical Architect

    2 weeks ago

    Bengaluru South, Karnataka, India CodersBrain Full time US$ 1,50,000 - US$ 2,00,000 per year

    About the RoleWe are seeking a highly skilledAWS Big Data Lead & Technical Architectwith over 10 years of experience in designing, implementing, and leading enterprise-grade Big Data solutions. The ideal candidate will combine deeptechnical expertise in AWS and Big Data technologieswith strong leadership and architectural skills to drive large-scale data...

  • AWS Big Data Engineer/Architect

    2 weeks ago

    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    About the Role :We are looking for an experienced AWS Big Data Engineer & Architect to design, implement, and manage large-scale data platforms on AWS. The ideal candidate will have strong expertise in Big Data technologies, cloud-native architecture, and hands-on experience building scalable, secure, and high-performance data solutions.Key Responsibilities...

  • AWS Big data Architect

    2 weeks ago

    Bengaluru, Karnataka, India Birlasoft Limited Full time

    Job DescriptionKey Responsibilities- Design and architect end to end solutions on AWS and create the HLD and LLD documents- Experience in real-time Data Ingestion and Processing- Hands-on experience in AWS S3, Kafka, Glue, PySpark, Python, Redshift, AWS Cloud best practices and optimization- Experience with integration of different data sources with Data...

  • Senior Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Big Data Engineer - AWS Scalability ExpertWe are seeking an exceptional Senior Big Data Engineer with in-depth knowledge of AWS Cloud Services and Big Data technologies to lead the design, development, and optimization of scalable data engineering solutions.Key Responsibilities:Data Architecture Design: Develop and implement highly efficient Big Data...

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job OverviewWe are seeking a highly skilled data engineer to join our team. As a data engineer, you will be responsible for designing and implementing data pipelines using AWS services such as S3, Glue, PySpark and EMR.Key Responsibilities:Design and implement data pipelines using AWS services.Develop and maintain data processing and transformation scripts...

  • Big Basket

    2 weeks ago

    Bengaluru, Karnataka, India big basket Full time

    What would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...

  • AWS Data Engineer

    4 days ago

    Bengaluru, India Arccaa Analytics & IT Solutions Full time

    Job Description :We are seeking a highly skilled AWS Data Engineer with strong hands-on experience in Python, PySpark, and a wide range of AWS services. The ideal candidate should have excellent analytical skills and the ability to develop scalable data processing solutions while meeting complex business requirements.Key Responsibilities :- Develop and...

  • Big Data Architect

    23 hours ago

    Bengaluru, India Bizessence Full time

    **Job Description**: - Overall experience of over 8+ years in big data space in leading projects or unit of work. - Experience in architecting, designing, and delivering data pipelining solutions in cloud technologies such as Azure Synapse, AWS EMR, Databricks or Snowflake. Certifications are a plus. - Project experience in Data Warehousing, Business...