AWS Big Data Lead

3 weeks ago

Bengaluru, India CODERS BRAIN TECHNOLOGY PRIVATE LIMITED Full time

About the Role

We are seeking a highly skilled AWS Big Data Lead & Technical Architect with over 10 years of experience in designing, implementing, and leading enterprise-grade Big Data solutions. The ideal candidate will combine deep technical expertise in AWS and Big Data technologies with strong leadership and architectural skills to drive large-scale data transformation initiatives.

Key ResponsibilitiesLeadership & Strategy

  • Lead and mentor cross-functional teams of Big Data engineers and solution architects.
  • Define and execute the data architecture strategy, roadmaps, and modernization initiatives.
  • Collaborate with business stakeholders, product managers, and data scientists to deliver scalable and impactful data solutions.
  • Provide technical thought leadership and guide clients in adopting AWS-based data platforms.

Technical Architecture

  • Architect and implement end-to-end Big Data solutions (data ingestion, storage, processing, and analytics) on AWS.
  • Design and optimize data lakes, data warehouses, and streaming architectures using AWS services (S3, Glue, Redshift, EMR, Athena, Kinesis, Lambda, DynamoDB).
  • Define best practices for scalability, security, data governance, and performance optimization.
  • Create architecture blueprints, high-level design documents, and technical specifications.
  • Ensure compliance with data security, privacy, and regulatory frameworks (GDPR, HIPAA, etc.).

Engineering & Delivery

  • Oversee the development of ETL/ELT pipelines, real-time streaming solutions, and advanced analytics platforms.
  • Optimize workloads for cost efficiency, reliability, and high availability.
  • Collaborate with DevOps teams to implement CI/CD pipelines, Infrastructure as Code (Terraform/CloudFormation), and monitoring solutions.
  • Evaluate emerging technologies and recommend innovative solutions for evolving business needs.

Required Skills & Qualifications

  • 10+ years of experience in Big Data engineering, solution architecture, and leadership.
  • Strong expertise in AWS cloud services (S3, EMR, Glue, Redshift, Kinesis, Athena, Lambda, DynamoDB).
  • Hands-on experience with Hadoop ecosystem, Spark, Kafka, Hive, and Presto.
  • Proficiency in Python, Java/Scala, and SQL for data processing.
  • Deep understanding of data modeling, metadata management, and governance frameworks.
  • Strong experience in technical architecture, system design, and integration.
  • Excellent leadership, stakeholder management, and communication skills.
  • AWS Certifications (e.g., AWS Certified Solutions Architect – Professional, AWS Data Analytics Specialty) preferred.

Job Type: Full-time

Work Location: In person

  • AWS Big Lead Data Engineer

    1 week ago

    Bengaluru, Karnataka, India CODERS BRAIN TECHNOLOGY PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the Role : We are looking for an experienced AWS Big Data Lead Engineer to design, build, and manage scalable data solutions on AWS. The ideal candidate will have extensive hands-on experience in Big Data technologies, cloud-native architecture, and leadership to guide engineering teams in delivering enterprise-grade data pipelines and analytics...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India VidPro Consultancy Services Full time

    Role : Big Data Engineer Location : Bangalore Job Type : Fulltime, Hybrid Skills : Python, Spark, SQL, Databricks, Hadoop, Hive, Spark, AWS, DSA Job Overview We are seeking a Junior Big Data Engineer specializing in AWS for a full-time role located in Bangalore Urban, Bangalore Rural, Bangalore. As a key contributor in this role, you will leverage your...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India VidPro Consultancy Services Full time

    Role : Big Data Engineer Location : Bangalore Job Type : Fulltime, Hybrid Skills : Python, Spark, SQL, Databricks, Hadoop, Hive, Spark, AWS, DSA Job Overview We are seeking a Junior Big Data Engineer specializing in AWS for a full-time role located in Bangalore Urban, Bangalore Rural, Bangalore. As a key contributor in this role, you will...

  • AWS Big Data Engineer/Architect

    1 week ago

    Bengaluru, Karnataka, India CODERS BRAIN TECHNOLOGY PRIVATE LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About the Role : We are looking for an experienced AWS Big Data Engineer & Architect to design, implement, and manage large-scale data platforms on AWS. The ideal candidate will have strong expertise in Big Data technologies, cloud-native architecture, and hands-on experience building scalable, secure, and high-performance data solutions.Key...

  • Big Data Consultant, Data

    2 weeks ago

    Bengaluru, India AWS ProServe IN - Karnataka Full time

    AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and...

  • Big Data Consultant, Data

    2 weeks ago

    Bengaluru, India AWS ProServe IN - Karnataka Full time

    AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and...

  • AWS Big data pyspark SQL Spark Airflow

    2 weeks ago

    Bengaluru, India ScaleneWorks Full time

    Job Title: AWS Big Data Engineer About the Role: We are looking for a highly skilled AWS Big Data Engineer with extensive experience in PySpark, SQL, Spark, and Airflow. The ideal candidate will have a strong background in coding and a deep understanding of big data technologies. You will be responsible for designing, developing, and maintaining big data...

  • Sr Architect

    2 weeks ago

    Bengaluru, India WNS Full time

    Company Description WNS (Holdings) Limited (NYSE: WNS) , is a leading Business Process Management (BPM) company. We combine our deep industry knowledge with technology and analytics expertise to co-create innovative, digital-led transformational solutions with clients across 10 industries. We enable businesses in Travel, Insurance, Banking and...

  • Sr Architect

    2 weeks ago

    Bengaluru, India WNS Full time

    Company Description WNS (Holdings) Limited (NYSE: WNS) , is a leading Business Process Management (BPM) company. We combine our deep industry knowledge with technology and analytics expertise to co-create innovative, digital-led transformational solutions with clients across 10 industries. We enable businesses in Travel, Insurance, Banking and...

  • Data Scientist

    2 weeks ago

    Bengaluru, India AWS ProServe IN - Karnataka Full time

    A Bachelor or Masters Degree in a highly quantitative field (Computer Science, Machine Learning, Operational Research, Statistics, Mathematics, etc.) or equivalent experience - 6+ years of industry experience in predictive modeling, data science and analysis - Previous experience in a ML or data scientist role and a track record of building ML or DL models -...