AWS Big Data Lead

1 week ago

Bengaluru, Karnataka, India CODERS BRAIN TECHNOLOGY PRIVATE LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per year

About the Role

We are seeking a highly skilled AWS Big Data Lead & Technical Architect with over 10 years of experience in designing, implementing, and leading enterprise-grade Big Data solutions. The ideal candidate will combine deep technical expertise in AWS and Big Data technologies with strong leadership and architectural skills to drive large-scale data transformation initiatives.

Key ResponsibilitiesLeadership & Strategy

  • Lead and mentor cross-functional teams of Big Data engineers and solution architects.
  • Define and execute the data architecture strategy, roadmaps, and modernization initiatives.
  • Collaborate with business stakeholders, product managers, and data scientists to deliver scalable and impactful data solutions.
  • Provide technical thought leadership and guide clients in adopting AWS-based data platforms.

Technical Architecture

  • Architect and implement end-to-end Big Data solutions (data ingestion, storage, processing, and analytics) on AWS.
  • Design and optimize data lakes, data warehouses, and streaming architectures using AWS services (S3, Glue, Redshift, EMR, Athena, Kinesis, Lambda, DynamoDB).
  • Define best practices for scalability, security, data governance, and performance optimization.
  • Create architecture blueprints, high-level design documents, and technical specifications.
  • Ensure compliance with data security, privacy, and regulatory frameworks (GDPR, HIPAA, etc.).

Engineering & Delivery

  • Oversee the development of ETL/ELT pipelines, real-time streaming solutions, and advanced analytics platforms.
  • Optimize workloads for cost efficiency, reliability, and high availability.
  • Collaborate with DevOps teams to implement CI/CD pipelines, Infrastructure as Code (Terraform/CloudFormation), and monitoring solutions.
  • Evaluate emerging technologies and recommend innovative solutions for evolving business needs.

Required Skills & Qualifications

  • 10+ years of experience in Big Data engineering, solution architecture, and leadership.
  • Strong expertise in AWS cloud services (S3, EMR, Glue, Redshift, Kinesis, Athena, Lambda, DynamoDB).
  • Hands-on experience with Hadoop ecosystem, Spark, Kafka, Hive, and Presto.
  • Proficiency in Python, Java/Scala, and SQL for data processing.
  • Deep understanding of data modeling, metadata management, and governance frameworks.
  • Strong experience in technical architecture, system design, and integration.
  • Excellent leadership, stakeholder management, and communication skills.
  • AWS Certifications (e.g., AWS Certified Solutions Architect – Professional, AWS Data Analytics Specialty) preferred.

Job Type: Full-time

Work Location: In person

  • AWS Big Lead Data Engineer

    5 hours ago

    Bengaluru, Karnataka, India CODERS BRAIN TECHNOLOGY PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the Role : We are looking for an experienced AWS Big Data Lead Engineer to design, build, and manage scalable data solutions on AWS. The ideal candidate will have extensive hands-on experience in Big Data technologies, cloud-native architecture, and leadership to guide engineering teams in delivering enterprise-grade data pipelines and analytics...

  • AWS Big Data Engineer/Architect

    4 hours ago

    Bengaluru, Karnataka, India CODERS BRAIN TECHNOLOGY PRIVATE LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About the Role : We are looking for an experienced AWS Big Data Engineer & Architect to design, implement, and manage large-scale data platforms on AWS. The ideal candidate will have strong expertise in Big Data technologies, cloud-native architecture, and hands-on experience building scalable, secure, and high-performance data solutions.Key...

  • Big Data Lead

    1 week ago

    Bengaluru, Karnataka, India Persistent Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...

  • Technical Lead- Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Acme Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    We are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profileCandidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.

  • Big Data Engineer Lead

    4 days ago

    Bengaluru, Karnataka, India Brillio Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Key Skills - Hadoop, PySpark, Python, SQL, Apache Iceberg (niche) , HiveRequirementsSolid knowledge of Hadoop ecosystem such as Hive, Iceberg, Spark SQL and Proficiency in Python, Unix ,SQLExperience with Apache Kafka, Apache Flink, and other relevant streaming technologies.Strong hands-on experience with Hive and SQL for querying and data...

  • AWS Architect Lead

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Req ID: 327912NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Architect Lead to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Title: Digital Engineering Sr...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...

  • Lead Architect AWS

    7 days ago

    Bengaluru, Karnataka, India Fractal Full time US$ 1,50,000 - US$ 2,00,000 per year

    It's fun to work in a company where people truly BELIEVE in what they are doingWe're committed to bringing passion and customer focus to the business.Job Description PositionAWS Lead ArchitectAWS Practice ResponsibilitiesConsult, Design, build and operationalize large scale enterprise data solutions using one or more of AWS data and analytics services in...

  • Aws Lead

    2 days ago

    Bengaluru, Karnataka, India Linkworks Tech Labs Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Role Overview:We are seeking a highly skilled Senior Lead AWS Expert with strong experience in Big Data Analytics to join our team.The ideal candidate will be able to work independently, design scalable solutions, and support customer initiatives from the front line.Non-Negotiable Requirements:Excellent communication and articulation skillsAbility to...