Senior AWS Data Engineer

2 days ago

Bengaluru, Karnataka, India SWITS DIGITAL Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Description – Senior AWS Data Engineer
Experience Required:
8+ Years (Developer – Standard)

Relevant Experience:
8 Years

Location:
Bangalore / Hyderabad

Qualifications

  • Bachelor's degree in Computer Science, Software Engineering, MIS, or equivalent.
  • 8+ years as a Data Engineer on the AWS stack with hands-on DevOps experience.
  • AWS Solutions Architect or AWS Developer Certification (mandatory).

Technical Expertise Required

  • Strong hands-on experience with AWS services: CloudFormation, S3, Athena, Glue/Glue DataBrew, EMR/Spark, RDS, Redshift, DataSync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, Secrets Manager, EventBridge, EC2, SQS, SNS, Lake Formation, CloudWatch, CloudTrail.
  • Experience implementing streaming solutions using Kinesis, AWS Managed Airflow, and AWS Managed Kafka.
  • Strong background building AWS Data Lake and Data Warehouse solutions.
  • Experience designing and implementing ETL/ELT pipelines.
  • Knowledge of RBAC implementation using AWS IAM and Redshift RBAC models.
  • Experience building CI/CD pipelines using CloudFormation and Jenkins.
  • Strong programming experience: Python, Shell scripting, SQL.

  • Expertise in developing automated data pipelines from:

  • Relational databases → RDS, Aurora, Redshift

  • REST APIs → S3 / RDS / Aurora / Redshift

  • Experience with modern source code tools (Bitbucket).

  • Experience with DevOps and development tools: Jenkins, CloudBees, SonarQube, Artifactory, Maven, MS Build, Gradle, Docker.
  • Atlassian tools: Jira, Confluence.
  • Experience with Infrastructure as Code using CloudFormation.
  • Experience integrating Sonar/Security scans and test automation scripts in CI/CD.
  • Experience in DevOps QA environments focusing on pipeline creation and optimization.

Key Responsibilities

  • Design, develop, and implement data ingestion and processing pipelines on AWS.
  • Develop end-to-end AWS-based data lake and data warehouse solutions.
  • Implement streaming and orchestration solutions using Kinesis, Airflow, or Kafka.
  • Build and enhance CI/CD pipelines for the EDP Platform using Jenkins & CloudFormation.
  • Implement automation for data ingestion from databases, file systems, NAS, and REST APIs.
  • Manage IAM roles, RBAC strategies, and security best practices across AWS services.
  • Integrate DevOps tools (SonarQube, Artifactory, CloudBees) into the CI/CD strategy.
  • Collaborate with engineering, QA, and DevOps teams to streamline delivery.
  • Maintain clear documentation including exceptions, issue logs, and action plans.
  • Administer and manage DevOps tools in SaaS environments.
  • Build Jenkins pipelines (Pipeline-as-Code) and maintain shared libraries.
  • Monitor and optimize system performance using AWS monitoring tools.

Mandatory Skills
Primary Skills

  • Core AWS Data Engineering & DevOps: Python, SQL, CI/CD (Jenkins, CloudFormation), ETL/ELT, Data Lake
  • AWS Data Services Expertise: IAM, Glue, Glue Crawlers, Glue DataBrew, Step Functions, Lambda, Redshift, SQS, SNS, EventBridge, Athena, Lake Formation
  • Version Control: Bitbucket / GitHub

Secondary Skills

  • Streaming technologies: Kinesis, Kafka
  • Docker, SonarQube, Maven, Groovy

Nice-to-Have Skills

  • CloudBees
  • QA integration
  • Agile project management exposure
  • Strong documentation skills
  • Continuous learning mindset

  • Senior Data Engineer – AWS

    11 hours ago

    Bengaluru, Karnataka, India Evnek Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a Senior Data Engineer who will design, build, and maintain scalable data pipelines and ingestion frameworks.The ideal candidate must have experience with DBT, orchestration tools like Airflow or Prefect, and cloud platforms such as AWS.Responsibilities include developing ELT pipelines, optimizing queries, implementing CI/CD, and...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • Software Development Manager, AWS OpenSearch Service, AWS OpenSearch Core

    4 days ago

    Bengaluru, Karnataka, India Amazon Web Services (AWS) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionAWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon's Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll support the...

  • Senior Software Engineer-AWS

    2 weeks ago

    Bengaluru, Karnataka, India RapidQube Digital Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We RapidQube Digital Solutions are hiring – Senior Software Engineer / Module Lead (AWS & Data Engineering)Role: SSE/Module Lead-AWS & Data EngineeringExp: 6-8 YrsLocation: BangaloreType: Full-timeMode: Work from officeNotice Period: Immediate JoinersWe RapidQube Digital Solutions are looking for a Senior Software Engineer / Module Lead with strong...

  • Data Engineer Senior Consultant

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Req ID: 341131NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Location: | Experience:...

  • AWS Architect

    7 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role SummaryAs a AWS Architect, you will lead the design and implementation of scalable, secure, and high-performance data solutions using AWS Platform. You will define architectural standards, guide engineering teams, and collaborate with stakeholders to align data strategies with business goals. Your role will focus on leveraging AWS capabilities to build...

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Teamware Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    AWS Data EngineersRole Overview:PwC is seeking a highly skilled AWS Data Engineer to join our Cloud, Data & AI practice and play a key role in delivering cutting-edge, cloud-native data solutions for our clients across industries. In this role, you will design and implement scalable, secure, and resilient data architectures on AWS that enable actionable...

  • AWS Devops Engineer

    15 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 16,00,000 per year

    Req ID: 343046NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Devops Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). 8+ Proven experience in Design,...

  • Aws Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Nam Info Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Hi ,Hope you are doing well. Please find the below Job description. IF this is of your interest kindly share the resume along with contact details and the current CTC and expected CTC and send it to -Role : AWS Data Engineer with Snowflake,Spark and Medallion ArchitectureLocation : Banashankari 2nd Stage Bengaluru ( All 5 Days Onsite)Duration : FTE with NAM...

  • AWS Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Info Origin Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Note: Virtual Drive on 14th and 15th OctRole OverviewWe are looking for an experienced AWS Engineer with around 5-7 years of hands-on experience in designing, deploying, and managing applications on the AWS cloud platform. The ideal candidate should have strong expertise in AWS services, automation, and cloud security, along with the ability to collaborate...