AWS Data

1 week ago

Bengaluru, India Steady Rabbit Full time

Job Title: AWS Data /API Gateway Pipeline Engineer

Experience: 6+ Years

Location: Remote/Bangalore/Hyderabad

Job Description:

AWS Data/API Gateway Pipeline Engineer responsible for designing, building, and maintaining real-time, serverless data pipelines and API services. This role requires extensive hands-on experience with Java, Python, Redis, DynamoDB Streams, and PostgreSQL, along with working knowledge of AWS Lambda and AWS Glue for data processing and orchestration.

This position involves collaboration with architects, backend developers, and DevOps engineers to deliver scalable, event-driven data solutions and secure API services across cloud-native systems.

Key Responsibilities:

API & Backend Engineering

  • Build and deploy RESTful APIs using AWS API Gateway, Lambda, and Java and Python.
  • Integrate backend APIs with Redis for low-latency caching and pub/sub messaging.
  • Use PostgreSQL for structured data storage and transactional processing.
  • Secure APIs using IAM, OAuth2, and JWT, and implement throttling and versioning strategies.

Data Pipeline & Streaming

  • Design and develop event-driven data pipelines using DynamoDB Streams to trigger downstream processing.
  • Use AWS Glue to orchestrate ETL jobs for batch and semi-structured data workflows.
  • Build and maintain Lambda functions to process real-time events and orchestrate data flows.
  • Ensure data consistency and resilience across services, queues, and databases.

Cloud Infrastructure & DevOps

  • Deploy and manage cloud infrastructure using CloudFormation, Terraform, or AWS CDK.
  • Monitor system health and service metrics using CloudWatch, SNS and structured logging.
  • Contribute to CI/CD pipeline development for testing and deploying Lambda/API services.

Required Skills and Experience

  • Bachelor's degree in computer science, Engineering, or a related field.
  • Over 6 years of experience in developing backend or data pipeline services using Java and Python.
  • Strong hands-on experience with:
  • AWS API Gateway, Lambda, DynamoDB Streams
  • Redis (caching, messaging)
  • PostgreSQL (schema design, tuning, SQL)
  • AWS Glue for ETL jobs and data transformation
  • Solid understanding of REST API design principles, serverless computing, and real-time architecture.

Preferred Skills and Experience

  • Familiarity with Kafka, Kinesis, or other message streaming systems
  • Swagger/OpenAPI for API documentation
  • Docker and Kubernetes (EKS)
  • Git, CI/CD tools (e.g., GitHub Actions)
  • Experience with asynchronous event processing, retries, and dead-letter queues (DLQs)
  • Exposure to data lake architectures (S3, Glue Data )

  • Data Scientist

    1 week ago

    Bengaluru, Karnataka, India AWS ProServe IN - Karnataka Full time

    **DESCRIPTION**: AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small - and mid-market accounts to enterprise-level customers including public sector. AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure...

  • AWS Sr Data Engineer

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Sr Data Engineer to join our team in Bangalore or Remote, Karnātaka (IN-KA), India (IN). Position Location:OUS with...

  • Data Engineer with Snowflake, AWS Glue, Kafka, API

    4 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer with Snowflake, AWS Glue, Kafka, API to join our team in Bangalore, Karntaka (IN-KA), India (IN).- 6+...

  • Data Engineer with Snowflake, AWS Glue, Kafka, API

    1 week ago

    Bengaluru, India NTT DATA Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer with Snowflake, AWS Glue, Kafka, API to join our team in Bangalore, Karnātaka (IN-KA), India (IN). 6+...

  • Data Engineer with Snowflake, AWS Glue, Kafka, API

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 337802NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer with Snowflake, AWS Glue, Kafka, API to join our team in Bangalore, Karnātaka (IN-KA), India (IN). 6+...

  • Aws Cloud Architect

    1 week ago

    Bengaluru, India NTT DATA Full time

    **Req ID**: 248981 We are currently seeking a AWS Cloud Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Background As an Amazon Web Services (AWS) cloud architect, you will be responsible to architect and manage the cloud environment for a Digital Banking Asset. Duties include architecting and implementing cloud solutions,...

  • Data Engineer with Snowflake, AWS Glue, Kafka, API

    1 week ago

    Bengaluru, India NTT DATA, Inc. Full time

    6+ years of experience in Data Engineering or related role. Hands-on experience with Snowflake (data modelling, performance tuning, query optimization, Snowpipe, Time Travel, Streams & Tasks). Strong expertise in AWS Glue for ETL job development, orchestration, and optimization. Proficiency with AWS services such as S3, Lambda, Redshift, Athena, Step...

  • AWS Architect Lead

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Req ID: 327912NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Architect Lead to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Title: Digital Engineering Sr...

  • AWS Data

    12 hours ago

    Bengaluru, Karnataka, India Steady Rabbit Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title: AWS Data /API Gateway Pipeline EngineerExperience: 6+ YearsLocation: Remote/Bangalore/HyderabadJob Description:AWS Data/API Gateway Pipeline Engineer responsible for designing, building, and maintaining real-time, serverless data pipelines and API services. This role requires extensive hands-on experience with Java, Python, Redis, DynamoDB...

  • System Development Engineer, AWS NGDE

    1 week ago

    Bengaluru, India Amazon Web Services (AWS) Full time

    DescriptionAWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon's Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll support the...