AWS Data

12 hours ago

Bengaluru, Karnataka, India Steady Rabbit Full time ₹ 8,00,000 - ₹ 12,00,000 per year

Job Title: AWS Data /API Gateway Pipeline Engineer

Experience: 6+ Years

Location: Remote/Bangalore/Hyderabad

Job Description:

AWS Data/API Gateway Pipeline Engineer responsible for designing, building, and maintaining real-time, serverless data pipelines and API services. This role requires extensive hands-on experience with Java, Python, Redis, DynamoDB Streams, and PostgreSQL, along with working knowledge of AWS Lambda and AWS Glue for data processing and orchestration.

This position involves collaboration with architects, backend developers, and DevOps engineers to deliver scalable, event-driven data solutions and secure API services across cloud-native systems.

Key Responsibilities:

API & Backend Engineering

  • Build and deploy RESTful APIs using AWS API Gateway, Lambda, and Java and Python.
  • Integrate backend APIs with Redis for low-latency caching and pub/sub messaging.
  • Use PostgreSQL for structured data storage and transactional processing.
  • Secure APIs using IAM, OAuth2, and JWT, and implement throttling and versioning strategies.

Data Pipeline & Streaming

  • Design and develop event-driven data pipelines using DynamoDB Streams to trigger downstream processing.
  • Use AWS Glue to orchestrate ETL jobs for batch and semi-structured data workflows.
  • Build and maintain Lambda functions to process real-time events and orchestrate data flows.
  • Ensure data consistency and resilience across services, queues, and databases.

Cloud Infrastructure & DevOps

  • Deploy and manage cloud infrastructure using CloudFormation, Terraform, or AWS CDK.
  • Monitor system health and service metrics using CloudWatch, SNS and structured logging.
  • Contribute to CI/CD pipeline development for testing and deploying Lambda/API services.

Required Skills and Experience

  • Bachelor's degree in computer science, Engineering, or a related field.
  • Over 6 years of experience in developing backend or data pipeline services using Java and Python.
  • Strong hands-on experience with:
  • AWS API Gateway, Lambda, DynamoDB Streams
  • Redis (caching, messaging)
  • PostgreSQL (schema design, tuning, SQL)
  • AWS Glue for ETL jobs and data transformation
  • Solid understanding of REST API design principles, serverless computing, and real-time architecture.

Preferred Skills and Experience

  • Familiarity with Kafka, Kinesis, or other message streaming systems
  • Swagger/OpenAPI for API documentation
  • Docker and Kubernetes (EKS)
  • Git, CI/CD tools (e.g., GitHub Actions)
  • Experience with asynchronous event processing, retries, and dead-letter queues (DLQs)
  • Exposure to data lake architectures (S3, Glue Data )

  • AWS Sr Data Engineer

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Sr Data Engineer to join our team in Bangalore or Remote, Karnātaka (IN-KA), India (IN). Position Location:OUS with...

  • Data Engineer with Snowflake, AWS Glue, Kafka, API

    4 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer with Snowflake, AWS Glue, Kafka, API to join our team in Bangalore, Karntaka (IN-KA), India (IN).- 6+...

  • Data Engineer with Snowflake, AWS Glue, Kafka, API

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 337802NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer with Snowflake, AWS Glue, Kafka, API to join our team in Bangalore, Karnātaka (IN-KA), India (IN). 6+...

  • AWS Architect Lead

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Req ID: 327912NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Architect Lead to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Title: Digital Engineering Sr...

  • System Development Engineer, AWS NGDE

    11 hours ago

    Bengaluru, Karnataka, India Amazon Web Services (AWS) Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    DescriptionAWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon's Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll support the...

  • AWS Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking a skilled and experienced AWS Data Engineer to join our team. The ideal candidate will be a hands-on expert in designing, building, and managing robust and scalable data pipelines on the Amazon Web Services (AWS) platform. This role is crucial for our data-driven initiatives, requiring a strong understanding of cloud-based data solutions and a...

  • AWS Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Teamware Solutions Full time

    About the CompanyGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdAbout the RoleWe are hiring an AWS Data Engineer- Location: Bangalore- Work Model: Hybrid- Experience: 5-7 years- Notice Period: Immediate- 15 days- Open roles: 22Data Engineer:Data Engineer, DevOps, Data Modeller, QA, Business systems analyst, Data Analyst,...

  • AWS Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • Aws data engineer

    2 weeks ago

    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, Py Spark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...