AWS Data and Integration Engineer

6 days ago

Chennai, Tamil Nadu, India Quantum Strides Full time ₹ 12,00,000 - ₹ 36,00,000 per year


About the Role:

We are seeking a Data Engineer with strong AWS expertise to design, develop, and implement data pipelines and integrations for ingesting and processing data from various IWMS platforms into AWS RDS. This role requires expertise in building scalable, secure, and resilient data ingestion solutions using AWS-native services, along with the ability to create custom integration adapters using web services and serverless functions.

The ideal candidate will enforce industry best practices for data auditing, error handling, security (including Row-Level Security), and operational monitoring to ensure future production stability and data integrity.

Key Responsibilities:

Design and build data pipelines to extract, transform, and load (ETL) data from IWMS systems (e.g., TRIRIGA, ARCHIBUS, Planon) into AWS RDS

Develop integration adapters using Web Services and custom functions leveraging Java or Python, as needed

Utilize AWS services such as Lambda, Glue, Step Functions, S3, and others for data processing and orchestration

Develop frameworks for batch and near real-time data ingestion, integrating with external and internal systems

Implement industry best practices for data ingestion, auditing, error handling, Row-Level Security (RLS), and operational logging

Ensure data accuracy, consistency, security, and traceability across all data pipelines and processes

Collaborate with business analysts, product teams, and technical stakeholders to define data mapping, transformation logic, and integration specifications

Proactively troubleshoot, optimize, and tune data workflows for performance, scalability, and reliability

Enforce data security, compliance, and governance standards within all integration and data pipeline solutions

Required Skills & Qualifications:

3-7 years of experience as an AWS Data Engineer

Strong hands-on experience with AWS services like Glue, Lambda, RDS, Step Functions, and S3

Proficiency in developing integration solutions using Web Services (REST/SOAP) and building custom adapters using Java or Python

Strong expertise in SQL and Python for data processing, transformation, and workflow orchestration

Experience handling JSON, XML, and API-based integrations

Familiarity with enterprise data integration practices, including auditing, error handling, and enforcing data security policies like RLS

Experience integrating data from IWMS or ERP platforms

Good to Have:

Prior experience with IWMS platforms such as IBM TRIRIGA, ARCHIBUS, or Planon

Familiarity with big data technologies like Spark, Hive, or PySpark

AWS certification (e.g., AWS Certified Data Analytics Specialty, Solutions Architect, or Developer Associate)


  • AWS Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India MyCareernet Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company:IT Services OrganizationKey Skills:AWS, Pyspark, Databricks, SQL, Python, ETL, Azure Databricks, Data modeling, Data Warehouse, Data Engineer, Data Engineering, PL/SQL, Data ModellingRoles and Responsibilities:Design, develop, and maintain ETL processes to support data integration and transformation.Utilize Python for data engineering tasks, ensuring...

  • AWS Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Crescent Techservices Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role: AWS Data EngineerType: 6-12 month contractLocation: Chennai, Tamil Nadu (WFO)Experience: 6-8 YearsRequirements:Proficiency in Python and PySpark: Strong experience writing robust Python code and utilizing PySpark for distributed data processing, transformation, and working with large datasets.AWS Data Engineering Expertise: Hands-on experience with...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Senior AWS Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Sedin Technologies Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Title: AWS Data Engineer (IoT/Streaming Data) Location: Chennai or Bangalore. Experience: 3+ Years Employment Type: Full-time About the Role We are seeking a highly skilled AWS Data Engineer to design, build, and optimize large-scale data pipelines and analytics platforms. The ideal candidate will have strong hands-on expertise in AWS Glue, Athena,...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Data Engineer – Chennai Build the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights. Location: Chennai, India Experience: 2–3 years in data engineering or data-driven product development Role Overview As a Data Engineer, you will be responsible for building and...

  • AWS Data engineer

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    P2-C3-STSAWS Data EngineerDesign and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and S3.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes.Create and manage applications using Python, SQL, Databricks, and various AWS technologies.Automate repetitive tasks and...

  • AWS Data engineer

    2 days ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    AWS Data EngineerDesign and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and S3.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes.Create and manage applications using Python, SQL, Databricks, and various AWS technologies.Automate repetitive tasks and build...

  • IN | AWS Engineer

    1 week ago

    Chennai, Tamil Nadu, India Growel Softech Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    - Responsibilities Must have 1. Strong expertise in SQL Python PySpark. 2. Good knowledge on Data warehousing techniques. 3. Good knowledge on AWS Big Data services and snowflake. Design develop and maintain scalable data pipelines and architectures for data processing and integration. Implement data streaming solutions to handle real-time data ingestion and...

  • AWS/Azure Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Axiom Software Solutions Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    • Data Pipeline Development:Design, implement, and manage scalable ETL/ELT pipelines using AWS services and Databricks.• Data Integration:Ingest and process structured, semi-structured, and unstructured data from multiple sources into AWS Data Lake or Databricks.• Data Transformation:Develop advanced data processing workflows using PySpark, Databricks...

  • AWS Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    P2-C3-STSAWS Data Engineer Design and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and QS/SNS/Cloudwatch/Step function/CDK Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes Create and manage applications using Python, Pyspark, SQL, Databricks, and various AWS...