AWS Data Engineer

4 weeks ago

Hyderabad, Telangana, India HireIT Consultants Full time

Job Title : AWS Data Engineer IoT, ERP/MES, CRM & Generative AI Integration

Location : Remote / Onsite / Hybrid

Job Type : Full-Time

Experience Level : Mid to Senior Level

Industry : IoT, Industrial Automation, Enterprise Systems

Job Overview :

We are looking for a hands-on AWS Data Engineer with experience in IoT ecosystems, enterprise application integration, and emerging AI/ML capabilities. The ideal candidate will design and build modern data pipelines that process telemetry from IoT Core (MQTT) into Aurora PostgreSQL, while also integrating ERP/MES dumps, CRM field-service data, and cloud SaaS exports using tools like AWS Glue, AppFlow, and Lambda. Experience with LLM enablement and vector databases is a strong plus.

Key Responsibilities :

- Develop scalable data pipelines to handle data ingestion from :

1. IoT Core MQTT topics using AWS IoT Rules Aurora PostgreSQL for telemetry storage.

2. ERP/MES data dumps (e.g., SAP, Oracle Manufacturing) and CRM service exports (e.g., Salesforce, ServiceNow).

3. S3-based data uploads from field gateways or system exports.

- Implement and maintain AWS Glue Jobs, AppFlow, and AWS Lambda functions to automate extraction, transformation, and loading (ETL/ELT).

- Create metadata-enriched, queryable datasets for use in analytics, dashboards, or feeding LLMs (Large Language Models) and vector databases for semantic search and intelligent applications.

- Design and optimize Aurora PostgreSQL schemas to support structured IoT telemetry, event logs, and traceability data.

- Integrate with SAP, Oracle, Salesforce, ServiceNow using AppFlow, REST APIs, or custom connectors.

- Enable real-time monitoring and alerting of IoT data pipelines and ensure high availability and resilience.

- Collaborate with AI/ML and data science teams to vectorize data using tools like Amazon OpenSearch, Pinecone, or FAISS, and build LLM pipelines for industrial search, chat, or recommendation use cases.

Required Skills :

- Strong hands-on expertise with AWS IoT Core, MQTT protocol, and IoT Rules Engine.

- Proficiency in Aurora PostgreSQL schema design, query tuning, and time-series handling.

- Proven experience with AWS Glue, Lambda, and AppFlow for orchestration and integration.

- Solid programming experience in Python or Node.js, especially for Lambda functions.

- Working knowledge of data lake architecture, S3, Glue Catalog, and Athena.

- Experience with ERP/MES system exports (e.g., SAP IDocs, BAPIs, Oracle DB dumps).

- Familiarity with Salesforce/ServiceNow APIs or AppFlow connectors.

- Exposure to LLM frameworks (LangChain, Bedrock, etc.) and vector databases (OpenSearch, Pinecone, etc.).

- Experience with CI/CD, Terraform/CloudFormation, and monitoring tools (e.g., CloudWatch, Prometheus).

Preferred Qualifications :

- AWS Certifications (e.g., AWS Certified Data Analytics, AWS Certified Machine Learning, Solutions Architect).

- Experience working in smart factory, industrial IoT, or connected device ecosystems.

- Exposure to Kafka or Kinesis for streaming pipeline implementations.

- Understanding of data governance, data lineage, and compliance standards.

(ref:hirist.tech)

  • Aws Lead Engineer

    3 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Req ID 304644 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AWS Lead Engineer to join our team in Hyderabad Telangana IN-TG India IN Basic Qualifications 3 years ...

  • AWS Data Engineer

    1 week ago

    Hyderabad, Telangana, India Coforge Full time

    We're Hiring : AWS Data Engineers at Coforge Ltd . Immediate Joiners Preferred.Locations: Hyderabad Only.Experience Required: 5 to 7 YearsSend your CV to the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS. You'll work with...

  • AWS Data Engineer

    1 day ago

    Hyderabad, Telangana, India Coforge Full time

    We're Hiring: AWS Data Engineers at Coforge Ltd. Immediate Joiners Preferred.Job Locations: Hyderabad & Greater NoidaExperience Required: 5 to 7 YearsSend your CV to Gaurav.2.Kumar@coforge.comAbout the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and...

  • AWS Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India Coforge Full time

    We're Hiring: AWS Data Engineers at Coforge Ltd. Immediate Joiners Preferred.Locations: Hyderabad Only.Experience Required: 5 to 7 YearsSend your CV to Gaurav.2.Kumar@coforge.comAbout the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS....

  • AWS Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India Coforge Full time

    We're Hiring : AWS Data Engineers at Coforge Ltd . Immediate Joiners Preferred. Locations: Hyderabad Only. Experience Required: 5 to 7 Years Send your CV to About the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS. You'll work with...

  • AWS Data Engineer

    24 hours ago

    Hyderabad, Telangana, India Coforge Full time

    We're Hiring : AWS Data Engineers at Coforge Ltd . Immediate Joiners Preferred. Job Locations: Hyderabad & Greater Noida Experience Required: 5 to 7 Years Send your CV to About the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS....

  • AWS Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India TECHOAKS IT SOLUTIONS PRIVATE LIMITED Full time

    Client : DisneyJob Title : AWS Data Engineer (Databricks Focus)Location : HyderabadType : Full-Time with Info ServicesPosition Overview :We are looking for an AWS Data Engineer with strong Databricks and PySpark experience to help design, develop, and optimize scalable data pipelines. The role requires a strong blend of data engineering expertise, AWS...

  • AWS Data Engineer

    4 days ago

    Hyderabad, Telangana, India STANCO Solutions Pvt Ltd Full time

    Hiring for AWS Data EngineerExperience: 5+ YearsSkill Set: AWS, Python, Pyspark, Spark, ScalaLocation: Hyderabad, ChennaiSalary: 35 LPANotice Period: Immediate to 15 DaysJD:-Primary Skills: Python, Pyspark, Glue, Redshift, Lambda, DMS, RDS ,Cloud Formation and other AWS serverlessStrong exp in SQLDetailed JD:-Seeking a developer who has good Experience in...

  • Lead AWS Data Engineer

    3 days ago

    Hyderabad, Telangana, India Coforge Full time

    Job Title: Lead AWS Data EngineerSkills: Big Data technologies (e.g., Hadoop, Spark) and AWS S3. Python or Java or Scala. data modeling, ETL processes, and data warehousing solutionsExperience Required: YearsJob Location: Hyderabad, Pune & Greater NoidaWe at Coforge are hiring Lead AWS Data Engineer with following skillset:As a Technical Lead in Data...

  • AWS Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India Allnessjobs Full time

    Job Role : Data EngineerExperience : 8+ YearsMode : HybridKey Responsibilities :- Design and implement enterprise-grade Data Lake solutions using AWS (e.g., S3, Glue, Lake Formation).- Define data architecture patterns, best practices, and frameworks for handling large-scale data ingestion, storage, computing and processing.- Optimize cloud infrastructure...