Consultant, Data Engineer

Job Description

Inviting applications for the role of Consultant, Data Engineer (AWS, Python, UI and Web Engineer - Agentic AI

Responsibilities

- Design and develop scalable backend services and RESTful APIs using Node.js, integrating with AWS Lambda, DynamoDB, and PostgreSQL (PGDB) to process structured and semi-structured data.

- JavaScript, Asynchronous programming, NodeJs frameworks, Restful APIs development, DB Management, Security Practices, Error handling and logging

- Build and orchestrate event-driven workflows and microservices using AWS Lambda, Step Functions, and CodePipeline, ensuring high performance and system availability.

- Develop secure, containerized applications using Docker and deploy them on AWS EC2 instances, ensuring scalable and fault-tolerant service architecture.

- Implement frontend components using Angular, interacting with backend APIs and dynamically rendering data from SQL and NoSQL sources.

- Refactor and migrate legacy applications and services to cloud-native AWS architectures, leveraging DynamoDB, RDS, and Lambda for improved scalability and cost efficiency.

- Optimize SQL queries and indexing strategies for PostgreSQL databases to support high-performance APIs and reduce latency for end-users.

- Secure APIs and cloud resources using IAM roles, VPC configurations, and AWS KMS, adhering to best practices in compliance and data protection.

- Participate in the design and development of full-stack applications by translating user stories and business requirements into robust frontend and backend components.

- Perform unit testing, integration testing, and data validation to ensure API and UI reliability before production deployment.

- Lead and support CI/CD pipeline integration using Git, CodePipeline, and other DevOps tools to automate testing, deployment, and monitoring of Node.js and Angular applications.

- Coordinate production deployments and work closely with release management teams to ensure minimal downtime and smooth delivery of application updates.

- Contribute to disaster recovery and backup strategies for application state and critical data, ensuring business continuity and compliance with SLAs.

- Engage in code reviews and technical design discussions to promote clean code, maintainability, and adherence to cloud-native architectural principles.

Qualifications we seek in you

Minimum Qualifications

- Experience in designing, implementing data pipelines, build data applications, data migration on AWS

- Strong experience of implementing data lake using AWS services like Glue, Lambda, Step, Redshift

- Strong experience in Node JS, Angular, React, Python and SQL

- Proven expertise in AWS services such as S3, Lambda, Glue, EMR, and Redshift.

- Advanced programming skills in Python for data processing and automation.

- Hands-on experience with Apache Spark for large-scale data processing.

- Proficiency in SQL for data querying and transformation.

- Strong understanding of security principles and best practices for cloud-based environments.

- Experience with monitoring tools and implementing proactive measures to ensure system availability and performance.

- Excellent problem-solving skills and ability to troubleshoot complex issues in a distributed, cloud-based environment.

- Strong communication and collaboration skills to work effectively with cross-functional teams.

Preferred Qualifications/ Skills

- Bachelor's/Master's Degree-Computer Science, Electronics, Electrical or equivalent

- AWS Data Engineering & Cloud certifications

- Experience with multiple data integration technologies and cloud platforms

- Knowledge of Change & Incident Management process

-

-

-

-

-

-