AWS Data Engineer

3 weeks ago

PuneHyderabadGurgaonGurugram, IN Huquo Full time

We are seeking a highly motivated and experienced AWS Engineer. This position requires an individual with AWS cloud experience and ambition to continually keep up with best practices when it comes to cloud development. The successful candidate must be able to seek out requirements and create best-in-class cloud-native solutions. The engineer must always create solutions that are repeatable, scalable and well-governed. They will deploy and rigorously test solutions to ensure they are robust and secure. The engineer will be responsible for creating and maintaining diagrams associated with any solutions that are deployed into production.

Must have:

- Knowledge and experience in designing and developing RESTful services.

- Experience building server less applications in AWS.

- Experience in building real-time/streaming data pipelines.

- 3-4 years of SQL & Python programming experience.

- 2-3 years of experience with AWS tech stack (Glue, Redshift, Kinesis, Athena, CloudTrail, CloudWatch, Lambda, API Gateway, Step functions, SQS, S3, IAM roles, Secrets Manager).

- Experience working with ETL Tools like Glue, Fivetran, Talend, Matillion, etc.

- 1-2 years of experience in DBT with Data Modeling, SQL, Jinja templating, and packages/macros to build robust, performant, and reliable data transformation and feature extraction pipelines.

- 1-2 years of experience in Airbyte building ingestion modules for streaming, batch, and API sources including building CDC mechanisms for database sources

- Experience building distributed architecture-based systems, especially handling large data volumes and real-time distribution.

- Initiative and problem-solving skills when working independently.

- Familiarity with Big Data Design Patterns, modeling, and architecture.

- Exposure to NoSQL databases and cloud-based data transformation technologies.

- Understanding of object-oriented design principles.

- Knowledge of enterprise integration patterns.

- Experience with messaging middleware, including queues, pub-sub channels, and streaming technologies.

- Expertise in building high-performance, highly scalable, cloud-based applications.

- Experience with SQL and No-SQL databases.

- Good collaboration and communication skills, highly self-driven, and take ownership.


- Experience in Writing well-documented, Clean, and Effective codes is a must.

Good to Have:

- AWS Cloud Certifications.

- Good experience in Airflow, MWAA

- Knowledge of Jinja templating in Python.

- Working knowledge of DevOps methodologies, including designing CI/CD pipelines.

- Knowledge of Pyspark, DevOps. (intermediary proficiency should be fine, Pyspark is optional)

- Proficient in SQL, Python, and PySpark.

- Good experience building Real-Time streaming data pipelines with Kafka, Kinesis etc

- Good understanding of Data warehousing & Data Lake solutions concepts.

- Good Knowledge on Azure DE Create and maintain scalable, robust AWS architecture.

- Collaborate with technical teams on modern architectures (Microservices, REST APIs, DynamoDB, Lambda, API Gateway).

- Develop API-based, CDC, batch, and real-time data pipelines for structured and unstructured datasets.

- Enable integration with third-party systems as needed.

- Ensure solutions are repeatable and scalable across the organization.

- Work with development teams to gather requirements, develop solutions, and deploy them.

- Provide robust solution documentation for a wide audience.

- Collaborate with data professionals to bring applications to life, meeting business needs.

- Prioritize data protection and cloud security in all BE/B.Tech/MS/M.Tech/ME from reputed institute.

- Every individual comes with a different set of skills and qualities so even if you don't tick all the boxes for the role today, we urge you to apply as there might be a suitable/unique role for you tomorrow

(ref:hirist.tech)

  • AWS Data Engineer

    4 weeks ago

    Bangalore/Pune/Hyderabad/Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Position - AWS Data EngineerLocation - Pune/ Gurgaon/Hyderabad HybridExperience - 5+Job Description : - 5+ years of experience as a Data Engineer on the AWS Stack- AWS Solutions Architect or AWS Developer Certification required- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync,...

  • AWS Data Engineer

    3 weeks ago

    Bangalore/Pune/Hyderabad/Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Position - AWS Data EngineerLocation - Pune/ Gurgaon/Hyderabad HybridExperience - 5+Job Description : - 5+ years of experience as a Data Engineer on the AWS Stack- AWS Solutions Architect or AWS Developer Certification required- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync,...

  • AWS Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN True Tech Professionals Full time

    We are seeking a skilled Senior Data Engineer to join our dynamic team.- The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL.- The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure, ensuring optimal performance...

  • AWS Data Engineer

    2 months ago

    Gurgaon/Gurugram, IN True Tech Professionals Full time

    We are seeking a skilled Senior Data Engineer to join our dynamic team.- The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL.- The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure, ensuring optimal performance...

  • AWS Data Engineer

    4 weeks ago

    Gurgaon/Gurugram/Bangalore/Pune, IN HuQuo Consulting Pvt. Ltd. Full time

    - Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail- Programming experience with Python, Shell scripting, and SQL- Responsible for building, test, QA & UAT...

  • AWS Data Engineer

    3 weeks ago

    Gurgaon/Gurugram/Bangalore/Pune, IN HuQuo Consulting Pvt. Ltd. Full time

    - Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail- Programming experience with Python, Shell scripting, and SQL- Responsible for building, test, QA & UAT...

  • Lead Data Engineer

    1 week ago

    Pune/Gurgaon/Gurugram/Noida/Bangalore, IN Pathways Consultant Full time

    Lead Data EngineerLocation : Pune, Gurgaon, Noida, BangaloreExperience : 7 -10 yearsNotice : Early joiners required (0 - 10 Days)Salary : 20 - 25 LPAShift : 12:00 PM-9:00 PM/ 12:30 PM-9:30 PMResponsibilities :- Should possess hands-on experience in working on some of the relational and non-relational databases (Oracle/SQL Server/DB2/PostgreSQL/MySQL/Golden...

  • AWS Data Engineer

    2 months ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description : Responsibilities :- Proficient in designing and implementing data ingestion pipelines from various sources.- Build and enhance Python and PySpark-based frameworks for efficient and scalable data ingestion processes.- Collaborate with cross-functional teams to understand requirements and tailor frameworks to meet specific business needs.-...

  • Lead Data Engineer/Manager

    4 weeks ago

    Gurgaon/Gurugram/Bangalore, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Title: Lead Data EngineerJob SummaryLooking for a versatile professional to join our team in the role of Hybrid Data Engineer and Database Administrator. This position requires a blend of expertise in Data Engineering and Database Administration, with a strong foundation in Oracle DBA roles and a demonstrated transition into data engineering. The ideal...

  • Lead Data Engineer/Manager

    3 weeks ago

    Gurgaon/Gurugram/Bangalore, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Title: Lead Data EngineerJob SummaryLooking for a versatile professional to join our team in the role of Hybrid Data Engineer and Database Administrator. This position requires a blend of expertise in Data Engineering and Database Administration, with a strong foundation in Oracle DBA roles and a demonstrated transition into data engineering. The ideal...

  • Big Data Engineer

    1 month ago

    Gurgaon/Gurugram/Bangalore, IN TCCS Full time

    Client : Carelon Global SolutionsNotice Period : 20 days.Job Description :Minimum experience : - Should have hands-on experience in Software development for at least 9 years.- Should have hands-on experience in order to handle project work as Technical Lead for at least 2 yr.- Responsible for designing, deploying, and managing high quality data solutions in...

  • Big Data Engineer

    3 weeks ago

    Gurgaon/Gurugram/Bangalore, IN TCCS Full time

    Client : Carelon Global SolutionsNotice Period : 20 days.Job Description :Minimum experience : - Should have hands-on experience in Software development for at least 9 years.- Should have hands-on experience in order to handle project work as Technical Lead for at least 2 yr.- Responsible for designing, deploying, and managing high quality data solutions in...

  • AWS Data Architect

    3 weeks ago

    Gurgaon/Gurugram, IN Valiance Analytics Pvt. Ltd. Full time

    Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises 120+...

  • AWS Data Architect

    2 months ago

    Gurgaon/Gurugram, IN Valiance Analytics Pvt. Ltd. Full time

    Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises 120+...

  • AWS Data Engineer

    2 months ago

    Pune/Hyderabad, IN Huquo Full time

    Role : Data EngineerMust-Have : - 4 to 6 years of Relevant experience in Data Engineering and delivery.- 3 to 4 years of relevant work experience in large-scale Data applications- AWS Glue is mandatory.- Strong 4-6 years of working experience in SQL Spark Python, Snowflake, and AWS cloud knowledge.- Good aptitude, strong problem-solving abilities, and...

  • AWS Data Engineer

    3 weeks ago

    Pune/Hyderabad, IN Huquo Full time

    Role : Data EngineerMust-Have : - 4 to 6 years of Relevant experience in Data Engineering and delivery.- 3 to 4 years of relevant work experience in large-scale Data applications- AWS Glue is mandatory.- Strong 4-6 years of working experience in SQL Spark Python, Snowflake, and AWS cloud knowledge.- Good aptitude, strong problem-solving abilities, and...

  • Lead Data Engineer

    4 weeks ago

    Delhi NCR/Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Responsibilities :- Should possess hands-on experience in working on some of the relational and non-relational databases (Oracle/SQL Server/DB2/PostgreSQL/MySQL/Golden Gate/Data Guard) on AWS and/or on-prem infrastructure.- 3+ years' Experience with AWS Services like AWS RDS, Aurora, EC2, S3, DMS, AWS Backups, and DynamoDB.- 3+ years' Experience with...

  • Lead Data Engineer

    3 weeks ago

    Delhi NCR/Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Responsibilities :- Should possess hands-on experience in working on some of the relational and non-relational databases (Oracle/SQL Server/DB2/PostgreSQL/MySQL/Golden Gate/Data Guard) on AWS and/or on-prem infrastructure.- 3+ years' Experience with AWS Services like AWS RDS, Aurora, EC2, S3, DMS, AWS Backups, and DynamoDB.- 3+ years' Experience with...

  • AWS Data Architect

    2 months ago

    Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...

  • AWS Data Engineer

    2 months ago

    Bangalore/Pune/Hyderabad, IN Kezan Consulting Full time

    Company Overview : Kezan Consulting is a leading provider of Human Resources Services in the industry. We specialize in providing comprehensive HR solutions to our clients, helping them achieve their goals and drive business success. With a team of highly skilled professionals and a commitment to delivering excellence, we have established ourselves as a...