AWS Data Engineer

2 months ago


Chennai, India CliqHR Full time

Mandatory Skills : AWS, Python, SQL, spark, Airflow, Snowflake

Responsibilities :

- Create and manage cloud resources in AWS

- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies

- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform

- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations

- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.

- Define process improvement opportunities to optimize data collection, insights and displays.

- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible

- Identify and interpret trends and patterns from complex data sets

- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.

- Key participant in regular Scrum ceremonies with the agile teams

- Proficient at developing queries, writing reports and presenting findings

- Mentor junior members and bring best industry practices

(ref:hirist.tech)
  • AWS Data Engineer

    2 days ago


    chennai, India RELX Full time

    About the role The role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient...

  • AWS Data Engineer

    2 days ago


    Chennai, India RELX India (Pvt) Ltd L&P div Company Full time

    About the role The role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient...

  • Data Engineer

    2 months ago


    chennai, India Notus Full time

    AWS Data Engineer Job Title: AWS Data Engineer Location: Bangalore / Chennai Experience: 8+ Years Job Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services,...

  • AWS Data Engineer

    3 weeks ago


    Chennai, India LexisNexis Full time

    Software Engineer IIIDo you enjoy designing analytic solutions at an enterprise scale for global customers?Do you have experience in working on complex problems?About our TeamOur product analytics team focuses on using data to understand and enhance the user experience of our customer facing products. We gather and analyze user interaction data from various...

  • AWS Data Engineer

    3 weeks ago


    chennai, India LexisNexis Full time

    Software Engineer III Do you enjoy designing analytic solutions at an enterprise scale for global customers? Do you have experience in working on complex problems? About our Team Our product analytics team focuses on using data to understand and enhance the user experience of our customer facing products. We gather and analyze user interaction data...

  • AWS Data Engineer

    3 weeks ago


    Chennai, India LexisNexis Full time

    Software Engineer IIIDo you enjoy designing analytic solutions at an enterprise scale for global customers?Do you have experience in working on complex problems?About our TeamOur product analytics team focuses on using data to understand and enhance the user experience of our customer facing products. We gather and analyze user interaction data from various...


  • chennai, India Virtusa Full time

    Data Engineer Python, AWS - CREQ188952 Description Skillset required for this project : Python, AWS, Starbust, Neo4jRoles and Responsibilities : Data Engineer Role1. Data Pipeline Development: Design, build, and maintain scalable data pipelines in AWS Glue using Python code language to ingest, transform, and load data from sources (AWS S3 bucket) into data...

  • Data Engineer

    4 weeks ago


    Bangalore/Chennai, India Notus Full time

    AWS Data Engineer Job Title: AWS Data Engineer Location: Bangalore / Chennai Experience: 8+ Years Job Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services,...

  • Data Engineer

    1 month ago


    Bangalore/Chennai, Tamil Nadu, India Notus Full time

    AWS Data EngineerJob Title: AWS Data EngineerLocation: Bangalore / ChennaiExperience: 8+ YearsJob Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services, Kafka,...

  • AWS Data Engineer

    24 hours ago


    Chennai, India HTC Global Services Full time

    AWS Data EngineerExperience: 5+ yearsLocation: Chennai Notice Period: Immediate to 30 daysJob Description: Bachelors or master’s in software engineering, Computer Science, or other relevant disciplinesStrong Knowledge in SQL and Python v3.x LanguageCan analyse new source data, model entities, and write complex SQL.Minimum 5 years of Overall Development...

  • AWS Data Engineer

    2 days ago


    Chennai, India HTC Global Services Full time

    AWS Data EngineerExperience: 5+ yearsLocation: Chennai Notice Period: Immediate to 30 daysJob Description: Bachelors or master’s in software engineering, Computer Science, or other relevant disciplinesStrong Knowledge in SQL and Python v3.x LanguageCan analyse new source data, model entities, and write complex SQL.Minimum 5 years of Overall Development...

  • AWS Data Engineer

    1 month ago


    Chennai, India CliqHR Full time

    Job Description :- Must have minimum 5+ years of experience as AWS Data EngineerNice to have : AWS Certified Data Analytics Specialty certification- Experience in designing and implementing data pipelines using AWS Glue and orchestration using Airflow for batch, streaming (Kafka/Kinesis) and API ingestion patterns- Work closely with DevOps engineer to...

  • AWS Data Engineer

    1 month ago


    Chennai, India CliqHR Full time

    Job Description : - Must have minimum 5+ years of experience as AWS Data EngineerNice to have : AWS Certified Data Analytics Specialty certification- Experience in designing and implementing data pipelines using AWS Glue and orchestration using Airflow for batch, streaming (Kafka/Kinesis) and API ingestion patterns- Work closely with DevOps engineer to...

  • AWS Data Engineer

    1 month ago


    Chennai, Tamil Nadu, India CliqHR Full time

    Job Description :- Must have minimum 5+ years of experience as AWS Data EngineerNice to have : AWS Certified Data Analytics Specialty certification- Experience in designing and implementing data pipelines using AWS Glue and orchestration using Airflow for batch, streaming (Kafka/Kinesis) and API ingestion patterns- Work closely with DevOps engineer to...

  • AWS Data Engineer

    5 days ago


    Chennai, India CliqHR Full time

    Job Description : - AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).-...

  • AWS Data Engineer

    6 days ago


    chennai, India CliqHR Full time

    Job Description : - AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).- Proficient...

  • AWS Data Engineer

    6 days ago


    Chennai, India CliqHR Full time

    Job Description :- AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).-...

  • AWS Data Engineer

    3 hours ago


    Chennai, Tamil Nadu, India CliqHR Full time

    Job Description :- AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).-...


  • chennai, India Anicalls (Pty) Ltd Full time

    Candidate should have:Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborateStrong experience in CICD technologies including Python, SQL, Airflow, and Git in a cloud settingUnderstanding of ELK stack is a plus for logging and reporting purposesExperience...


  • chennai, India Virtusa Full time

    Data Engineer(Pyspark, AWS and SQL) - CREQ186019 Description 4-6 years work experience in Software Engineering especially in professional software product development.Expertise in AWS and python coding.Flexible to learn and work for any programming language based on need.Proficient in pipeline for file loading from multiple different sources having different...