AWS Data Engineer

2 months ago

BangaloreAnywhere in IndiaMultiple Locations TalentPulse Consultant Full time

Overview :

- The AWS Data Engineer plays a crucial role in our organization by designing and implementing scalable, reliable, and secure data solutions in the AWS cloud environment.

- They are responsible for developing and maintaining data pipelines, optimizing data workflows, and ensuring the quality and integrity of our data.

- This position is essential for leveraging data-driven insights to drive business decisions and enhance our products and services.

Key Responsibilities :

- Designing, building, and maintaining scalable data pipelines and ETL processes in AWS

- Optimizing data models and data architecture for performance and reliability

- Implementing data security and privacy measures in compliance with industry standards and regulations

- Developing and maintaining data infrastructure on AWS, such as Redshift, S3, Glue, and EMR

- Collaborating with data scientists and analysts to support their data needs and analysis

- Monitoring, troubleshooting, and optimizing data workflows to ensure data quality and reliability

- Automating data processes and workflows to improve efficiency

- Implementing best practices for data governance, storage, and access control

- Supporting the integration of new data sources and technologies into the data ecosystem

- Documenting data pipelines, workflows, and processes for knowledge sharing and future reference

- Providing technical leadership and mentorship to junior data engineering team members

- Staying updated with the latest AWS data technologies and best practices

- Collaborating with cross-functional teams to understand and address their data needs

- Participating in on-call support and incident response activities when necessary

- Contributing to the continuous improvement of data engineering processes and standards

Required Qualifications :

- Bachelor's degree in Computer Science, Engineering, or a related field

- Proven experience in designing, building, and maintaining data solutions in AWS

- Strong proficiency in SQL, ETL processes, and data modeling

- Hands-on experience with AWS services such as Redshift, S3, Glue, EMR, Lambda, and Kinesis

- Proficiency in at least one programming language such as Python, Java, or Scala

- Experience with big data technologies and frameworks such as Hadoop, Spark, or Hive

- Knowledge of data warehousing concepts and best practices

- Experience in implementing data security and compliance measures in AWS

- Excellent problem-solving and troubleshooting skills related to data systems and workflows

- Effective communication and collaboration skills to work across teams and departments

- Ability to work in a fast-paced, dynamic environment and manage multiple priorities

- Experience with version control systems and continuous integration/continuous deployment (CI/CD) pipelines

- Understanding of Agile methodologies and practices

- AWS certifications such as AWS Certified Big Data - Specialty or AWS Certified Solutions Architect

Skills : AWS, data engineering, etl, sql, python, big data, data modeling, data warehousing

(ref:hirist.tech)

  • Aptus Data Labs

    3 weeks ago

    Anywhere in India/Multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Aptus Data Labs

    1 month ago

    Anywhere in India/Multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Aptus Data Labs

    1 month ago

    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Aptus Data Labs

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Data Engineer

    3 weeks ago

    Bangalore/Anywhere in India/Multiple Locations, IN Talhive HR Management LLP Full time

    About Loopio :Loopio supercharges the way companies respond to Requests for Proposals (RFPs), Due Diligence Questionnaires (DDQs), and Security Questionnaires. Our platform helps our 900 customers work faster, create higher-quality proposals, and win more business. Our mission is to empower people to focus on what matters. We do this by giving both our...

  • Data Engineer

    3 weeks ago

    Bangalore/Anywhere in India/Multiple Locations, IN Talhive HR Management LLP Full time

    About Loopio :Loopio supercharges the way companies respond to Requests for Proposals (RFPs), Due Diligence Questionnaires (DDQs), and Security Questionnaires. Our platform helps our 900 customers work faster, create higher-quality proposals, and win more business. Our mission is to empower people to focus on what matters. We do this by giving both our...

  • Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations Huquo Full time

    Position : AWS Data EngineerLocation : Pune/ Gurgaon/ HybridExperience : 5+Job Description :- 5+ years of experience as a Data Engineer on the AWS Stack- AWS Solutions Architect or AWS Developer Certification required- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS,...

  • Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations Huquo Full time

    Position : AWS Data EngineerLocation : Pune/ Gurgaon/ HybridExperience : 5+Job Description :- 5+ years of experience as a Data Engineer on the AWS Stack- AWS Solutions Architect or AWS Developer Certification required- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS,...

  • Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Huquo Full time

    Position : AWS Data EngineerLocation : Pune/ Gurgaon/ HybridExperience : 5+Job Description :- 5+ years of experience as a Data Engineer on the AWS Stack- AWS Solutions Architect or AWS Developer Certification required- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS,...

  • Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Huquo Full time

    Position : AWS Data EngineerLocation : Pune/ Gurgaon/ HybridExperience : 5+Job Description :- 5+ years of experience as a Data Engineer on the AWS Stack- AWS Solutions Architect or AWS Developer Certification required- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS,...

  • Data Architect

    5 days ago

    Anywhere In India/multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ Years Location - Remote Skills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS Cloud We are seeking a highly skilled and experienced Data Architect to join our team.The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS...

  • AWS Data Engineer

    5 days ago

    Anywhere in India/Multiple Locations Huquo Full time

    Job Description : Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail Programming experience with Python, Shell scripting, and SQL Responsible for building,...

  • Data Engineering Lead

    2 months ago

    Anywhere in India/Multiple Locations VAST Consulting Full time

    Job Description : - Should have 8+ years of working experience.- Bachelor's or Master's degree in Computer Science, Engineering, or related field.- Demonstrated leadership experience leading cross-functional teams in the design and implementation of complex data solutions.- Experience in a data engineering role with strong understanding of graph...

  • Senior Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations VAST Consulting Full time

    Job Description : - Should have 5+ years of working experience.- Bachelor's or Master's degree in Computer Science, Engineering, or related field.- 5+ years of experience in a data engineering role with strong understanding of graph databases, streaming and batch analytics, cloud data platforms, data visualizations and big data processing.- Deep...

  • AWS Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations Huquo Full time

    Job Description : - Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail - Programming experience with Python, Shell scripting, and SQL - Responsible for...

  • AWS Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations Huquo Full time

    Job Description : - Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail - Programming experience with Python, Shell scripting, and SQL - Responsible for...

  • AWS Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Huquo Full time

    Job Description :- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail- Programming experience with Python, Shell scripting, and SQL- Responsible for...

  • AWS Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Huquo Full time

    Job Description :- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail- Programming experience with Python, Shell scripting, and SQL- Responsible for...

  • Senior Cloud Data Engineer

    2 months ago

    Bangalore/Anywhere in India/Multiple Locations Change leaders Full time

    Job Overview:Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.Location: India (Most...

  • Data Engineer

    5 days ago

    Anywhere in India/Multiple Locations Circuit Compilers Full time

    Job Description : 5 to 8 years in the build release management, software configuration, design, development, and cloud implementation. Data Engineer with expertise in Python, Scala, PySpark, AWS S3, Glue, Redshift, Lambda, DBT, Serverless, Snowflake, SQL, Datalake, and Data Pipeline. Leveraged AWS Glue for data cataloging, ETL job orchestration, and schema...