AWS Data Engineer

2 months ago


Anywhere in IndiaMultiple Locations IT Source Global Full time

We have Immediate Openings on AWS data engineer

Job Description :

- Data Pipeline Development: Design and develop ETL processes using AWS Glue, Python, and PySpark to extract, transform, and load data from various sources into data lakes or data warehouses.

- Data Integration: Integrate data from multiple sources, ensuring data quality, consistency, and availability for downstream analytics and reporting.

- Performance Optimization: Optimize data processing workflows for performance and scalability, ensuring low-latency and high-throughput data processing.

- AWS Infrastructure: Deploy and manage AWS resources, including S3, Lambda, Glue Catalog, Athena, and Redshift, to support data engineering tasks.

- Automation: Automate data workflows and processes using AWS Glue workflows, triggers, and job scheduling.

- Data Quality: Implement data validation and cleansing procedures to maintain the integrity and quality of the data.

- Collaboration: Collaborate with cross-functional teams, including data scientists, analysts, and product managers, to understand data requirements and deliver solutions that meet business needs.

- Monitoring and Troubleshooting: Monitor data pipelines for performance issues and troubleshoot any failures or inefficiencies.

- Documentation: Maintain clear and concise documentation of data pipelines, processes, and AWS infrastructure setups.

(ref:hirist.tech)
  • Data Engineer

    2 days ago


    Anywhere in India/Multiple Locations Grackle Business Solutions Pvt Ltd Full time

    Job OverviewWe are seeking an experienced Data Engineer to join our team at Grackle Business Solutions Pvt Ltd. This role requires a strong background in data engineering, with a focus on AWS services and Databricks.About the RoleThe successful candidate will be responsible for designing, implementing, and maintaining large-scale data pipelines using...

  • Big Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations D-TechWorks Pvt Ltd Full time

    We are looking for Aws big data engineer In Remote , India Position : Aws big data engineerExperience : 7 to 9 YearLocation : Remote , India Mandate skills : BigData Python Pyspark AWS Glue Airflow Redshift Responsibilities :- Ensure effective Design, Development, Validation and Support activities in line with client needs and architectural requirements.,-...

  • AWS Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Hum Technologies Full time

    Job Description : We are hiring for AWS Data Engineer with strong exp in AWS, SQL, Python , Spark & CI/CD for one of the Fortune 500 Clients Company Name : Hum TechnologiesClient : One of the Fortune 500 CompaniesLocation : Remote/Hybrid Skills : AWS (5+ years), Python, PySpark, CI/CD, ETL/ELT, data pipelines, Jenkins, SQL, testing, Agile project...

  • Big Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations TalentXO Full time

    Required Qualifications : - 7-8 years of experience as a Data Engineer or in a similar role - Proficient in Python programming and PySpark for data processing and transformation - Extensive experience in designing and implementing data pipelines using AWS Glue and AWS MWAA (Airflow) - Strong SQL skills, including experience with AWS Redshift -...

  • AppSierra Solutions

    3 weeks ago


    Anywhere in India/Multiple Locations AppSierra Solutions Pvt Ltd Full time

    Description :We are seeking an experienced AWS Data Engineer proficient in AWS technologies, PySpark, Glue, S3, and Terraform to join our innovative team. As an integral part of our data engineering group, you will be responsible for designing, building, and maintaining scalable data pipelines that facilitate seamless data extraction, transformation, and...


  • Anywhere in India/Multiple Locations AppSierra Solutions Pvt Ltd Full time

    At AppSierra Solutions Pvt Ltd, we are seeking a highly skilled AWS Data Engineer to drive innovation in our team. With a strong focus on technical excellence and collaboration, this role demands a unique blend of analytical and problem-solving skills to design and implement efficient data processing solutions using AWS technologies.About the RoleWe estimate...

  • AWS EMR Engineer

    2 months ago


    Anywhere in India/Multiple Locations capgemini Full time

    Job SummaryJoin Capgemini as an AWS EMR Engineer and take on the challenge of managing and optimizing big data processing workflows on Amazon EMR clusters. This role requires expertise in cloud computing, big data processing, and scripting/coding skills, with a focus on delivering efficient and scalable data processing solutions.Key Responsibilities- Minimum...


  • Anywhere in India/Multiple Locations Excelra Knowledge Solutions Full time

    Data Engineer (Cloud & Ontologies)Job Description : Excelra is hiring for experienced Data Engineer with expertise in ontologies, AWS, Azure, and various data technologies. The role involves building and maintaining scalable data pipelines, working with cloud platforms, and supporting server and application deployment.Roles and Responsibilities : - Cloud...

  • Aws data engineer

    3 weeks ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....


  • Anywhere in India/Multiple Locations Capgemini Full time

    Roles & Responsibilities - AWS+EMR- Minimum 2-6 years of experience in AWS technologies.- Setting up and managing EMR clusters for processing large-scale data using frameworks like Apache Hadoop, Apache Spark, Apache Hive, etc.- Configuring EMR clusters based on specific requirements, including choosing the appropriate instance types, storage configurations,...

  • AWS Data Engineer

    3 months ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    4 months ago


    India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    4 months ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    1 month ago


    india ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    1 month ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Data Engineer

    4 days ago


    Anywhere in India/Multiple Locations Risk Resources LLP Full time

    Join Risk Resources LLP as a highly skilled Data Engineer specializing in designing, developing, and maintaining scalable data solutions on cloud platforms.About the RoleWe are seeking a seasoned professional with expertise in Snowflake, Azure, and AWS technologies to lead our data engineering efforts. As a key member of our team, you will be responsible for...

  • Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations Machine Minds Full time

    Job Description : Data EngineerThe Position : We are seeking an experienced Data Engineer to join our team of passionate professionals working on cutting-edge technology. In this role, you will be responsible for the ELT of Canibuild data using Python, Airflow, and SQL within an AWS environment. Additionally, you will create and maintain data...


  • Anywhere in India/Multiple Locations Hum Technologies Full time

    Job TitleAWS Data EngineerJob DescriptionWe are seeking an experienced AWS Data Engineer to join our team at Hum Technologies. This role will involve designing, building, and maintaining efficient data applications and services on the AWS platform.Responsibilities:Designing, building, and maintaining reusable and reliable codeEnsuring high performance and...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Risk Resources LLP Full time

    Overview : The Data Engineer specializing in Snowflake, Azure, and AWS technologies plays a crucial role in designing, developing, and maintaining scalable data solutions to meet the organization's evolving data needs. The role requires expertise in a range of data engineering tools and platforms for managing and transforming large sets of structured...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Crescendo Global Full time

    Job Description : Are you an experienced Data Engineer with expertise in Python, Pyspark, and AWS? Our client, a leading technology firm in India, is looking for a Senior Data Engineer to join their team. If you have a strong analytical mindset and a passion for leveraging data to drive business insights, this opportunity is perfect for you.Location : PAN...