AWS Data Engineer

2 weeks ago

Indore, Madhya Pradesh, India Risk Resources LLP Full time

Role : AWS Data Engineer

Required Technical Skill Set : ETL, SQL & AWS

Desired Competencies (Technical/Behavioral Competency) :

Must-Have :

- Strong Knowledge of Aws Glue/AWS REDSHIFt/SQL/ETL.Good knowledge and experience in Pyspark for forming complex Transformation logic.

Good-to-Have : Python

Responsibility of / Expectations from the Role :

1. Good knowledge of SQL and Data warehousing Concepts

2. Experienced in AWS cloud services such as AWS EC2, AWS S3, AWS Lambda, AWS Glue and AWS Redshift

3. Hand on knowledge of Using Python & Pyspark for Data transformations

4. Good knowledge in glue to write transformation logic/ call custom code written in SQL /Pysprak file with transformation logic

5. To handle complex data processing using air flow

6. Cloud watch, custom logging using python

7. To perform data quality analysis using glue/pyspark

Key Responsibilities :

- Design, build, and maintain scalable data pipelines using AWS Glue and Redshift.

- Implement ETL processes to transform and prepare data for analysis.

- Develop and optimize SQL queries for efficient data retrieval and manipulation.

- Collaborate with data scientists and analysts to understand data requirements and deliver solutions.

- Utilize Apache Airflow for workflow management and to schedule data jobs.

- Ensure data quality and integrity across all data pipelines.

- Monitor performance and troubleshoot issues in data workflows.

- Document data models, workflows, and architecture for knowledge sharing.

- Stay updated with industry trends and AWS services to enhance data architecture.

- Work on data security protocols and ensure compliance with regulations.

- Participate in code reviews and contribute to best practices in data engineering.

- Assist in capacity planning and scaling of the data infrastructure.

- Create dashboards and reports to visualize data trends and insights.

- Train and mentor junior team members on data engineering best practices.

- Support data governance initiatives and contribute to a data-driven culture.

(ref:hirist.tech)

  • AWS Data Engineer

    3 weeks ago

    Indore, Madhya Pradesh, India Qubryx Full time

    AWS Data Engineer Location: Remote (India) Experience: 3+ Years Employment Type: Full-Time About the Role: We are seeking a talented AWS Data Engineer with at least 3 years of hands-on experience in building and managing data pipelines using AWS services. This role involves working with large-scale data, integrating multiple data sources (including...

  • AWS Data Engineer

    6 days ago

    Indore, Madhya Pradesh, India beBeeDataEngineer Full time

    We're looking for a talented Data Pipeline Engineer to build and manage large-scale data pipelines using AWS services.This role involves working with structured and unstructured data, integrating multiple sources, and enabling efficient, secure, and analytics-ready solutions.Key Responsibilities:Design and implement scalable data pipelines using AWS Glue,...

  • AWS Cloud Data Engineer

    1 week ago

    Indore, Madhya Pradesh, India beBeeData Full time

    Job DescriptionA talented data engineer with expertise in AWS is required to build and manage scalable data pipelines. This role involves working with large-scale data, integrating multiple sources, and enabling efficient solutions.Develop and maintain ETL/ELT data pipelines using AWS Glue, Redshift, Lambda, EMR, S3, and Athena.Process and integrate...

  • Senior Data Engineer

    2 days ago

    Indore, Madhya Pradesh, India beBeeDataEngineer Full time

    Job OverviewWe are seeking a skilled AWS Glue Developer to join our team. As a key member of our team, you will be responsible for designing, developing, and maintaining data pipelines using AWS Glue.Key ResponsibilitiesDesign and develop data pipelines using AWS Glue to meet business requirements.Maintain and troubleshoot existing data pipelines to ensure...

  • AWS Data Architect

    1 week ago

    Indore, Madhya Pradesh, India beBeeData Full time

    Job Summary :We are seeking a highly skilled AWS Data Architect to design, build, and maintain scalable data pipelines using AWS Glue and Redshift. As a key member of our team, you will be responsible for implementing ETL processes to transform and prepare data for analysis, developing and optimizing SQL queries for efficient data retrieval and manipulation,...

  • Cloud Data Engineer Trainer with AWS Specialization

    2 weeks ago

    Indore, Madhya Pradesh, India beBeeData Full time

    **Snowflake Data Engineering Trainer (AWS Specialist)**

  • Lead Data Engineer

    2 weeks ago

    Indore, Madhya Pradesh, India Data Fidelity Full time

    Experience : 6 to 8 YrsType: ContractDuration : 6 monthsUK hours – remoteTechnology: Snowflake, dbt, Azure, CI/CDLeads the end-to-end design, development, and optimization of data pipelines and infrastructure to support Management Information (MI) solutions, ensuring high standards of data accuracy, availability, and performance.Designs and develops...

  • AWS Data Analytics Specialist

    2 days ago

    Indore, Madhya Pradesh, India beBeeExpert Full time

    Job Opportunity: AWS Data Analytics ExpertWe are seeking a skilled professional to join our team as an AWS data analytics expert. In this role, you will be responsible for collecting and interpreting large datasets, identifying trends and patterns, and providing actionable insights to drive business decisions.A day in the life of this position involves...

  • AWS Cloud Engineer

    4 weeks ago

    Indore, Madhya Pradesh, India Intertec Systems Full time

    Skills : - AWS EC2, AWS Lambda, AWS S3, Kubernetes, Docker, Terraform, CloudFormation, Python (includes All Tasks) : Cloud Operations & Management : - Design, implement, and manage enterprise AWS infrastructure focusing on high availability. - Develop and maintain infrastructure standards and best practices documentation. - Implement comprehensive monitoring...

  • AWS DevOps Engineer

    1 week ago

    Indore, Madhya Pradesh, India Semi leaf Full time

    AWS DevOps EngineersExperience - 5 to 12 YearsLocation- - Bachelor's degree in computer science, Information Technology, or a related field.Technical Competency :- Design, deploy, and manage AWS infrastructure using Terraform and Docker.- Manage and optimize Kubernetes clusters in EKS to ensure smooth and efficient operations.- Proficiency in CI/CD tools...