AWS Data Engineer

2 days ago

Bengaluru, Karnataka, India Acme Services Full time

We are seeking a skilled and experienced AWS Data Engineer to join our team.

The ideal candidate will be a hands-on expert in designing, building, and managing robust and scalable data pipelines on the Amazon Web Services (AWS) platform.

This role is crucial for our data-driven initiatives, requiring a strong understanding of cloud-based data solutions and a passion for optimizing data workflows.

You will work on complex ETL (Extract, Transform, Load) processes, ensuring data integrity, security, and performance.

Key Responsibilities :

- Data Pipeline Development: Design, build, and maintain scalable and efficient data pipelines using a range of AWS services.

- ETL Processes: Implement and manage ETL processes to extract data from various sources, transform it for analysis, and load it into data lakes or data warehouses.

- Data Workflow Optimization: Continuously monitor and optimize data workflows and processing jobs to improve performance, reduce latency, and ensure cost-effectiveness.

- Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality, clean, and accessible data.

- Cloud Security and Governance: Implement and maintain data security best practices on AWS, including access control, encryption, and compliance with data governance policies.

- Automation: Automate data-related tasks and infrastructure management using scripting and Infrastructure as Code (IaC) principles.

- Troubleshooting: Identify, diagnose, and resolve complex data-related issues and system failures.

Required Skills & Experience :

- Hands-on AWS Expertise: Strong experience with core AWS data services, including AWS Glue, Amazon S3, and AWS Lambda.

- Programming Proficiency: Expert-level skills in Python for scripting, automation, and data manipulation.

- Distributed Data Processing: Proven experience with PySpark for processing large-scale datasets.

- Data Engineering Fundamentals: Solid understanding of data warehousing, data modeling, and ETL/ELT concepts.

- SQL Knowledge: Proficient in SQL for data querying and manipulation.

- Familiarity with other AWS Services: Experience with other AWS services such as Amazon Redshift, Amazon Athena, and AWS Step Functions is a plus.

- Security and Performance: Knowledge of AWS security best practices (e.g., IAM, KMS) and experience with performance tuning and cost optimization.

- Problem-Solving: Excellent analytical and problem-solving skills with a meticulous attention to detail.

(ref:hirist.tech)

  • AWS Data engineer

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    TCS presents an excellent Opportunity For "AWS Data engineer" RoleJob Description1 Role - AWS Data engineer2 Location of Requirement - Bengaluru3 Experience Range - 10 to 14 YearsDesired CompetenciesPrincipal AWS Data engineer with Python programming experienceAWS Data engineer python Spark, ETL data processing. Implementation of data pipelines using tools...

  • AWS Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring AWS Data Engineer Position: AWS Data EngineerJob Location: BangaloreExperience : 10-14 yearsInterested professionals kindly apply through the link.Must Have:- Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering...

  • AWS Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services We are hiring AWS Data Engineer Position: AWS Data Engineer Job Location: Bangalore Experience : 10-14 years Interested professionals kindly apply through the link. Must Have: Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and...

  • AWS Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    14 hours ago

    Bengaluru, Karnataka, India Acme Services Full time US$ 90,000 - US$ 1,20,000 per year

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring AWS Data Engineer Position: AWS Data EngineerJob Location: BangaloreExperience : 10-14 yearsInterested professionals kindly apply through the link.Must Have:Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering a...

  • AWS Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India VaQya LLC Full time

    Job DescriptionCompany DescriptionVaQya LLC is a physician-owned medical billing company dedicated to creating value for private medical practices. All physician-owned practices that use VaQya for Revenue Cycle Management (RCM) services become partners in VaQya without any investment. We provide top-tier billing solutions with real-time transparency, helping...