AWS Data Engineer with SQL

3 days ago

Mumbai, Maharashtra, India Guddge Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per year

PLEASE APPLY IF YOU CAN JOIN IMMEDIATELY AND HAVE 7+ YRS AWS DATA ENGINEER EXPERIENCE WITH SQL AND GIT

Job Description:

We are seeking a skilled Data Engineer with 7+ years of experience in data processing, ETL pipelines, and cloud-based data solutions. The ideal candidate will have strong expertise in AWS Glue, Redshift, S3, EMR, and Lambda, SQL, Stored Procedures with hands-on experience using Python and PySpark for large-scale data transformations. The candidate will be responsible for designing, building, and maintaining scalable data pipelines and systems to support analytics and data-driven decision-making.

Additionally, need to have strong expertise in Terraform and Git-based CI/CD pipelines to support infrastructure automation and configuration management.

Key Responsibilities:

ETL Development & Automation:

  • Design and implement ETL pipelines using AWS Glue and PySpark to transform raw data into consumable formats.
  • Automate data processing workflows using AWS Lambda and Step Functions.

Data Integration & Storage:

  • Integrate and ingest data from various sources into Amazon S3 and Redshift.
  • Optimize Redshift for query performance and cost efficiency.

Data Processing & Analytics:

  • Use AWS EMR and PySpark for large-scale data processing and complex transformations.
  • Build and manage data lakes on Amazon S3 for analytics use cases. Monitoring & Optimization:
  • Monitor and troubleshoot data pipelines to ensure high availability and performance.
  • Implement best practices for cost optimization and performance tuning in Redshift, Glue, and EMR.

Terraform & Git-based Workflows:

  • Design and implement Terraform modules to provision cloud infrastructure across AWS/Azure/GCP.
  • Manage and optimize CI/CD pipelines using Git-based workflows (e.g., GitHub Actions, GitLab CI, Jenkins, Azure DevOps).
  • Collaborate with developers and cloud architects to automate infrastructure provisioning and deployments.
  • Write reusable and scalable Terraform modules following best practices and code quality standards.
  • Maintain version control, branching strategies, and code promotion processes in Git.

Collaboration:

  • Work closely with stakeholders to understand requirements and deliver solutions.
  • Document data workflows, designs, and processes for future reference.

Must-Have Skills:

  • Strong proficiency in SQL, Stored Procs, Python and PySpark for data engineering tasks.
  • Hands-on experience with AWS Glue, Redshift, S3, and EMR.
  • Expertise in building, deploying, and optimizing data pipelines and workflows.
  • Solid understanding of database optimization techniques.
  • Strong hands-on experience with Terraform, including writing and managing modules, state files, and workspaces.
  • Proficient in CI/CD pipeline design and maintenance using tools like: GitHub Actions / GitLab CI / Jenkins / Azure DevOps Pipelines
  • Deep understanding of Git workflows (e.g., GitFlow, trunk-based development).
  • Experience in serverless architecture using AWS Lambda for automation and orchestration.
  • Knowledge of data modeling, partitioning, and schema design for data lakes and warehouses.
  • Ability to work 5 PM IST to 1 AM IST (evening/night shift in order to align with customers business hours)

  • AWS Data Engineer

    3 days ago

    Mumbai, Maharashtra, India Growel Softech Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    AWS Data Engineer 8-11 years AWS Data Engineer, Python Python, S3, RDS, Glue, Lambda, IAM, SNS, SQL , Quicksight

  • AWS Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India Infogain Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Roles & ResponsibilitiesRole SummaryWe are looking for a highly skilledAWS Databricks Data Engineerto design, develop, and optimize data pipelines and lakehouse solutions on AWS using Databricks. The ideal candidate will have strong experience inPySpark, SQL, Delta Lake, AWS native services, Unity Catalogand building scalable data processing solutions for...

  • AWS Data Engineer

    1 day ago

    Mumbai, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background in AWS data services, big data technologies, and programming languages.Exp- 3 to 7 years Location- Mumbai RequirementsKey Responsibilities:1. Design and implement...

  • AWS Data Engineer

    1 week ago

    Mumbai, Maharashtra, India Apex One Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS. Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL. Experience with batch job scheduling and managing data dependencies. Knowledge of data processing tools like Spark and Airflow. Automate repetitive tasks and build reusable frameworks...

  • AWS Data Engineer

    3 days ago

    Mumbai, Maharashtra, India Infogain Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Roles & ResponsibilitiesRequired Qualifications5+ years of software engineering experience, with at least 2+ years in AWS serverless development.Proven expertise in Python (data handling, report generation, API integrations).Hands-on experience with AWS Lambda, SQS, S3, CloudWatch, IAM, and DLQs.Strong knowledge of Snowflake (SQL queries, connectors,...

  • Aws Data Engineer

    3 days ago

    Navi Mumbai, Maharashtra, India HR Central Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Education & Experience:BE / B. Tech from IIT or Tier I / II collegesCertification in Cloud Platforms AWS or GCPTotal Experience of 4-8yearsHands on experience in python coding is must.Experience in data engineering which includes laudatory accountHands-on experience in Big Data cloud platforms like AWS(redshift, Glue, Lambda), Data Lakes, and Data...

  • AWS data platform engineer

    2 weeks ago

    Mumbai, Maharashtra, India Tata Consultancy Services Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    TCS presents an excellent Opportunity For "AWS data platform engineer" RoleJob Description1 Role -AWS data platform engineer2 Location of Requirement -Mumbai3 Experience Range -8 to 10 YearsDesired CompetenciesGood understanding on the AWS cloud platform capabilities is mandatory.Experience rolling out infrastructure as a code, using Terraform/Ansible...

  • AWS Certified Data Engineer

    1 day ago

    Mumbai, Maharashtra, India CodeVyasa Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Looking forAWS Certified Data Engineer| Mumbaito join a team of rockstar developers. The candidate should have a minimum of4+ yrs. of experience.About CodeVyasa:CodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such asMcKinsey, Walmart, RazorPay, Swiggy, and others. We are about 550+ people strong and...

  • Aws Data Engineer

    1 week ago

    Mumbai, Maharashtra, India Tata Consultancy Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Mid/Senior Data EngineerroleMin. 5 yrs on role Software Engineering + Backend Eng. (with focus on Python today)practice with high quality codes (unit testing, integration testing, others) + code metricsfast discovery what is in new repository code, asking right technical questions about codebase and code quality, CI/CD as a general rule of work (automatic...

  • IN | AWS Data Engg Developer

    3 days ago

    Mumbai, Maharashtra, India Growel Softech Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    - Skills Required Strong experience working in Cloud-based Engineering teams preferably using AWS. Solid understanding of dimensional modelling. Thorough understanding of Python and SQL for data exploration and transformation ideally within Spark environments (Pyspark SparkSQL) such as within Glue jobs. Strong written and oral communication skills and...