AWS Data Engineer with SQL

1 day ago

Mumbai, Maharashtra, India Guddge Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per year

PLEASE APPLY IF YOU CAN JOIN IMMEDIATELY AND HAVE 7+ YRS AWS DATA ENGINEER EXPERIENCE WITH SQL AND GIT

Job Description:

We are seeking a skilled Data Engineer with 7+ years of experience in data processing, ETL pipelines, and cloud-based data solutions. The ideal candidate will have strong expertise in AWS Glue, Redshift, S3, EMR, and Lambda, SQL, Stored Procedures with hands-on experience using Python and PySpark for large-scale data transformations. The candidate will be responsible for designing, building, and maintaining scalable data pipelines and systems to support analytics and data-driven decision-making.

Additionally, need to have strong expertise in Terraform and Git-based CI/CD pipelines to support infrastructure automation and configuration management.

Key Responsibilities:

ETL Development & Automation:

  • Design and implement ETL pipelines using AWS Glue and PySpark to transform raw data into consumable formats.
  • Automate data processing workflows using AWS Lambda and Step Functions.

Data Integration & Storage:

  • Integrate and ingest data from various sources into Amazon S3 and Redshift.
  • Optimize Redshift for query performance and cost efficiency.

Data Processing & Analytics:

  • Use AWS EMR and PySpark for large-scale data processing and complex transformations.
  • Build and manage data lakes on Amazon S3 for analytics use cases. Monitoring & Optimization:
  • Monitor and troubleshoot data pipelines to ensure high availability and performance.
  • Implement best practices for cost optimization and performance tuning in Redshift, Glue, and EMR.

Terraform & Git-based Workflows:

  • Design and implement Terraform modules to provision cloud infrastructure across AWS/Azure/GCP.
  • Manage and optimize CI/CD pipelines using Git-based workflows (e.g., GitHub Actions, GitLab CI, Jenkins, Azure DevOps).
  • Collaborate with developers and cloud architects to automate infrastructure provisioning and deployments.
  • Write reusable and scalable Terraform modules following best practices and code quality standards.
  • Maintain version control, branching strategies, and code promotion processes in Git.

Collaboration:

  • Work closely with stakeholders to understand requirements and deliver solutions.
  • Document data workflows, designs, and processes for future reference.

Must-Have Skills:

  • Strong proficiency in SQL, Stored Procs, Python and PySpark for data engineering tasks.
  • Hands-on experience with AWS Glue, Redshift, S3, and EMR.
  • Expertise in building, deploying, and optimizing data pipelines and workflows.
  • Solid understanding of database optimization techniques.
  • Strong hands-on experience with Terraform, including writing and managing modules, state files, and workspaces.
  • Proficient in CI/CD pipeline design and maintenance using tools like: GitHub Actions / GitLab CI / Jenkins / Azure DevOps Pipelines
  • Deep understanding of Git workflows (e.g., GitFlow, trunk-based development).
  • Experience in serverless architecture using AWS Lambda for automation and orchestration.
  • Knowledge of data modeling, partitioning, and schema design for data lakes and warehouses.
  • Ability to work 5 PM IST to 1 AM IST (evening/night shift in order to align with customers business hours)

  • AWS Data Engineer

    1 day ago

    Mumbai, Maharashtra, India Growel Softech Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    AWS Data Engineer 8-11 years AWS Data Engineer, Python Python, S3, RDS, Glue, Lambda, IAM, SNS, SQL , Quicksight

  • Aws Data Engineer

    1 day ago

    Mumbai, Maharashtra, India ERM Placement Services Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job role: AWS Data EngineerLocation: PAN IndiaJob descriptionKey ResponsibilitiesDesign and build data pipelines & Data lakes to automate ingestion of structured and unstructured data that provide fast, optimized, and robust end-to-end solutions Knowledge about the concepts of data lake and dat warehouse Experience working with AWS big data technologies...

  • AWS Data Engineer

    2 days ago

    Mumbai, Maharashtra, India Infogain Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Roles & ResponsibilitiesRequired Qualifications5+ years of software engineering experience, with at least 2+ years in AWS serverless development.Proven expertise in Python (data handling, report generation, API integrations).Hands-on experience with AWS Lambda, SQS, S3, CloudWatch, IAM, and DLQs.Strong knowledge of Snowflake (SQL queries, connectors,...

  • AWS Data Engineer

    24 hours ago

    Mumbai, Maharashtra, India Infogain Full time ₹ 25,00,000 - ₹ 75,00,000 per year

    ROLES & RESPONSIBILITIESROLE OVERVIEWWe are seeking a Data Engineer Lead who can deliver end-to-end data projects, lead a team of engineers, and collaborate with stakeholders to design scalable solutions. The ideal candidate will have strong technical expertise in PySpark, AWS Glue, Lambda, Postgres, Jenkins, Cloud DevOps, SQS, and experience in data...

  • AWS data platform engineer

    2 weeks ago

    Mumbai, Maharashtra, India Tata Consultancy Services Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    TCS presents an excellent Opportunity For "AWS data platform engineer" RoleJob Description1 Role -AWS data platform engineer2 Location of Requirement -Mumbai3 Experience Range -8 to 10 YearsDesired CompetenciesGood understanding on the AWS cloud platform capabilities is mandatory.Experience rolling out infrastructure as a code, using Terraform/Ansible...

  • AWS Data Engineer

    23 hours ago

    Mumbai, Maharashtra, India Infogain Full time ₹ 18,00,000 - ₹ 21,00,000 per year

    ROLES & RESPONSIBILITIESKey ResponsibilitiesData Migration ExecutionBuild and optimize ETL/ELT pipelines for bulk data loads, transformations, and Change Data Capture (CDC).Assist in schema conversion, SQL optimization, and data validation processes.Implement Spark-based jobs for high-volume and high-performance migration workloads.Collaboration &...

  • AWS Quicksight Engineer

    4 days ago

    Mumbai, Maharashtra, India Hybrowlabs Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    AWS QuickSight Engineer (Dashboard Analytics)Experience:3+ years overall IT | 2+ years in AWS QuickSight & SQLLocation:Mumbai, on siteEmployment Type:Full-timeAbout the RoleAre you passionate about transforming data into stories that drive strategic business decisions?We're looking for anAWS QuickSight Engineerto join our growing analytics team — someone...

  • AWS, Snowflake, DBT, Terraform- Senior Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India COREDATA CONSULTANCY Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Role DescriptionWe are seeking a Senior Data Engineer with expertise in AWS, Snowflake, DBT, and Terraform. This is 1 year extendable contractual role where you will design, build, and optimize scalable data solutions. Your responsibilities will include creating and maintaining data pipelines, developing data models, implementing ETL processes, and ensuring...

  • IN | AWS Data Engg Developer

    24 hours ago

    Mumbai, Maharashtra, India Growel Softech Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    - Skills Required Strong experience working in Cloud-based Engineering teams preferably using AWS. Solid understanding of dimensional modelling. Thorough understanding of Python and SQL for data exploration and transformation ideally within Spark environments (Pyspark SparkSQL) such as within Glue jobs. Strong written and oral communication skills and...

  • Senior Data Engineer

    4 days ago

    Mumbai, Maharashtra, India All European Careers Full time  1,20,000 -  1,80,000 per year

    For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of automated ETL pipelines, implementation of the analytics of the platform operations and importing new data sources and its maintenance. The Analytics Data...