Vanguard AWS Glue Developer

5 days ago

Pune, Maharashtra, India Agbe Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Job Description

Job Title: Vanguard AWS Glue Developer

Location: Pune

Experience: Years

Employment Type: Contract

Work Mode: Onsite

About the Role:

We are seeking an experienced AWS Glue Developer with strong expertise in building scalable ETL pipelines and data integration solutions on AWS cloud platform. The ideal candidate will have hands-on experience with Vanguard applications and AWS Glue ecosystem, capable of designing, developing, and optimizing large-scale data workflows.

Key Responsibilities:

Design, develop, and maintain ETL pipelines using AWS Glue for data ingestion, transformation, and loading

Build and optimize Glue jobs using Python/PySpark for processing large-scale datasets

Develop data integration solutions connecting multiple data sources to AWS data lakes and warehouses Implement data quality checks, validation rules, and error handling mechanisms in ETL workflows Work with Glue Data Catalog for metadata management and schema evolution

Optimize Glue job performance through partitioning, bucketing, and resource tuning

Collaborate with data engineers, architects, and business teams to understand data requirements Implement data security best practices including encryption, IAM policies, and access controls Troubleshoot and resolve production issues in ETL pipelines

Create technical documentation for ETL processes and data lineage Participate in code reviews and ensure adherence to coding standards

Monitor and maintain data pipeline health using CloudWatch and other AWS monitoring tools

Must-Have Skills:

Technical Skills (Mandatory):

  • AWS Glue: 3+ years of hands-on experience in AWS Glue ETL development
  • Python/PySpark: Strong programming skills in Python and PySpark for data transformation
  • AWS Services: Proficiency in S3, Redshift, Athena, Lambda, and EMR
  • Data Formats: Experience with Parquet, Avro, JSON, CSV, and ORC file formats
  • SQL: Advanced SQL skills for data querying and transformation
  • ETL Concepts: Deep understanding of ETL/ELT design patterns and best practices
  • Data Modeling: Knowledge of dimensional modeling, star/snowflake schemas
  • Version Control: Experience with Git/Bitbucket for code management

Preferred Skills:

  • Experience with Vanguard platform or financial services domain Knowledge of AWS Step Functions for workflow orchestration Familiarity with Apache Spark optimization techniques
  • Experience with data lake architectures and Delta Lake
  • AWS certifications (Solutions Architect, Data Analytics, Developer) Experience with CI/CD pipelines for data workflows
  • Knowledge of data governance and compliance frameworks
  • Exposure to Terraform or CloudFormation for infrastructure as code

Soft Skills:

  • Strong analytical and problem-solving abilities
  • Excellent communication skills for stakeholder interaction Ability to work independently and in team environments

Proactive approach to identifying and resolving issues Strong documentation skills

Educational Qualification:

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related field Relevant AWS certifications are a plus

  • Python Developer with AWS

    4 days ago

    Pune, Maharashtra, India Amrapali Ind Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role : Python DeveloperExperience : 4-10YrsNotice period : 0-15 daysPrimary skills : Python programming, AWS (S3, EKS /ECS, API Gateway, Lambda, Glue)Detailed Job description:5+ years of work experience using Python and AWS for developing enterprise software applications• Experience in Apache Kafka, including topic creation, message optimization, and...

  • AWS Redshift Developer

    5 days ago

    Pune, Maharashtra, India Coforge Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    AWS Redshift Developer We are hiring AWS Redshift Developer Shift Timings: 2:00 PM – 11:00 PM IST Experience Required: 8 to 10 Years Availability: Immediate joiners preferred Key Skills: AWS Redshift, SQL, ETL & Data Warehousing. Responsibilities:Design and develop high-performance ETL pipelines using Redshift and AWS services. ...

  • AWS Data Engineer

    2 weeks ago

    Pune, Maharashtra, India NotDisclosed Full time ₹ 10,00,000 - ₹ 12,00,000 per year

    Key Skills (Mandatory): Python, PySpark, Glue, Redshift, Lambda, DMS, RDS, CloudFormation, SQLJob Responsibilities:Design, develop, and maintain scalable data pipelines and ETL processes using AWS services (Glue, Lambda, DMS, Redshift, RDS, etc.).Optimize data models for performance, scalability, and efficiency.Write complex SQL queries for data analysis,...

  • Aws Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Viraaj HR Solutions Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Industry & Sector:IT Services — Cloud & Data Engineering practice focused on building enterprise-scale analytics platforms, cloud data lakes, and production-grade ETL/ELT solutions on AWS for large commercial and enterprise clients.Location: India (On-site). Role: AWS Data Engineer — hands-on contributor building scalable, secure data pipelines and...

  • AWS Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Arthur Grand Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Arthur Grand Technologies is currently seeking a highly motivated and skilled AWS Data Engineer for one of our clients.Role: AWS Data EngineerLocation: PuneDuration: FulltimeMandatory Skills: Very strong on Python, Pyspark, AWS, Glue, Lambda, S3, SparkMust Have:BS/BA degree or equivalent experienceGeneral: Strong organizational, problem-solving, and critical...

  • Aws Data Engineer

    3 days ago

    Pune, Maharashtra, India Inwinteck Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Communication, problem-solving Responsibilities:* Collaborate with cross-functional teams on pipeline design & governance* Design, develop & maintain AWS data pipelines using GLUE, Redshift, Lambda & PythonProvident fund

  • Aws Engineer

    2 weeks ago

    Pune, Maharashtra, India Kaizen Sra Technologies Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    JD: AWSGood understanding of AWS Services & architecture such as EC2, S3, RDS, Lambda, Glue, Athena, Redshift, API Gateway, CloudFormation, etc.Programming skills in PythonGood analytical and problem-solving skills, essential for debugging and optimizing AWS resource utilization.Experience with version control systems like Git, promoting code integrity and...

  • AWS Data Engineer

    1 day ago

    Pune, Maharashtra, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    Company: QAP Software SolutionsPosition: AWS Data EngineerLocation: Pune, India (Onsite)Experience: 5–7 YearsStart Date: Immediate / As early as possibleShift Timing: UK Shift (1 PM – 10 PM IST)Role OverviewWe are seeking an experienced AWS Data Engineer with 5–7 years of relevant experience to join our team on a contract basis. The ideal candidate...

  • AWS Data Engineer

    22 hours ago

    Pune, Maharashtra, India NCSI Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: AWS Data Engineer Company Name: NCSi Job Description: NCSi is seeking a skilled AWS Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing and building robust data pipelines, developing data integration processes, and optimizing database performance in cloud environments. You will work collaboratively with...

  • Aws Engineer

    7 days ago

    Pune, Maharashtra, India Glauben Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Must Have Strong work experience in AWS KafkaJob DescriptionRole Summary:We are looking for a highly skilled and proactive Data Engineer with deep expertise in AWS, Snowflake, SQL, Kafka,  Python, and PySpark. This role is ideal for someone who thrives in building scalable data pipelines, optimizing cloud infrastructure, and enabling real-time data...