AWS Glue Developer

2 weeks ago

Pune, Maharashtra, India Perficient Full time

Job Overview:

We are seeking a highly motivated Lead AWS Data Engineer who thrives in building efficient and scalable data pipelines on AWS. With your technical expertise in AWS ETL services and the ability to lead and mentor others, you will be responsible for designing, developing, and managing large-scale data pipelines, ensuring data quality, security, and performance.

Perficient is always looking for the best and brightest talent and we need you We're a quickly growing, global digital consulting leader, and we're transforming the world's largest enterprises and biggest brands. You'll work with the latest technologies, expand your skills, and become a part of our global community of talented, diverse, and knowledgeable colleagues.

RESPONSIBILITIES

  • Design, develop, and implement secure and scalable data pipelines on AWS utilizing services like Glue, Lambda, Step Functions, and Kinesis.
  • Lead a team of ETL engineers in designing and implementing data integration solutions.
  • Optimize data pipelines for performance, scalability, and cost-effectiveness.
  • Develop and maintain documentation for data pipelines, ensuring transparency and knowledge transfer.
  • Implement data quality checks and monitoring to ensure data integrity throughout the ETL process.
  • Collaborate with data analysts, data scientists, and business stakeholders to identify data needs and define ETL requirements.
  • Secure data access using AWS Identity and Access Management (IAM) policies.
  • Automate data pipeline deployment and management using Infrastructure as Code (IaC) principles with Terraform.
  • Stay up-to-date on the latest advancements in AWS data services and ETL best practices.
  • Troubleshoot and resolve complex data pipeline issues.

QUALIFICATIONS

  • 5+ years of experience designing and implementing data pipelines on AWS.
  • Proven experience with AWS ETL services such as Glue, Lambda, Step Functions, and Kinesis.
  • Strong understanding of data warehousing concepts and data modeling principles.
  • Experience with SQL and scripting languages like Python or Bash for data manipulation and automation.
  • Experience with data quality tools and techniques.
  • Excellent communication, collaboration, leadership, and problem-solving skills.
  • Ability to mentor and guide junior team members.

Additional skills:

  • Experience with cloud-native databases like Amazon DynamoDB and Amazon Aurora.
  • Experience with data warehousing platforms like Redshift or Snowflake.
  • Experience with containerization technologies like Docker and Kubernetes.
  • Experience with CI/CD methodologies for data pipelines.

Preferred education and certification:

  • Bachelor's degree in computer science or related field
  • AWS Certified Data Analytics - Specialty or AWS Certified Solutions Architect - Associate.

WHO WE ARE

Perficient is a leading global digital consultancy. We imagine, create, engineer, and run digital transformation solutions that help our clients exceed customers' expectations, outpace competition, and grow their business. With unparalleled strategy, creative, and technology capabilities, our colleagues bring big thinking and innovative ideas, along with a practical approach to help our clients – the world's largest enterprises and biggest brands succeed.

WHAT WE BELIEVE

At Perficient, we promise to challenge, champion, and celebrate our people. You will experience a unique and collaborative culture that values every voice. Join our team, and you'll become part of something truly special.

We believe in developing a workforce that is as diverse and inclusive as the clients we work with. We're committed to actively listening, learning, and acting to further advance our organization, our communities, and our future leaders... and we're not done yet.

  • AWS Glue Developer

    2 weeks ago

    Pune, Maharashtra, India Perficient Full time

    Job Overview:We are seeking a highly motivated Lead AWS Data Engineer who thrives in building efficient and scalable data pipelines on AWS. With your technical expertise in AWS ETL services and the ability to lead and mentor others, you will be responsible for designing, developing, and managing large-scale data pipelines, ensuring data quality, security,...

  • Pyspark AWS Developer

    2 weeks ago

    Pune, Maharashtra, India Virtusa Full time

    Pyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...

  • Amazon Glue

    2 weeks ago

    Pune, Maharashtra, India Zensar Technologies Full time

    AMAZON GLUE-(0098348)DescriptionAWS TECHNICAL SPECIALIST9-12 YRSPUNE/BANGALORE/HYDERABADWhat's this role about?As an AWS Technical Specialist, you will be responsible for migration to AWS Data Cloud or implementing data solutions using AWS Data Cloud services including integration with existing data and analytics platforms and tools.Here's how you'll...

  • Aws+ Talend Developer

    2 weeks ago

    Pune, Maharashtra, India Nityo Infotech Full time

    Clarity call for AWS DEV Profile Mandate: •Experience range - 2 to 6 Years.•Production support experience.•AWS: Knowledge of scheduling spark applications in AWS EMR cluster.Design, build and operationalize large-scale enterprise data solutions and applications using one or more AWS data and analytics services in combination with 3rd parties - Spark,...

  • Senior ETL Developer with AWS

    2 weeks ago

    Pune, Maharashtra, India OpsTree Solutions Full time

    Here is the Monument JD.JobDescriptionWeare seeking a skilled ETL (Extract Transform Load) developer withexpertise in AWS services to join our team.Asan ETL developer you will play a crucial role in designingdeveloping and maintaining robust ETL processes to support our dataintegration and analysis needs.ResponsibilitiesDesigndevelop and implement efficient...

  • AWS Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Techno Wise Full time

    We are looking for aAWS Data Engineerwho will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources.Key ResponsibilitiesPerform technical assessment...

  • AWS Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Techno Wise Full time

    We are looking for a AWS Data Engineer who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. Key Responsibilities Perform technical...

  • Pyspark, AWS Architect

    2 weeks ago

    Pune, Maharashtra, India Virtusa Full time

    Pyspark, AWS Architect (ATC) CREQ184787 Description 10+ years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...

  • Technology Lead

    4 weeks ago

    Pune, Maharashtra, India BlueByte Technologies Full time

    Job Description : - 7 to 12 years of experience in designing, implementing, and managing cloud solutions on AWS.- Design, develop, and implement cloud solutions on AWS, utilizing a wide range of AWS services, including Glue ETL, Glue Data Catalog, Athena, Redshift, RDS, DynamoDB, Step Function, Event Bridge, Lambda, API Gateway, ECS, and ECR.- Demonstrate...

  • Technology Lead

    4 weeks ago

    Pune, Maharashtra, India BlueByte Technologies Full time

    Job Description : - 7 to 12 years of experience in designing, implementing, and managing cloud solutions on AWS.- Design, develop, and implement cloud solutions on AWS, utilizing a wide range of AWS services, including Glue ETL, Glue Data Catalog, Athena, Redshift, RDS, DynamoDB, Step Function, Event Bridge, Lambda, API Gateway, ECS, and ECR.- Demonstrate...

  • Aws - Pune

    2 weeks ago

    Pune, Maharashtra, India Nityo Infotech Full time

    AWS/Talend: Key responsibilities: • Owning Assignments for Dev/Maintenance tasks for AWS,• Managing scheduling with Talend,AutomateNow,Airflow scheduler.• Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Handling Nifi ingestions• Good understating of Technologies such as Spark,Kafka.• Should...

  • Aws - Pune

    2 weeks ago

    Pune, Maharashtra, India Nityo Infotech Full time

    AWS/Talend: Key responsibilities: Owning Assignments for Dev/Maintenance tasks for AWS, Managing scheduling with Talend,AutomateNow,Airflow scheduler. Should have Hands on Experience of Development on Cloudera Platform. Developing Unix Shell scripts Handling Nifi ingestions Good understating of Technologies such as Spark,Kafka. Should able to analyze the...

  • Openings for AWS with Vyom Labs

    2 weeks ago

    Pune, Maharashtra, India Vyom Labs Pvt Ltd Full time

    Experience: More than 4 Years. JD of AWS: AWS Engineers (Seniors, IND Based): S3 Lambda, SQS/ SNS, RDS, Dynamo, VPC, KMS, Athena, Glue, API Integration AWS Solution Architect (senior, IND Based): S3 Lambda, SQS/ SNS, RDS, Dynamo, VPC, KMS, Athena, Glue, API Integration. AWS (Seniors, IND based) cloud formation, Terraform( strong Skill Set)...

  • Openings for AWS with Vyom Labs

    2 weeks ago

    Pune, Maharashtra, India Vyom Labs Pvt Ltd Full time

    Experience: More than 4 Years.JD of AWS:AWS Engineers (Seniors, IND Based): S3 Lambda, SQS/ SNS, RDS, Dynamo, VPC, KMS, Athena, Glue, API IntegrationAWS Solution Architect (senior, IND Based): S3 Lambda, SQS/ SNS, RDS, Dynamo, VPC, KMS, Athena, Glue, API Integration.AWS (Seniors, IND based) cloud formation, Terraform( strong Skill Set) experience with...

  • AWS Sr. Data Engineer Job

    2 weeks ago

    Pune, Maharashtra, India YASH Technologies Full time

    YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, we're a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single...

  • AWS Data Engineer

    2 weeks ago

    Pune, Maharashtra, India EXL Full time

    Role:AWS Data EngineerExperience: 4 to 6 YearsLocation:Gurgaon, Bangalore – HybridJob Summary:We are looking for a highly motivated AWS Engineer. This role calls for someone with experience in AWS cloud who is enthusiastic about staying updated with the latest cloud development practices. The ideal candidate will excel at understanding requirements and...

  • AWS Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Huquo Full time

    Job Description :Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple Fortune...

  • Python Aws Associate

    2 weeks ago

    Pune, Maharashtra, India PeopleLogic Business Solutions Full time

    Hands-on developer capable of debugging the system and fixing production-related issues. Strong ability to analyze functional needs that drive the analysis and technical design of quality technical solutions. Implements solutions that are aligned with business/IT strategies and comply with Client's Architectural standards. Maintains knowledge of emerging...

  • AWS Data engineer

    2 weeks ago

    Pune, Maharashtra, India Virtusa Full time

    AWS Data engineer - CREQ188721 Description Having 5-7 years of IT experience overall and 3-5 years of experience in AWS and Snowflake Proficient in AWS technologies like Glue, Athena, S3, Pyspark & etc. Must be good at SQL and worked in Snowflake database. Understand the concepts of Data Lake, Data Warehouse, SCD Types & etc. Nice to have experience with...

  • Aws Data Architect

    2 weeks ago

    Pune, Maharashtra, India Zensar Technologies Full time

    AWS Data architect/solution engineer(India)What's this role about?Looking for AWS Data architect/solution engineer with 8-15 years of experience Skills required to contribute:We're looking for someone with: The ability to create and maintain optimal data pipeline architecture by designing and implementing data ingestion solutions on AWS using data management...