AWS Data Infrastructure Specialist

2 weeks ago

Remote, India Staffington Consulting Pvt Ltd Full time

Overview

Staffington Consulting Pvt Ltd is a leading consulting firm specializing in cloud-based solutions. We are seeking a highly skilled AWS Data Infrastructure Specialist to join our team. As a key member of our data workstream, you will design and implement complex data transformations using AWS services such as Glue, Spark, and Lambda.

Responsibilities:

  • Design and implement data transformation pipelines using Python, Spark, and AWS Glue.
  • Ensure data quality and accuracy throughout the transformation process.
  • Develop and maintain Terraform modules to provision and manage AWS data services.
  • Implement robust and scalable infrastructure solutions using Terraform.
  • Create and maintain CI/CD pipelines to automate the deployment of Terraform code and infrastructure changes.
  • Collaborate with AWS architects, team leads, data engineers, and other stakeholders to understand and define infrastructure and functional requirements for the data workstream.
  • Identify and recommend suitable AWS resources to meet the project's data processing and storage needs.
  • Collaborate with DevOps engineers to design, build, and maintain the data workstream environment, ensuring security, scalability, and performance.
  • Troubleshoot and resolve any infrastructure-related issues within the data environment.
  • Provide ongoing support and maintenance for the data infrastructure and pipelines.
  • Monitor system performance, identify and resolve bottlenecks, and implement optimizations.

Skills & Qualifications:

  • Deep understanding and hands-on experience with core AWS data services, including EMR, Glue, Spark, Data Lake, LakeFormation, IAM, KMS, Lambda, SQS, Athena, Kinesis Firehose/Kafka, S3, EventBridge, Aurora Postgres, DynamoDB, Redis, Snowflake, and other relevant services.
  • Extensive experience in deploying and managing infrastructure using Terraform.
  • Proficiency in writing, testing, and maintaining Terraform modules.
  • Strong experience in designing and implementing complex data transformations using ETL services like Glue and Spark.
  • Proficiency in Python for data manipulation, ETL processes, and data analysis.
  • Understanding of data modeling principles and experience with Data Definition/Description Language (DDL).
  • Knowledge of AWS security best practices and experience with implementing security controls within the AWS environment.
  • Excellent communication and collaboration skills to effectively work with cross-functional teams.
  • Ability to clearly articulate technical concepts to both technical and non-technical audiences.

  • Aws Architect

    1 week ago

    Remote, India True Data Software Full time

    Experience - 8+ Years Remote Job - Remote, Anywhere Vacancy - 1 **Requirements**: Bachelor's degree in either Computer Science, Computer Engineering, Software Engineering, MIS, or other IT-related discipline - Minimum 8+ years experience with following AWS services: VPC, Route53, CloudFront, WAF WebACL, CloudWatch, EKS + Fargate, EC2, Lambda, AppMesh,...

  • AWS Data Infrastructure Specialist

    2 weeks ago

    Anywhere in India/Multiple Locations/Remote Ampstek Full time

    About AmpstekAmpstek is a innovative technology company that requires experienced professionals like you to drive our growth and success. As a leader in your field, you will have the opportunity to shape our data engineering strategy and contribute to the development of cutting-edge data solutions.What You Will DoYou will design and develop high-quality data...

  • Aws Cloud Administrator

    5 days ago

    Remote, India Akra Tech Full time

    **LOCATION: CHENNAI**: **Requirements**: - Bachelor’s degree in Computer Science, Information Technology, or related field. - Minimum of 2 years of experience as a Cloud Administrator or similar role, with a focus on AWS cloud infrastructure. - Solid understanding of AWS services such as EC2, S3, RDS, VPC, IAM, Lambda, and CloudWatch. - Experience with...

  • Cloud Infrastructure Automation Specialist

    2 weeks ago

    Remote, India Strategic HR Solutions Full time

    Job OverviewWe are seeking a Cloud Infrastructure Automation Specialist to join our team at Strategic HR Solutions. The ideal candidate will have experience in working with Terraform IaC and key features, Execution Plans, State files etc. and be able to design and implement efficient and reliable cloud infrastructure automation solutions.Key...

  • AWS Data Engineer

    2 weeks ago

    Remote, India Coders Brain Technology Private Limited Full time

    Job Description : We are looking for a highly skilled AWS Data Engineer with expertise in PySpark, AWS Glue, EMR, Lambda, DMS, and ETL pipelines. The ideal candidate should have hands-on experience in designing, implementing, and optimizing data pipelines on AWS while ensuring scalability and performance. Key Responsibilities : - Design and develop scalable...

  • AWS Data Engineer

    3 days ago

    Remote, India beBee Careers Full time

    Job Summary:">This is a highly skilled role for an experienced data engineer to design and develop ETL jobs using AWS Glue, including crawlers, ETL scripts (PySpark/Scala), and workflows.">Key Responsibilities:">">Design and implement efficient ETL processes using PySpark or Scala within AWS Glue jobs.">Omitimize Glue jobs for performance and scalability,...

  • Aws Emr Admin

    3 days ago

    Remote, India Thinkreh Full time

    **Roles and Responsibilities**: **Skills**: - AWS EMR, EC2, AWS S3, Cloud Formation Template, Batch data, AWS Code Pipeline services **Nice to Have**: - EKS **Responsibility**: - Full hands-on role so need to have good admin knowledge on AWS EMR, EC2, AWS S3, Cloud - Formation Template, Batch data etc. - Managing and Deploying EMR Clusters, with the...

  • CMDB/BMC IT Infrastructure Specialist

    1 week ago

    Remote, India Softility Full time

    At Softility, we're seeking a skilled CMDB/BMC IT Infrastructure Specialist to join our team. In this role, you will be responsible for configuring and maintaining BMC Remedy CMDB and Discovery solutions to meet business requirements and ITIL best practices.Key responsibilities include:Defining and implementing CMDB governance policies, processes, and...

  • Aws Data Architect

    2 weeks ago

    Remote, India RARR Technologies Pvt Ltd Full time

    **Key Responsibilities**: - Design end-to-end data solutions on AWS, emphasizing Databricks and Python for data processing. - Develop scalable and efficient data architectures to meet business objectives. - Utilize AWS cloud services for architecting and implementing data solutions. - Optimize data processing and storage using various AWS services. - Lead...

  • AWS Cloud Data Architect

    2 weeks ago

    Remote, India Coders Brain Technology Private Limited Full time

    **Job Description for Experienced Professionals**We are seeking a highly skilled AWS Data Engineer to join our team at Coders Brain Technology Private Limited. As an AWS Data Engineer, you will play a critical role in designing and developing scalable ETL pipelines using AWS Glue, EMR, and PySpark.The ideal candidate should have hands-on experience in...