AWS Data Architect

2 months ago


india HCLTech Full time

AWS Data Architect

Job location: Chennai and Bangalore


Job description:

We are seeking an experienced AWS Principal Data Architect to lead the migration of Hadoop DWH workloads from on-premise to AWS EMR. As an AWS Data Architect, you will be a recognized expert in cloud data engineering, developing solutions designed for effective data processing and warehousing requirements of large enterprises. You will be responsible for designing, implementing, and optimizing the data architecture in AWS, ensuring highly scalable, flexible, secured and resilient cloud architectures solving business problems and helps accelerate the adoption of our client’s data initiatives on the cloud.


Key Responsibilities:

  • Lead the migration of Hadoop workloads from on-premise to AWS-EMR stack.
  • Design and implement data architectures on AWS, including data pipelines, storage, and security.
  • Collaborate with cross-functional teams to ensure seamless migration and integration.
  • Optimize data architectures for scalability, performance, and cost-effectiveness.
  • Develop and maintain technical documentation and standards.
  • Provide technical leadership and mentorship to junior team members.
  • Work closely with stakeholders to understand business requirements, and ensure data architectures meet business needs.
  • Work alongside customers to build enterprise data platforms using AWS data services like Elastic Map Reduce (EMR), Redshift, Kinesis, Data Exchange, Data Sync, RDS , Data Store, Amazon MSK, DMS, Glue, Appflow, AWA Zero-ETL, Glue Data Catalog, Athena, Lake Formation, S3, RMS, Data Zone, Amazon MWAA, APIs Kong
  • Deep understanding of Hadoop components, conceptual processes and system functioning and relative components in AWS EMR and other AWS services. Good experience on Spark-EMR
  • Experience in Snowflake/Redshift
  • Good idea of AWS system engineering aspects of setting up CI-CD pipelines on AWS using Cloudwatch, Cloudtrail, KMS, IAM IDC, Secret Manager, etc
  • Extract best-practice knowledge, reference architectures, and patterns from these engagements for sharing with the worldwide AWS solution architect community


Basic Qualifications:


  • 10+ years of IT experience with 5+ years of experience in Data Engineering and 5+ years of hands-on experience in AWS Data/EMR Services (e.g. S3, Glue, Glue Catalog, Lake Formation)
  • Strong understanding of Hadoop architecture, including HDFS, YARN, MapReduce, Hive, HBase.
  • Experience with data migration tools like Glue, Data Sync.
  • Excellent knowledge of data modeling, data warehousing, ETL processes, and other Data management systems.
  • Strong understanding of security and compliance requirements in cloud.
  • Experience in Agile development methodologies and version control systems.
  • Excellent communication an leadership skills. Ability to work effectively across internal and external organizations and virtual teams.
  • Deep experience on AWS native data services including Glue, Glue Catalog, EMR, Spark-EMR, Data Sync, RDS, Data Exchange, Lake Formation, Athena,
  • AWS Certified Data Analytics – Specialty.
  • AWS Certified Solutions Architect – Professional.
  • Experience on Containerization and serverless computing.
  • Familiarity with DevOps practices and automation tools.
  • Experience in Snowflake/Redshift implementation is additionally preferred.


Preferred Qualifications:


  • Technical degrees in computer science, software engineering, or mathematics
  • Cloud and Data Engineering background with Migration experience.


Other Skills:


  • A critical thinker with strong research, analytics and problem-solving skills
  • Self-motivated with a positive attitude and an ability to work independently and or in a team
  • Able to work under tight timeline and deliver on complex problems.
  • Must be able to work flexible hours (including weekends and nights) as needed.
  • A strong team player

  • AWS Data Architect

    2 months ago


    india HCLTech Full time

    AWS Data Architect Job location: Chennai and Bangalore Job description: We are seeking an experienced AWS Principal Data Architect to lead the migration of Hadoop DWH workloads from on-premise to AWS EMR. As an AWS Data Architect, you will be a recognized expert in cloud data engineering, developing solutions designed for effective data processing and...

  • AWS Data Architect

    2 months ago


    india Prodapt Full time

    Overview:We are seeking an experienced Data Architect to lead a major data migration initiative. The role involves designing and implementing strategies for migrating data from legacy systems to modern platforms (cloud), ensuring data integrity, scalability, and security. The ideal candidate will have deep technical expertise in cloud platforms, especially...

  • AWS Data Architect

    2 months ago


    india Prodapt Full time

    Overview: We are seeking an experienced Data Architect to lead a major data migration initiative. The role involves designing and implementing strategies for migrating data from legacy systems to modern platforms (cloud), ensuring data integrity, scalability, and security. The ideal candidate will have deep technical expertise in cloud platforms, especially...

  • Aws data engineer

    3 days ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 weeks ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 weeks ago


    india ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago


    India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...


  • India Wavicle Data Solutions Full time

    Wavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...

  • Aws Solution Architect

    6 months ago


    India Saasvaap Full time

    **JOB DESCRIPTION**: We are looking for a highly skilled and experienced AWS Solution Architect to join our team. As an AWS Solution Architect, you will play a key role in designing and implementing cloud-based solutions for our clients. You will be responsible for understanding client requirements, architecting scalable and secure AWS infrastructure, and...


  • India CosMic IT Full time

    Full Time - India - Posted 1 year ago - Applications have closed - CosMicIT **CosMic IT** - Find Your Dream Job Here_ Greetings Everyone! We have an urgent requirement for AWS Application Architect Location: India/Offshore **Job Description**: 6. Providing technical support: The AWS Application Architect should provide technical support to the...


  • india Tata Consultancy Services Full time

    Location: HyderabadExperience: 5-12years Skills : AWS Services: ECS Fargate, Lambda, Aurora PostgreSQL, S3, CloudWatch and other AWS services Backend: Java, Spring Boot Frontend: React, Emerald Ui Containerization: Docker Orchestration: ECS Fargate AWS CloudWatch, HarsiCorp, API Gateway, Datadog Responsibilities : 1. Design and architect scalable,...


  • india Tata Consultancy Services Full time

    Location: Hyderabad Experience: 5-12years Skills : AWS Services: ECS Fargate, Lambda, Aurora PostgreSQL, S3, CloudWatch and other AWS services Backend: Java, Spring Boot Frontend: React, Emerald Ui Containerization: Docker Orchestration: ECS Fargate AWS CloudWatch, HarsiCorp, API Gateway, Datadog Responsibilities : 1. Design and architect...

  • Lead data engineer

    7 days ago


    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Aws Architect

    5 months ago


    India Orion Systems Integrators, Inc. Full time

    India Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries...

  • AWS Data Engineer

    3 weeks ago


    india Vantage Point Consulting Inc. Full time

    AWS Data Engineer - Hadoop MigrationLocation: Chennai or BengaluruRole Type: Full-TimeWe’re seeking a skilled AWS Principal Data Architect to lead the migration of Hadoop DWH workloads from on-premise to AWS EMR. Join our team and help design and optimize scalable, secure, and resilient cloud data architectures for enterprise data processing.Key...

  • Aws data engineer

    1 month ago


    India FLYONIT Full time

    Job Summary:   We are looking for a highly skilled AWS Data Engineer with 5-6 years of experience to join our dynamic team. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud. You will be responsible for...

  • AWS Data Engineer

    1 month ago


    india FLYONIT Full time

    Job Summary: We are looking for a highly skilled AWS Data Engineer with 5-6 years of experience to join our dynamic team. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud. You will be responsible for designing...


  • india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...