AWS Data Engineer

4 months ago


india Webologix Ltd INC Full time

Job Position: AWS Data Engineer

Job Type: Full-Time

Location: Kolkata, IN

Experience: - 4+ to 10+ Years

Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL.


Key Responsibilities:


  • Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to facilitate ETL (Extract, Transform, Load) processes and ensure data integrity and accessibility.
  • Data Storage Management: Utilize Amazon S3 for scalable and secure data storage. Optimize data storage solutions and manage data lifecycle policies to ensure efficient data retrieval and cost management.
  • Data Transformation and Processing: Develop and execute data transformation workflows using AWS Glue and PySpark. Ensure data is processed efficiently and accurately to meet business requirements.
  • Database Management: Manage and optimize relational and NoSQL databases using Amazon RDS and DynamoDB. Implement data models and design schemas to support business applications and reporting needs.
  • Scripting and Automation: Write Python scripts to automate data processing tasks, integrate data from various sources, and develop custom solutions for data manipulation and analysis.
  • SQL and PL/SQL Development: Utilize SQL for querying relational databases and performing complex data manipulations. Apply PL/SQL for advanced database procedures and optimizations in Oracle environments.
  • Data Quality and Performance: Monitor and maintain data quality, performance, and security. Implement best practices for data management and troubleshoot issues to ensure reliable data operations.
  • Collaboration and Documentation: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide technical expertise. Document data pipelines, processes, and architecture to support ongoing maintenance and scalability.


Required Skills and Qualifications:

  • Proven experience as a Data Engineer or similar role with a focus on AWS technologies.
  • Strong proficiency in AWS services including S3, Lambda, Glue, Step Functions, RDS, and DynamoDB.
  • Expertise in Python and PySpark for data processing and automation tasks.
  • Solid experience with SQL and PL/SQL for querying and managing relational databases.
  • Demonstrated ability to design and implement data pipelines and workflows.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration abilities.


Qualifications:

Bachelor’s degree in computer science, Information Technology, or a related field.


  • Aws data engineer

    3 months ago


    India FLYONIT Full time

    Job Summary:   We are looking for a highly skilled AWS Data Engineer with 5-6 years of experience to join our dynamic team. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud. You will be responsible for...

  • AWS Data Engineer

    3 months ago


    india FLYONIT Full time

    Job Summary: We are looking for a highly skilled AWS Data Engineer with 5-6 years of experience to join our dynamic team. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud. You will be responsible for designing...

  • Aws data engineer

    1 month ago


    India Recro Full time

    Job Title: Data Engineer Experience : 5+ years Location : Remote Job Type : Full-time Role Overview: We are seeking an experienced Data Engineer to develop and optimize data pipelines and manage cloud infrastructure. The ideal candidate has strong Python, Pyspark, and AWS skills, with a focus on performance optimization and clean,...

  • AWS Data Engineer

    4 months ago


    India FLYONIT Full time

    Job Summary:   We are looking for a highly skilled AWS Data Engineer with 5-6 years of experience to join our dynamic team. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud. You will be responsible for...

  • AWS Data Engineer

    4 months ago


    India FLYONIT Full time

    Job Summary: We are looking for a highly skilled AWS Data Engineer with 5-6 years of experience to join our dynamic team. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud. You will be responsible for designing...

  • Aws data engineer

    1 month ago


    India Tata Consultancy Services Full time

    Dear Candidate, Greetings from TATA CONSULTANCY SERVICES LIMITED!!! Skill: AWS Data Engineer + Python & Scala Location: PAN INDIA Experience: 4 to 8 years Industry experience in Data Engineering on AWS cloud with glue, redshift , Athena experience. Ability to write high quality, maintainable, and robust code, often in SQL, Scala and Python....


  • India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Senior Data Engineer with over 5 years of expertise in data engineering. As a Senior Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...

  • Aws data engineer

    1 month ago


    India Recro Full time

    Role Details Position : AWS Data Engineer Location : Remote Experience : 5+ years Education : Technical degree preferred Notice : Immediate joiners or those currently serving preferre What We Need From You To move forward, please reply with the following details: Updated CV Compensation : What is your current CTC and expected...

  • Aws data engineer

    4 weeks ago


    India Programmers.io Full time

    Job Description: Job Title: AWS Data Engineer Shift Timings: 1:30 PM - 10:30 PM Location: Jaipur Experience required: 3 to 8 years AWS Data Engineer - Marketing Key Tasks: Analyze existing marketing data/tables and summarize data. Collaborating with existing DE team to ingest additional data sources for marketing Developing data...


  • India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Senior Data Engineer with over 5 years of expertise in data engineering. As a Senior Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...


  • India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Senior Data Engineer with over 5 years of expertise in data engineering. As a Senior Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for success. ...


  • India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Senior Data Engineer with over 5 years of expertise in data engineering.As a Senior Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for success.Key...

  • AWS Data Engineer

    1 month ago


    India Programmers.io Full time

    Job Description: Job Title: AWS Data Engineer Shift Timings: 1:30 PM - 10:30 PM Location: Jaipur Experience required: 3 to 8 years AWS Data Engineer - Marketing Key Tasks: Analyze existing marketing data/tables and summarize data. Collaborating with existing DE team to ingest additional data sources for marketing Developing data workflows to...

  • AWS Data Engineer

    1 month ago


    India Programmers.io Full time

    Job Description: Job Title: AWS Data Engineer Shift Timings: 1:30 PM - 10:30 PM Location: Jaipur Experience required: 3 to 8 years AWS Data Engineer - Marketing Key Tasks: Analyze existing marketing data/tables and summarize data. Collaborating with existing DE team to ingest additional data sources for marketing Developing data...


  • india Wavicle Data Solutions Full time

    Job Description:We are seeking an experienced AWS Redshift Database Administrator (DBA) to join our dynamic team. The ideal candidate will possess a strong background in database administration, data warehousing, and hands-on experience with AWS services. You will play a crucial role in managing, optimizing, and securing our database systems to support our...

  • Aws data engineer

    1 week ago


    India SHETHINK Full time

    AWS Data Engineer Good To Have Skills - AWS Certifications Must Have Skills - Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Experience Level - 8 - 12 Years Employee Type - Salaried External Description The Data platform associate will work in a variety of settings to build the data systems including design, implementation,...

  • AWS Data Engineer

    2 months ago


    India Programmers.io Full time

    Exp - 4 years - 8 years Shift Timings - 1:30pm-10:30pm Remote opportunity available till offices resumes AWS Data Engineer - Marketing Key Tasks: Analyze existing marketing data/tables and summarize data. Collaborating with existing DE team to ingest additional data sources for marketing Developing data workflows to process, clean & link / unify...

  • AWS Data Engineer

    2 months ago


    India Programmers.io Full time

    Exp - 4 years - 8 years Shift Timings - 1:30pm-10:30pmRemote opportunity available till offices resumes AWS Data Engineer - MarketingKey Tasks:Analyze existing marketing data/tables and summarize data.Collaborating with existing DE team to ingest additional data sources for marketingDeveloping data workflows to process, clean & link / unify consumer data...

  • AWS Data Engineer

    2 months ago


    India Recro Full time

    Job Title: Data EngineerExperience: 5+ yearsLocation: RemoteJob Type: Full-timeRole Overview:We are seeking an experienced Data Engineer to develop and optimize data pipelines and manage cloud infrastructure. The ideal candidate has strong Python, Pyspark, and AWS skills, with a focus on performance optimization and clean, maintainable code.Key...

  • AWS Data Engineer

    2 months ago


    India Recro Full time

    Job Title: Data Engineer Experience : 5+ years Location : Remote Job Type : Full-time Role Overview: We are seeking an experienced Data Engineer to develop and optimize data pipelines and manage cloud infrastructure. The ideal candidate has strong Python, Pyspark, and AWS skills, with a focus on performance optimization and clean, maintainable code. Key...