AWS Data Engineer

1 month ago

BangaloreNoida, India Firstcareercentre Full time

Job Title: AWS Data Engineer

Job Summary:

We are seeking a highly skilled and experienced AWS Data Engineer to design, develop, and optimize data pipelines, integrate various data sources, and implement AWS cloud solutions.

Key Responsibilities:

Data Pipeline Development:

  • Design, build, and maintain scalable ETL pipelines using AWS services (e.g., Glue, Lambda, S3, Redshift, etc.).
  • Integrate data from multiple heterogeneous data sources into a data warehouse or data lake.
  • Optimize existing data pipelines for performance, reliability, and cost-effectiveness.

Cloud Infrastructure:

  • Manage and configure AWS services such as EC2, RDS, S3, Glue, Athena, Lambda, Redshift, and EMR.
  • Automate infrastructure provisioning using tools like CloudFormation or Terraform.
  • Ensure data security and compliance with AWS best practices (IAM roles, encryption, VPC).

Data Warehousing and Storage:

  • Design and implement scalable data warehousing solutions using Amazon Redshift, Snowflake, or other technologies.
  • Manage data storage in Amazon S3, ensuring efficient and cost-effective storage architectures (partitioning, compression).
  • Implement data versioning and backup strategies.

Data Modeling and Optimization:

  • Perform data modeling and schema design to support data warehouses and reporting systems.
  • Optimize SQL queries and database performance.
  • Implement data governance and quality control procedures (e.g., monitoring, alerting).

Collaboration:

  • Work closely with data scientists, analysts, and stakeholders to understand data needs.
  • Collaborate with DevOps and engineering teams to ensure the smooth operation of data infrastructure.

Monitoring & Reporting:

  • Set up monitoring for ETL pipelines and cloud infrastructure (CloudWatch, X-Ray, etc.).
  • Provide regular reports on data pipeline performance and optimize for continuous improvement.

Required Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience in data engineering roles, with significant exposure to AWS services.
  • Strong proficiency in AWS services such as Glue, Redshift, S3, Lambda, and RDS.
  • Experience with big data tools such as Spark, Hadoop, or EMR.
  • Hands-on experience with ETL tools and techniques.
  • Proficiency in SQL and experience in data modeling and database performance tuning.
  • Knowledge of scripting languages such as Python or Scala.
  • Experience with CI/CD pipelines and infrastructure as code tools like Terraform or CloudFormation.
  • Familiarity with data formats such as Parquet, Avro, and JSON.
  • Experience in data warehousing solutions (Redshift, Snowflake, etc.).

Preferred Qualifications:

  • AWS certifications like AWS Certified Data Analytics - Specialty or AWS Certified Solutions Architect.
  • Knowledge of NoSQL databases like DynamoDB or MongoDB.
  • Experience with DevOps and container orchestration tools (e.g., Docker, Kubernetes).
  • Familiarity with machine learning or data science tools on AWS (e.g., SageMaker).
  • Experience in real-time data processing (e.g., using Kinesis or Kafka).

Soft Skills:

  • Strong problem-solving skills and ability to work in a fast-paced environment.
  • Excellent communication and teamwork skills.
  • Ability to multitask and manage multiple priorities effectively.

  • AWS Data Engineer

    4 weeks ago

    Bangalore/Noida, India Firstcareercentre Full time

    Data Engineering Role at FirstcareercentreWe are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, integrating various data sources, and implementing cloud solutions. The Data Engineer will work closely with data scientists, analysts, and...

  • AWS Data Engineer

    1 month ago

    Noida, Uttar Pradesh, India MNR Solutions Full time

    Job Title: AWS Data EngineerAbout the Role:We are seeking an experienced AWS Data Engineer to support our data engineering initiatives at MNR Solutions. The ideal candidate will have extensive knowledge of AWS data services and a strong background in data engineering.Key Responsibilities:Design and develop data pipelines using AWS services to efficiently...

  • AWS Data Engineer

    1 month ago

    Bangalore/Noida, IN Firstcareercentre Full time

    Job Summary :We are seeking a highly skilled and experienced AWS Data Engineer to join our data team. The AWS Data Engineer will be responsible for designing, developing, and optimizing data pipelines, integrating various data sources, and implementing AWS cloud solutions. The ideal candidate should have a strong background in data engineering, cloud...

  • AWS Data Engineer

    1 month ago

    Bangalore, India JoulestoWatts Business Solutions Pvt Ltd Full time

    Job Title: AWS Data EngineerWe are seeking a highly skilled AWS Data Engineer to join our team at JoulestoWatts Business Solutions Pvt Ltd. The ideal candidate will have a strong focus on AWS technologies and experience in designing, developing, and maintaining data pipelines and ETL processes.Key Responsibilities:Design and develop data pipelines and ETL...

  • Data Engineer

    1 month ago

    Chennai/Bangalore/Pune/Hyderabad/Noida, IN MNR Solutions Full time

    Job Description :We are looking for an experienced AWS Data Engineer to join our team. The ideal candidate will have extensive knowledge of AWS data services and a strong background in data engineering. This role involves designing, implementing, and maintaining data pipelines and architectures to support business intelligence and analytics initiatives.Key...

  • AWS Data Engineer

    21 hours ago

    Bangalore, India Tata Consultancy Services Full time

    Experience: 4+ Years Location: bangalore/hyderabad Role: AWS Data Engineer Job Description: Good hands on experience in Python programming and Pyspark and snowflake · Data Engineering experience using AWS core services (Lambda, Glue, EMR and RedShift) · Required skill set- SQL, Airflow · Have Experience with snowflake or Hive or AWS S3 ·...

  • Data engineer aws

    4 weeks ago

    Bangalore, India Eximietas Design Full time

    We are seeking a skilled AWS Data Engineer with over 3+ years of experience in data engineering and development expertise in Java and Python. The ideal candidate will have hands-on experience in designing, building, and maintaining data pipelines, as well as working with a wide range of data technologies, including Kafka, S3, CDC (Change Data Capture),...

  • AWS Data Engineer

    2 weeks ago

    bangalore, India Tata Consultancy Services Full time

    AWS Data Engineer: Required Technical Skill Set: AWS Redshift, Glue, PySpark Location of Requirement: Chennai/Mumbai/Bangalore/Pune/Indore/Hyderabad Desired Experience Range: 4-10 Years Must-Have: - Strong hands-on experience in Python programming and PySpark - Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda) - Experience working with...

  • Aws data engineer

    3 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    AWS Data Engineer: Required Technical Skill Set: AWS Redshift, Glue, Py Spark Location of Requirement: Chennai/Mumbai/Bangalore/Pune/Indore/Hyderabad Desired Experience Range: 4-10 Years Must-Have: Strong hands-on experience in Python programming and Py Spark Experience using AWS services (Red Shift, Glue, EMR, S3 & Lambda) Experience...

  • AWS Data Engineer

    2 weeks ago

    bangalore, India Tata Consultancy Services Full time

    AWS Data Engineer: Required Technical Skill Set: AWS Redshift, Glue, PySpark Location of Requirement: Chennai/Mumbai/Bangalore/Pune/Indore/Hyderabad Desired Experience Range: 4-10 Years Must-Have: Strong hands-on experience in Python programming and PySpark Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda) Experience working with Apache...

  • Data Engineer AWS

    2 months ago

    bangalore, India Eximietas Design Full time

    We are seeking a skilled AWS Data Engineer with over 3+ years of experience in data engineering and development expertise in Java and Python. The ideal candidate will have hands-on experience in designing, building, and maintaining data pipelines, as well as working with a wide range of data technologies, including Kafka, S3, CDC (Change Data Capture),...

  • AWS Data Engineer

    1 month ago

    Noida, India Firstcareercentre Full time

    Job Summary :We are seeking a highly skilled and experienced AWS Data Engineer to join our data team. The AWS Data Engineer will be responsible for designing, developing, and optimizing data pipelines, integrating various data sources, and implementing AWS cloud solutions. The ideal candidate should have a strong background in data engineering, cloud...

  • AWS Data Engineer

    3 weeks ago

    bangalore, India Tata Consultancy Services Full time

    AWS Data Engineer:Required Technical Skill Set: AWS Redshift, Glue, PySparkLocation of Requirement: Chennai/Mumbai/Bangalore/Pune/Indore/HyderabadDesired Experience Range: 4-10 YearsMust-Have:Strong hands-on experience in Python programming and PySparkExperience using AWS services (RedShift, Glue, EMR, S3 & Lambda)Experience working with Apache Spark and...

  • AWS Data Engineer

    3 weeks ago

    bangalore, India Tata Consultancy Services Full time

    AWS Data Engineer:Required Technical Skill Set: AWS Redshift, Glue, PySparkLocation of Requirement: Chennai/Mumbai/Bangalore/Pune/Indore/HyderabadDesired Experience Range: 4-10 YearsMust-Have:- Strong hands-on experience in Python programming and PySpark- Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda)- Experience working with Apache Spark...

  • AWS Data Engineer

    20 hours ago

    Bangalore, India Tata Consultancy Services Full time

    We are looking for AWS Data Engineer AWS Data Engineer Experience Range- 5 to 10years. Work Location - Kolkata/Bangalore/Pune/Bhubaneswar /Delhi Mode of Interview: Online Interview Interview Date: 27th Nov 24 (Wednesday) Interview Time: 10 am to 5pm Mandatory Skills: AWS Data engineering, Python, Concepts and implementation...

  • AWS Data Engineer Position

    4 weeks ago

    Bangalore, India JoulestoWatts Business Solutions Pvt Ltd Full time

    JoulestoWatts Business Solutions Pvt Ltd is seeking a AWS Data Engineer to join our team.Job DescriptionWe are looking for a highly skilled AWS Data Engineer to design, develop, and maintain data pipelines and ETL processes on the AWS platform.Key ResponsibilitiesDesign and develop data pipelines and ETL processes on the AWS platform.Extract, transform, and...

  • Aws data engineer

    4 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    Dear Candidate, Greetings from TCS Human Resources Team!! Job Role: AWS Data Engineer Job Locations: PAN India Experience Range: 6 to 10 years Job Description:-· Strong hands-on experience in Python programming and Py Spark · Experience using AWS services (Red Shift, Glue, EMR, S3 & Lambda)· Experience working with Apache Spark and Hadoop ecosystem....

  • Aws data engineer

    3 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    Bhuwalka Campus Role: AWS Data engineer Date: 9-Nov-2024 Exp: 4-8 Years

  • Data Engineer Aws

    2 months ago

    Bangalore City, India Eximietas Design Full time

    We are seeking a skilled AWS Data Engineer with over 3+ years of experience in data engineering and development expertise in Java and Python. The ideal candidate will have hands-on experience in designing, building, and maintaining data pipelines, as well as working with a wide range of data technologies, including Kafka, S3, CDC (Change Data Capture),...

  • aws data engineer

    2 weeks ago

    bangalore, India Genpact Full time

    hi everyone, we are hiring for Aws data engineer Bangalore location 4-8 years of exp immediate joiner