AWS Data Engineer

7 days ago

BangaloreNoida, India Firstcareercentre Full time

Job Summary :

We are seeking a highly skilled and experienced AWS Data Engineer to join our data team. The AWS Data Engineer will be responsible for designing, developing, and optimizing data pipelines, integrating various data sources, and implementing AWS cloud solutions. The ideal candidate should have a strong background in data engineering, cloud platforms (specifically AWS), and big data technologies.

Key Responsibilities :

Data Pipeline Development :

- Design, build, and maintain scalable ETL pipelines using AWS services (e.g., Glue, Lambda, S3, Redshift, etc.).

- Integrate data from multiple heterogeneous data sources into a data warehouse or data lake.

- Optimize existing data pipelines for performance, reliability, and cost-effectiveness.

Cloud Infrastructure :

- Manage and configure AWS services such as EC2, RDS, S3, Glue, Athena, Lambda, Redshift, and EMR.

- Automate infrastructure provisioning using tools like CloudFormation or Terraform.

- Ensure data security and compliance with AWS best practices (IAM roles, encryption, VPC).

Data Warehousing and Storage :

- Design and implement scalable data warehousing solutions using Amazon Redshift, Snowflake, or other technologies.

- Manage data storage in Amazon S3, ensuring efficient and cost-effective storage architectures (partitioning, compression).

- Implement data versioning and backup strategies.

Data Modeling and Optimization :

- Perform data modeling and schema design to support data warehouses and reporting systems.

- Optimize SQL queries and database performance.

- Implement data governance and quality control procedures (e.g., monitoring, alerting).

Collaboration :

- Work closely with data scientists, analysts, and stakeholders to understand data needs.

- Collaborate with DevOps and engineering teams to ensure the smooth operation of data infrastructure.

Monitoring & Reporting :

- Set up monitoring for ETL pipelines and cloud infrastructure (CloudWatch, X-Ray, etc.).

- Provide regular reports on data pipeline performance and optimize for continuous improvement.

Required Qualifications :

- Bachelor's degree in Computer Science, Engineering, or a related field.

- 3+ years of experience in data engineering roles, with significant exposure to AWS services.

- Strong proficiency in AWS services such as Glue, Redshift, S3, Lambda, and RDS.

- Experience with big data tools such as Spark, Hadoop, or EMR.

- Hands-on experience with ETL tools and techniques.

- Proficiency in SQL and experience in data modeling and database performance tuning.

- Knowledge of scripting languages such as Python or Scala.

- Experience with CI/CD pipelines and infrastructure as code tools like Terraform or CloudFormation.

- Familiarity with data formats such as Parquet, Avro, and JSON.

- Experience in data warehousing solutions (Redshift, Snowflake, etc.).

Preferred Qualifications :

- AWS certifications like AWS Certified Data Analytics - Specialty or AWS Certified Solutions Architect.

- Knowledge of NoSQL databases like DynamoDB or MongoDB.

- Experience with DevOps and container orchestration tools (e.g., Docker, Kubernetes).

- Familiarity with machine learning or data science tools on AWS (e.g., SageMaker).

- Experience in real-time data processing (e.g., using Kinesis or Kafka).

Soft Skills :

- Strong problem-solving skills and ability to work in a fast-paced environment.

- Excellent communication and teamwork skills.

- Ability to multitask and manage multiple priorities effectively.

(ref:hirist.tech)

  • Aws data engineer

    2 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    Experience: 4+ Years Location: bangalore/hyderabad Role: AWS Data Engineer Job Description: Good hands on experience in Python programming and Pyspark and snowflake · Data Engineering experience using AWS core services (Lambda, Glue, EMR and Red Shift) · Required skill set- SQL, Airflow · Have Experience with snowflake or Hive or AWS S3 ·...

  • AWS Data Engineer

    2 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    Experience: 4+ Years Location: bangalore/hyderabad Role: AWS Data Engineer Job Description: Good hands on experience in Python programming and Pyspark and snowflake · Data Engineering experience using AWS core services (Lambda, Glue, EMR and RedShift) · Required skill set- SQL, Airflow · Have Experience with snowflake or Hive or AWS S3 ·...

  • Aws data engineer

    4 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    AWS Data Engineer: Required Technical Skill Set: AWS Redshift, Glue, Py Spark Location of Requirement: Chennai/Mumbai/Bangalore/Pune/Indore/Hyderabad Desired Experience Range: 4-10 Years Must-Have: Strong hands-on experience in Python programming and Py Spark Experience using AWS services (Red Shift, Glue, EMR, S3 & Lambda) Experience...

  • AWS Data Engineer

    4 weeks ago

    bangalore, India Tata Consultancy Services Full time

    AWS Data Engineer: Required Technical Skill Set: AWS Redshift, Glue, PySpark Location of Requirement: Chennai/Mumbai/Bangalore/Pune/Indore/Hyderabad Desired Experience Range: 4-10 Years Must-Have: - Strong hands-on experience in Python programming and PySpark - Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda) - Experience working with...

  • AWS Data Engineer

    4 weeks ago

    bangalore, India Tata Consultancy Services Full time

    AWS Data Engineer: Required Technical Skill Set: AWS Redshift, Glue, PySpark Location of Requirement: Chennai/Mumbai/Bangalore/Pune/Indore/Hyderabad Desired Experience Range: 4-10 Years Must-Have: Strong hands-on experience in Python programming and PySpark Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda) Experience working with Apache...

  • AWS Data Engineer

    4 weeks ago

    bangalore, India Tata Consultancy Services Full time

    AWS Data Engineer:Required Technical Skill Set: AWS Redshift, Glue, PySparkLocation of Requirement: Chennai/Mumbai/Bangalore/Pune/Indore/HyderabadDesired Experience Range: 4-10 YearsMust-Have:- Strong hands-on experience in Python programming and PySpark- Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda)- Experience working with Apache Spark...

  • AWS Data Engineer

    1 month ago

    bangalore, India Tata Consultancy Services Full time

    AWS Data Engineer:Required Technical Skill Set: AWS Redshift, Glue, PySparkLocation of Requirement: Chennai/Mumbai/Bangalore/Pune/Indore/HyderabadDesired Experience Range: 4-10 YearsMust-Have:Strong hands-on experience in Python programming and PySparkExperience using AWS services (RedShift, Glue, EMR, S3 & Lambda)Experience working with Apache Spark and...

  • AWS Data Engineer

    2 months ago

    Noida, India Firstcareercentre Full time

    Job Summary :We are seeking a highly skilled and experienced AWS Data Engineer to join our data team. The AWS Data Engineer will be responsible for designing, developing, and optimizing data pipelines, integrating various data sources, and implementing AWS cloud solutions. The ideal candidate should have a strong background in data engineering, cloud...

  • AWS Data Engineer

    2 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    We are looking for AWS Data Engineer AWS Data Engineer Experience Range- 5 to 10years. Work Location - Kolkata/Bangalore/Pune/Bhubaneswar /Delhi Mode of Interview: Online Interview Interview Date: 27th Nov 24 (Wednesday) Interview Time: 10 am to 5pm Mandatory Skills: AWS Data engineering, Python, Concepts and implementation...

  • Aws data engineer

    4 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    Bhuwalka Campus Role: AWS Data engineer Date: 9-Nov-2024 Exp: 4-8 Years

  • aws data engineer

    4 weeks ago

    bangalore, India Genpact Full time

    hi everyone, we are hiring for Aws data engineer Bangalore location 4-8 years of exp immediate joiner

  • aws data engineer

    3 weeks ago

    bangalore, India Genpact Full time

    hi everyone,we are hiring for Aws data engineerBangalore location4-8 years of expimmediate joiner

  • AWS Data Engineer

    1 month ago

    bangalore, India Tata Consultancy Services Full time

    WALKIN @Bengaluru Bhuwalka CampusRole: AWS Data engineerDate: 9-Nov-2024Exp: 4-8 Years

  • AWS Data Engineer

    1 month ago

    bangalore, India Tata Consultancy Services Full time

    WALKIN @Bengaluru Bhuwalka Campus Role: AWS Data engineer Date: 9-Nov-2024 Exp: 4-8 Years

  • aws data engineer

    4 weeks ago

    Bangalore, India Genpact Full time

    hi everyone, we are hiring for Aws data engineer Bangalore location 4-8 years of exp immediate joiner

  • Data Engineer

    1 month ago

    Bangalore, India SS Consultancy Services Full time

    Job Responsibilities :- Be part of the data team to design and build a BI and analytics solution- Implement batch and near real time data movement design patterns and define best practices in data engineering.- Design and develop optimal cloud data solutions (lakes, warehouses, marts, analytics) by collaborating with diverse IT teams including business...

  • Data Engineer

    1 week ago

    Bangalore, India BizViz Technologies Pvt Ltd Full time

    Position Overview : We are seeking a Data Engineer with a strong background in AWS and 2-5 years of relevant experience. The ideal candidate will possess excellent communication and interpersonal skills, as these are crucial for our collaborative and dynamic work environment.Location : HSR Layout - Bangalore, KAExperience : 2-5 yearsKey Responsibilities :...

  • Senior Data Engineer

    1 week ago

    Bangalore, India Kloud9 Full time

    Job Description : As a Senior Data Engineer, you will partner with Software Engineers, Data Scientists and Business Intelligence Engineers. You will gain a deep understanding of our services and the data they produce and become our resident expert in how to transform that data into a format that is useful for analytics and business intelligence. You will...

  • AWS Cloud Data Engineer

    1 month ago

    Remote/Bangalore, India Creative Technostructure Full time

    Data Engineer - AWS Cloud ExpertAt Creative Technostructure, we are seeking an experienced Data Engineer to join our team as a AWS Cloud Expert. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines and data warehouses using AWS services such as Glue, Lambda, Redshift, S3,...

  • Tableau Admin with Aws Experience

    6 months ago

    Noida, India NTT DATA Full time

    **Req ID**: 264906 We are currently seeking a Tableau Admin with AWS Experience to join our team in NOIDA, Uttar Pradesh (IN-UP), India (IN). Tableau Admin with AWS Experience: **Key Responsibilities**: - Manage, configure, and administer Tableau Server on AWS, including setting up sites and managing user access and permissions. - Monitor server...