Aws Data Engineer

2 weeks ago

Bengaluru Gurugram Noida, India EXL Full time ₹ 15,00,000 - ₹ 20,00,000 per year

System Design & architecture understanding, PySpark, Python, SQL, Git, Github, AWS Services Glue, Lambda, Step Functions, S3, Athena.

Job Description:

We are seeking a talented and skilled Senior AWS Data Engineer with expertise in PySpark, Python, SQL, Git, and AWS Services, to join our dynamic team. The ideal candidate will have a strong background in data engineering, data processing, and cloud technologies. Candidate will play a crucial role in designing, developing, and maintaining our data infrastructure to support our analytics.

Responsibilities:

  1. Develop and maintain ETL pipelines using PySpark and AWS Glue to process and transform large volumes of data efficiently.
  2. Collaborate with analysts to understand data requirements and ensure data availability and quality. Candidate should have good understanding of project architecture to make necessary changes as required.
  3. Ability to write highly optimize SQL queries for data extraction, transformation, and loading.
  4. Utilize Git for version control, ensuring proper documentation and tracking of code changes.

  5. Design, implement, and manage scalable data lakes on AWS, including S3, or other relevant services for efficient data storage and retrieval.

  6. Develop and optimize high-performance, scalable databases using Amazon DynamoDB.

  7. Proficiency in Amazon QuickSight for creating interactive dashboards and data visualizations.

  8. Automate workflows using AWS Cloud services like event bridge, step functions.

  9. Monitor and optimize data processing workflows for performance and scalability.
  10. Troubleshoot data-related issues and provide timely resolution.
  11. Stay up-to-date with industry best practices and emerging technologies in data engineering.

Qualifications:

1. Bachelor's degree in Computer Science, Data Science, or a related field. Master's degree is a plus.

2. Strong proficiency in PySpark and Python for data processing and analysis.

3. Proficiency in SQL for data manipulation and querying.

4. Experience with version control systems, preferably Git.

5. Expertise with AWS services, including S3, Redshift, Glue, Step Functions, Event Bridge, CloudWatch, Lambda, Quicksight, DynamoDB, Athena, CodeCommit etc.

  1. Familiarity with Databricks and it's concepts.
  2. Excellent problem-solving skills and attention to detail.
  3. Strong communication and collaboration skills to work effectively within a team.
  4. Ability to manage multiple tasks and prioritize effectively in a fast-paced environment.

Preferred Skills:

1. Knowledge of data warehousing concepts and data modeling.

2. Familiarity with big data technologies like Hadoop and Spark.

3. AWS certifications related to data engineering.

  • AWS Data Engineer

    3 days ago

    Noida, India Coforge Full time

    Role - AWS Data Engineer Skills - AWS & PySpark Job Locations - Pune, Greater Noida & Hyderabad Experience - 6+ years We at Coforge are hiring AWS Data Engineers with the following skill-set: - Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar. - Build and optimize data architectures (data lakes,...

  • AWS Data Engineer

    4 days ago

    Noida, India Coforge Full time

    Role - AWS Data EngineerSkills - AWS & PySparkJob Locations - Pune, Greater Noida & HyderabadExperience - 6+ yearsWe at Coforge are hiring AWS Data Engineers with the following skill-set:Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar.Build and optimize data architectures (data lakes, data...

  • AWS Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferredSkills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shiftGood communication skills and can deliver independently*Mandatory Competencies*Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS...

  • AWS Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Coforge Full time

    Role - AWS Data EngineerSkills - AWS & PySparkJob Locations - Pune, Greater Noida & HyderabadExperience - 6+ yearsWe at Coforge are hiring AWS Data Engineers with the following skill-set:- Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar.- Build and optimize data architectures (data lakes, data...

  • AWS Data Engineer

    12 minutes ago

    Noida, India Coforge Full time

    Role - AWS Data EngineerSkills - AWS & PySparkJob Locations - Pune, Greater Noida & HyderabadExperience - 6+ yearsWe at Coforge are hiring AWS Data Engineers with the following skill-set:- Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar.- Build and optimize data architectures (data lakes, data...

  • AWS Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Coforge Full time

    Role - AWS Data Engineer Skills - AWS & PySpark Job Locations - Pune, Greater Noida & Hyderabad Experience - 6+ years We at Coforge are hiring AWS Data Engineers with the following skill-set: Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar. Build and optimize data architectures (data lakes, data...

  • AWS Data Engineer

    4 days ago

    Noida, India Coforge Full time

    Role - AWS Data Engineer Skills - AWS & PySpark Job Locations - Pune, Greater Noida & Hyderabad Experience - 6+ years We at Coforge are hiring AWS Data Engineers with the following skill-set: Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar. Build and optimize data architectures...

  • AWS Data Engineer

    3 days ago

    Noida, India Coforge Full time

    Role - AWS Data EngineerSkills - AWS & PySparkJob Locations - Pune, Greater Noida & HyderabadExperience - 6+ years We at Coforge are hiring AWS Data Engineers with the following skill-set:Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar.Build and optimize data architectures (data lakes, data...

  • AWS Data Engineer

    4 days ago

    Noida, India Coforge Full time

    Role - AWS Data EngineerSkills - AWS & PySparkJob Locations - Pune, Greater Noida & HyderabadExperience - 6+ years We at Coforge are hiring AWS Data Engineers with the following skill-set:Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar.Build and optimize data architectures (data lakes, data...

  • AWS Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Why Join Us?Are you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industry?Do you want to do the best work of your life at one of thefastest growing IT services companies? Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations? It'shappening right hereat Iris Software.About Iris...