Pyspark AWS Data Engineer

3 days ago


Pune, India Virtusa Full time
Pyspark AWS Data Engineer - CREQ187065 Description 6-8 years of relevant work experience showing growth as a Data Engineer.
Hands On programming experience
Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.
Experience of performance optimization in Batch and Real time processing applications
Expertise in Data Governance and Data Security Implementation
Worked on Scheduling tools like Airflow
Good hands-on design and programming skills building reusable tools and products
Experience developing in AWS or similar cloud platforms. Preferred:, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
Good knowledge of Python. Good to have Java/Scala.
Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).
Experience in efficient data processing using open table format Delta, Iceberg.
Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
Expertise in practices like Agile, Peer reviews, Continuous Integration
Primary Location Pune, Maharashtra, India Job Type Experienced Primary Skills Amazon Redshift, Kafka Years of Experience 8 Qualification

6-8 years of relevant work experience showing growth as a Data Engineer.
Hands On programming experience
Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.
Experience of performance optimization in Batch and Real time processing applications
Expertise in Data Governance and Data Security Implementation
Worked on Scheduling tools like Airflow
Good hands-on design and programming skills building reusable tools and products
Experience developing in AWS or similar cloud platforms. Preferred:, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
Good knowledge of Python. Good to have Java/Scala.
Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).
Experience in efficient data processing using open table format Delta, Iceberg.
Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
Expertise in practices like Agile, Peer reviews, Continuous Integration

Travel No

  • pune, India Virtusa Full time

    Pyspark AWS Data Engineer - CREQ187065 Description 6-8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...


  • Pune, Maharashtra, India Fusemachines Full time

    About Fusemachines Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 450 full-time employees)....

  • AWS Data Engineer

    3 weeks ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • AWS Data Engineer

    2 months ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • Big Data Engineer

    2 weeks ago


    Pune, India Techno Wise Full time

    Job Role : Big Data EngineerRelevant Experience : 3+ yearsLocation : Navi Mumbai /Bengaluru/PuneNotice Period : Immediate or serving Notice PeriodPrimary Skills : Big Data, PySpark, Cloud- Azure or AWS, Databricks, SQL, PythonOverview : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a...

  • Pyspark AWS Developer

    3 weeks ago


    pune, India Virtusa Full time

    Pyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...

  • Pyspark AWS Developer

    2 months ago


    Pune, India Virtusa Full time

    Pyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer. Hands On programming experience Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. Experience of performance optimization in Batch and Real time processing applications Expertise in Data Governance and Data...

  • Pyspark AWS Developer

    2 months ago


    pune, India Virtusa Full time

    Pyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...


  • Pune, Maharashtra, India Virtusa Full time

    Pyspark, AWS Architect (ATC) CREQ184787 Description 10+ years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...

  • Pyspark AWS Developer

    4 weeks ago


    Pune, India Virtusa Full time

    Pyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer. Hands On programming experience Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. Experience of performance optimization in Batch and Real time processing applications Expertise in Data Governance and Data...

  • Pyspark AWS Developer

    2 weeks ago


    Pune, Maharashtra, India Virtusa Full time

    Pyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...

  • AWS Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Techno Wise Full time

    We are looking for aAWS Data Engineerwho will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources.Key ResponsibilitiesPerform technical assessment...


  • pune, India YASH Technologies Full time

    We are looking for Data Professionals with 7 years of minimum experience who can Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency.Build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services...

  • AWS Data Engineer

    4 weeks ago


    pune, India EXL Full time

    Role: AWS Data EngineerExperience: 4 to 6 YearsLocation: Gurgaon, Bangalore – HybridJob Summary:We are seeking a highly motivated and experienced AWS Engineer. This position requires an individual with AWS cloud experience and ambition to continually keep up with best practices when it comes to cloud development. The successful candidate must be able to...

  • AWS Data Engineer

    3 weeks ago


    pune, India EXL Full time

    Role: AWS Data EngineerExperience: 4 to 6 YearsLocation: Gurgaon, Bangalore – HybridJob Summary:We are seeking a highly motivated and experienced AWS Engineer. This position requires an individual with AWS cloud experience and ambition to continually keep up with best practices when it comes to cloud development. The successful candidate must be able to...


  • Pune, India YASH Technologies Full time

    We are looking for Data Professionals with 7 years of minimum experience who can Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency. Build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services...


  • Pune, India YASH Technologies Full time

    We are looking for Data Professionals with 7 years of minimum experience who can Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency. Build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services...


  • Pune, India YASH Technologies Full time

    We are looking for Data Professionals with 7 years of minimum experience who can Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency. Build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services...

  • AWS Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Techno Wise Full time

    We are looking for a AWS Data Engineer who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. Key Responsibilities Perform technical...

  • AWS Data engineer

    2 weeks ago


    Pune, Maharashtra, India Virtusa Full time

    AWS Data engineer - CREQ188721 Description Having 5-7 years of IT experience overall and 3-5 years of experience in AWS and Snowflake Proficient in AWS technologies like Glue, Athena, S3, Pyspark & etc. Must be good at SQL and worked in Snowflake database. Understand the concepts of Data Lake, Data Warehouse, SCD Types & etc. Nice to have experience with...