Pyspark AWS Data Engineer
3 days ago
Hands On programming experience
Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.
Experience of performance optimization in Batch and Real time processing applications
Expertise in Data Governance and Data Security Implementation
Worked on Scheduling tools like Airflow
Good hands-on design and programming skills building reusable tools and products
Experience developing in AWS or similar cloud platforms. Preferred:, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
Good knowledge of Python. Good to have Java/Scala.
Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).
Experience in efficient data processing using open table format Delta, Iceberg.
Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
Expertise in practices like Agile, Peer reviews, Continuous Integration
Primary Location Pune, Maharashtra, India Job Type Experienced Primary Skills Amazon Redshift, Kafka Years of Experience 8 Qualification
6-8 years of relevant work experience showing growth as a Data Engineer.
Hands On programming experience
Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.
Experience of performance optimization in Batch and Real time processing applications
Expertise in Data Governance and Data Security Implementation
Worked on Scheduling tools like Airflow
Good hands-on design and programming skills building reusable tools and products
Experience developing in AWS or similar cloud platforms. Preferred:, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
Good knowledge of Python. Good to have Java/Scala.
Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).
Experience in efficient data processing using open table format Delta, Iceberg.
Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
Expertise in practices like Agile, Peer reviews, Continuous Integration
-
Pyspark AWS Data Engineer
2 days ago
pune, India Virtusa Full timePyspark AWS Data Engineer - CREQ187065 Description 6-8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...
-
Data Engineer PySpark AWS
2 weeks ago
Pune, Maharashtra, India Fusemachines Full timeAbout Fusemachines Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 450 full-time employees)....
-
AWS Data Engineer
3 weeks ago
Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full timeJob Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...
-
AWS Data Engineer
2 months ago
Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full timeJob Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...
-
Big Data Engineer
2 weeks ago
Pune, India Techno Wise Full timeJob Role : Big Data EngineerRelevant Experience : 3+ yearsLocation : Navi Mumbai /Bengaluru/PuneNotice Period : Immediate or serving Notice PeriodPrimary Skills : Big Data, PySpark, Cloud- Azure or AWS, Databricks, SQL, PythonOverview : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a...
-
Pyspark AWS Developer
3 weeks ago
pune, India Virtusa Full timePyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...
-
Pyspark AWS Developer
2 months ago
Pune, India Virtusa Full timePyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer. Hands On programming experience Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. Experience of performance optimization in Batch and Real time processing applications Expertise in Data Governance and Data...
-
Pyspark AWS Developer
2 months ago
pune, India Virtusa Full timePyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...
-
Pyspark, AWS Architect
2 weeks ago
Pune, Maharashtra, India Virtusa Full timePyspark, AWS Architect (ATC) CREQ184787 Description 10+ years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...
-
Pyspark AWS Developer
4 weeks ago
Pune, India Virtusa Full timePyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer. Hands On programming experience Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. Experience of performance optimization in Batch and Real time processing applications Expertise in Data Governance and Data...
-
Pyspark AWS Developer
2 weeks ago
Pune, Maharashtra, India Virtusa Full timePyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...
-
AWS Data Engineer
2 weeks ago
Pune, Maharashtra, India Techno Wise Full timeWe are looking for aAWS Data Engineerwho will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources.Key ResponsibilitiesPerform technical assessment...
-
Lead Data Engineer- AWS
3 months ago
pune, India YASH Technologies Full timeWe are looking for Data Professionals with 7 years of minimum experience who can Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency.Build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services...
-
AWS Data Engineer
4 weeks ago
pune, India EXL Full timeRole: AWS Data EngineerExperience: 4 to 6 YearsLocation: Gurgaon, Bangalore – HybridJob Summary:We are seeking a highly motivated and experienced AWS Engineer. This position requires an individual with AWS cloud experience and ambition to continually keep up with best practices when it comes to cloud development. The successful candidate must be able to...
-
AWS Data Engineer
3 weeks ago
pune, India EXL Full timeRole: AWS Data EngineerExperience: 4 to 6 YearsLocation: Gurgaon, Bangalore – HybridJob Summary:We are seeking a highly motivated and experienced AWS Engineer. This position requires an individual with AWS cloud experience and ambition to continually keep up with best practices when it comes to cloud development. The successful candidate must be able to...
-
Lead Data Engineer- AWS
3 months ago
Pune, India YASH Technologies Full timeWe are looking for Data Professionals with 7 years of minimum experience who can Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency. Build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services...
-
Lead Data Engineer- AWS
3 months ago
Pune, India YASH Technologies Full timeWe are looking for Data Professionals with 7 years of minimum experience who can Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency. Build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services...
-
Lead Data Engineer- AWS
3 months ago
Pune, India YASH Technologies Full timeWe are looking for Data Professionals with 7 years of minimum experience who can Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency. Build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services...
-
AWS Data Engineer
2 weeks ago
Pune, Maharashtra, India Techno Wise Full timeWe are looking for a AWS Data Engineer who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. Key Responsibilities Perform technical...
-
AWS Data engineer
2 weeks ago
Pune, Maharashtra, India Virtusa Full timeAWS Data engineer - CREQ188721 Description Having 5-7 years of IT experience overall and 3-5 years of experience in AWS and Snowflake Proficient in AWS technologies like Glue, Athena, S3, Pyspark & etc. Must be good at SQL and worked in Snowflake database. Understand the concepts of Data Lake, Data Warehouse, SCD Types & etc. Nice to have experience with...