Pyspark AWS Developer
2 weeks ago
Hands On programming experience
Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.
Experience of performance optimization in Batch and Real time processing applications
Expertise in Data Governance and Data Security Implementation.
Good hands-on design and programming skills building reusable tools and products
Experience developing in AWS or similar cloud platforms
Preferred:
, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).
Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
Expertise in practices like Agile, Peer reviews, Continuous Integration.
Primary Location Pune, Maharashtra, India Job Type Experienced Primary Skills Java, HTML 5, DynamoDB, Python, AWS Glue, Spark, Amazon Redshift, Kafka Years of Experience 10 Qualification
8-10years of relevant work experience showing growth as a Data Engineer.
Hands On programming experience
Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.
Experience of performance optimization in Batch and Real time processing applications
Expertise in Data Governance and Data Security Implementation.
Good hands-on design and programming skills building reusable tools and products
Experience developing in AWS or similar cloud platforms
Preferred:
, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).
Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
Expertise in practices like Agile, Peer reviews, Continuous Integration.
Travel No
-
Pyspark AWS Architect ATC
3 weeks ago
Pune, Maharashtra, India virtusa consulting services pvt. ltd. Full timeApply for Pyspark, AWS Architect ATC, Career Progress Consultants in Pune for Year of Experience on
-
Pyspark, AWS Architect
2 weeks ago
Pune, Maharashtra, India Virtusa Full timePyspark, AWS Architect (ATC) CREQ184787 Description 10+ years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...
-
Data Engineer PySpark AWS
1 week ago
Pune, Maharashtra, India Fusemachines Full timeAbout Fusemachines Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 450 full-time employees)....
-
Python PySpark Developer
2 weeks ago
Pune, Maharashtra, India Synechron Full timePython PySpark Developer Exp : 5 - 8 yrs Loc: Pune Notice: 0 -15 days About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization...
-
Aws+ Talend Developer
2 weeks ago
Pune, Maharashtra, India Nityo Infotech Full timeClarity call for AWS DEV Profile Mandate: •Experience range - 2 to 6 Years.•Production support experience.•AWS: Knowledge of scheduling spark applications in AWS EMR cluster.Design, build and operationalize large-scale enterprise data solutions and applications using one or more AWS data and analytics services in combination with 3rd parties - Spark,...
-
Python PySpark Developer
1 week ago
Pune, Maharashtra, India Synechron Full timePython PySpark Developer Exp : 5 - 8 yrs Loc: Pune Notice: 0 -15 days About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization...
-
Python PySpark Developer
2 weeks ago
Pune, Maharashtra, India Synechron Full timePython PySpark DeveloperExp : 5 - 8 yrsLoc: PuneNotice: 0 -15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span...
-
Data Engineer
4 weeks ago
Pune, Maharashtra, India Overture Rede Private Limited. Full timeDescription:- 3 to 6 years years experience in Big Data tech stack- Strong development background- Java or scala 3-6 years- Spark 1-4 years. Certifications are a plus- Azure - 1-3 years. Certifications are a plus- Databricks 1-2 years. Certifications are a plus- Strong SQL background- UI Development experience is plusJob Requirements: - Participate in the...
-
Data Engineer
4 weeks ago
Pune, Maharashtra, India Overture Rede Private Limited. Full timeDescription:- 3 to 6 years years experience in Big Data tech stack- Strong development background- Java or scala 3-6 years- Spark 1-4 years. Certifications are a plus- Azure - 1-3 years. Certifications are a plus- Databricks 1-2 years. Certifications are a plus- Strong SQL background- UI Development experience is plusJob Requirements: - Participate in the...
-
Python PySpark Developer
2 weeks ago
Pune, Maharashtra, India Synechron Full timePython PySpark DeveloperExp : - 8 yrsLoc: PuneNotice: 0 -15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span...
-
Senior ETL Developer with AWS
1 week ago
Pune, Maharashtra, India OpsTree Solutions Full timeHere is the Monument JD.JobDescriptionWeare seeking a skilled ETL (Extract Transform Load) developer withexpertise in AWS services to join our team.Asan ETL developer you will play a crucial role in designingdeveloping and maintaining robust ETL processes to support our dataintegration and analysis needs.ResponsibilitiesDesigndevelop and implement efficient...
-
AWS Data Engineer
2 weeks ago
Pune, Maharashtra, India Techno Wise Full timeWe are looking for aAWS Data Engineerwho will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources.Key ResponsibilitiesPerform technical assessment...
-
AWS Data Engineer
2 weeks ago
Pune, Maharashtra, India Techno Wise Full timeWe are looking for a AWS Data Engineer who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. Key Responsibilities Perform technical...
-
Bigdata-Pyspark Developer
2 weeks ago
Pune, Maharashtra, India LTIMindtree Full timeExp- 5 to 15 Years Locations- PAN India LTIM locations Rel Experience- 3 Years (in Python/ Pyspar/ ScalaSpark) Scala development and design using Scala 3+ or Python Hadoop, Spark/Pyspark, Hive, YARN Data Modelling: A good data engineer should be able to design, implement and maintain data models that can support the organization's data storage and analysis...
-
AWS Data Engineer
2 weeks ago
Pune, Maharashtra, India EXL Full timeRole: AWS Data EngineerExperience: 4 to 6 YearsLocation: Gurgaon, Bangalore – HybridJob Summary:We are seeking a highly motivated and experienced AWS Engineer. This position requires an individual with AWS cloud experience and ambition to continually keep up with best practices when it comes to cloud development. The successful candidate must be able to...
-
Aws - Pune
2 weeks ago
Pune, Maharashtra, India Nityo Infotech Full timeAWS/Talend: Key responsibilities: • Owning Assignments for Dev/Maintenance tasks for AWS,• Managing scheduling with Talend,AutomateNow,Airflow scheduler.• Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Handling Nifi ingestions• Good understating of Technologies such as Spark,Kafka.• Should...
-
Data Engineer
1 month ago
Pune, Maharashtra, India EDGESOFT Full timeJob Description :- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.- 5 to 10 years of proven experience as a Data Engineer with a strong emphasis on DataBricks.- Proficiency in PySpark and extensive hands on experience in building and optimizing data pipelines using DataBricks.- Solid understanding of different...
-
Data Engineer
4 weeks ago
Pune, Maharashtra, India EDGESOFT Full timeJob Description :- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.- 5 to 10 years of proven experience as a Data Engineer with a strong emphasis on DataBricks.- Proficiency in PySpark and extensive hands on experience in building and optimizing data pipelines using DataBricks.- Solid understanding of different...
-
Python Developer
2 weeks ago
Pune, Maharashtra, India IT Full timeTotal Yrs. of Experience : 8+ Relevant Yrs of experience.Roles and Responsibilities :- 5+ years of hands-on Python development experience with excellent programming skills- 3+ years of experience with cloud-based platform, ideally Microsoft Azure- Working experience and skills on big data technologies such as PySpark, Databricks, Kafka- Strong solution...
-
Aws - Pune
1 week ago
Pune, Maharashtra, India Nityo Infotech Full timeAWS/Talend: Key responsibilities: Owning Assignments for Dev/Maintenance tasks for AWS, Managing scheduling with Talend,AutomateNow,Airflow scheduler. Should have Hands on Experience of Development on Cloudera Platform. Developing Unix Shell scripts Handling Nifi ingestions Good understating of Technologies such as Spark,Kafka. Should able to analyze the...