Pyspark AWS Developer

2 weeks ago


Pune, Maharashtra, India Virtusa Full time
Pyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer.
Hands On programming experience
Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.
Experience of performance optimization in Batch and Real time processing applications
Expertise in Data Governance and Data Security Implementation.
Good hands-on design and programming skills building reusable tools and products
Experience developing in AWS or similar cloud platforms

Preferred:
, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).
Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
Expertise in practices like Agile, Peer reviews, Continuous Integration.
Primary Location Pune, Maharashtra, India Job Type Experienced Primary Skills Java, HTML 5, DynamoDB, Python, AWS Glue, Spark, Amazon Redshift, Kafka Years of Experience 10 Qualification
8-10years of relevant work experience showing growth as a Data Engineer.
Hands On programming experience
Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.
Experience of performance optimization in Batch and Real time processing applications
Expertise in Data Governance and Data Security Implementation.
Good hands-on design and programming skills building reusable tools and products
Experience developing in AWS or similar cloud platforms

Preferred:
, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).
Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
Expertise in practices like Agile, Peer reviews, Continuous Integration.
Travel No

  • Pune, Maharashtra, India virtusa consulting services pvt. ltd. Full time

    Apply for Pyspark, AWS Architect ATC, Career Progress Consultants in Pune for Year of Experience on


  • Pune, Maharashtra, India Virtusa Full time

    Pyspark, AWS Architect (ATC) CREQ184787 Description 10+ years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...


  • Pune, Maharashtra, India Fusemachines Full time

    About Fusemachines Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 450 full-time employees)....


  • Pune, Maharashtra, India Synechron Full time

    Python PySpark Developer Exp : 5 - 8 yrs Loc: Pune Notice: 0 -15 days About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization...

  • Aws+ Talend Developer

    2 weeks ago


    Pune, Maharashtra, India Nityo Infotech Full time

    Clarity call for AWS DEV Profile Mandate: •Experience range - 2 to 6 Years.•Production support experience.•AWS: Knowledge of scheduling spark applications in AWS EMR cluster.Design, build and operationalize large-scale enterprise data solutions and applications using one or more AWS data and analytics services in combination with 3rd parties - Spark,...


  • Pune, Maharashtra, India Synechron Full time

    Python PySpark Developer Exp : 5 - 8 yrs Loc: Pune Notice: 0 -15 days About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization...


  • Pune, Maharashtra, India Synechron Full time

    Python PySpark DeveloperExp : 5 - 8 yrsLoc: PuneNotice: 0 -15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span...

  • Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Overture Rede Private Limited. Full time

    Description:- 3 to 6 years years experience in Big Data tech stack- Strong development background- Java or scala 3-6 years- Spark 1-4 years. Certifications are a plus- Azure - 1-3 years. Certifications are a plus- Databricks 1-2 years. Certifications are a plus- Strong SQL background- UI Development experience is plusJob Requirements: - Participate in the...

  • Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Overture Rede Private Limited. Full time

    Description:- 3 to 6 years years experience in Big Data tech stack- Strong development background- Java or scala 3-6 years- Spark 1-4 years. Certifications are a plus- Azure - 1-3 years. Certifications are a plus- Databricks 1-2 years. Certifications are a plus- Strong SQL background- UI Development experience is plusJob Requirements: - Participate in the...


  • Pune, Maharashtra, India Synechron Full time

    Python PySpark DeveloperExp : - 8 yrsLoc: PuneNotice: 0 -15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span...


  • Pune, Maharashtra, India OpsTree Solutions Full time

    Here is the Monument JD.JobDescriptionWeare seeking a skilled ETL (Extract Transform Load) developer withexpertise in AWS services to join our team.Asan ETL developer you will play a crucial role in designingdeveloping and maintaining robust ETL processes to support our dataintegration and analysis needs.ResponsibilitiesDesigndevelop and implement efficient...

  • AWS Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Techno Wise Full time

    We are looking for aAWS Data Engineerwho will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources.Key ResponsibilitiesPerform technical assessment...

  • AWS Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Techno Wise Full time

    We are looking for a AWS Data Engineer who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. Key Responsibilities Perform technical...


  • Pune, Maharashtra, India LTIMindtree Full time

    Exp- 5 to 15 Years Locations- PAN India LTIM locations Rel Experience- 3 Years (in Python/ Pyspar/ ScalaSpark) Scala development and design using Scala 3+ or Python Hadoop, Spark/Pyspark, Hive, YARN Data Modelling: A good data engineer should be able to design, implement and maintain data models that can support the organization's data storage and analysis...

  • AWS Data Engineer

    2 weeks ago


    Pune, Maharashtra, India EXL Full time

    Role: AWS Data EngineerExperience: 4 to 6 YearsLocation: Gurgaon, Bangalore – HybridJob Summary:We are seeking a highly motivated and experienced AWS Engineer. This position requires an individual with AWS cloud experience and ambition to continually keep up with best practices when it comes to cloud development. The successful candidate must be able to...

  • Aws - Pune

    2 weeks ago


    Pune, Maharashtra, India Nityo Infotech Full time

    AWS/Talend: Key responsibilities: • Owning Assignments for Dev/Maintenance tasks for AWS,• Managing scheduling with Talend,AutomateNow,Airflow scheduler.• Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Handling Nifi ingestions• Good understating of Technologies such as Spark,Kafka.• Should...

  • Data Engineer

    1 month ago


    Pune, Maharashtra, India EDGESOFT Full time

    Job Description :- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.- 5 to 10 years of proven experience as a Data Engineer with a strong emphasis on DataBricks.- Proficiency in PySpark and extensive hands on experience in building and optimizing data pipelines using DataBricks.- Solid understanding of different...

  • Data Engineer

    4 weeks ago


    Pune, Maharashtra, India EDGESOFT Full time

    Job Description :- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.- 5 to 10 years of proven experience as a Data Engineer with a strong emphasis on DataBricks.- Proficiency in PySpark and extensive hands on experience in building and optimizing data pipelines using DataBricks.- Solid understanding of different...

  • Python Developer

    2 weeks ago


    Pune, Maharashtra, India IT Full time

    Total Yrs. of Experience : 8+ Relevant Yrs of experience.Roles and Responsibilities :- 5+ years of hands-on Python development experience with excellent programming skills- 3+ years of experience with cloud-based platform, ideally Microsoft Azure- Working experience and skills on big data technologies such as PySpark, Databricks, Kafka- Strong solution...

  • Aws - Pune

    1 week ago


    Pune, Maharashtra, India Nityo Infotech Full time

    AWS/Talend: Key responsibilities: Owning Assignments for Dev/Maintenance tasks for AWS, Managing scheduling with Talend,AutomateNow,Airflow scheduler. Should have Hands on Experience of Development on Cloudera Platform. Developing Unix Shell scripts Handling Nifi ingestions Good understating of Technologies such as Spark,Kafka. Should able to analyze the...