Pyspark AWS Developer

4 weeks ago


Pune, India Virtusa Full time
Pyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer.
Hands On programming experience
Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.
Experience of performance optimization in Batch and Real time processing applications
Expertise in Data Governance and Data Security Implementation.
Good hands-on design and programming skills building reusable tools and products
Experience developing in AWS or similar cloud platforms. Preferred:, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).
Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
Expertise in practices like Agile, Peer reviews, Continuous Integration.
Primary Location Pune, Maharashtra, India Job Type Experienced Primary Skills Java, HTML 5, DynamoDB, Python, AWS Glue, Spark, Amazon Redshift, Kafka Years of Experience 10 Qualification

8-10years of relevant work experience showing growth as a Data Engineer.
Hands On programming experience
Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.
Experience of performance optimization in Batch and Real time processing applications
Expertise in Data Governance and Data Security Implementation.
Good hands-on design and programming skills building reusable tools and products
Experience developing in AWS or similar cloud platforms. Preferred:, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).
Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
Expertise in practices like Agile, Peer reviews, Continuous Integration.

Travel No
  • Pyspark AWS Developer

    4 weeks ago


    Pune, India Virtusa Full time

    Pyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...

  • Pyspark AWS Developer

    4 weeks ago


    pune, India Virtusa Full time

    Pyspark AWS Developer - CREQ184802 Description 8-10years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...

  • AWS Data Engineer

    4 weeks ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, IN Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • AWS Data Engineer

    2 weeks ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • Data Streaming

    4 weeks ago


    Pune, India ACE Talent Consulting Full time

    Job Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Data Streaming

    4 weeks ago


    Pune, India ACE Talent Consulting Full time

    ob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • AWS Data Engineer

    1 month ago


    Pune, India SRS Business Solutions (India) Pvt. Ltd. Full time

    We have an opening for "AWS Data Engineer" for Pune location.Exp: 7+YearsLoc: PuneNP: Immediate to 15 DaysJob Description: 7 to 12 years of experience in designing, implementing, and managing cloud solutions on AWS. Design, develop, and implement cloud solutions on AWS, utilizing a wide range of AWS services, including Glue ETL, Glue Data Catalog, Athena,...

  • AWS Data Engineer

    1 month ago


    Bangalore,Pune,Kolkata,Mumbai,Chennai, India connect io Full time

    Role : AWS Data Engineer Mandatory Skills : 5+ Years in AWS Services Hands on exp in Glue and Pyspark. Experience in Python. Hands on exp in Airflow/Step Function. Exposure Lambda, API : Creating data models that can be used to extract information from various sources and store it in a usable format Maintaining the integrity of data by designing backup...

  • Aws

    1 month ago


    Pune, India Nityo Infotech Full time

    AWS/Talend: Key responsibilities: • Owning Assignments for Dev/Maintenance tasks for AWS,• Managing scheduling with Talend,AutomateNow,Airflow scheduler.• Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Handling Nifi ingestions• Good understating of Technologies such as Spark,Kafka.• Should...

  • Big Data Engineer

    2 weeks ago


    Bangalore/Chennai/Pune/Trivandrum/Thiruvananthapuram, IN Tata Elxsi Full time

    Job Description : - At least 4+ years of experience pyspark framework.- Good experience writing complex SQL and No SQL databases.- Excellent coding and design skills, particularly in Pyspark and Python.- Strong practical working experience with Unix scripting in at least one of Python, HDFS, SQL, PL/SQL, Shell (either bash or zsh).- Experience in AWS...

  • Big Data Engineer

    2 weeks ago


    Bangalore/Chennai/Pune/Trivandrum/Thiruvananthapuram, India Tata Elxsi Full time

    Job Description : - At least 4+ years of experience pyspark framework.- Good experience writing complex SQL and No SQL databases.- Excellent coding and design skills, particularly in Pyspark and Python.- Strong practical working experience with Unix scripting in at least one of Python, HDFS, SQL, PL/SQL, Shell (either bash or zsh).- Experience in AWS...

  • AWS Data Engineer

    4 weeks ago


    Pune, India Techno Wise Full time

    We are looking for aAWS Data Engineerwho will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources.Key ResponsibilitiesPerform technical assessment...

  • AWS Data Engineer

    2 weeks ago


    Pune, India Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :- Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.- This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • AWS Data Engineer

    1 month ago


    pune, India Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :- Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.- This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...


  • Pune, India LTIMindtree Full time

    Exp- 5 to 15 YearsLocations- PAN India LTIM locationsRel Experience- 3 Years (in Python/ Pyspar/ ScalaSpark)Scala development and design using Scala 3+ or PythonHadoop, Spark/Pyspark, Hive, YARNData Modelling: A good data engineer should be able to design, implement and maintain data models that can support the organization's data storage and analysis needs,...


  • pune, India OpsTree Solutions Full time

    Here is the Monument JD.JobDescriptionWeare seeking a skilled ETL (Extract Transform Load) developer withexpertise in AWS services to join our team.Asan ETL developer you will play a crucial role in designingdeveloping and maintaining robust ETL processes to support our dataintegration and analysis needs.ResponsibilitiesDesigndevelop and implement efficient...


  • pune, India YASH Technologies Full time

    We are looking for Data Professionals with 7 years of minimum experience who can Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency.Build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services...

  • Aws - Pune

    4 weeks ago


    Pune, India Nityo Infotech Full time

    AWS/Talend: Key responsibilities: • Owning Assignments for Dev/Maintenance tasks for AWS,• Managing scheduling with Talend,AutomateNow,Airflow scheduler.• Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Handling Nifi ingestions• Good understating of Technologies such as Spark,Kafka.• Should...


  • Pune, India YASH Technologies Full time

    We are looking for Data Professionals with 7 years of minimum experience who can Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency. Build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services...


  • Pune, India YASH Technologies Full time

    We are looking for Data Professionals with 7 years of minimum experience who can Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency. Build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services...