PySpark AWS Data Engineer

3 weeks ago


Bengaluru, India Evnek Technologies Pvt Ltd Full time
Job Description
  • Develop, implement, and optimize ETL workflows using PySpark/Spark.
  • Utilize AWS services such as Glue, Athena, and S3 for data processing and storage.
  • Build and manage data pipelines to support data-driven applications and analytics.
  • Collaborate with cross-functional teams to design and implement scalable data solutions.
  • Optimize the performance of distributed data processing applications.
  • Ensure high-quality code through testing, debugging, and peer reviews.
  • Monitor and troubleshoot production data pipelines to ensure reliability.
  • Stay updated with emerging technologies and industry best practices in big data and cloud computing.


Requirements

Required Skills and Qualifications:

  • Experience: Minimum of 3 years of hands-on experience in PySpark or Spark development.
  • AWS Expertise: Proficiency in AWS services such as Glue, Athena, S3, and other relevant cloud tools.
  • Programming Skills: Strong experience in Python and distributed data processing.
  • Data Management: Knowledge of data lakes, data warehousing, and ETL processes.
  • Problem-Solving: Ability to debug and resolve complex technical issues in big data pipelines.
  • Collaboration: Strong communication and teamwork skills to work with geographically dispersed teams.


Requirements
Python, PySpark, AWS ,ETL , GLUE, ATHENA
  • AWS Data Engineer

    2 months ago


    Bengaluru, India AppSierra Solutions Pvt Ltd Full time

    Description :We are seeking a skilled AWS Data Engineer with expertise in Databricks and Pyspark to join our dynamic team. In this crucial role, you will be responsible for designing and implementing big data processing pipelines that efficiently handle and analyze large volumes of data. You will work closely with cross-functional teams to gather...

  • Azure Data Engineer

    1 month ago


    Bengaluru, India Juniper Consultancy Services Full time

    Who are we looking for :We are looking for an experienced AWS Data Engineer with expertise in PySpark and Python to join our dynamic team. You will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure,leveraging the power of AWS services and big data technologies.Technical Skills : - 8+ years of experience in...

  • Cloud Data Engineer

    7 days ago


    Bengaluru, Karnataka, India SKYLARK HR SOLUTIONS Pvt Ltd Full time

    Job DescriptionWe are seeking a highly skilled Cloud Data Engineer with expertise in AWS and PySpark to join our team at SKYLARK HR SOLUTIONS Pvt Ltd.Company OverviewAs a leading provider of human resource solutions, we strive to deliver exceptional services to our clients. Our team is dedicated to innovation and excellence, and we're looking for talented...


  • Bengaluru, India Evnek Technologies Pvt Ltd Full time

    Develop, implement, and optimize ETL workflows using PySpark/Spark.Utilize AWS services such as Glue, Athena, and S3 for data processing and storage.Build and manage data pipelines to support data-driven applications and analytics.Collaborate with cross-functional teams to design and implement scalable data solutions.Optimize the performance of distributed...


  • Bengaluru / Bangalore, India Softpath Tech Solutions Private Limited Full time

    DescriptionWe are looking for a highly skilled AWS Databricks Pyspark Developer with 5-8 years of experience to join our team in Bangalore ,India. The ideal candidate will have a strong background in developing and maintaining large-scale data processing systems using AWS Databricks and Pyspark.ResponsibilitiesDesign and develop data processing pipelines...

  • AWS Data Engineer

    2 months ago


    Bengaluru, India JoulestoWatts Business Solutions Pvt Ltd Full time

    Role : AWS Data Engineer. Experience : 6+ Years. Location : Bangalore (Work from office 5 Days). Job Description : AWS Data Engineer/Lead Developer- ,experience with Sql, S3, AWS Glue, AWS Lambda, Pyspark, Aurora DB, Dynamo DB, Redshift, Datawarehousing, CI/CD, Stonebranch(Scheduling Tool).- We are seeking a highly skilled AWS Data Engineer to join our team...


  • Bengaluru, India Natobotics Technologies Private Limited Full time

    **INFOSYS IS HIRING PYTHON,PYSPARK WITH AWS FOR BANGALORE & MUMBAI** Exp : 5+ Yrs Role : Python,Pyspark With AWS Location : Bangalore & Mumbai Payroll : Natobotics Client : Infosys Below is JD. Skill Set (any 1 as primary pls mention) 1. Python 2. PySpark 3. AWS 4. SQL 5. Snowflake, 6. DevOps JD details 1. Design and develop data integration...


  • Bengaluru, India Thoucentric Technology Pvt. Ltd. Full time

    We are looking for an experienced AWS Data Engineer to design, develop, and maintain data solutions using core AWS services. The ideal candidate will have hands-on experience with tools like Amazon S3, Redshift, AWS Glue, and DynamoDB, and will build scalable, efficient, and secure data pipelines and architectures. The role also requires strong expertise in...

  • PySpark Data Engineer

    2 months ago


    Bengaluru, India KPI Partners Full time

    Over all 2-4 years of Data Engineering experiece.Must have PySpark, Python, Spark and SQL.Must have anyone cloud expereince (Azure / AWS).Good to have Databricks Pro Certification.Exceptional opportunity for individuals who are willing to work in Data & Analytics firm.

  • Senior Data Engineer

    2 months ago


    Bengaluru, India SKYLARK HR SOLUTIONS Pvt Ltd Full time

    Position : PySpark/Python with AWS Developer. Location : Bangalore. Number of Open Positions : 7. Experience Required : 7-9 Years. Relevant- Experience : 3+ Years.Shift : General Shift. Remote Work : WFH. Notice period : 30 Days. Note WE ARE NOT CONSIDERING CANDIDATES- FROM DATA ANALYST OR DATA SCIENTIST. Role Overview : As a PySpark/Python Developer with...

  • AWS Engineer

    2 months ago


    Bengaluru, India One Degree North HR Services Full time

    Requirements : - Minimum 5 years of experience with AWS development. - Hands-on experience in Technical skills especially AWS Glue, Pyspark programming, and Postgres SQL. - Strong exposure to Relational Databases, i. e. MS SQL and Postgres SQL. - Good in SQL, PL/SQL, DDL, and DML Commands. - Hands-on experience in AWS services i. e. AWS Glue, SCT, DMS,...

  • AWS Data Engineer

    2 weeks ago


    Bengaluru, India Spruce IT Pvt. Ltd. Full time

    Job Title : AWS Data Engineer. Company : Spruce InfoTech, Inc. Job Type : Contract-to-Hire (C2H) with MNC. Location : Bangalore. Experience : 5+ years. Job Description : Spruce InfoTech, Inc. is hiring a skilled AWS Data Engineer to join a leading MNC on a Contract-to-Hire basis. The ideal candidate will bring robust experience in cloud data engineering,...

  • Data Engineer

    3 months ago


    Bengaluru, India ANRI Solutions HR Services Full time

    Job Description : We are seeking a skilled Data Engineer with 4-8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Python and PySpark, and will be responsible for designing, developing, and maintaining scalable data pipelines and architectures.Responsibilities : - Design and implement data pipelines using...


  • Bengaluru, India ARA Resources Pvt. Ltd. Full time

    About The Company:Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across...

  • AWS Data Engineer

    2 weeks ago


    Bengaluru, India Deloitte Full time

    We are looking for Candidates who are having experience in AWS Data Engineer .Experience Required: 5+ years.Location: Bengaluru, Karnataka, IndiaKey Responsibilities:Build & manage ETL pipelines using Python , PySpark & AWS Glue .Process and store data on AWS S3 & optimize queries in Redshift .Develop serverless solutions with AWS Lambda & design...

  • AWS Data Engineer

    3 weeks ago


    Bengaluru, India Tata Consultancy Services Full time

    Experience: 4+ YearsLocation: bangalore/hyderabadRole: AWS Data EngineerJob Description:Good hands on experience in Python programming and Pyspark and snowflake· Data Engineering experience using AWS core services (Lambda, Glue, EMR and RedShift) · Required skill set- SQL, Airflow· Have Experience with snowflake or Hive or AWS S3· Responsibility – Will...

  • AWS Data Engineer

    1 month ago


    Bengaluru, India Tata Consultancy Services Full time

    AWS Data Engineer:Required Technical Skill Set: AWS Redshift, Glue, PySparkLocation of Requirement: Chennai/Mumbai/Bangalore/Pune/Indore/HyderabadDesired Experience Range: 4-10 YearsMust-Have:Strong hands-on experience in Python programming and PySparkExperience using AWS services (RedShift, Glue, EMR, S3 & Lambda)Experience working with Apache Spark and...

  • AWS Data Engineer

    3 weeks ago


    Bengaluru, India Thoucentric Full time

    Job DescriptionPosition Overview     We are looking for an experienced   AWS Data Engineer   to design, develop, and maintain data solutions using core AWS services. The ideal candidate will have hands-on experience with tools like Amazon S3, Redshift, AWS Glue, and DynamoDB, and will build scalable, efficient, and secure data pipelines and...

  • Aws data engineer

    2 weeks ago


    Bengaluru, India Tata Consultancy Services Full time

    Experience: 4+ YearsLocation: bangalore/hyderabadRole: AWS Data EngineerJob Description:Good hands on experience in Python programming and Pyspark and snowflake· Data Engineering experience using AWS core services (Lambda, Glue, EMR and Red Shift) · Required skill set- SQL, Airflow· Have Experience with snowflake or Hive or AWS S3· Responsibility –...


  • Bengaluru, India ARA Resources Pvt. Ltd. Full time

    About The Company:Ara's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. The accolades It has been garnering can be attributed to their undeterred focus in delivering quality solutions across...