Pyspark Data Engineer

1 week ago

Hyderabad Pune, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

We are looking for a skilled Pyspark Data Engineer with 3 to 5 years of experience. The ideal candidate will have expertise in Hadoop, Spark/Pyspark, Hive, YARN, Scala development, and data modeling. This position is based in Pune and Hyderabad.

Roles and Responsibility

  • Design and develop scalable data pipelines using Pyspark and Spark.
  • Collaborate with cross-functional teams to identify and prioritize project requirements.
  • Develop and maintain large-scale data systems and architectures.
  • Ensure data quality and integrity by implementing robust testing and validation procedures.
  • Participate in code reviews and contribute to improving overall code quality.
  • Troubleshoot and resolve complex technical issues efficiently.

Job Requirements

  • Strong proficiency in programming languages such as Python or Scala.
  • Experience with big data technologies including Hadoop, Spark/Pyspark, and Hive.
  • Knowledge of data modeling and operating systems such as Windows, Linux/Unix.
  • Familiarity with Agile Scrum methodologies and tools like Jira, Confluence, and GitHub.
  • Excellent problem-solving skills and attention to detail.
  • Ability to work collaboratively in a team environment and communicate effectively.
  • Full-time graduation.
  • Notice period: Immediate.

How to Apply

To apply, please send your resume to .

  • Python,pyspark,apachespark

    6 days ago

    Hyderabad, Telangana, India NTT DATA Full time

    **Req ID**: 327070 We are currently seeking a python,pySpark,ApacheSpark to join our team in Hyderabad, Telangana (IN-TG), India (IN). NTT DATA Services currently seeks Python Developer to join our team in Hyderabad Design and build ETL solutions with experience in data engineering, data modelling in large-scale in both batch and real-time...

  • Data Engineer

    1 week ago

    Pune, India RSquareSoft Technologies Full time

    Role: Data Engineer Location: Pune (On-site)Job Type: Full-TimeExperience: 4–7 YearsKey ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL workflows.Work with large datasets using PySpark , Python , and SQL to ensure efficient data transformation and integration.Implement data solutions on AWS, leveraging...

  • Data Engineer

    7 days ago

    Pune, India RSquareSoft Technologies Full time

    Role: Data Engineer Location: Pune (On-site)Job Type: Full-TimeExperience: 4–7 YearsKey ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL workflows.Work with large datasets using PySpark , Python , and SQL to ensure efficient data transformation and integration.Implement data solutions on AWS, leveraging services like S3, Glue,...

  • Data Engineer

    1 week ago

    Pune, India RSquareSoft Technologies Full time

    Role: Data Engineer Location: Pune (On-site) Job Type: Full-Time Experience: 4–7 Years Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL workflows. Work with large datasets using PySpark , Python , and SQL to ensure efficient data transformation and integration. Implement data solutions on AWS, leveraging services like S3,...

  • Data Engineer

    1 week ago

    Pune, India RSquareSoft Technologies Full time

    Role: Data Engineer Location: Pune (On-site) Job Type: Full-Time Experience: 4–7 Years Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL workflows. Work with large datasets using PySpark , Python , and SQL to ensure efficient data transformation and integration. Implement data solutions on AWS, leveraging services like S3,...

  • Data Engineer

    2 weeks ago

    Pune, India RSquareSoft Technologies Full time

    Role: Data Engineer Location: Pune (On-site) Job Type: Full-Time Experience: 4–7 Years Key Responsibilities - Design, develop, and maintain scalable data pipelines and ETL workflows. - Work with large datasets using PySpark, Python, and SQL to ensure efficient data transformation and integration. - Implement data solutions on AWS, leveraging services like...

  • Data Engineer

    1 week ago

    Pune, India RSquareSoft Technologies Full time

    Role: Data Engineer Location: Pune (On-site) Job Type: Full-Time Experience: 4–7 Years Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL workflows. Work with large datasets using PySpark , Python , and SQL to ensure efficient data transformation and integration. Implement data solutions on AWS, leveraging services like S3,...

  • Data Engineer

    1 week ago

    Pune, India RSquareSoft Technologies Full time

    Role: Data EngineerLocation: Pune (On-site)Job Type: Full-TimeExperience: 4–7 YearsKey ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL workflows.Work with large datasets using PySpark, Python, and SQL to ensure efficient data transformation and integration.Implement data solutions on AWS, leveraging services like S3, Glue,...

  • Data Engineer

    1 week ago

    pune, India RSquareSoft Technologies Full time

    Role: Data EngineerLocation: Pune (On-site)Job Type: Full-TimeExperience: 4–7 YearsKey ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL workflows.Work with large datasets using PySpark, Python, and SQL to ensure efficient data transformation and integration.Implement data solutions on AWS, leveraging services like S3, Glue,...

  • Data Engineer

    6 days ago

    Pune, India RSquareSoft Technologies Full time

    Role: Data EngineerLocation: Pune (On-site)Job Type: Full-TimeExperience: 4–7 YearsKey ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL workflows.Work with large datasets using PySpark , Python , and SQL to ensure efficient data transformation and integration.Implement data solutions on AWS, leveraging services like S3,...