PySpark Developer

1 month ago

Hyderabad, India Alignity Solutions Full time
Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.
  • Jobseeker Video Testimonials 
  • Employee Glassdoor Reviews
If you are a Pyspark Developer Position looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive Talent Solution.

Role:Pyspark Developer
Location: Mumbai
Exp: 5 - 8 Years

Requirements

We are seeking an experienced PySpark Developer to join our data engineering team. The ideal candidate will have expertise in Apache Spark and Python programming, focusing on building scalable, high-performance data processing pipelines. As a PySpark Developer, you will collaborate with cross-functional teams to design, build, and deploy big data solutions that drive business insights and analytics.

Key Responsibilities:
  • Develop, test, and maintain large-scale data processing systems using PySpark and other big data technologies.
  • Design and implement data pipelines to extract, transform, and load data from various data sources, ensuring scalability and reliability.
  • Work with data scientists, data analysts, and other stakeholders to understand requirements and provide solutions that meet business needs.
  • Optimize and tune PySpark applications for efficient performance, including memory management, processing time, and resource utilization.
  • Integrate data from multiple sources, managing schema, data transformations, and data quality.
  • Participate in code reviews, design discussions, and performance tuning sessions to ensure high-quality deliverables.
  • Document processes, data flow, and other key technical aspects of the developed solutions.
Required Skills and Experience:
  • Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience).
  • 2+ years of hands-on experience in PySpark, Spark SQL, and Spark DataFrames.
  • Proficiency in Python programming, with experience in data manipulation and processing.
  • Strong knowledge of Apache Spark architecture and experience working with large datasets in a distributed environment.
  • Experience with SQL and relational databases, including query optimization.
  • Familiarity with ETL frameworks and data processing tools (e.g., Hadoop, Hive, Kafka).
  • Experience in cloud platforms such as AWS, Azure, or Google Cloud and their respective big data services.
  • Understanding of data lake and data warehouse concepts and best practices.
  • Knowledge of data partitioning, caching, and other optimization techniques in Spark.
  • Strong problem-solving and debugging skills, with attention to detail and accuracy.
Preferred Qualifications:
  • Experience with data orchestration tools (e.g., Apache Airflow).
  • Familiarity with NoSQL databases (e.g., Cassandra, MongoDB).
  • Knowledge of DevOps practices, including CI/CD and containerization tools (e.g., Docker, Kubernetes).
  • Experience with machine learning frameworks integrated with Spark (e.g., MLlib).
Soft Skills:
  • Excellent communication skills and ability to work collaboratively in a team environment.
  • Strong analytical skills with an ability to translate complex business requirements into scalable technical solutions.
  • Ability to manage multiple projects, prioritize tasks, and adapt in a fast-paced environment.


BenefitsVisit us at . Alignity Solutions is an Equal Opportunity Employer, M/F/V/D.

CEO Message: Click Here
Clients Testimonial: Click Here

  • PySpark Developer

    3 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Role- PySpark DeveloperExperience- 5 TO 10 YRSLocation- Bangalore / HyderabadMust Have- PysparkDesired Competencies (Technical/Behavioral Competency)Must-Have · Hands-on experience in Pyspark including Dataframe core functions sparkSQL and SparkStreaming. · Minimum 3 years of experience HIVE, Hadoop, Kafka, YARN, HBase & MongoDB · Hands on experience in...

  • PySpark Developer

    3 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Role- PySpark DeveloperExperience - 5 TO 10 YRSLocation - Bangalore / HyderabadMust Have - PysparkDesired Competencies (Technical/Behavioral Competency)Must-Have · Hands-on experience in Pyspark including Dataframe core functions sparkSQL and SparkStreaming. · Minimum 3 years of experience HIVE, Hadoop, Kafka, YARN, HBase & MongoDB · Hands on experience...

  • PySpark Developer

    2 days ago

    Hyderabad, India Kairos Konnect Full time

    Pyspark Developer Key things : Python, PysparkOffshore Years exp 6+ yrsNo of positions : 5 rolesHyderabad- 5 days onsiteShift timings are 1pm-10pmResponsibilities :- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.- Collaborate with product and technology teams to...

  • Pyspark developer

    2 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Role - Py Spark Developer Experience - 5 TO 10 YRS Location - Bangalore / Hyderabad Must Have - Pyspark Desired Competencies (Technical/Behavioral Competency) Must-Have · Hands-on experience in Pyspark including Dataframe core functions spark SQL and Spark Streaming. · Minimum 3 years of experience HIVE, Hadoop, Kafka, YARN, HBase & Mongo...

  • PySpark Developers

    7 months ago

    Hyderabad, India Techno Wise Full time

    We are looking for a PySpark developer ( with ETL background ) to be able to design and build solution on one of our customer programs. This to build a data standardized and curation layer that will integrate data across internal and external sources, provide analytical insights and integrate with customer’s critical systems. Roles and...

  • PySpark Developer

    4 months ago

    Hyderabad, India Chiselon Technologies Pvt Ltd Full time

    #Hiring Alert#We are looking for our client!Job Title: PySpark Developer Location: Remote Job Type: Full-Time Experience: 5 7 yearsNotice Period: Immediate Joiner, Currently Serving Notice period Qualifications and SkillsProficiency in Python (Mandatory skill) with a strong understanding of its libraries and frameworks.Experience with PySpark (Mandatory...

  • PySpark QA

    6 months ago

    Hyderabad, India Virtusa Full time

    PySpark QA - CREQ191292 Description JOB DESCRIPTION Skill: PySpark QA Role / Tier: Lead Software Engineer/Tier 2 Experience: 6 – 9 years Job Description: Primary Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark. build CI/CD pipelines Spark APIs to cleanse, explore,...

  • Tcs opportunity for pyspark developer

    3 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS !!!Job Title : Pyspark developerLocation- Chennai/Bangalore/Gurgaon/Pune/BhuvneshwarExperience required : 5+ yearsRequired InformationDetailsRequired Technical Skill-Knowledge of Pyspark, Big Data experience, AWS EMR, S3, IAM, Lambda, SNS, SQSMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala,...

  • TCS Opportunity for Pyspark developer

    4 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS !!!Job Title : Pyspark developerLocation- Chennai/Bangalore/Gurgaon/Pune/BhuvneshwarExperience required : 5+ yearsRequired InformationDetailsRequired Technical Skill-Knowledge of Pyspark, Big Data experience, AWS EMR, S3, IAM, Lambda, SNS, SQSMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala,...

  • TCS Opportunity for Pyspark developer

    5 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS !!!Job Title : Pyspark developerLocation- Chennai/Bangalore/Gurgaon/Pune/BhuvneshwarExperience required : 5+ years Required InformationDetailsRequired Technical Skill-Knowledge of Pyspark, Big Data experience, AWS EMR, S3, IAM, Lambda, SNS, SQS Must-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala,...

  • TCS Opportunity for Pyspark developer

    4 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS !!! Job Title : Pyspark developer Location- Chennai/Bangalore/Gurgaon/Pune/Bhuvneshwar Experience required : 5+ years Required Information Details Required Technical Skill- Knowledge of Pyspark, Big Data experience, AWS EMR, S3, IAM, Lambda, SNS, SQS Must-Have Good work experience on Big Data Platforms like Hadoop, Spark, Scala,...

  • TCS Opportunity for Pyspark developer

    4 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS !!!Job Title : Pyspark developerLocation- Chennai/Bangalore/Gurgaon/Pune/BhuvneshwarExperience required : 5+ years Required InformationDetailsRequired Technical Skill-Knowledge of Pyspark, Big Data experience, AWS EMR, S3, IAM, Lambda, SNS, SQS Must-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala,...

  • Pyspark With Azure Databricks

    1 month ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on devanshi.nigam@htcinc.com with below details - We are Looking for Immediate or 15days joiners only Candidate‘s Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice...

  • PySpark with Azure Databricks

    1 month ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on devanshi.nigam@htcinc.com with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice Period- If...

  • Tata Consultancy Services | PySpark Developer

    1 week ago

    hyderabad, India Tata Consultancy Services Full time

    Role : PySpark DeveloperTechnical Skill Set : PySpark, Python, HDFS, Hadoop, SQLLocation : Mumbai, Pune ,Chennai, Banglore , NCR, HyderabadMust-Have :Sound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured & unstructured dataAbility to design data pipelines in end to end manner Knowledge on Avro, Parquet...

  • PySpark with Azure Databricks

    1 month ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate,We have an opportunity of PySpark with DataBricks position with HTC Global ServicesPlease share your updated resume on with below details -We are Looking for Immediate or 15days joiners onlyCandidate's Full Name (As Per Aadhar) -Total Exp. -Rel. Exp. (in Pyspark) -Rel. Exp. (in Databricks) -Notice Period-If serving Notice or not working,...

  • PySpark Developer

    3 months ago

    hyderabad, India Synechron Full time

    Hello Everyone, PySpark Developer (PySpark + GCP), Experience - 5 to 8 years Location - Hyderabad Notice - 0 - 15 days About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s...

  • PySpark Developer

    1 month ago

    hyderabad, India Synechron Full time

    Hello Everyone,PySpark Developer (PySpark + GCP),Experience - 5 to 8 yearsLocation - HyderabadNotice - 0 - 15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s...

  • PySpark Developer

    3 months ago

    hyderabad, India Synechron Full time

    Hello Everyone,PySpark Developer (PySpark + GCP),Experience - 5 to 8 yearsLocation - HyderabadNotice - 0 - 15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s...

  • PySpark with Azure Databricks

    2 months ago

    Hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice Period- If serving...