Pyspark Developer

4 weeks ago


Hyderabad, India Corporate Resources Full time
Job Description

1. Knowledge of the key phases of software delivery lifecycle and established software development methodologies2. Must have strong understanding of data architecture, data integration and data management processes, ability to develop transformation logic in Spark-SQL based on dataframes

3. 4 to 7 years of expertise in data and analytics concepts. Big Data, Hadoop, Hive, Impala, Sqoop, oozie (Pyspark, Athena, Presto, Airflow, CLI, Glue) Scala, Cloud concepts

4. AWS based services like SageMaker (AWS/GCP) is a plus.

5. Exposure to DevOps tools (Ansible, Consul, Puppet etc) added advantage.

IndustryIT-Software / Software ServicesFunctional AreaIT Software - Application Programming, MaintenanceJob RoleSoftware DeveloperJob TypePermanentQualification

UG QualificationB.Tech/B.E - ComputersPG QualificationAny Post Graduate - Any SpecializationDoctorateDoctorate Not Required - NoneDesired Candidate Profile

Please refer to the Job description above

  • Hyderabad, India Notus Solution Full time

    Overview:The PySparkEngineer plays a crucial role in our organization by leveragingtheir expertise in PySpark and Big Data technologies to designdevelop and maintain scalable data pipelines and analyticssolutions. This role is essential in enabling datadrivendecisionmaking and ensuring the optimal performance of our datasystems.KeyResponsibilities:Designing...


  • hyderabad, India Notus Solution Full time

    Overview: The PySparkEngineer plays a crucial role in our organization by leveragingtheir expertise in PySpark and Big Data technologies to designdevelop and maintain scalable data pipelines and analyticssolutions. This role is essential in enabling datadrivendecisionmaking and ensuring the optimal performance of our datasystems.KeyResponsibilities:...

  • Pyspark

    4 weeks ago


    Hyderabad, India Nityo Infotech Full time

    Lead and guide development activities of data ingestions to AWS cloud and Databricks data harmonization meeting the functional and non-functional requirements.Collaborate with SME and business SME to develop architectural requirements to ensure client satisfaction with productDefine the standards processes and the best practices to be followed for...

  • Pyspark

    1 month ago


    Hyderabad, India Nityo Infotech Full time

    Lead and guide development activities of data ingestions to AWS cloud and Databricks data harmonization meeting the functional and non-functional requirements.Collaborate with SME and business SME to develop architectural requirements to ensure client satisfaction with productDefine the standards processes and the best practices to be followed for...

  • Pyspark

    1 month ago


    hyderabad, India Nityo Infotech Full time

    Lead and guide development activities of data ingestions to AWS cloud and Databricks data harmonization meeting the functional and non-functional requirements.Collaborate with SME and business SME to develop architectural requirements to ensure client satisfaction with productDefine the standards processes and the best practices to be followed for...

  • Python Developer

    2 weeks ago


    hyderabad, India PURVIEW Full time

    Role: Python Developer (Python +Airflow +AWS)Location: HyderabadDuration: PermanentJob Description· Strong knowledge of Python/Pyspark and Bash scripting· Experience working with Dataframes, Pandas, Scipy, Numpy libraries is a plus· Strong hands-on working knowledge in the AWS Components Experience in AWS Native Services: IAM, EC2, S3, API Gateway, Secret...

  • Python Developer

    2 weeks ago


    Hyderabad, India PURVIEW Full time

    Role: Python Developer (Python +Airflow +AWS)Location: HyderabadDuration: PermanentJob Description· Strong knowledge of Python/Pyspark and Bash scripting· Experience working with Dataframes, Pandas, Scipy, Numpy libraries is a plus· Strong hands-on working knowledge in the AWS Components Experience in AWS Native Services: IAM, EC2, S3, API Gateway, Secret...

  • Python Developer

    2 weeks ago


    hyderabad, India PURVIEW Full time

    Role: Python Developer (Python +Airflow +AWS) Location: Hyderabad Duration: Permanent Job Description · Strong knowledge of Python/Pyspark and Bash scripting · Experience working with Dataframes, Pandas, Scipy, Numpy libraries is a plus · Strong hands-on working knowledge in the AWS Components Experience in AWS Native Services: IAM, EC2, S3, API Gateway,...

  • Python Developer

    2 weeks ago


    Hyderabad, India PURVIEW Full time

    Role: Python Developer (Python +Airflow +AWS)Location: HyderabadDuration: PermanentJob Description· Strong knowledge of Python/Pyspark and Bash scripting· Experience working with Dataframes, Pandas, Scipy, Numpy libraries is a plus· Strong hands-on working knowledge in the AWS Components Experience in AWS Native Services: IAM, EC2, S3, API Gateway, Secret...


  • Anywhere in India,Multiple Locations,Bangalore,Hyderabad,Pune,Chennai CA-One India Full time

    Job descriptionJob Opportunity: Pyspark DeveloperExperience: 6+ YearsLocation: Bangalore, Hyderabad, Pune, ChennaiJob description : Good hands-on experience in Pyspark, preferably more than 5 years Should have good knowledge of Python and spark concepts Develop and maintain data pipelines and ETL processes using Python and Pyspark. Design, implement, and...

  • Data Engineer

    1 month ago


    hyderabad, India SYNERGY GLOBAL IT SOLUTIONS Full time

    Job Description : - 4+ years' experience in developing applications using Pyspark, Azuredatabricks, SQL and extracting, ingesting, processing of large data sets.- 2+ years' programming experience in building high quality applications, data pipelines and analytics solutions and data products using Python/PySpark.- 2+ years' experience working on cloud...

  • Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India SYNERGY GLOBAL IT SOLUTIONS Full time

    Job Description :- 4+ years' experience in developing applications using Pyspark, Azuredatabricks, SQL and extracting, ingesting, processing of large data sets.- 2+ years' programming experience in building high quality applications, data pipelines and analytics solutions and data products using Python/PySpark.- 2+ years' experience working on...

  • Data Engineer

    2 weeks ago


    Hyderabad, India SYNERGY GLOBAL IT SOLUTIONS Full time

    Job Description : - 4+ years' experience in developing applications using Pyspark, Azuredatabricks, SQL and extracting, ingesting, processing of large data sets.- 2+ years' programming experience in building high quality applications, data pipelines and analytics solutions and data products using Python/PySpark.- 2+ years' experience working...


  • Hyderabad, India CGI Information Systems and Management Consultants Full time

    Job Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Integrating new data management tools into company ecosystems- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for...

  • ETL Developer

    2 weeks ago


    Hyderabad, India Cloud Hire Full time

    Experience : 3 - 8 YrsLocation : Hyderabad Job Description :- 3 to 8 yrs in Pyspark, Synapps , Logicapps, deltalake, ADF.- Consulting with data management teams to get a big-picture idea of the company's data storage needs.- Presenting the company with warehousing options based on their storage needs.- Designing and coding the data warehousing system...

  • Big Data Engineer

    2 weeks ago


    Hyderabad, India TalentXo Full time

    Role & Responsibilities :Good development practices :- Hands on coder with good experience in programming languages like Java or Python.- Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.- Good understanding of programming principles and development practices like checkin policy, unit testing, code...

  • Business Analyst

    1 month ago


    Pune,Bangalore,Hyderabad,Gurgaon,Gurugram,Chennai,Mumbai, India Idyllic Services Pvt Ltd Full time

    Job Description : Mandatory Skills : Business Analysis and PySpark (Both Mandatory). - Understanding of Global Change Delivery Business Transformation Frameworks, methodologies and best practice techniques - Outstanding understanding of Client Group structures, processes and objectives. - Understanding of banking and understanding of how change drives...


  • Hyderabad, India Model N Full time

    Model N is hiring a Consultant, integration Specialist for our Business Services team. The purpose of the role is to work on complex algorithms for all our clients and serve as the main liaison between our clients and our different internal teams (Managed Services, Advisory, Audit, Consulting) by ensuring a smooth onboarding process, handling several...


  • hyderabad, India Model N Full time

    Model N is hiring a Consultant, integration Specialist for our Business Services team. The purpose of the role is to work on complex algorithms for all our clients and serve as the main liaison between our clients and our different internal teams (Managed Services, Advisory, Audit, Consulting) by ensuring a smooth onboarding process, handling several...

  • Big Data Engineer

    2 weeks ago


    Bangalore/Hyderabad, Karnataka, India TalentXo Full time

    Role & Responsibilities :Good development practices :- Hands on coder with good experience in programming languages like Java or Python.- Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.- Good understanding of programming principles and development practices like checkin policy, unit testing, code...