CGI - Python PySpark Developer - Data Management System

4 weeks ago


Hyderabad, India CGI Information Systems and Management Consultants Full time

Job Description :


- Designing, installing, testing, and maintaining scalable data management systems

- Ensuring systems meet business requirements and industry standards

- Integrating new data management tools into company ecosystems

- Creating custom software components and analytics applications

- Research data acquisition opportunities and new uses for existing data

- Experience in application development experience in Scala, Spark, scalatest/Junit libraries with maven.

- Experience in application development experience in Python & PySpark/Spark.

- Experience in working on OO principles.

- Ability to write SQL Queries.

- Ability to write bash shell scripts.

- Ability to learn& adapt.

- Ability to communicate in clear & concise way.

- Experience in writing Unit test cases & perform thorough unit testing.

- CI/CD concepts.

- Unix/Linux basics.

- REST API basics.

(ref:hirist.tech)

  • Bangalore,Chennai,Pune,Hyderabad, India CGI Information Systems and Management Consultants Full time

    Job Description : - Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Integrating new data management tools into company ecosystems- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for...


  • Bangalore/Chennai/Pune/Hyderabad, IN CGI Information Systems and Management Consultants Full time

    Job Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Integrating new data management tools into company ecosystems- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for...


  • Bangalore/Chennai/Pune/Hyderabad/Mumbai, India CGI Full time

    Job Title : Data Engineer SSE Work Location : Bangalore/Chennai/Pune/Hyderabad/Mumbai (Any CGI location). - Data pipeline/workflow development in GCP, Hadoop, Kubernetes, ELK - Supporting existing production applications - Assist in connectivity and environment development The candidate will need to understand the requirements and work mostly...


  • Hyderabad, India CGI Full time

    Job Title: Python Production Support Position: Senior Software Engineer Experience: 5 - 8 Years Category: Software Development/ Engineering Main location: Bangalore/Hyderabad Position ID: J1023-0909 Employment Type: Full Time Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 4 years of relevant...


  • Anywhere in India,Multiple Locations,Bangalore,Hyderabad,Pune,Chennai CA-One India Full time

    Job descriptionJob Opportunity: Pyspark DeveloperExperience: 6+ YearsLocation: Bangalore, Hyderabad, Pune, ChennaiJob description : Good hands-on experience in Pyspark, preferably more than 5 years Should have good knowledge of Python and spark concepts Develop and maintain data pipelines and ETL processes using Python and Pyspark. Design, implement, and...

  • Dba

    4 days ago


    Hyderabad, India CGI Full time

    Job Title: DBA Position: Senior Software Engineer Experience: 5 - 8 Years Category: Software Development/ Engineering Main location: Bangalore/Hyderabad Position ID: J1023-1704 Employment Type: Full Time Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 4 years of relevant experience. **Insights you can act...

  • Python Developer

    5 days ago


    hyderabad, India PURVIEW Full time

    Role: Python Developer (Python +Airflow +AWS)Location: HyderabadDuration: PermanentJob Description· Strong knowledge of Python/Pyspark and Bash scripting· Experience working with Dataframes, Pandas, Scipy, Numpy libraries is a plus· Strong hands-on working knowledge in the AWS Components Experience in AWS Native Services: IAM, EC2, S3, API Gateway, Secret...

  • Data Engineer

    4 weeks ago


    Bangalore,Hyderabad,Chennai,Pune,Gurgaon,Gurugram, India ADV Full time

    Mandatory Skills : #Pyspark #Python #AWS #Data Pipeline #Python #PySpark #Hadoop #Spark #SQL #Big Data #Kafka #Scala Organization : AltimetrikRole : Data EngineerJob Description : Technical & Other Skills : - 5+ years of working experience in scalable data pipeline using Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill and...

  • AWS Data Engineer

    1 week ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • AWS Data Engineer

    3 weeks ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, IN Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • Python Developer

    5 days ago


    hyderabad, India PURVIEW Full time

    Role: Python Developer (Python +Airflow +AWS) Location: Hyderabad Duration: Permanent Job Description · Strong knowledge of Python/Pyspark and Bash scripting · Experience working with Dataframes, Pandas, Scipy, Numpy libraries is a plus · Strong hands-on working knowledge in the AWS Components Experience in AWS Native Services: IAM, EC2, S3, API Gateway,...

  • Python Developer

    5 days ago


    Hyderabad, India PURVIEW Full time

    Role: Python Developer (Python +Airflow +AWS)Location: HyderabadDuration: PermanentJob Description· Strong knowledge of Python/Pyspark and Bash scripting· Experience working with Dataframes, Pandas, Scipy, Numpy libraries is a plus· Strong hands-on working knowledge in the AWS Components Experience in AWS Native Services: IAM, EC2, S3, API Gateway, Secret...

  • Python Developer

    5 days ago


    Hyderabad, India PURVIEW Full time

    Role: Python Developer (Python +Airflow +AWS)Location: HyderabadDuration: PermanentJob Description· Strong knowledge of Python/Pyspark and Bash scripting· Experience working with Dataframes, Pandas, Scipy, Numpy libraries is a plus· Strong hands-on working knowledge in the AWS Components Experience in AWS Native Services: IAM, EC2, S3, API Gateway, Secret...

  • Pyspark + Python

    4 weeks ago


    Hyderabad, India Nityo Infotech Full time

    Description , India , Job , Level , Location , PAN , Python ,Pyspark + python Experience Required 9 - 12 Years Industry Type IT Employment Type Permanent Location India

  • Pyspark + Python

    4 days ago


    hyderabad, India Nityo Infotech Full time

    Description , India , Job , Level , Location , PAN , Python ,Pyspark + python Experience Required 9 - 12 Years Industry Type IT Employment Type Permanent Location India

  • Python/pyspark/scala

    23 hours ago


    Hyderabad, India Xpetize Full time

    **Years of Experience : 3+** Years** **Joining Time frame **:immediate to 1 Week** **Positions: 4** **Mandatory skills**: **Mandatory skills**: - Experience in Python/Pyspark/Scala - SQL - GCP/AWS/Azure - Hadoop / HDFS/Other Databases - Airflow/Other Automation tools - Linux/ Bash scripting - Kafka/Flume/Kinesis/Data Streaming **Job Type : Full...

  • Data Engineer

    4 weeks ago


    hyderabad, India SYNERGY GLOBAL IT SOLUTIONS Full time

    Job Description : - 4+ years' experience in developing applications using Pyspark, Azuredatabricks, SQL and extracting, ingesting, processing of large data sets.- 2+ years' programming experience in building high quality applications, data pipelines and analytics solutions and data products using Python/PySpark.- 2+ years' experience working on cloud...

  • Data Engineer

    1 week ago


    Hyderabad, India SYNERGY GLOBAL IT SOLUTIONS Full time

    Job Description :- 4+ years' experience in developing applications using Pyspark, Azuredatabricks, SQL and extracting, ingesting, processing of large data sets.- 2+ years' programming experience in building high quality applications, data pipelines and analytics solutions and data products using Python/PySpark.- 2+ years' experience working on...

  • Data Engineer

    1 week ago


    Hyderabad, India SYNERGY GLOBAL IT SOLUTIONS Full time

    Job Description : - 4+ years' experience in developing applications using Pyspark, Azuredatabricks, SQL and extracting, ingesting, processing of large data sets.- 2+ years' programming experience in building high quality applications, data pipelines and analytics solutions and data products using Python/PySpark.- 2+ years' experience working...

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India SYNERGY GLOBAL IT SOLUTIONS Full time

    Job Description :- 4+ years' experience in developing applications using Pyspark, Azuredatabricks, SQL and extracting, ingesting, processing of large data sets.- 2+ years' programming experience in building high quality applications, data pipelines and analytics solutions and data products using Python/PySpark.- 2+ years' experience working on...