CGI - Python PySpark Developer - Data Management System
4 weeks ago
Job Description :
- Designing, installing, testing, and maintaining scalable data management systems
- Ensuring systems meet business requirements and industry standards
- Integrating new data management tools into company ecosystems
- Creating custom software components and analytics applications
- Research data acquisition opportunities and new uses for existing data
- Experience in application development experience in Scala, Spark, scalatest/Junit libraries with maven.
- Experience in application development experience in Python & PySpark/Spark.
- Experience in working on OO principles.
- Ability to write SQL Queries.
- Ability to write bash shell scripts.
- Ability to learn& adapt.
- Ability to communicate in clear & concise way.
- Experience in writing Unit test cases & perform thorough unit testing.
- CI/CD concepts.
- Unix/Linux basics.
- REST API basics.
-
Bangalore,Chennai,Pune,Hyderabad, India CGI Information Systems and Management Consultants Full timeJob Description : - Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Integrating new data management tools into company ecosystems- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for...
-
Bangalore/Chennai/Pune/Hyderabad, IN CGI Information Systems and Management Consultants Full timeJob Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Integrating new data management tools into company ecosystems- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for...
-
CGI - Data Engineer - Python/Hadoop
1 week ago
Bangalore/Chennai/Pune/Hyderabad/Mumbai, India CGI Full timeJob Title : Data Engineer SSE Work Location : Bangalore/Chennai/Pune/Hyderabad/Mumbai (Any CGI location). - Data pipeline/workflow development in GCP, Hadoop, Kubernetes, ELK - Supporting existing production applications - Assist in connectivity and environment development The candidate will need to understand the requirements and work mostly...
-
Python Production Support
4 days ago
Hyderabad, India CGI Full timeJob Title: Python Production Support Position: Senior Software Engineer Experience: 5 - 8 Years Category: Software Development/ Engineering Main location: Bangalore/Hyderabad Position ID: J1023-0909 Employment Type: Full Time Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 4 years of relevant...
-
Python/PySpark Developer
4 weeks ago
Anywhere in India,Multiple Locations,Bangalore,Hyderabad,Pune,Chennai CA-One India Full timeJob descriptionJob Opportunity: Pyspark DeveloperExperience: 6+ YearsLocation: Bangalore, Hyderabad, Pune, ChennaiJob description : Good hands-on experience in Pyspark, preferably more than 5 years Should have good knowledge of Python and spark concepts Develop and maintain data pipelines and ETL processes using Python and Pyspark. Design, implement, and...
-
Dba
4 days ago
Hyderabad, India CGI Full timeJob Title: DBA Position: Senior Software Engineer Experience: 5 - 8 Years Category: Software Development/ Engineering Main location: Bangalore/Hyderabad Position ID: J1023-1704 Employment Type: Full Time Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 4 years of relevant experience. **Insights you can act...
-
Python Developer
5 days ago
hyderabad, India PURVIEW Full timeRole: Python Developer (Python +Airflow +AWS)Location: HyderabadDuration: PermanentJob Description· Strong knowledge of Python/Pyspark and Bash scripting· Experience working with Dataframes, Pandas, Scipy, Numpy libraries is a plus· Strong hands-on working knowledge in the AWS Components Experience in AWS Native Services: IAM, EC2, S3, API Gateway, Secret...
-
Data Engineer
4 weeks ago
Bangalore,Hyderabad,Chennai,Pune,Gurgaon,Gurugram, India ADV Full timeMandatory Skills : #Pyspark #Python #AWS #Data Pipeline #Python #PySpark #Hadoop #Spark #SQL #Big Data #Kafka #Scala Organization : AltimetrikRole : Data EngineerJob Description : Technical & Other Skills : - 5+ years of working experience in scalable data pipeline using Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill and...
-
AWS Data Engineer
1 week ago
Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full timeJob Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...
-
AWS Data Engineer
3 weeks ago
Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, IN Change leaders Full timeJob Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...
-
Python Developer
5 days ago
hyderabad, India PURVIEW Full timeRole: Python Developer (Python +Airflow +AWS) Location: Hyderabad Duration: Permanent Job Description · Strong knowledge of Python/Pyspark and Bash scripting · Experience working with Dataframes, Pandas, Scipy, Numpy libraries is a plus · Strong hands-on working knowledge in the AWS Components Experience in AWS Native Services: IAM, EC2, S3, API Gateway,...
-
Python Developer
5 days ago
Hyderabad, India PURVIEW Full timeRole: Python Developer (Python +Airflow +AWS)Location: HyderabadDuration: PermanentJob Description· Strong knowledge of Python/Pyspark and Bash scripting· Experience working with Dataframes, Pandas, Scipy, Numpy libraries is a plus· Strong hands-on working knowledge in the AWS Components Experience in AWS Native Services: IAM, EC2, S3, API Gateway, Secret...
-
Python Developer
5 days ago
Hyderabad, India PURVIEW Full timeRole: Python Developer (Python +Airflow +AWS)Location: HyderabadDuration: PermanentJob Description· Strong knowledge of Python/Pyspark and Bash scripting· Experience working with Dataframes, Pandas, Scipy, Numpy libraries is a plus· Strong hands-on working knowledge in the AWS Components Experience in AWS Native Services: IAM, EC2, S3, API Gateway, Secret...
-
Pyspark + Python
4 weeks ago
Hyderabad, India Nityo Infotech Full timeDescription , India , Job , Level , Location , PAN , Python ,Pyspark + python Experience Required 9 - 12 Years Industry Type IT Employment Type Permanent Location India
-
Pyspark + Python
4 days ago
hyderabad, India Nityo Infotech Full timeDescription , India , Job , Level , Location , PAN , Python ,Pyspark + python Experience Required 9 - 12 Years Industry Type IT Employment Type Permanent Location India
-
Python/pyspark/scala
23 hours ago
Hyderabad, India Xpetize Full time**Years of Experience : 3+** Years** **Joining Time frame **:immediate to 1 Week** **Positions: 4** **Mandatory skills**: **Mandatory skills**: - Experience in Python/Pyspark/Scala - SQL - GCP/AWS/Azure - Hadoop / HDFS/Other Databases - Airflow/Other Automation tools - Linux/ Bash scripting - Kafka/Flume/Kinesis/Data Streaming **Job Type : Full...
-
Data Engineer
4 weeks ago
hyderabad, India SYNERGY GLOBAL IT SOLUTIONS Full timeJob Description : - 4+ years' experience in developing applications using Pyspark, Azuredatabricks, SQL and extracting, ingesting, processing of large data sets.- 2+ years' programming experience in building high quality applications, data pipelines and analytics solutions and data products using Python/PySpark.- 2+ years' experience working on cloud...
-
Data Engineer
1 week ago
Hyderabad, India SYNERGY GLOBAL IT SOLUTIONS Full timeJob Description :- 4+ years' experience in developing applications using Pyspark, Azuredatabricks, SQL and extracting, ingesting, processing of large data sets.- 2+ years' programming experience in building high quality applications, data pipelines and analytics solutions and data products using Python/PySpark.- 2+ years' experience working on...
-
Data Engineer
1 week ago
Hyderabad, India SYNERGY GLOBAL IT SOLUTIONS Full timeJob Description : - 4+ years' experience in developing applications using Pyspark, Azuredatabricks, SQL and extracting, ingesting, processing of large data sets.- 2+ years' programming experience in building high quality applications, data pipelines and analytics solutions and data products using Python/PySpark.- 2+ years' experience working...
-
Data Engineer
3 weeks ago
Hyderabad, Telangana, India SYNERGY GLOBAL IT SOLUTIONS Full timeJob Description :- 4+ years' experience in developing applications using Pyspark, Azuredatabricks, SQL and extracting, ingesting, processing of large data sets.- 2+ years' programming experience in building high quality applications, data pipelines and analytics solutions and data products using Python/PySpark.- 2+ years' experience working on...