CGI - Python PySpark Developer - Data Management System
4 weeks ago
Job Description :
- Designing, installing, testing, and maintaining scalable data management systems
- Ensuring systems meet business requirements and industry standards
- Integrating new data management tools into company ecosystems
- Creating custom software components and analytics applications
- Research data acquisition opportunities and new uses for existing data
- Experience in application development experience in Scala, Spark, scalatest/Junit libraries with maven.
- Experience in application development experience in Python & PySpark/Spark.
- Experience in working on OO principles.
- Ability to write SQL Queries.
- Ability to write bash shell scripts.
- Ability to learn& adapt.
- Ability to communicate in clear & concise way.
- Experience in writing Unit test cases & perform thorough unit testing.
- CI/CD concepts.
- Unix/Linux basics.
- REST API basics.
-
Bangalore/Chennai/Pune/Hyderabad, IN CGI Information Systems and Management Consultants Full timeJob Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Integrating new data management tools into company ecosystems- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for...
-
Hyderabad, India CGI Information Systems and Management Consultants Full timeJob Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Integrating new data management tools into company ecosystems- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for...
-
CGI - Data Engineer - Python/Hadoop
1 week ago
Bangalore/Chennai/Pune/Hyderabad/Mumbai, India CGI Full timeJob Title : Data Engineer SSE Work Location : Bangalore/Chennai/Pune/Hyderabad/Mumbai (Any CGI location). - Data pipeline/workflow development in GCP, Hadoop, Kubernetes, ELK - Supporting existing production applications - Assist in connectivity and environment development The candidate will need to understand the requirements and work mostly...
-
Python Pyspark Developer
3 weeks ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...
-
Python Pyspark Developer
3 weeks ago
chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...
-
Data Engg Python Pyspark
3 days ago
chennai, India Virtusa Full timeData Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...
-
Python Pyspark Developer
2 weeks ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilitiesDesign, develop, and deploy scalable data processing applications using Python and PySpark.Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions.Write efficient and optimized code to process and analyze large volumes of data.Implement data ingestion processes from various data...
-
Python/PySpark Developer
4 weeks ago
Anywhere in India,Multiple Locations,Bangalore,Hyderabad,Pune,Chennai CA-One India Full timeJob descriptionJob Opportunity: Pyspark DeveloperExperience: 6+ YearsLocation: Bangalore, Hyderabad, Pune, ChennaiJob description : Good hands-on experience in Pyspark, preferably more than 5 years Should have good knowledge of Python and spark concepts Develop and maintain data pipelines and ETL processes using Python and Pyspark. Design, implement, and...
-
Data Architect
23 hours ago
Pune, Maharashtra, India CGI Full timeExp: 4+ years Location: Pune **Job Description**: Primary Skills (Technical Must Haves) - Very good exp in designing data and AI products - Have strong experience in designing and implementing medallion Datalake architecture - Strong experience in handling PII data and legal regulations - Having experience in Data governance and Data Modelling - Very...
-
Data Engg Python Pyspark
2 weeks ago
chennai, India Virtusa Full timeJob description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files Ability to work independently on...
-
Data Engineer
4 weeks ago
Chennai, India HNM Solutions Full timeRole : Data Engineer with PythonLocation : ChennaiExperience : 5+ yearsRequirements :Data Engineer with Python experts :Minimum 5 years in Data engineering role with Python along with relevant experience.1. Strong working experience in Python programming.2. Expertise with one of the Python frameworks - pyspark,3. strong experience with using pandas, numpy,...
-
Data Engineer
4 weeks ago
Bangalore,Hyderabad,Chennai,Pune,Gurgaon,Gurugram, India ADV Full timeMandatory Skills : #Pyspark #Python #AWS #Data Pipeline #Python #PySpark #Hadoop #Spark #SQL #Big Data #Kafka #Scala Organization : AltimetrikRole : Data EngineerJob Description : Technical & Other Skills : - 5+ years of working experience in scalable data pipeline using Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill and...
-
Python Production Support
3 days ago
Hyderabad, India CGI Full timeJob Title: Python Production Support Position: Senior Software Engineer Experience: 5 - 8 Years Category: Software Development/ Engineering Main location: Bangalore/Hyderabad Position ID: J1023-0909 Employment Type: Full Time Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 4 years of relevant...
-
Senior Python Developer
4 weeks ago
Bangalore, India Spruce IT Pvt. Ltd. Full timeJob Role: Sr Python Developer. Skills: PySpark / Flink / Apache Spark / Scala. Experience: 6+ years. Location: Pan India. JD: - Sr Python Developer.- Must have Hands on experience- in python.- Develop pipeline objects using PySpark / Flink / Apache Spark / Scala. - Candidates preferred who have experience in building real-time data streams using Flink and...
-
Senior Python Developer
2 weeks ago
Bangalore, Karnataka, India Spruce IT Pvt. Ltd. Full timeJob Role: Sr Python Developer. Skills: PySpark / Flink / Apache Spark / Scala. Experience: 6+ years. Location: Pan India. JD: - Sr Python Developer.- Must have Hands on experience- in python.- Develop pipeline objects using PySpark / Flink / Apache Spark / Scala. - Candidates preferred who have experience in building real-time data streams using Flink and...
-
AWS Data Engineer
1 week ago
Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full timeJob Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...
-
AWS Data Engineer
2 weeks ago
Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, IN Change leaders Full timeJob Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...
-
Jira System Administrator
2 hours ago
Chennai, Tamil Nadu, India CGI Full timePrimary Responsibilities: - Functional Analysis & Improvement: Analyze and review our current JIRA functionality. Document the existing framework and identify opportunities for enhancement, ensuring our tools are aligned with our operational goals. - JIRA Administration: Work with JIRA filters, reporting, dashboards, workflows, fields, and overall JIRA...
-
Azure Databricks Engineer/Data Engineer
1 week ago
Bangalore/Chennai/Pune/Gurgaon/Gurugram/Kolkata, India Pylon Management Consulting Full timePrimary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Triage issues to find gaps in existing pipelines and fix the issues- Work with business to understand the need in reporting layer and develop data...
-
Senior Data Engineer
4 weeks ago
Bangalore, India Logic Planet IT Services Full timeJob Description : - Calling all talented data engineers with 4-6 years of experience or more!. - We are looking for both senior and lead data engineers who are proficient in Python, PySpark, SQL, Databricks, Kafka, Cloud, AWS, and GIT. - This is your chance to showcase your expertise and make a significant impact in the world of data. Skills Required...