CGI - Python PySpark Developer - Data Management System

4 weeks ago


BangaloreChennaiPuneHyderabad, India CGI Information Systems and Management Consultants Full time

Job Description :


- Designing, installing, testing, and maintaining scalable data management systems

- Ensuring systems meet business requirements and industry standards

- Integrating new data management tools into company ecosystems

- Creating custom software components and analytics applications

- Research data acquisition opportunities and new uses for existing data

- Experience in application development experience in Scala, Spark, scalatest/Junit libraries with maven.

- Experience in application development experience in Python & PySpark/Spark.

- Experience in working on OO principles.

- Ability to write SQL Queries.

- Ability to write bash shell scripts.

- Ability to learn& adapt.

- Ability to communicate in clear & concise way.

- Experience in writing Unit test cases & perform thorough unit testing.

- CI/CD concepts.

- Unix/Linux basics.

- REST API basics.

(ref:hirist.tech)

  • Bangalore/Chennai/Pune/Hyderabad, IN CGI Information Systems and Management Consultants Full time

    Job Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Integrating new data management tools into company ecosystems- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for...


  • Hyderabad, India CGI Information Systems and Management Consultants Full time

    Job Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Integrating new data management tools into company ecosystems- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for...


  • Bangalore/Chennai/Pune/Hyderabad/Mumbai, India CGI Full time

    Job Title : Data Engineer SSE Work Location : Bangalore/Chennai/Pune/Hyderabad/Mumbai (Any CGI location). - Data pipeline/workflow development in GCP, Hadoop, Kubernetes, ELK - Supporting existing production applications - Assist in connectivity and environment development The candidate will need to understand the requirements and work mostly...


  • Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...


  • chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...


  • chennai, India Virtusa Full time

    Data Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...


  • Chennai, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign, develop, and deploy scalable data processing applications using Python and PySpark.Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions.Write efficient and optimized code to process and analyze large volumes of data.Implement data ingestion processes from various data...


  • Anywhere in India,Multiple Locations,Bangalore,Hyderabad,Pune,Chennai CA-One India Full time

    Job descriptionJob Opportunity: Pyspark DeveloperExperience: 6+ YearsLocation: Bangalore, Hyderabad, Pune, ChennaiJob description : Good hands-on experience in Pyspark, preferably more than 5 years Should have good knowledge of Python and spark concepts Develop and maintain data pipelines and ETL processes using Python and Pyspark. Design, implement, and...

  • Data Architect

    23 hours ago


    Pune, Maharashtra, India CGI Full time

    Exp: 4+ years Location: Pune **Job Description**: Primary Skills (Technical Must Haves) - Very good exp in designing data and AI products - Have strong experience in designing and implementing medallion Datalake architecture - Strong experience in handling PII data and legal regulations - Having experience in Data governance and Data Modelling - Very...


  • chennai, India Virtusa Full time

    Job description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files Ability to work independently on...

  • Data Engineer

    4 weeks ago


    Chennai, India HNM Solutions Full time

    Role : Data Engineer with PythonLocation : ChennaiExperience : 5+ yearsRequirements :Data Engineer with Python experts :Minimum 5 years in Data engineering role with Python along with relevant experience.1. Strong working experience in Python programming.2. Expertise with one of the Python frameworks - pyspark,3. strong experience with using pandas, numpy,...

  • Data Engineer

    4 weeks ago


    Bangalore,Hyderabad,Chennai,Pune,Gurgaon,Gurugram, India ADV Full time

    Mandatory Skills : #Pyspark #Python #AWS #Data Pipeline #Python #PySpark #Hadoop #Spark #SQL #Big Data #Kafka #Scala Organization : AltimetrikRole : Data EngineerJob Description : Technical & Other Skills : - 5+ years of working experience in scalable data pipeline using Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill and...


  • Hyderabad, India CGI Full time

    Job Title: Python Production Support Position: Senior Software Engineer Experience: 5 - 8 Years Category: Software Development/ Engineering Main location: Bangalore/Hyderabad Position ID: J1023-0909 Employment Type: Full Time Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 4 years of relevant...


  • Bangalore, India Spruce IT Pvt. Ltd. Full time

    Job Role: Sr Python Developer. Skills: PySpark / Flink / Apache Spark / Scala. Experience: 6+ years. Location: Pan India. JD: - Sr Python Developer.- Must have Hands on experience- in python.- Develop pipeline objects using PySpark / Flink / Apache Spark / Scala. - Candidates preferred who have experience in building real-time data streams using Flink and...


  • Bangalore, Karnataka, India Spruce IT Pvt. Ltd. Full time

    Job Role: Sr Python Developer. Skills: PySpark / Flink / Apache Spark / Scala. Experience: 6+ years. Location: Pan India. JD: - Sr Python Developer.- Must have Hands on experience- in python.- Develop pipeline objects using PySpark / Flink / Apache Spark / Scala. - Candidates preferred who have experience in building real-time data streams using Flink and...

  • AWS Data Engineer

    1 week ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • AWS Data Engineer

    2 weeks ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, IN Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...


  • Chennai, Tamil Nadu, India CGI Full time

    Primary Responsibilities: - Functional Analysis & Improvement: Analyze and review our current JIRA functionality. Document the existing framework and identify opportunities for enhancement, ensuring our tools are aligned with our operational goals. - JIRA Administration: Work with JIRA filters, reporting, dashboards, workflows, fields, and overall JIRA...


  • Bangalore/Chennai/Pune/Gurgaon/Gurugram/Kolkata, India Pylon Management Consulting Full time

    Primary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Triage issues to find gaps in existing pipelines and fix the issues- Work with business to understand the need in reporting layer and develop data...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, India Logic Planet IT Services Full time

    Job Description : - Calling all talented data engineers with 4-6 years of experience or more!. - We are looking for both senior and lead data engineers who are proficient in Python, PySpark, SQL, Databricks, Kafka, Cloud, AWS, and GIT. - This is your chance to showcase your expertise and make a significant impact in the world of data. Skills Required...