Current jobs related to Pyspark Lead Developer - Chennai - Cloud Kinetics Technology Solutions Private Ltd

  • Pyspark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    Pyspark Developer Job DescriptionWe are seeking a highly skilled Pyspark Developer to join our team at Krishpar Technologies Pvt. Ltd. The ideal candidate will have experience in developing Big Data applications using Pyspark on Hadoop, Hive, and/or Kafka, HBase, and MongoDB.Key Responsibilities:Design and develop scalable and efficient Big Data applications...

  • Pyspark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Summary:We are seeking a highly skilled Pyspark Developer to join our team at Risk Resources LLP. The ideal candidate will have a strong background in big data processing and a proven track record of developing efficient and scalable data processing applications using Pyspark.Key Responsibilities:Design and develop Pyspark applications for big data...

  • PySpark Lead Developer Architect

    4 weeks ago

    Chennai, Tamil Nadu, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job DescriptionJob SummaryWe are seeking a highly skilled PySpark Lead Developer Architect to join our team at Cloud Kinetics Technology Solutions Private Ltd. The ideal candidate will have extensive experience in creating high-performance PySpark applications, data analysis, and machine learning/AI-based solutions.Key ResponsibilitiesDesign and develop...

  • Pyspark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Summary:We are seeking a highly skilled Pyspark developer to join our team at Risk Resources LLP. The ideal candidate will have a strong background in big data processing and a proven track record of developing efficient and scalable data processing applications using Pyspark.Key Responsibilities:Design and develop data processing pipelines using...

  • Pyspark Developer

    4 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Summary:We are seeking a highly skilled Pyspark developer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing, developing, and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities:Design and develop Pyspark applications for big data processingWork with big data...

  • Pyspark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Summary:We are seeking a highly skilled Pyspark developer to join our team at Risk Resources LLP. The ideal candidate will have a strong background in big data processing and a proven track record of developing efficient and scalable applications using Pyspark.Key Responsibilities:Design and develop Pyspark applications for big data processingWork with...

  • Pyspark Developer

    1 week ago

    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    About the RoleWe are seeking an experienced Data Engineer with Pyspark expertise to join our team at Krishpar Technologies Pvt. Ltd.Key ResponsibilitiesDevelop Big Data applications using Pyspark on Hadoop, Hive, and/or Kafka, HBase, and MongoDB.Build Machine Learning models using Pyspark.Deploy applications on Cloud platforms.RequirementsAt least 4-7 years...

  • PySpark Developer

    4 weeks ago

    Chennai, Tamil Nadu, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job Title: Pyspark DeveloperAbout the Role:We are seeking a highly skilled Pyspark Developer to join our team at Cloud Kinetics Technology Solutions Private Ltd. As a Pyspark Developer, you will be responsible for designing, developing, and deploying high-performance PySpark applications that can handle millions of rows from various file formats to find...

  • Pyspark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Title: Data Engineer - PysparkJob Summary: We are seeking a highly skilled Data Engineer - Pyspark to join our team at Risk Resources LLP. The ideal candidate will have a strong background in big data processing and a proven track record of developing efficient and scalable data processing applications using Pyspark.Key Responsibilities:Develop and...

  • Senior PySpark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job Title: Senior PySpark DeveloperJob Summary:We are seeking a highly skilled Senior PySpark Developer to join our team at Cloud Kinetics Technology Solutions Private Ltd. As a Senior PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark.Key Responsibilities:Design and develop...

  • Pyspark Lead Developer Architect

    2 months ago

    Chennai, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Primary Skills:Technical:Must be a Subject Matter Expert in PySpark.Hands on experience in creating PySpark jobs for data transformation and aggregation in Financial Market domain.Experience in querying data from column oriented databases.Strong understanding of Hadoop architecture and design best practices.Thorough understanding of fundamental software...

  • Pyspark Lead Developer Architect

    1 month ago

    chennai, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Primary Skills:Technical:Must be a Subject Matter Expert in PySpark.Hands on experience in creating PySpark jobs for data transformation and aggregation in Financial Market domain.Experience in querying data from column oriented databases.Strong understanding of Hadoop architecture and design best practices.Thorough understanding of fundamental software...

  • Pyspark Lead Developer Architect

    3 weeks ago

    chennai, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Primary Skills: Technical: Must be a Subject Matter Expert in PySpark.Hands on experience in creating PySpark jobs for data transformation and aggregation in Financial Market domain.Experience in querying data from column oriented databases.Strong understanding of Hadoop architecture and design best practices.Thorough understanding of fundamental software...

  • PySpark Developer

    4 weeks ago

    Pune/Bangalore/Chennai/Hyderabad/Mysore, India Vtricks Technologies Full time

    Job Title: PySpark DeveloperWe are seeking an experienced PySpark Developer to join our team at Vtricks Technologies. As a PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using PySpark and Azure services.Key Responsibilities:Develop and maintain PySpark-based data pipelines using Azure...

  • Pyspark

    1 month ago

    chennai, India Risk Resources LLP Full time

    Overview:The role of a Pyspark developer is crucial in our organization as they are responsible for developing and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities:Experience working in big data platforms for implementing projects with high SLA of data availability and data quality exposure to Azure cloud...

  • Pyspark

    3 weeks ago

    chennai, India Risk Resources LLP Full time

    Overview: The role of a Pyspark developer is crucial in our organization as they are responsible for developing and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities: Experience working in big data platforms for implementing projects with high SLA of data availability and data quality exposure to Azure cloud...

  • PySpark Developer

    4 weeks ago

    Pune/Bangalore/Chennai/Hyderabad/Mysore, India Vtricks Technologies Full time

    Job Title: PySpark DeveloperWe are seeking an experienced PySpark Developer to join our team at Vtricks Technologies. As a key member of our Agile team, you will be responsible for designing, developing, and maintaining large-scale PySpark-based data pipelines using Azure services.Key Responsibilities:Develop and maintain PySpark-based data pipelines using...

  • PySpark Developer

    4 weeks ago

    Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full time

    Job Title: PySpark DeveloperAbout the Role:We are seeking a highly skilled PySpark Developer to join our team at Risk Resources LLP. As a key member of our data engineering team, you will be responsible for designing and implementing Big Data pipelines using PySpark, database migration, transformation, and integration solutions for our Data warehousing...

  • Pyspark

    2 months ago

    Chennai, India Risk Resources LLP Full time

    Overview:The role of a Pyspark developer is crucial in our organization as they are responsible for developing and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities:Experience working in big data platforms for implementing projects with high SLA of data availability and data quality exposure to Azure cloud...

  • Senior PySpark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job Title: Senior PySpark DeveloperJob Summary:We are seeking a highly skilled Senior PySpark Developer to join our team at Cloud Kinetics Technology Solutions Private Ltd. As a Senior PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark.Key Responsibilities:Design and develop...

Pyspark Lead Developer

3 months ago

Chennai, India Cloud Kinetics Technology Solutions Private Ltd Full time


Primary Skills:

Technical:

  • Must be a Subject Matter Expert in PySpark.
  • Hands on experience in creating PySpark jobs for data transformation and aggregation in Financial Market domain.
  • Experience in querying data from column oriented databases.
  • Strong understanding of Hadoop architecture and design best practices.
  • Thorough understanding of fundamental software engineering and computer science principles: object-oriented design, structured design, databases, algorithms, data structures, usability, refactoring, debugging, and configuration management
  • Ensure excellent quality of the code delivered such that stability and resiliency of the production system is not compromised.
  • Evaluate and implement innovative and continuous design improvements to PySpark framework.
  • Keeps current with new practice, technical developments, and innovation in market for potential use as solutions to requirements.
  • Adhere to best practices and coding standards, document and publish the same.
  • Manage and support / maintain Cyber Risk, Resilience Risk, Stability Risks of application and drive towards low risk environment.

Functional:

  • Strong understanding of Financial Markets Asset Classes


Requirements

Responsibilities

  • Creating high performance pySpark applications which should be able to handle millions of rows from various file format to find Market Abusive Regulations (MAR).
  • Perform data analysis and apply ML/AI based libraries for innovative solutions to the requirements / problems in MAR solution.
  • Keep the technical specification documentation updated and version controlled.
  • This role will work closely with business analysts and Trade surveillance users.
  • Provide effort estimates of based on requirements.
  • Adhere to best practices, coding standards.