Pyspark Developer

2 months ago

Chennai, India Cloud Kinetics Technology Solutions Private Ltd Full time

Primary Skills:

Technical:

  • Hands on experience in creating PySpark jobs for data transformation and aggregation in Financial Market domain.
  • Experience in querying and processing from column oriented databases using python.
  • Strong understanding of Hadoop architecture and design best practices.
  • Thorough understanding of fundamental software engineering and computer science principles: objectoriented design structured design databases algorithms data structures usability refactoring debugging and configuration management
  • Ensure excellent quality of the code delivered such that stability and resiliency of the production system is not compromised.
  • Adhere to best practices and coding standards document and publish the same.

Functional:

  • Strong understanding of Financial Markets Asset Classes

Others:

  • Education Degree or above in Information Technology Computer Science or equivalent
  • Excellent verbal and written communications skills
  • Experience in coaching/developing junior engineers.
  • Passionate about learning new technologies.
  • Good knowledge of release process and control procedures.
  • Solid understanding of software development life cycle models as well as expert knowledge of both Agile and traditional project management principles and practices and the ability to blend them together in the right proportions to fit a project and business environment.
  • Prior experience with SCRUM/Agile methodologies with enterpriselevel application development projects.



Requirements

Responsibilities

  • Creating high performance pySpark applications which should be able to handle millions of rows from various file format to find Market Abusive Regulations (MAR).
  • Perform data analysis and apply ML/AI based libraries for innovative solutions to the requirements / problems in MAR solution.
  • Keep the technical specification documentation updated and version controlled.
  • This role will work closely with business analysts and Trade surveillance users.
  • Provide effort estimates of based on requirements.
  • Adhere to best practices coding standards.


PROGRAMMING SKILLS Must have experience and knowledge of current Java technologies and methodologies, and hands-on experience on the following: Web front-end experience React JS /Ember JS/HTML/CSS/JavaScript Core Java / JEE / JBoss EAP Object-relational Mappers JPA/Hibernate JMS XML / XSLT JUnit The application of design patterns Test-Driven Development (TDD) Relational database - Oracle An understanding of the following would also be advantageous and preferred: Workflow based processing REST API Development and Java Web Services Micro Services Architecture JBoss Rules Jasper

  • Pyspark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Summary:We are seeking a highly skilled Pyspark Developer to join our team at Risk Resources LLP. The ideal candidate will have a strong background in big data processing and a proven track record of developing efficient and scalable data processing applications using Pyspark.Key Responsibilities:Design and develop Pyspark applications for big data...

  • Pyspark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    Pyspark Developer Job DescriptionWe are seeking a highly skilled Pyspark Developer to join our team at Krishpar Technologies Pvt. Ltd. The ideal candidate will have experience in developing Big Data applications using Pyspark on Hadoop, Hive, and/or Kafka, HBase, and MongoDB.Key Responsibilities:Design and develop scalable and efficient Big Data applications...

  • Pyspark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Summary:We are seeking a highly skilled Pyspark developer to join our team at Risk Resources LLP. The ideal candidate will have a strong background in big data processing and a proven track record of developing efficient and scalable data processing applications using Pyspark.Key Responsibilities:Design and develop data processing pipelines using...

  • Pyspark Developer

    4 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Summary:We are seeking a highly skilled Pyspark developer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing, developing, and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities:Design and develop Pyspark applications for big data processingWork with big data...

  • Pyspark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Summary:We are seeking a highly skilled Pyspark developer to join our team at Risk Resources LLP. The ideal candidate will have a strong background in big data processing and a proven track record of developing efficient and scalable applications using Pyspark.Key Responsibilities:Design and develop Pyspark applications for big data processingWork with...

  • Pyspark Developer

    1 week ago

    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    About the RoleWe are seeking an experienced Data Engineer with Pyspark expertise to join our team at Krishpar Technologies Pvt. Ltd.Key ResponsibilitiesDevelop Big Data applications using Pyspark on Hadoop, Hive, and/or Kafka, HBase, and MongoDB.Build Machine Learning models using Pyspark.Deploy applications on Cloud platforms.RequirementsAt least 4-7 years...

  • PySpark Developer

    4 weeks ago

    Chennai, Tamil Nadu, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job Title: Pyspark DeveloperAbout the Role:We are seeking a highly skilled Pyspark Developer to join our team at Cloud Kinetics Technology Solutions Private Ltd. As a Pyspark Developer, you will be responsible for designing, developing, and deploying high-performance PySpark applications that can handle millions of rows from various file formats to find...

  • Pyspark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Title: Data Engineer - PysparkJob Summary: We are seeking a highly skilled Data Engineer - Pyspark to join our team at Risk Resources LLP. The ideal candidate will have a strong background in big data processing and a proven track record of developing efficient and scalable data processing applications using Pyspark.Key Responsibilities:Develop and...

  • PySpark Developer

    4 weeks ago

    Pune/Bangalore/Chennai/Hyderabad/Mysore, India Vtricks Technologies Full time

    Job Title: PySpark DeveloperWe are seeking an experienced PySpark Developer to join our team at Vtricks Technologies. As a PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using PySpark and Azure services.Key Responsibilities:Develop and maintain PySpark-based data pipelines using Azure...

  • Pyspark

    1 month ago

    chennai, India Risk Resources LLP Full time

    Overview:The role of a Pyspark developer is crucial in our organization as they are responsible for developing and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities:Experience working in big data platforms for implementing projects with high SLA of data availability and data quality exposure to Azure cloud...

  • Pyspark

    3 weeks ago

    chennai, India Risk Resources LLP Full time

    Overview: The role of a Pyspark developer is crucial in our organization as they are responsible for developing and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities: Experience working in big data platforms for implementing projects with high SLA of data availability and data quality exposure to Azure cloud...

  • Senior PySpark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job Title: Senior PySpark DeveloperJob Summary:We are seeking a highly skilled Senior PySpark Developer to join our team at Cloud Kinetics Technology Solutions Private Ltd. As a Senior PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark.Key Responsibilities:Design and develop...

  • PySpark Developer

    4 weeks ago

    Pune/Bangalore/Chennai/Hyderabad/Mysore, India Vtricks Technologies Full time

    Job Title: PySpark DeveloperWe are seeking an experienced PySpark Developer to join our team at Vtricks Technologies. As a key member of our Agile team, you will be responsible for designing, developing, and maintaining large-scale PySpark-based data pipelines using Azure services.Key Responsibilities:Develop and maintain PySpark-based data pipelines using...

  • Pyspark

    2 months ago

    Chennai, India Risk Resources LLP Full time

    Overview:The role of a Pyspark developer is crucial in our organization as they are responsible for developing and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities:Experience working in big data platforms for implementing projects with high SLA of data availability and data quality exposure to Azure cloud...

  • PySpark Developer

    4 weeks ago

    Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full time

    Job Title: PySpark DeveloperAbout the Role:We are seeking a highly skilled PySpark Developer to join our team at Risk Resources LLP. As a key member of our data engineering team, you will be responsible for designing and implementing Big Data pipelines using PySpark, database migration, transformation, and integration solutions for our Data warehousing...

  • Senior PySpark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job Title: Senior PySpark DeveloperJob Summary:We are seeking a highly skilled Senior PySpark Developer to join our team at Cloud Kinetics Technology Solutions Private Ltd. As a Senior PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark.Key Responsibilities:Design and develop...

  • Senior PySpark Developer

    4 weeks ago

    Chennai, Tamil Nadu, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job Title: Senior PySpark DeveloperAbout the Role:We are seeking a highly skilled Senior PySpark Developer to join our team at Cloud Kinetics Technology Solutions Private Ltd. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying high-performance PySpark applications that can handle large datasets and...

  • Senior PySpark Developer

    4 weeks ago

    Chennai, Tamil Nadu, India Techno Wise Full time

    We are seeking a highly skilled PySpark Developer to join our team at Techno Wise. As a key member of our data engineering team, you will be responsible for designing and building scalable data solutions using PySpark.Key Responsibilities:Design, build, and unit test applications in Spark/PysparkDevelop in-depth knowledge of Hadoop, Spark, and similar...

  • Senior PySpark Developer

    4 weeks ago

    Chennai, Tamil Nadu, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job Title: Senior PySpark DeveloperJob Summary:We are seeking a highly skilled Senior PySpark Developer to join our team at Cloud Kinetics Technology Solutions Private Ltd. The ideal candidate will have hands-on experience in creating high-performance PySpark applications for data transformation and aggregation in the Financial Markets domain.Key...

  • Pyspark Developer Position

    2 weeks ago

    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    Job Title: Pyspark Developer PositionCompany: Krishpar Technologies Pvt. LtdDescription:We are seeking a skilled Pyspark Developer to join our team. The successful candidate will have expertise in Big Data technologies, including Hadoop and Spark.Responsibilities:- Implementing DevOps / CI-CD using Bitbucket, Jenkins, etc.,- Implementing Test Automation...