Pyspark Developer

3 months ago

Chennai, India Cloud Kinetics Technology Solutions Private Ltd Full time

PrimarySkills:

Technical:

  • Handson experience in creating PySpark jobs for data transformation andaggregation in Financial Marketdomain.
  • Experiencein querying and processing from column oriented databases usingpython.
  • Strongunderstanding of Hadoop architecture and design bestpractices.
  • Thoroughunderstanding of fundamental software engineering and computerscience principles: objectoriented design structured designdatabases algorithms data structures usability refactoringdebugging and configurationmanagement
  • Ensureexcellent quality of the code delivered such that stability andresiliency of the production system is notcompromised.
  • Adhereto best practices and coding standards document and publish thesame.

Functional:

  • Strongunderstanding of Financial Markets AssetClasses

Others:

  • Education Degreeor above in Information Technology Computer Science orequivalent
  • Excellentverbal and written communicationsskills
  • Experiencein coaching/developing juniorengineers.
  • Passionateabout learning newtechnologies.
  • Goodknowledge of release process and controlprocedures.
  • Solidunderstanding of software development life cycle models as well asexpert knowledge of both Agile and traditional project managementprinciples and practices and the ability to blend them together inthe right proportions to fit a project and businessenvironment.
  • Priorexperience with SCRUM/Agile methodologies with enterpriselevelapplication developmentprojects.



Requirements

Responsibilities

  • Creatinghigh performance pySpark applications which should be able tohandle millions of rows from various file format to find MarketAbusive Regulations(MAR).
  • Performdata analysis and apply ML/AI based libraries for innovativesolutions to the requirements / problems in MARsolution.
  • Keepthe technical specification documentation updated and versioncontrolled.
  • Thisrole will work closely with business analysts and Tradesurveillanceusers.
  • Provideeffort estimates of based onrequirements.
  • Adhereto best practices codingstandards.


PROGRAMMING SKILLS Must have experience and knowledge of currentJava technologies and methodologies, and hands-on experience on thefollowing: Web front-end experience React JS /EmberJS/HTML/CSS/JavaScript Core Java / JEE / JBoss EAPObject-relational Mappers JPA/Hibernate JMS XML / XSLT JUnit Theapplication of design patterns Test-Driven Development (TDD)Relational database - Oracle An understanding of the followingwould also be advantageous and preferred: Workflow based processingREST API Development and Java Web Services Micro ServicesArchitecture JBoss Rules Jasper

  • Pyspark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Summary:We are seeking a highly skilled Pyspark Developer to join our team at Risk Resources LLP. The ideal candidate will have a strong background in big data processing and a proven track record of developing efficient and scalable data processing applications using Pyspark.Key Responsibilities:Design and develop Pyspark applications for big data...

  • Pyspark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    Pyspark Developer Job DescriptionWe are seeking a highly skilled Pyspark Developer to join our team at Krishpar Technologies Pvt. Ltd. The ideal candidate will have experience in developing Big Data applications using Pyspark on Hadoop, Hive, and/or Kafka, HBase, and MongoDB.Key Responsibilities:Design and develop scalable and efficient Big Data applications...

  • Pyspark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Summary:We are seeking a highly skilled Pyspark developer to join our team at Risk Resources LLP. The ideal candidate will have a strong background in big data processing and a proven track record of developing efficient and scalable data processing applications using Pyspark.Key Responsibilities:Design and develop data processing pipelines using...

  • Pyspark Developer

    4 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Summary:We are seeking a highly skilled Pyspark developer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing, developing, and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities:Design and develop Pyspark applications for big data processingWork with big data...

  • Pyspark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Summary:We are seeking a highly skilled Pyspark developer to join our team at Risk Resources LLP. The ideal candidate will have a strong background in big data processing and a proven track record of developing efficient and scalable applications using Pyspark.Key Responsibilities:Design and develop Pyspark applications for big data processingWork with...

  • Pyspark Developer

    1 week ago

    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    About the RoleWe are seeking an experienced Data Engineer with Pyspark expertise to join our team at Krishpar Technologies Pvt. Ltd.Key ResponsibilitiesDevelop Big Data applications using Pyspark on Hadoop, Hive, and/or Kafka, HBase, and MongoDB.Build Machine Learning models using Pyspark.Deploy applications on Cloud platforms.RequirementsAt least 4-7 years...

  • PySpark Developer

    4 weeks ago

    Chennai, Tamil Nadu, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job Title: Pyspark DeveloperAbout the Role:We are seeking a highly skilled Pyspark Developer to join our team at Cloud Kinetics Technology Solutions Private Ltd. As a Pyspark Developer, you will be responsible for designing, developing, and deploying high-performance PySpark applications that can handle millions of rows from various file formats to find...

  • Pyspark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Job Title: Data Engineer - PysparkJob Summary: We are seeking a highly skilled Data Engineer - Pyspark to join our team at Risk Resources LLP. The ideal candidate will have a strong background in big data processing and a proven track record of developing efficient and scalable data processing applications using Pyspark.Key Responsibilities:Develop and...

  • PySpark Developer

    4 weeks ago

    Pune/Bangalore/Chennai/Hyderabad/Mysore, India Vtricks Technologies Full time

    Job Title: PySpark DeveloperWe are seeking an experienced PySpark Developer to join our team at Vtricks Technologies. As a PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using PySpark and Azure services.Key Responsibilities:Develop and maintain PySpark-based data pipelines using Azure...

  • Pyspark

    1 month ago

    chennai, India Risk Resources LLP Full time

    Overview:The role of a Pyspark developer is crucial in our organization as they are responsible for developing and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities:Experience working in big data platforms for implementing projects with high SLA of data availability and data quality exposure to Azure cloud...

  • Pyspark

    3 weeks ago

    chennai, India Risk Resources LLP Full time

    Overview: The role of a Pyspark developer is crucial in our organization as they are responsible for developing and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities: Experience working in big data platforms for implementing projects with high SLA of data availability and data quality exposure to Azure cloud...

  • Senior PySpark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job Title: Senior PySpark DeveloperJob Summary:We are seeking a highly skilled Senior PySpark Developer to join our team at Cloud Kinetics Technology Solutions Private Ltd. As a Senior PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark.Key Responsibilities:Design and develop...

  • PySpark Developer

    4 weeks ago

    Pune/Bangalore/Chennai/Hyderabad/Mysore, India Vtricks Technologies Full time

    Job Title: PySpark DeveloperWe are seeking an experienced PySpark Developer to join our team at Vtricks Technologies. As a key member of our Agile team, you will be responsible for designing, developing, and maintaining large-scale PySpark-based data pipelines using Azure services.Key Responsibilities:Develop and maintain PySpark-based data pipelines using...

  • Pyspark

    2 months ago

    Chennai, India Risk Resources LLP Full time

    Overview:The role of a Pyspark developer is crucial in our organization as they are responsible for developing and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities:Experience working in big data platforms for implementing projects with high SLA of data availability and data quality exposure to Azure cloud...

  • PySpark Developer

    4 weeks ago

    Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full time

    Job Title: PySpark DeveloperAbout the Role:We are seeking a highly skilled PySpark Developer to join our team at Risk Resources LLP. As a key member of our data engineering team, you will be responsible for designing and implementing Big Data pipelines using PySpark, database migration, transformation, and integration solutions for our Data warehousing...

  • Senior PySpark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job Title: Senior PySpark DeveloperJob Summary:We are seeking a highly skilled Senior PySpark Developer to join our team at Cloud Kinetics Technology Solutions Private Ltd. As a Senior PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark.Key Responsibilities:Design and develop...

  • Senior PySpark Developer

    4 weeks ago

    Chennai, Tamil Nadu, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job Title: Senior PySpark DeveloperAbout the Role:We are seeking a highly skilled Senior PySpark Developer to join our team at Cloud Kinetics Technology Solutions Private Ltd. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying high-performance PySpark applications that can handle large datasets and...

  • Senior PySpark Developer

    4 weeks ago

    Chennai, Tamil Nadu, India Techno Wise Full time

    We are seeking a highly skilled PySpark Developer to join our team at Techno Wise. As a key member of our data engineering team, you will be responsible for designing and building scalable data solutions using PySpark.Key Responsibilities:Design, build, and unit test applications in Spark/PysparkDevelop in-depth knowledge of Hadoop, Spark, and similar...

  • Senior PySpark Developer

    4 weeks ago

    Chennai, Tamil Nadu, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job Title: Senior PySpark DeveloperJob Summary:We are seeking a highly skilled Senior PySpark Developer to join our team at Cloud Kinetics Technology Solutions Private Ltd. The ideal candidate will have hands-on experience in creating high-performance PySpark applications for data transformation and aggregation in the Financial Markets domain.Key...

  • Pyspark Developer Position

    2 weeks ago

    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    Job Title: Pyspark Developer PositionCompany: Krishpar Technologies Pvt. LtdDescription:We are seeking a skilled Pyspark Developer to join our team. The successful candidate will have expertise in Big Data technologies, including Hadoop and Spark.Responsibilities:- Implementing DevOps / CI-CD using Bitbucket, Jenkins, etc.,- Implementing Test Automation...