Software Engineer, PySpark

1 month ago

Gurugram, India NatWest Digital X Full time

Join us as a Software Engineer

  • This is an opportunity for a driven Software Engineer to design and engineer software with the customer or user experience as the primary objective
  • We’ll look to you to engineer and maintain innovative, customer centric, high performance, secure and robust solutions
  • It’s a chance to hone your existing technical skills and advance your career as you develop the discipline of software engineering across the business
  • We're offering this role at senior analyst levelWhat you'll do

    In your new role, you’ll design, develop and deploy applications capable of meeting and exceeding the anticipated load, performance and availability volumes, including load balancing, performance testing and benchmarking. You’ll be working within a feature team and using extensive experience to engineer software, scripts and tools that are often complex, as well as liaising with other engineers, architects and business analysts across the platform.

    Additionally, you’ll be collaborating with principal engineers and domain architects to understand the wider platform, domain and enterprise agendas and support the realisation of these. And, you’ll make sure that decisions made are based on robust data, return on investment and value measures that demonstrate thoughtful and intelligent cost management.

    You’ll also be:

    • Producing software rapidly and of high quality which adds value to the business
    • Working in permanent teams that are responsible for the full life cycle, from initial development, through enhancement and maintenance to replacement or decommissioning
    • Designing and developing software with a focus on the automation of build, test and deployment activities, using executable patterns
    • Designing, producing, testing and implementing our working code
    • Working across the life cycle, from requirements analysis and design, through coding to testing, deployment and operationsThe skills you'll need

      You’ll need a background in software engineering, software design, architecture, and an understanding of how your area of expertise supports our customers.

      You’ll also need:

      • Experience of working with code repositories, bug tracking tools and wikis
      • Coding experience in PySpark
      • Experience of DevOps and Agile methodology and associated toolsets and methodologies
      • A background in solving highly complex, analytical and numerical problems
      • Experience of implementing programming best practice, especially around scalability, automation, virtualisation, optimisation, availability and performance

  • Coforge - Machine Learning Engineer - PySpark/Python

    2 weeks ago

    Gurugram, India COFORGE Full time

    Responsibilities :Model Deployment & Management :- Ensure seamless operation of deployed machine learning models within the RCP platform.- Monitor and troubleshoot model performance for accuracy and efficiency.- Collaborate with data scientists and software engineers to optimize model pipelines for production.Machine Learning Operations (MLOps) :- Utilize...

  • AWS Data Engineer

    1 week ago

    gurugram, India Invitas Full time

    Job Position : AWS-Python- PySpark Engineer Job Type : Full-TimeLocation : GurgaonExperience : 5+ YearsMust Have : - Cloud Platforms (AWS), Automation Tools such as (Jenkins or Ansible) - Python and PySpark, EKS or AKS, Amazon EMR, Amazon Athena - AWS Glue, Amazon Lambda, Amazon EC2 and Amazon's Storage service like S3 and few other services like...

  • AWS Data Engineer

    2 weeks ago

    Gurugram, India Invitas Full time

    Job Position : AWS-Python- PySpark Engineer Job Type : Full-TimeLocation : GurgaonExperience : 5+ YearsMust Have : - Cloud Platforms (AWS), Automation Tools such as (Jenkins or Ansible)- Python and PySpark, EKS or AKS, Amazon EMR, Amazon Athena- AWS Glue, Amazon Lambda, Amazon EC2 and Amazon's Storage service like S3 and few other services like...

  • PySpark Developer

    2 weeks ago

    Gurugram, India Waytogo Consultants Full time

    Responsibilities :Design and develop PySpark applications using Spark DataFrames and SQL to extract, transform, and load (ETL) data.Read data from various sources such as relational databases, data lakes, and cloud storage using PySpark connectors.Clean, transform, and enrich data using PySpark functions for data wrangling and manipulation.Build and maintain...

  • PySpark Developer

    4 weeks ago

    gurugram, India Waytogo Consultants Full time

    Responsibilities : Design and develop PySpark applications using Spark DataFrames and SQL to extract, transform, and load (ETL) data. Read data from various sources such as relational databases, data lakes, and cloud storage using PySpark connectors. Clean, transform, and enrich data using PySpark functions for data wrangling and manipulation. Build and...

  • AWS Data Engineer

    4 weeks ago

    Gurugram, India True Tech Professionals Full time

    We are seeking a skilled Senior Data Engineer to join our dynamic team.- The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL.- The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure, ensuring optimal performance...

  • Coforge - Machine Learning Engineer - PySpark/Python

    2 weeks ago

    Gurgaon/Gurugram, IN COFORGE Full time

    Responsibilities :Model Deployment & Management :- Ensure seamless operation of deployed machine learning models within the RCP platform.- Monitor and troubleshoot model performance for accuracy and efficiency.- Collaborate with data scientists and software engineers to optimize model pipelines for production.Machine Learning Operations (MLOps) :- Utilize...

  • Coforge - Machine Learning Engineer - PySpark/Python

    2 weeks ago

    Gurgaon/Gurugram, India COFORGE Full time

    Responsibilities :Model Deployment & Management :- Ensure seamless operation of deployed machine learning models within the RCP platform.- Monitor and troubleshoot model performance for accuracy and efficiency.- Collaborate with data scientists and software engineers to optimize model pipelines for production.Machine Learning Operations (MLOps) :- Utilize...

  • AWS Data Engineer

    4 weeks ago

    Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description : Responsibilities :- Proficient in designing and implementing data ingestion pipelines from various sources.- Build and enhance Python and PySpark-based frameworks for efficient and scalable data ingestion processes.- Collaborate with cross-functional teams to understand requirements and tailor frameworks to meet specific business needs.-...

  • PySpark Developer

    3 weeks ago

    Gurgaon/Gurugram, IN Waytogo Consultants Full time

    Responsibilities :Design and develop PySpark applications using Spark DataFrames and SQL to extract, transform, and load (ETL) data.Read data from various sources such as relational databases, data lakes, and cloud storage using PySpark connectors.Clean, transform, and enrich data using PySpark functions for data wrangling and manipulation.Build and maintain...

  • PySpark Developer

    2 weeks ago

    Gurgaon/Gurugram, India Waytogo Consultants Full time

    Responsibilities : Design and develop PySpark applications using Spark DataFrames and SQL to extract, transform, and load (ETL) data. Read data from various sources such as relational databases, data lakes, and cloud storage using PySpark connectors. Clean, transform, and enrich data using PySpark functions for data wrangling and manipulation. Build and...

  • AWS Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN True Tech Professionals Full time

    We are seeking a skilled Senior Data Engineer to join our dynamic team.- The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL.- The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure, ensuring optimal performance...

  • AWS Data Engineer

    4 weeks ago

    Gurgaon,Gurugram, India True Tech Professionals Full time

    We are seeking a skilled Senior Data Engineer to join our dynamic team.- The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL.- The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure, ensuring optimal performance...

  • AWS Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description : Responsibilities :- Proficient in designing and implementing data ingestion pipelines from various sources.- Build and enhance Python and PySpark-based frameworks for efficient and scalable data ingestion processes.- Collaborate with cross-functional teams to understand requirements and tailor frameworks to meet specific business needs.-...

  • AWS Data Engineer

    4 weeks ago

    Gurgaon,Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description : Responsibilities :- Proficient in designing and implementing data ingestion pipelines from various sources.- Build and enhance Python and PySpark-based frameworks for efficient and scalable data ingestion processes.- Collaborate with cross-functional teams to understand requirements and tailor frameworks to meet specific business needs.-...

  • Machine Learning Engineer/Architect

    2 weeks ago

    Gurugram, India Huquo Full time

    Role :- Design and deploy machine learning systems- Research and implement appropriate ML algorithms and tools- Develop machine learning applications according to requirements- Select appropriate datasets and data representation methods- Perform statistical analysis and fine-tuning using test results- Train and retrain systems when necessary- Extend existing...

  • Machine Learning Engineer/Architect

    4 weeks ago

    gurugram, India Huquo Full time

    Role :- Design and deploy machine learning systems- Research and implement appropriate ML algorithms and tools- Develop machine learning applications according to requirements- Select appropriate datasets and data representation methods- Perform statistical analysis and fine-tuning using test results- Train and retrain systems when necessary- Extend existing...

  • Data Engineer

    2 weeks ago

    Gurugram, India Intuitive Apps Full time

    Key Skills : Minimum 6 years Exp in Data Engineer , 3yrs in Azure Data Factory, Pyspark, DatabricksJob Description :- Create and maintain optimal data pipeline architecture- Knowledge on Data Modelling, Data warehouse, and Data Analysis is also required.- Design and develop Data Warehouse solutions- Assemble large, complex data sets that meet functional /...

  • Data Engineer

    4 weeks ago

    gurugram, India Cognizant Full time

    Position Summary: The Data engineer is responsible for development & maintenance of the Data Lake within Cognizant. You should be able to collaborate with technology cross-commits and business teams to code, test and deploy scalable solution and adhering to required quality standards. You must be a self-starter, think outside the box and enjoy coming...

  • Data Engineer

    4 weeks ago

    Gurugram, India Cognizant Full time

    Position Summary: The Data engineer is responsible for development & maintenance of the Data Lake within Cognizant. You should be able to collaborate with technology cross-commits and business teams to code, test and deploy scalable solution and adhering to required quality standards. You must be a self-starter, think outside the box and enjoy coming up...