Software Engineer, PySpark

2 months ago


Chennai, Tamil Nadu, India NatWest Digital X Full time

Join us as a Software Engineer

In your new role, you'll engineer and maintain innovative, customer centric, high performance, secure and robust solutionsWe'll look to you to design and engineer software focusing on the customer or user experience as the primary objectiveIt's a chance to hone your existing technical skills and advance your career as you develop the discipline of software engineering across the businessWhat you'll do As a Software Engineer, you'll design, develop and deploy applications capable of meeting and exceeding the anticipated load, performance and availability volumes, including load balancing, performance testing and benchmarking. You'll be working within a feature team and using extensive experience to engineer software, scripts and tools that are often complex, as well as liaising with other engineers, architects and business analysts across the platform. You'll also be: Producing high quality software which adds value to the businessWorking in permanent teams who are responsible for the full life cycle, from initial development, through enhancement and maintenance to replacement or decommissioningCollaborating to optimise our software engineering capabilityDesigning, producing, testing and implementing our working codeWorking across the life cycle, from requirements analysis and design, through coding to testing, deployment and operationsThe skills you'll need You'll need a background in software engineering, software design, architecture, and an understanding of how your area of expertise supports our customers. You'll also have experience of test-driven development alongside the use of automated test frameworks, mocking or stubbing and unit testing tools. It'll be ideal if you have a background in solving highly complex, analytical and numerical problems. You'll also need: At least five years of experience in PySpark, AWS, and SQLExperience of DevOps and Agile methodology and associated toolsets and methodologiesKnowledge of relational, in-memory, distributed and NoSQL databasesExperience of implementing programming best practice, especially around scalability, automation, virtualisation, optimisation, availability and performance

  • Chennai, Tamil Nadu, India NatWest Digital X Full time

    Join us as a Software Engineer, PySparkThis is an opportunity for a technically minded individual to join us as a Software EngineerYou'll be working with new and innovative technology to deliver high impact solutionsHone your existing software engineering skills and advance your career in this critical roleWe're offering this role at associate levelWhat...


  • Chennai, Tamil Nadu, India NatWest Digital X Full time

    Join us as a Software Engineer, PySparkThis is an opportunity for a technically minded individual to join us as a Software Engineer, PySparkYou'll be working with new and innovative technology to deliver high impact solutionsHone your existing software engineering skills and advance your career in this critical roleWe're offering this role at vice president...


  • Chennai, Tamil Nadu, India NatWest Digital X Full time

    Join us as a Software EngineerThis is an opportunity for a driven Software Engineer to take on an exciting new career challengeDay-to-day, you'll build a wide network of stakeholders of varying levels of seniorityIt's a chance to hone your existing technical skills and advance your careerWe're offering this role at associate levelWhat you'll do In your new...


  • Chennai, Tamil Nadu, India NatWest Digital X Full time

    Join us as a Software EngineerThis is an opportunity for a driven Software Engineer to take on an exciting new career challengeDay-to-day, you'll build a wide network of stakeholders of varying levels of seniorityIt's a chance to hone your existing technical skills and advance your careerWhat you'll do In your new role, you'll engineer and maintain...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Data Engineer

    2 months ago


    Chennai, Tamil Nadu, India Randstad Full time

    Role : Data Engineer - PySparkExp : 5-10 years- 5+ years of experience in data engineering field.- Good experience in Pyspark - Including Dataframe core functions and Spark SQL.- Good experience in SQL DBs - Be able to write queries including fair complexity.- Should have experience in Big Data programming for data transformation and aggregations.- Good...

  • Pyspark Dev

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Pyspark Dev & QA - CREQ188700 DescriptionPyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of...


  • Chennai, Tamil Nadu, India Virtusa Full time

    Data Engg Python Pyspark - CREQ187455 Description Experience in pharma domain would be preferred.At least 5-8 years of experience in PYSPARK, AWS glue) and capable of configuring data pipelines. Possess the following technical skills AWS,SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar) Data Extraction from Teradata, HIVE, Oracle, and Flat files...

  • Pyspark Dev

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Pyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of installing, configuring, debugging and...


  • Chennai, Tamil Nadu, India Virtusa Full time

    Data Engineer(Pyspark, AWS and SQL) - CREQ186019 Description 4-6 years work experience in Software Engineering especially in professional software product development.Expertise in AWS and python coding.Flexible to learn and work for any programming language based on need.Proficient in pipeline for file loading from multiple different sources having different...


  • Chennai, Tamil Nadu, India Corporate Resources Full time

    Job Description Work on client projects to deliver AWS, PySpark, Databricks based Data engineering Analytics solutions Build and operate very large data warehouses or data lakes ETL optimization, designing, coding, tuning big data processes using Apache Spark Build data pipelines applications to stream and process datasets at low latencies Show efficiency...


  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India SGS Technical Services Pvt. Ltd Full time

    Job Title : Data : Chennai, IndiaImmediate Joiners Preferred: Notice period of up to 15 Keywords : Python Py spark ,SQL, with azure, data pipeline, Data warehouse (like snowflake) ETL controlJob Description :We are seeking a highly skilled Data Engineer to join our team in Chennai. The ideal candidate should have strong expertise in Python, PySpark, SQL,...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India SGS Technical Services Pvt. Ltd Full time

    Job Title : Data : Chennai, IndiaImmediate Joiners Preferred: Notice period of up to 15 Keywords : Python Py spark ,SQL, with azure, data pipeline, Data warehouse (like snowflake) ETL controlJob Description :We are seeking a highly skilled Data Engineer to join our team in Chennai. The ideal candidate should have strong expertise in Python, PySpark, SQL,...

  • Software Engineer, AVP

    2 months ago


    Chennai, Tamil Nadu, India NatWest Digital X Full time

    Join us as a Software EngineerIn your new role, you'll engineer and maintain innovative, customer centric, high performance, secure and robust solutionsWe'll look to you to design and engineer software focusing on the customer or user experience as the primary objectiveIt's a chance to hone your existing technical skills and advance your career as you...

  • Software Engineer

    1 week ago


    Chennai, Tamil Nadu, India Corporate Resources Full time

    Job DescriptionComputer Science/Software Engineering (or related) degree.6+ years experience with end-to-end ETL and Analytics application development on Oracle based data-warehouse and Big Data analytical platformsExperience working with Big Data Technologies, programs and toolsets like Hadoop, Hive, Sqoop, Impala, Kafka, and Python/Spark/ PySpark...


  • Chennai, Tamil Nadu, India SecureKloud Full time

    ResponsibilitiesProven experience as a Data Engineer or similar role, preferably working on data-intensive projects.Strong proficiency in programming languages such as Pyspark, Python, SQLHands-on experience in Databricks


  • Chennai, Tamil Nadu, India 12542 Citicorp Services India Private Limited Full time

    Data Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...


  • Chennai, Tamil Nadu, India SecureKloud Full time

    Responsibilities Proven experience as a Data Engineer or similar role, preferably working on data-intensive projects. Strong proficiency in programming languages such as Pyspark, Python, SQL Hands-on experience in Databricks

  • Data Engineer

    1 month ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    About the job :Responsibilities :- Design, develop, and maintain scalable and efficient data pipelines and ETL processes to support data integration and analytics- Collaborate with data scientists, analysts, and developers to understand data requirements and translate them into technical solutions- Implement data ingestion processes from various sources,...