Data Engineer, PySpark

6 days ago

Bengaluru, Karnataka, India NatWest Group Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Join us as a Data Engineer, PySpark

  • This is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiences
  • You'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data safe and secure
  • Participating actively in the data engineering community, you'll deliver opportunities to support the bank's strategic direction while building your network across the bank
  • We're offering this role at associate level
What you'll do

As a Data Engineer, you'll play a key role in driving value for our customers by building data solutions. You'll be carrying out data engineering tasks to build, maintain, test and optimise a scalable data architecture, as well as carrying out data extractions, transforming data to make it usable to data analysts and scientists, and loading data into data platforms.

You'll also be:

  • Developing comprehensive knowledge of the bank's data structures and metrics, advocating change where needed for product development
  • Practicing DevOps adoption in the delivery of data engineering, proactively performing root cause analysis and resolving issues
  • Collaborating closely with core technology and architecture teams in the bank to build data knowledge and data solutions
  • Developing a clear understanding of data platform cost levers to build cost effective and strategic solutions
  • Sourcing new data using the most appropriate tooling and integrating it into the overall solution to deliver for our customers
The skills you'll need

To be successful in this role, you'll need a good understanding of data usage and dependencies with wider teams and the end customer, as well as experience of extracting value and features from large scale data. You'll need at least five years of experience in PySpark, Python, SQL, CICD, Gitlab and AWS.

You'll also demonstrate:

  • Experience of ETL technical design, including data quality testing, cleansing and monitoring, and data warehousing and data modelling capabilities
  • Experience of using programming languages alongside knowledge of data and software engineering fundamentals
  • Good knowledge of modern code development practices
  • Strong communication skills with the ability to proactively engage with a wide range of stakeholders

  • Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • Data Engineer, PySpark

    2 weeks ago

    Bengaluru, Karnataka, India RBS Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Join us as a Data Engineer, PySparkThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Duties:Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix...

  • Data Engineer – Databricks

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Capgemini Engineering Full time

    Data Engineer – Databricks & PySparkLocation: BangaloreExperience: 6–9 yearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock the...

  • Pyspark

    4 days ago

    Bengaluru, Karnataka, India Virtusa Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    highly skilled Data Engineer with 6+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration...

  • Pyspark Lead

    1 week ago

    Bengaluru, Karnataka, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled PySpark Lead with 5 to 8 years of experience, based in Bangalore. The ideal candidate will have expertise in PySpark, SQL, ETL/Data Engineering Pipeline, Cloud understanding, CI/CD, Data Modelling, Airflow, Kafka, EMR/Databricks, Snowflake, and Hive.Roles and ResponsibilityDesign and develop scalable data pipelines using PySpark...

  • Big Data/Pyspark Developer

    6 days ago

    Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Big Data Engineer / PySpark Developer with deep expertise in distributed computing, PySpark, and Spark performance tuning for both batch and streaming data processing.Hands-on experience with Hive, open table formats such as Iceberg, and workflow orchestration tools like Airflow or Oozie.Strong coding skills adhering to OOP principles, design...

  • Data engineer

    6 days ago

    Bengaluru, Karnataka, India Golden Opportunities Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job DescriptionJob Title:Data engineer (Data brick, Python and Pyspark)Candidate Specification: 3+ years of experience, Notice Period � Immediate joiner, 5 days � WFO.Job Description3+ years� experience in Data EngineeringCandidate with coding experience in Python.Experience in Data brick and Pyspark.Candidate with good communication and coding...

  • Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Golden Opportunities Full time ₹ 1,20,000 - ₹ 1,80,000 per year

    Job DescriptionJob title:Data Engineer ( Python + PySpark + SQL )Candidate Specification: Minimum 6 to 8 years of experience in Data EngineerJob DescriptionData Engineer with strong expertise in Python, PySpark, and SQL.Design, develop, and maintain robust data pipelines using PySpark and Python.Strong understanding of SQL and relational databases (e.g.,...

  • Data Engineer with SQL/ETL/Pyspark

    2 weeks ago

    Bengaluru, Karnataka, India Infosys Finacle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Mandate Skills - SQL, ETL ,hadoop, pyspark, Apache, KafkaRequired Skills5+ years of relevant Data engineering experience using Python or Java as tech be well versed into HadoopDevelopment expertise with 2+ years of experience, in SQL, ETL processes and other similar technologiesSkilled in Identifying and optimizing database queriesStrong understanding of...