Data Engineer, PySpark

3 days ago

Bengaluru, Karnataka, India NatWest Group Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Join us as a Data Engineer, PySpark

  • This is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiences
  • You'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data safe and secure
  • Participating actively in the data engineering community, you'll deliver opportunities to support the bank's strategic direction while building your network across the bank
  • We're offering this role at associate level
What you'll do

As a Data Engineer, you'll play a key role in driving value for our customers by building data solutions. You'll be carrying out data engineering tasks to build, maintain, test and optimise a scalable data architecture, as well as carrying out data extractions, transforming data to make it usable to data analysts and scientists, and loading data into data platforms.

You'll also be:

  • Developing comprehensive knowledge of the bank's data structures and metrics, advocating change where needed for product development
  • Practicing DevOps adoption in the delivery of data engineering, proactively performing root cause analysis and resolving issues
  • Collaborating closely with core technology and architecture teams in the bank to build data knowledge and data solutions
  • Developing a clear understanding of data platform cost levers to build cost effective and strategic solutions
  • Sourcing new data using the most appropriate tooling and integrating it into the overall solution to deliver for our customers
The skills you'll need

To be successful in this role, you'll need a good understanding of data usage and dependencies with wider teams and the end customer, as well as experience of extracting value and features from large scale data. You'll need at least five years of experience in PySpark, Python, SQL, CICD, Gitlab and AWS.

You'll also demonstrate:

  • Experience of ETL technical design, including data quality testing, cleansing and monitoring, and data warehousing and data modelling capabilities
  • Experience of using programming languages alongside knowledge of data and software engineering fundamentals
  • Good knowledge of modern code development practices
  • Strong communication skills with the ability to proactively engage with a wide range of stakeholders

  • Data Engineer- PySpark

    3 days ago

    Bengaluru, Karnataka, India Valuelabs Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title- PySpark Data EngineerWe're growing our Data Engineering team at ValueLabs and looking for a talented individual to build scalable data pipelines on Cloudera Data PlatformExperience- 5years to 9years.Pyspark Job Description:Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the...

  • Data Engineer, PySpark

    1 week ago

    Bengaluru, Karnataka, India RBS Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Join us as a Data Engineer, PySparkThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data...

  • Experienced PySpark Engineer

    1 week ago

    Bengaluru, Karnataka, India beBeePySparkEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Experienced PySpark EngineerJob Summary:Our organization is seeking an experienced and highly skilled PySpark engineer to join our team. As a key member of the data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark.Key Responsibilities:Design and implement complex...

  • Pyspark

    2 days ago

    Bengaluru, Karnataka, India Virtusa Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    highly skilled Data Engineer with 6+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration...

  • Python Pyspark Data Engineer

    4 days ago

    Bengaluru, Karnataka, India DXC Technology Full time

    Python Pyspark Data Engineer Job Location Hyderabad Bangalore Chennai Kolkata Noida Gurgaon Pune Indore Mumbai Strong Python Skills - Proficient in Python for data manipulation automation and building reusable components Data Pipeline Development - Experience designing and maintaining ETL data pipelines using tools like Airflow or...

  • Pyspark Architect

    1 week ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Description: PySpark ArchitectLocation: Bangalore,Pune,Kolkata Experience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible...

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Data Engineer (Spark & PySpark)About the RoleWe are seeking a highly skilled and experienced Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark and Python.Your primary focus will be on developing and...

  • Big Data/Pyspark Developer

    3 days ago

    Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Senior Big Data Engineer / PySpark Developer with deep expertise in distributed computing, PySpark, and Spark performance tuning for both batch and streaming data processing.Hands-on experience with Hive, open table formats such as Iceberg, and workflow orchestration tools like Airflow or Oozie.Strong coding skills adhering to OOP principles, design...

  • Data engineer

    3 days ago

    Bengaluru, Karnataka, India Golden Opportunities Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job DescriptionJob Title:Data engineer (Data brick, Python and Pyspark)Candidate Specification: 3+ years of experience, Notice Period � Immediate joiner, 5 days � WFO.Job Description3+ years� experience in Data EngineeringCandidate with coding experience in Python.Experience in Data brick and Pyspark.Candidate with good communication and coding...

  • Pyspark" "Azure data bricks" "Azure Data Factory"

    3 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Please find below JD for the same as requested. Technical Skills:"Pyspark" "Azure data bricks" "Azure Data Factory"Experienced level - 5 yearsShould have hands-on experience in writing PySpark code on Databricks and expertise in Spark-Sql and Python coding as well. Should have worked on Azure Data lake Gen2 storage or good to have knowledgeHands-on exp in...