Data Engineer, PySpark
1 week ago
Join us as a Data Engineer, PySpark
- This is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiences
- You'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data safe and secure
- Participating actively in the data engineering community, you'll deliver opportunities to support the bank's strategic direction while building your network across the bank
- We're offering this role at associate level
As a Data Engineer, you'll play a key role in driving value for our customers by building data solutions. You'll be carrying out data engineering tasks to build, maintain, test and optimise a scalable data architecture, as well as carrying out data extractions, transforming data to make it usable to data analysts and scientists, and loading data into data platforms.
You'll also be:
- Developing comprehensive knowledge of the bank's data structures and metrics, advocating change where needed for product development
- Practicing DevOps adoption in the delivery of data engineering, proactively performing root cause analysis and resolving issues
- Collaborating closely with core technology and architecture teams in the bank to build data knowledge and data solutions
- Developing a clear understanding of data platform cost levers to build cost effective and strategic solutions
- Sourcing new data using the most appropriate tooling and integrating it into the overall solution to deliver for our customers
To be successful in this role, you'll need a good understanding of data usage and dependencies with wider teams and the end customer, as well as experience of extracting value and features from large scale data. You'll need at least five years of experience in PySpark, Python, SQL, CICD, Gitlab and AWS.
You'll also demonstrate:
- Experience of ETL technical design, including data quality testing, cleansing and monitoring, and data warehousing and data modelling capabilities
- Experience of using programming languages alongside knowledge of data and software engineering fundamentals
- Good knowledge of modern code development practices
- Strong communication skills with the ability to proactively engage with a wide range of stakeholders
Hours
45Job Posting Closing Date:
18/09/2025-
Data Engineer, PySpark
4 days ago
Bengaluru, Karnataka, India NatWest Group Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJoin us as a Data Engineer, PySparkThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 10,00,000 - ₹ 25,00,000 per yearJob Duties:Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix...
-
Data Engineer – Databricks
1 week ago
Bengaluru, Karnataka, India, Karnataka Capgemini Engineering Full timeData Engineer – Databricks & PySparkLocation: BangaloreExperience: 6–9 yearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock the...
-
Pyspark
1 day ago
Bengaluru, Karnataka, India Virtusa Full time ₹ 20,00,000 - ₹ 25,00,000 per yearhighly skilled Data Engineer with 6+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration...
-
Pyspark Lead
7 days ago
Bengaluru, Karnataka, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a skilled PySpark Lead with 5 to 8 years of experience, based in Bangalore. The ideal candidate will have expertise in PySpark, SQL, ETL/Data Engineering Pipeline, Cloud understanding, CI/CD, Data Modelling, Airflow, Kafka, EMR/Databricks, Snowflake, and Hive.Roles and ResponsibilityDesign and develop scalable data pipelines using PySpark...
-
Big Data/Pyspark Developer
3 days ago
Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSenior Big Data Engineer / PySpark Developer with deep expertise in distributed computing, PySpark, and Spark performance tuning for both batch and streaming data processing.Hands-on experience with Hive, open table formats such as Iceberg, and workflow orchestration tools like Airflow or Oozie.Strong coding skills adhering to OOP principles, design...
-
Data engineer
4 days ago
Bengaluru, Karnataka, India Golden Opportunities Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob DescriptionJob Title:Data engineer (Data brick, Python and Pyspark)Candidate Specification: 3+ years of experience, Notice Period � Immediate joiner, 5 days � WFO.Job Description3+ years� experience in Data EngineeringCandidate with coding experience in Python.Experience in Data brick and Pyspark.Candidate with good communication and coding...
-
Data Engineer with SQL/ETL/Pyspark
2 weeks ago
Bengaluru, Karnataka, India Infosys Finacle Full time ₹ 12,00,000 - ₹ 36,00,000 per yearMandate Skills - SQL, ETL ,hadoop, pyspark, Apache, KafkaRequired Skills5+ years of relevant Data engineering experience using Python or Java as tech be well versed into HadoopDevelopment expertise with 2+ years of experience, in SQL, ETL processes and other similar technologiesSkilled in Identifying and optimizing database queriesStrong understanding of...
-
Pyspark developer
1 week ago
Bengaluru, Karnataka, India Infosys Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Description:In the role of Data Engineer you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation Application Architecture definition and DesignYou will play an important role in creating the high level design artifactsYou will also...
-
Data & AI Engineer Lead
1 week ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearFramework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...