Software Engineer, PySpark, VP
20 hours ago
Join us as a Software Engineer, PySpark
- This is an opportunity for a technically minded individual to join us as a Software Engineer
- You'll be designing, producing, testing and implementing working software, working across the lifecycle of the system
- Hone your existing software engineering skills and advance your career in this critical role
- We're offering this role at vice president level
Working in a permanent feature team, you'll be developing knowledge of aspects of the associated platform across the disciplines of business, applications, data and infrastructure. You'll also be liaising with principal engineers, architects in the domain and other key stakeholders to understand how the platform works and how it supports business objectives.
You'll also be:
- Applying Agile methods to the development of software on the backlog
- Producing resilient and long-lived software and acting flexibly to cope with future needs
- Delivering intentional architecture and formulating emergent design through innovative ideas, experimentation and prototyping
- Designing and developing software with a focus on the automation of build, test and deployment activities, using executable patterns
We're looking for someone with strong full stack experience in software design and implementation, including being able to exploit programming languages to solve complex problems. You'll also need at least twelve years of experience with Python or PySpark with AWS and Airflow.
You'll need experience in writing advance Spark SQL or ANSI SQL queries with experience Spark SQL query optimistaion and performance tuning. You'll also need experience with continuous integration, DevOps, Gitlab and Artifactory.
Additionally, you'll demonstrate:
- Experience of leading the implementation of programming best practice, especially around scalability, automation, virtualisation, optimisation, availability and performance
- Sound collaboration skills with the ability to work with business teams to produce pragmatic solutions that work for the business
- Experience of information security policies and practices within the financial sector
- Strong stakeholder management skills and communication skills with the ability to communicate complex technical concepts in a simple way
-
Software Engineer, PySpark, AVP
6 days ago
Chennai, Tamil Nadu, India NatWest Group Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJoin us as a Software Engineer, PySparkThis is an opportunity for a driven Software Engineer to take on an exciting new career challengeDay-to-day, you'll build a wide network of stakeholders of varying levels of seniorityIt's a chance to hone your existing technical skills and advance your careerWe're offering this role at associate vice president levelWhat...
-
Software Engineer, Pyspark
1 week ago
Chennai, Tamil Nadu, India Natwest Digitalx Full time ₹ 5,00,000 - ₹ 15,00,000 per yearJoin us as a Software EngineerThis is an opportunity for a driven Software Engineer to take on an exciting new career challengeDay-to-day, you'll be engineering and maintaining innovative, customer centric, high performance, secure and robust solutionsIts a chance to hone your existing technical skills and advance your career while building a wide network of...
-
Software Engineer, Tableau And PySpark, AVP
2 weeks ago
Chennai, Tamil Nadu, India NatWest Group Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJoin us as a Software Engineer, Tableau And PySparkThis is an opportunity for a driven Software Engineer to take on an exciting new career challengeDay-to-day, you'll build a wide network of stakeholders of varying levels of seniorityIt's a chance to hone your existing technical skills and advance your careerWe're offering this role at associate vice...
-
PySpark Developer
3 days ago
Chennai, Tamil Nadu, India Risk Resources LLP Full time ₹ 10,000 - ₹ 80,000 per yearOverview The PySpark Developer plays a crucial role in leveraging big data technologies to analyze and transform data, thereby driving informed business decisions. This position focuses on the design, development, and optimization of data processing applications using PySpark, a Python API for Apache Spark. In the fast-paced tech environment, the PySpark...
-
Pyspark Data Engineer
20 hours ago
Chennai, Tamil Nadu, India Prowesstics Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a skilledData Engineerwith hands-on experience inPySparkandDatabricksto design, develop, and optimize large-scale data pipelines. The ideal candidate should have strong problem-solving skills, experience working in cloud-based environments, and the ability to collaborate effectively with cross-functional teams.Key Responsibilities:Develop...
-
Pyspark Developer
5 days ago
Chennai, Tamil Nadu, India viraaj hr solutions Full time ₹ 5,00,000 - ₹ 15,00,000 per yearPrimary Job Title: PySpark DeveloperRole & ResponsibilitiesDesign, develop and maintain scalable PySpark ETL pipelines for batch and streaming workloads across data lakes and warehouses.Ingest and transform data from diverse sources (Kafka, S3, HDFS, RDBMS) into analytics-ready formats using PySpark and Spark SQL.Optimize Spark jobs for performance and...
-
AWS Data Engineer + Pyspark
5 days ago
Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 12,00,000 - ₹ 36,00,000 per yearTCS Inviting ApplicationRole : AWS Data engineer+ PysparkExperience : 6-10 YearsLocation : ChennaiMust: PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data TestingNice To Have: Hadoop, Teradata Background, IaC[Cloud Formation / Terraform], GitLocationChennaiJob FunctionTECHNOLOGYRoleEngineerJob Id380170Desired...
-
Chennai, Tamil Nadu, India Antal TECH jobs Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSummary role description:Hiring for a Vice President – Product Engineering for a premier HealthTech platform provider, with market leadership position in US Healthcare.Company description:Our client is a US HealthTech platform provider catering to major HealthCare ecosystem players in the US, including Federal and state health agencies. Their digitally...
-
Data Engineer, VP
6 days ago
Chennai, Tamil Nadu, India NatWest Group Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole Overview: As a Data Engineer at our company, you will play a crucial role in simplifying our organization by developing innovative data-driven solutions through data pipelines, modeling, and ETL design. Your main goal will be to ensure commercial success while prioritizing customer safety and data security. You will be responsible for driving customer...
-
Data Engineer Pyspark
5 days ago
Chennai, Tamil Nadu, India NatWest Group Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJoin us as a Data EngineerThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data safe and...