Data Engineer Pyspark

3 days ago

Chennai, Tamil Nadu, India NatWest Group Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Join us as a Data Engineer

  • This is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiences
  • You'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data safe and secure
  • Participating actively in the data engineering community, you'll deliver opportunities to support the bank's strategic direction while building your network across the bank
  • We're offering this role at associate level
What you'll do

As a Data Engineer, you'll play a key role in driving value for our customers by building data solutions. You'll be carrying out data engineering tasks to build, maintain, test and optimise a scalable data architecture, as well as carrying out data extractions, transforming data to make it usable to data analysts and scientists, and loading data into data platforms.

You'll also be:

  • Developing comprehensive knowledge of the bank's data structures and metrics, advocating change where needed for product development
  • Practicing DevOps adoption in the delivery of data engineering, proactively performing root cause analysis and resolving issues
  • Collaborating closely with core technology and architecture teams in the bank to build data knowledge and data solutions
  • Developing a clear understanding of data platform cost levers to build cost effective and strategic solutions
  • Sourcing new data using the most appropriate tooling and integrating it into the overall solution to deliver for our customers
The skills you'll need

To be successful in this role, you'll need a good understanding of data usage and dependencies with wider teams and the end customer, as well as experience of extracting value and features from large scale data.

You'll also demonstrate:

  • Experience of ETL technical design, including data quality testing, cleansing and monitoring, and data warehousing and data modelling capabilities
  • At least five years of experience in Oracle PL-SQL, PySpark, AWS S3, Glue, and Airflow
  • Experience of using programming languages alongside knowledge of data and software engineering fundamentals
  • Good knowledge of modern code development practices
  • Strong communication skills with the ability to proactively engage with a wide range of stakeholders

  • AWS Data Engineer + Pyspark

    3 days ago

    Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    TCS Inviting ApplicationRole : AWS Data engineer+ PysparkExperience : 6-10 YearsLocation : ChennaiMust: PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data TestingNice To Have: Hadoop, Teradata Background, IaC[Cloud Formation / Terraform], GitLocationChennaiJob FunctionTECHNOLOGYRoleEngineerJob Id380170Desired...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    HiRole - Azure Data engineerLocation - Chennai, GurugramWork from officeFull timeImmediate joiner Only (15days Notice period only)Candidates with Certification in Databricks is good to haveTechnical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o...

  • Pyspark

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryAs a Sr. Developer you will play a pivotal role in optimizing and enhancing our data processing capabilities using PySpark and AWS technologies. Your expertise in Python and domain knowledge in Cards & Payments will drive impactful solutions. This hybrid role offers the flexibility of day shifts ensuring a balanced work-life...

  • AWS + Pyspark

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Skills- AWS +PysparkExperience: 4 to 9 yearsLocation: AIA-PuneAs an AWS Data Engineer, you will design, build, and manage robust data pipelines on the AWS cloud platform. You will leverage your expertise in AWS data services and programming languages to ingest, process, transform, and store data efficiently, enabling data-driven insights and...

  • Pyspark Developer

    1 week ago

    Chennai, Tamil Nadu, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Discover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewAt Citi we're not just building technology, we're building the...

  • Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India Million IQ Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    JD:Pyspark, Hive, Python Data EngineerExp:6+yrs(overall) Relevant in Hadoop 4+ and 2+ In Pyspark is mandatoryLocation: Chennai

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Work Fox Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Data EngineerMaintain ETL pipelines using Databricks and PySpark to extract, transform, and load data from various sources.Troubleshoot and resolve issues related to data transformations or loading processes in Databricks.Develop and maintain documentation for ETL processes, configurations, and data mappings.Strong proficiency in Databricks with hands-on...

  • Software Engineer, Pyspark

    1 week ago

    Chennai, Tamil Nadu, India Natwest Digitalx Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Join us as a Software EngineerThis is an opportunity for a driven Software Engineer to take on an exciting new career challengeDay-to-day, you'll be engineering and maintaining innovative, customer centric, high performance, secure and robust solutionsIts a chance to hone your existing technical skills and advance your career while building a wide network of...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per year

    Role: Data Engineer (Scala)Location: ChennaiWork Mode: HybridEmployment Type: Full-time PermanentOverview:We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and processing frameworks,...