Software Engineer, PySpark and AWS, AVP

7 days ago

Chennai, Tamil Nadu, India Natwest Digitalx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Join us as a Software Engineer, PySpark and AWS

  • This is an opportunity for a driven Software Engineer to take on an exciting new career challenge
  • Day-to-day, you'll build a wide network of stakeholders of varying levels of seniority
  • Its a chance to hone your existing technical skills and advance your career
  • We're offering this role at associate vice president level

What you'll do

In your new role, youll engineer and maintain innovative, customer centric, high performance, secure and robust solutions. Youll be working within a feature team and using your extensive experience to engineer software, scripts and tools that are often complex, as well as liaising with other engineers, architects and business analysts across the platform.

Youll also be:

  • Producing complex and critical software rapidly and of high quality which adds value to the business
  • Working in permanent teams who are responsible for the full life cycle, from initial development, through enhancement and maintenance to replacement or decommissioning
  • Collaborating to optimise our software engineering capability
  • Designing, producing, testing and implementing our working code
  • Working across the life cycle, from requirements analysis and design, through coding to testing, deployment and operations

The skills you'll need

Youll need a background in software engineering, software design, architecture, and an understanding of how your area of expertise supports our customers.

You'll need at least eight years of experience with PySpark and AirFlow. You'll also need experience in AWS data engineering eco systems like Athena, Glue catalog, S3 and EMR Serverless.

Youll also need:

  • Experience of working with development and testing tools, bug tracking tools and wikis
  • Experience in multiple programming languages or low code toolsets
  • Experience of DevOps, Testing and Agile methodology and associated toolsets
  • A background in solving highly complex, analytical and numerical problems
  • Experience of implementing programming best practice, especially around scalability, automation, virtualisation, optimisation, availability and performance

Hours - 45.

  • Pyspark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India MP DOMINIC AND CO Full time

    Job Summary - Design develop and implement scalable data pipelines and streaming use cases using PySpark and Spark on a distributed computing platform - Possess strong programming skills in Spark streaming - Have familiarity with cloud platforms like GCP - Gain experience in big data technologies such as Hadoop Hive and HDFS - Perform ETL operations...

  • TCS Hiring for AWS Senior Data Engineer with Pyspark, AWS, Glue_Chennai

    2 days ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Job Title: AWS Senior Data Engineer with Pyspark, AWS, GlueLocation: ChennaiExperience: 6 to 10 YearsNotice Period: 30-45 daysJob Description:Must: PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data TestingNice To Have: Hadoop, Teradata Background, IaC[Cloud Formation / Terraform], GitKind Regards,Priyankha M

  • Pyspark Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Prowesstics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilledData Engineerwith hands-on experience inPySparkandDatabricksto design, develop, and optimize large-scale data pipelines. The ideal candidate should have strong problem-solving skills, experience working in cloud-based environments, and the ability to collaborate effectively with cross-functional teams.Key Responsibilities:Develop...

  • Pyspark

    1 day ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryAs a Sr. Developer you will play a pivotal role in optimizing and enhancing our data processing capabilities using PySpark and AWS technologies. Your expertise in Python and domain knowledge in Cards & Payments will drive impactful solutions. This hybrid role offers the flexibility of day shifts ensuring a balanced work-life...

  • Data Engineer- PySpark

    1 week ago

    Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Build up data pipelines for consumption by the data science team.Clear understanding and experience with Python and PySpark.Experience in writing Python programs and SQL queries.Experience in SQL Query tuning.Build and maintain data pipelines in Pyspark with SQL and Python.Knowledge of Cloud (Azure/AWS) technologies is additional. Suggest and implement best...

  • Pyspark, AWS

    1 day ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are seeking a skilled Developer with 4 to 6 years of experience to join our team. The ideal candidate will have expertise in Amazon S3 and PySpark and a strong background in the Cards & Payments domain. This hybrid role offers the opportunity to work on cutting-edge projects in a dynamic environment contributing to the companys growth and...

  • AWS Data Engineer(Chennai, Indore

    2 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 10,00,000 - ₹ 15,00,000 per year

    Role: AWS Data EngineerJOB LOCATION : Chennai, Indore , PuneEXPERIENCE REQUIREMENT : 5+Required Technical Skill:Strong Knowledge ofAws Glue/AWS REDSHIFT/SQL/ETL.Good knowledge and experience in Pyspark for forming complex Transformation logic.AWS Data Engineer,SQL,ETL,DWH, Secondary : AWS Glue , AirflowMust-HaveGood Knowledge of SQL , ETLA minimum of 3 +...

  • AWS Data engineer

    7 days ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    AWS Data EngineerDesign and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and S3.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes.Create and manage applications using Python, SQL, Databricks, and various AWS technologies.Automate repetitive tasks and build...

  • AWS Data

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    P3-C3-TSTSAWS Data EngineerDesign and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and QS/SNS/Cloudwatch/Step function/CDK(or Terrafoam.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes.Create and manage applications using Python, Pyspark, SQL, Databricks, and...

  • AWS Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Crescent Techservices Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role: AWS Data EngineerType: 6-12 month contractLocation: Chennai, Tamil Nadu (WFO)Experience: 6-8 YearsRequirements:Proficiency in Python and PySpark: Strong experience writing robust Python code and utilizing PySpark for distributed data processing, transformation, and working with large datasets.AWS Data Engineering Expertise: Hands-on experience with...