Pyspark, AWS

1 day ago

Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Job Summary

We are seeking a skilled Developer with 4 to 6 years of experience to join our team. The ideal candidate will have expertise in Amazon S3 and PySpark and a strong background in the Cards & Payments domain. This hybrid role offers the opportunity to work on cutting-edge projects in a dynamic environment contributing to the companys growth and innovation in the financial sector.

Responsibilities

  • Develop and maintain scalable data processing solutions using PySpark to support business objectives in the Cards & Payments domain.
  • Collaborate with cross-functional teams to design and implement data storage solutions on Amazon S3 ensuring data integrity and security.
  • Analyze and optimize existing data workflows to improve efficiency and performance contributing to the overall success of the project.
  • Provide technical expertise and guidance to team members fostering a collaborative and innovative work environment.
  • Ensure compliance with industry standards and regulations maintaining the highest level of data privacy and security.
  • Participate in code reviews and provide constructive feedback to peers promoting best practices and continuous improvement.
  • Troubleshoot and resolve technical issues ensuring minimal disruption to business operations and maintaining system reliability.
  • Stay updated with the latest industry trends and technologies applying new knowledge to enhance project outcomes.
  • Contribute to the development of project documentation ensuring clarity and accuracy for future reference.
  • Work closely with stakeholders to understand business requirements and translate them into technical solutions.
  • Implement data quality checks and validation processes to ensure the accuracy and consistency of data outputs.
  • Support the deployment and integration of new systems and applications ensuring seamless transitions and minimal downtime.
  • Monitor system performance and implement enhancements to improve user experience and operational efficiency.

Qualifications

  • Possess strong proficiency in Amazon S3 and PySpark with a proven track record of successful project implementations.
  • Demonstrate in-depth knowledge of the Cards & Payments domain with experience in handling related data and processes.
  • Exhibit excellent problem-solving skills and the ability to work independently and collaboratively in a hybrid work model.
  • Show strong communication skills capable of articulating technical concepts to non-technical stakeholders.
  • Have a proactive approach to learning and adapting to new technologies and methodologies.
  • Display a commitment to quality and attention to detail ensuring the highest standards in all deliverables.
  • Hold a bachelors degree in Computer Science Information Technology or a related field.

  • Pyspark

    1 day ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryAs a Sr. Developer you will play a pivotal role in optimizing and enhancing our data processing capabilities using PySpark and AWS technologies. Your expertise in Python and domain knowledge in Cards & Payments will drive impactful solutions. This hybrid role offers the flexibility of day shifts ensuring a balanced work-life...

  • Pyspark Developer

    3 weeks ago

    Chennai, Tamil Nadu, India MP DOMINIC AND CO Full time

    Job Summary - Design develop and implement scalable data pipelines and streaming use cases using PySpark and Spark on a distributed computing platform - Possess strong programming skills in Spark streaming - Have familiarity with cloud platforms like GCP - Gain experience in big data technologies such as Hadoop Hive and HDFS - Perform ETL operations...

  • Data Engineer- PySpark

    1 week ago

    Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Build up data pipelines for consumption by the data science team.Clear understanding and experience with Python and PySpark.Experience in writing Python programs and SQL queries.Experience in SQL Query tuning.Build and maintain data pipelines in Pyspark with SQL and Python.Knowledge of Cloud (Azure/AWS) technologies is additional. Suggest and implement best...

  • TCS Hiring for AWS Senior Data Engineer with Pyspark, AWS, Glue_Chennai

    2 days ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Job Title: AWS Senior Data Engineer with Pyspark, AWS, GlueLocation: ChennaiExperience: 6 to 10 YearsNotice Period: 30-45 daysJob Description:Must: PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data TestingNice To Have: Hadoop, Teradata Background, IaC[Cloud Formation / Terraform], GitKind Regards,Priyankha M

  • Software Engineer, PySpark and AWS, AVP

    7 days ago

    Chennai, Tamil Nadu, India Natwest Digitalx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Join us as a Software Engineer, PySpark and AWSThis is an opportunity for a driven Software Engineer to take on an exciting new career challengeDay-to-day, you'll build a wide network of stakeholders of varying levels of seniorityIts a chance to hone your existing technical skills and advance your careerWe're offering this role at associate vice president...

  • AWS Data

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    P3-C3-TSTSAWS Data EngineerDesign and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and QS/SNS/Cloudwatch/Step function/CDK(or Terrafoam.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes.Create and manage applications using Python, Pyspark, SQL, Databricks, and...

  • Pyspark Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Prowesstics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilledData Engineerwith hands-on experience inPySparkandDatabricksto design, develop, and optimize large-scale data pipelines. The ideal candidate should have strong problem-solving skills, experience working in cloud-based environments, and the ability to collaborate effectively with cross-functional teams.Key Responsibilities:Develop...

  • AWS Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Talent21 Management Shared Services Pvt. ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Responsibilities:Design, develop, and deploy scalable, secure applications using AWS cloud-native technologies.Use AWS services like Lambda, Kinesis, Redshift, and API Gateway to build high-performance solutions.Architect serverless applications using AWS Lambda for event-driven computing.Build and maintain real-time or batched data pipelinesDesign and...

  • aws de

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    P3-C3-TSTS AWS Data EngineerDesign and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and QS/SNS/Cloudwatch/Step function/CDK(or Terrafoam.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes.Create and manage applications using Python, Pyspark, SQL, Databricks, and...

  • AWS Data Engineer(Chennai, Indore

    2 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 10,00,000 - ₹ 15,00,000 per year

    Role: AWS Data EngineerJOB LOCATION : Chennai, Indore , PuneEXPERIENCE REQUIREMENT : 5+Required Technical Skill:Strong Knowledge ofAws Glue/AWS REDSHIFT/SQL/ETL.Good knowledge and experience in Pyspark for forming complex Transformation logic.AWS Data Engineer,SQL,ETL,DWH, Secondary : AWS Glue , AirflowMust-HaveGood Knowledge of SQL , ETLA minimum of 3 +...