Pyspark, Aws

3 days ago

Chennai Tamil Nadu, India Cognizant Full time

**Job Summary**

**Responsibilities**
- Develop and maintain scalable data processing solutions using PySpark to support business objectives in the Cards & Payments domain.
- Collaborate with cross-functional teams to design and implement data storage solutions on Amazon S3 ensuring data integrity and security.
- Analyze and optimize existing data workflows to improve efficiency and performance contributing to the overall success of the project.
- Provide technical expertise and guidance to team members fostering a collaborative and innovative work environment.
- Ensure compliance with industry standards and regulations maintaining the highest level of data privacy and security.
- Participate in code reviews and provide constructive feedback to peers promoting best practices and continuous improvement.
- Troubleshoot and resolve technical issues ensuring mínimal disruption to business operations and maintaining system reliability.
- Contribute to the development of project documentation ensuring clarity and accuracy for future reference.
- Work closely with stakeholders to understand business requirements and translate them into technical solutions.
- Implement data quality checks and validation processes to ensure the accuracy and consistency of data outputs.
- Monitor system performance and implement enhancements to improve user experience and operational efficiency.

**Qualifications**
- Possess strong proficiency in Amazon S3 and PySpark with a proven track record of successful project implementations.
- Demonstrate in-depth knowledge of the Cards & Payments domain with experience in handling related data and processes.
- Exhibit excellent problem-solving skills and the ability to work independently and collaboratively in a hybrid work model.
- Show strong communication skills capable of articulating technical concepts to non-technical stakeholders.
- Have a proactive approach to learning and adapting to new technologies and methodologies.
- Display a commitment to quality and attention to detail ensuring the highest standards in all deliverables.
- Hold a bachelors degree in Computer Science Information Technology or a related field.

  • Aws + Pyspark

    1 week ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Skills - AWS +Pyspark** **Experience: 4 to 9 years** **Location: AIA-Pune** **As an AWS Data Engineer, you will design, build, and manage robust data pipelines on the AWS cloud platform. You will leverage your expertise in AWS data services and programming languages to ingest, process, transform, and store data efficiently, enabling data-driven insights...

  • AWS + Pyspark

    1 week ago

    Chennai, Tamil Nadu, India Cognizant Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Skills- AWS +PysparkExperience: 4 to 9 yearsLocation: AIA-PuneAs an AWS Data Engineer, you will design, build, and manage robust data pipelines on the AWS cloud platform. You will leverage your expertise in AWS data services and programming languages to ingest, process, transform, and store data efficiently, enabling data-driven insights and...

  • Pyspark

    3 days ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** As a Sr. Developer you will play a pivotal role in optimizing and enhancing our data processing capabilities using PySpark and AWS technologies. Your expertise in Python and domain knowledge in Cards & Payments will drive impactful solutions. This hybrid role offers the flexibility of day shifts ensuring a balanced work-life...

  • Etl Databricks with Aws

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Develop and maintain a metadata driven generic ETL framework for automating ETL code Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS. Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files, streaming). Develop and maintain robust data pipelines for batch and streaming data using Delta...

  • Aws Data

    2 weeks ago

    Chennai, Tamil Nadu, India virtusa Full time

    P3-C3-TSTSAWS Data EngineerDesign and build scalable data pipelines using AWS services like AWS Glue Amazon Redshift and QS SNS Cloudwatch Step function CDK or Terrafoam Develop efficient ETL processes for data extraction transformation and loading into data warehouses and lakes Create and manage applications using Python Pyspark SQL Databricks and various...

  • Aws data engineer

    1 week ago

    Chennai, India Tata Consultancy Services Full time

    Experience: 5-10 YrsLocation - Bangalore, Chennai, Hyderabad, Pune, Kochi, Bhubaneshawar, KolkataKey SkillsAWS Lambda, Python, Boto3 , Pyspark, GlueMust have SkillsStrong experience in Python to package, deploy and monitor data science appsKnowledge in Python based automationKnowledge of Boto3 and related Python packagesWorking experience in AWS and AWS...

  • AWS Data Engineer

    4 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Experience: 5-10 Yrs Location - Bangalore,Chennai,Hyderabad,Pune,Kochi,Bhubaneshawar,Kolkata Key Skills AWS Lambda, Python, Boto3 ,Pyspark, Glue Must have Skills Strong experience in Python to package, deploy and monitor data science apps Knowledge in Python based automation Knowledge of Boto3 and related Python packages Working experience in AWS and AWS...

  • TCS Hiring for AWS Senior Data Engineer with Pyspark, AWS, Glue_Chennai

    2 weeks ago

    chennai, India Tata Consultancy Services Full time

    Job Title: AWS Senior Data Engineer with Pyspark, AWS, Glue Location: Chennai Experience: 6 to 10 Years Notice Period: 30-45 days Job Description: Must: PySpark, AWS(ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow) ,Qlik Replicate, Data Testing Nice To Have: Hadoop, Teradata Background, IaC(Cloud Formation / Terraform), Git Kind Regards, Priyankha M

  • Pyspark

    1 week ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryAs a Sr. Developer you will play a pivotal role in optimizing and enhancing our data processing capabilities using PySpark and AWS technologies. Your expertise in Python and domain knowledge in Cards & Payments will drive impactful solutions. This hybrid role offers the flexibility of day shifts ensuring a balanced work-life...

  • Pyspark, AWS

    1 week ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are seeking a skilled Developer with 4 to 6 years of experience to join our team. The ideal candidate will have expertise in Amazon S3 and PySpark and a strong background in the Cards & Payments domain. This hybrid role offers the opportunity to work on cutting-edge projects in a dynamic environment contributing to the companys growth and...