AWS + Pyspark

2 days ago


Chennai, Tamil Nadu, India Cognizant Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Skills- AWS +Pyspark

Experience: 4 to 9 years

Location: AIA-Pune

As an AWS Data Engineer, you will design, build, and manage robust data pipelines on the AWS cloud platform. You will leverage your expertise in AWS data services and programming languages to ingest, process, transform, and store data efficiently, enabling data-driven insights and decision-making.

Key Responsibilities :

- Data Pipeline Development: Design, implement, and maintain scalable data pipelines using AWS services such as S3, Glue, Lambda, EMR, and Kinesis.

- Data Processing and Transformation: Utilize PySpark, Spark, and SQL to perform complex data transformations and aggregations on large datasets within the AWS ecosystem.

- Data Storage and Management: Design and implement data storage solutions using Amazon S3, RDS, DynamoDB, and Redshift, ensuring data quality, integrity, and accessibility.

- Data Modeling and Warehousing: Develop and maintain data models to support analytics and reporting, leveraging Redshift as the data warehousing solution.

- Infrastructure and Cloud Technologies: Provision and manage scalable data infrastructure using EC2, VPC, IAM, CloudFormation, and other relevant AWS services.

- Performance Optimization and Monitoring: Continuously monitor and optimize data pipelines and systems using CloudWatch, identifying and resolving performance bottlenecks.

- Collaboration and Knowledge Sharing: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide technical guidance.

Qualifications :

- Proficiency in Python, SQL, PySpark, and Spark.

- Strong expertise in AWS data services (S3, Glue, Lambda, EMR, Redshift, DynamoDB, RDS).

- Experience with data warehousing, ETL processes, and data modeling.

- Excellent problem-solving, analytical, and communication skills.


  • Pyspark

    2 days ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryAs a Sr. Developer you will play a pivotal role in optimizing and enhancing our data processing capabilities using PySpark and AWS technologies. Your expertise in Python and domain knowledge in Cards & Payments will drive impactful solutions. This hybrid role offers the flexibility of day shifts ensuring a balanced work-life...

  • Pyspark, AWS

    1 day ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are seeking a skilled Developer with 4 to 6 years of experience to join our team. The ideal candidate will have expertise in Amazon S3 and PySpark and a strong background in the Cards & Payments domain. This hybrid role offers the opportunity to work on cutting-edge projects in a dynamic environment contributing to the companys growth and...

  • PySpark Developer

    2 weeks ago


    Chennai, Tamil Nadu, India Risk Resources LLP Full time ₹ 10,000 - ₹ 80,000 per year

    Overview The PySpark Developer plays a crucial role in leveraging big data technologies to analyze and transform data, thereby driving informed business decisions. This position focuses on the design, development, and optimization of data processing applications using PySpark, a Python API for Apache Spark. In the fast-paced tech environment, the PySpark...


  • Chennai, Tamil Nadu, India Natwest Digitalx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Join us as a Software Engineer, PySpark and AWSThis is an opportunity for a driven Software Engineer to take on an exciting new career challengeDay-to-day, you'll build a wide network of stakeholders of varying levels of seniorityIts a chance to hone your existing technical skills and advance your careerWe're offering this role at associate vice president...

  • Pyspark Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Prowesstics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilledData Engineerwith hands-on experience inPySparkandDatabricksto design, develop, and optimize large-scale data pipelines. The ideal candidate should have strong problem-solving skills, experience working in cloud-based environments, and the ability to collaborate effectively with cross-functional teams.Key Responsibilities:Develop...

  • AWS Developer

    2 weeks ago


    Chennai, Tamil Nadu, India Talent21 Management Shared Services Pvt. ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Responsibilities:Design, develop, and deploy scalable, secure applications using AWS cloud-native technologies.Use AWS services like Lambda, Kinesis, Redshift, and API Gateway to build high-performance solutions.Architect serverless applications using AWS Lambda for event-driven computing.Build and maintain real-time or batched data pipelinesDesign and...

  • AWS data Engineer

    3 days ago


    Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Role : AWS Data EngineerRequired Technical Skill Set :PySpark, Python, ETL/Datawarehouse, AWS Glue, Step Functions, EMR, Redshift, Amazon S3Required Skills & Qualifications:Expertise in PySpark, PythonStrong proficiency in AWS services: Glue, Redshift, S3, Lambda, EMR, Kinesis.Hands-on experience with ETL tools and data pipeline orchestration.Proficiency in...

  • AWS Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India MyCareernet Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company:IT Services OrganizationKey Skills:AWS, Pyspark, Databricks, SQL, Python, ETL, Azure Databricks, Data modeling, Data Warehouse, Data Engineer, Data Engineering, PL/SQL, Data ModellingRoles and Responsibilities:Design, develop, and maintain ETL processes to support data integration and transformation.Utilize Python for data engineering tasks, ensuring...

  • AWS Data Engineer

    5 days ago


    Chennai, Tamil Nadu, India Antal TECH jobs Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are looking for passionate data engineers to join our Team.Experience : 3 to 5 yearsWork Mode & Location : Onsite /ChennaiWe are seeking a highly skilled AWS Data Engineer to design, build, and optimize large scale data pipelines and analytics platforms. The ideal candidate will have strong hands-on expertise in AWS Glue, Athena, Redshift, PySpark, and...

  • AWS Data engineer

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    AWS Data EngineerDesign and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and S3.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes.Create and manage applications using Python, SQL, Databricks, and various AWS technologies.Automate repetitive tasks and build...