Aws Glue

6 days ago

Chennai Tamil Nadu, India Cognizant Full time

**Job Summary**

**Responsibilities**
- Develop and maintain scalable data pipelines using Airflow to ensure efficient data processing and integration.
- Utilize AWS services to design and implement cloud-based solutions that enhance data storage and retrieval.
- Write and optimize SQL queries to extract transform and load data from various sources.
- Leverage PySpark to perform data analysis and processing on large datasets ensuring high performance and reliability.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Monitor and troubleshoot data pipelines to ensure data accuracy and integrity.
- Implement best practices for data management including data governance and security measures.
- Provide technical guidance and support to junior developers fostering a collaborative and knowledge-sharing environment.
- Conduct code reviews to ensure code quality and adherence to coding standards.
- Stay updated with the latest industry trends and technologies to continuously improve data solutions.
- Document technical specifications processes and workflows to maintain comprehensive project documentation.
- Participate in agile development processes including sprint planning stand-ups and retrospectives.

**Qualifications**
- Possess a strong understanding of Advanced Excel for data analysis and reporting.
- Demonstrate proficiency in using Airflow for orchestrating data workflows.
- Have hands-on experience with AWS services for cloud-based data solutions.
- Show expertise in writing and optimizing SQL queries for data manipulation.
- Exhibit proficiency in PySpark for processing large datasets.
- Have a solid understanding of Big Data technologies and best practices.
- Display excellent problem-solving skills and attention to detail.
- Possess strong communication and collaboration skills to work effectively with cross-functional teams.
- Show a proactive attitude towards learning and adopting new technologies.
- Demonstrate the ability to work independently and manage multiple tasks simultaneously.
- Have experience in agile development methodologies.
- Exhibit a commitment to maintaining data accuracy and integrity.
- Show a passion for driving impactful results through data-driven solutions.

**Certifications Required**
- AWS Certified Solutions Architect Google Cloud Professional Data Engineer Microsoft Certified: Azure Data Engineer Associate

  • AWS Glue Data Engineer

    2 weeks ago

    Bengaluru, Chennai, Hyderabad, India Perficient Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Perficient is the global AI-first consultancy. Our team of strategists, designers, technologists, and engineers partners with the worlds most innovative enterprises and admired brands to deliver real business results through the transformative power of AI. As part of our AI-First strategy, we empower every employee to build AI fluency and actively engage...

  • Lead Aws Glue Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India DXC Technology Full time

    Lead AWS Data Engineer Job Location Hyderabad Bangalore Chennai Noida Gurgaon Pune Indore Mumbai Kolkata We are seeking a skilled Lead AWS Data Engineer with strong programming and SQL skills to join our team The ideal candidate will have hands-on experience with AWS Data Analytics services and a basic understanding of general AWS services Additionally prior...

  • Aws Data

    1 week ago

    Chennai, Tamil Nadu, India virtusa Full time

    P3-C3-TSTSAWS Data EngineerDesign and build scalable data pipelines using AWS services like AWS Glue Amazon Redshift and QS SNS Cloudwatch Step function CDK or Terrafoam Develop efficient ETL processes for data extraction transformation and loading into data warehouses and lakes Create and manage applications using Python Pyspark SQL Databricks and various...

  • Aws data engineer

    4 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill - AWS Data Engineer - Redshift, Pyspark, GlueExp range - 5 yrs - 8yrsLocation- ChennaiNotice period 30 daysPls find the Job Description below.Good hands-on experience in Python programming and PysparkData Engineering experience using AWS core services (Lambda, Glue, EMR and Red...

  • Aws data engineer

    3 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill - AWS Data Engineer - Redshift, Pyspark, GlueExp range - 5 yrs - 8yrsLocation- ChennaiNotice period 30 daysPls find the Job Description below.Good hands-on experience in Python programming and PysparkData Engineering experience using AWS core services (Lambda, Glue, EMR and Red...

  • Aws Services

    4 days ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** **Responsibilities** - Develop and maintain data pipelines using Redshift Databricks and Kafka to ensure seamless data flow. - Implement and manage AWS Lambda functions to automate data processing tasks. - Utilize AWS Services to design and deploy scalable and secure data solutions. - Oversee the integration of AWS Glue for efficient data...

  • Aws + Pyspark

    6 days ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Skills - AWS +Pyspark** **Experience: 4 to 9 years** **Location: AIA-Pune** **As an AWS Data Engineer, you will design, build, and manage robust data pipelines on the AWS cloud platform. You will leverage your expertise in AWS data services and programming languages to ingest, process, transform, and store data efficiently, enabling data-driven insights...

  • Aws Data

    6 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    P3-C3-TSTS AWS Data Engineer Design and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and QS/SNS/Cloudwatch/Step function/CDK(or Terrafoam.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes. Automate repetitive tasks and build reusable frameworks to improve...

  • Python Aws

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    **Requirements**: Experience At least 5 years of experience in AWS based projects. Technical skills Proficiency in Python and PySpark for data engineering tasks. Big Data Strong knowledge of Big Data technologies and data warehousing concepts. AWS services Experience with AWS Data Engineering stack, including S3, RDS, Athena, Glue, Lambda, and Step...

  • Aws Support

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    **Role**: AWS support **Work Mode**: Hybrid **Work timings**: 2pm to 11pm **Location**: Chennai & Hyderabad **Primary Skills**: AWS, ETL, AirFlow, Pyspark **Detailed JD** Experience working in AWS platform Have sound knowledge on AWS Services like EC2, S3, Lambda, Glue, CloudWatch ETL Services (Glue Job, Redshift, Athena) Good knowledge in AirFlow,...