AWS Glue Designer

2 days ago


Greater Kolkata Area, India Tata Consultancy Services Full time

Experience: 15-20years

Location: Kolkata

Notice period should be*(immediate joiners or one month notice period)

Qualifications:

  • 4+ years of hands on experience in development, design, troubleshooting in AWS Glue
  • Know about using AWS glue in streaming solution. Integration of Glue with AWS other services. Data Quality implementation using Glue. Using Spark on Hadoop environment


Responsibility of / Expectations from the Role:

  • Able to implement efficient, scalable and reliable data integration solution using AWS Glue Service. Design and develop ETL workflows using AWS Glue components like Crawlers, Jobs and triggers. He will be able to write and optimize ETL Scripts in PySpark, configure data mapping, transformation using Glue visual interface or code editor.
  • Working experience in processing semi-structured data like json, XML using Glue.
  • Know about metadata management using Glue Data Catalog & Crawler.
  • Know to design custom transformation using AWS Glue development libraries.
  • Managing AWS Glue Costs and DPU Capacity planning.
  • Able to design Data Security and compliance pattern by applying AWS Glue’s security best practices like encrypting data in transit and at rest. Managing Access control and auditing data access and usage.


  • AWS Glue Designer

    4 days ago


    Greater Kolkata Area, India Tata Consultancy Services Full time

    Experience: 15-20yearsLocation: KolkataNotice period should be*(immediate joiners or one month notice period) Qualifications:4+ years of hands on experience in development, design, troubleshooting in AWS Glue Know about using AWS glue in streaming solution. Integration of Glue with AWS other services. Data Quality implementation using Glue. Using Spark on...

  • AWS Glue Designer

    4 days ago


    Kolkata, India Tata Consultancy Services Full time

    Experience: 15-20yearsLocation: KolkataNotice period should be*(immediate joiners or one month notice period) Qualifications:4+ years of hands on experience in development, design, troubleshooting in AWS Glue Know about using AWS glue in streaming solution. Integration of Glue with AWS other services. Data Quality implementation using Glue. Using Spark on...


  • kolkata, India Tata Consultancy Services Full time

    Experience: 15-20years Location: Kolkata Notice period should be*(immediate joiners or one month notice period) Qualifications: 4+ years of hands on experience in development, design, troubleshooting in AWS Glue Know about using AWS glue in streaming solution. Integration of Glue with AWS other services. Data Quality implementation using Glue. Using...


  • Kolkata, India Mindtree Full time

    Expertise in batch and file-based integrations. Experience of performing ETL ELT processes from multiple sources - Hands-on experience of working in AWS cloud environment and using Python, AWS Glue for data integrations. Experience of integrating with Snowflake eco-system and using of tools such as SnowSQL and Snowpipe. Strong Database and SQL Skills...


  • kolkata, India Tata Consultancy Services Full time

    Experience: 15-20yearsLocation: KolkataNotice period should be*(immediate joiners or one month notice period) Qualifications:4+ years of hands on experience in development, design, troubleshooting in AWS Glue Know about using AWS glue in streaming solution. Integration of Glue with AWS other services. Data Quality implementation using Glue. Using Spark on...


  • Greater Bengaluru Area, India LTIMindtree Full time

    Skills : Informatica PC + SQL + AWS Experience : 3 to 4.11 yrsLocation : All LTIM Office LocationsJob Description:Design develop and maintain data pipelines using Informatica PowerCenterWork extensively with SQL Server to optimize queries and ensure data integrityHave a working understanding of UnixManage and schedule data workflows using Tivoli...


  • Greater Bengaluru Area, India LTIMindtree Full time

    Skills : Informatica PC + SQL + AWS Experience : 3 to 4.11 yrsLocation : Pune & Hyderabad Job Description:Design develop and maintain data pipelines using Informatica PowerCenterWork extensively with SQL Server to optimize queries and ensure data integrityHave a working understanding of UnixManage and schedule data workflows using Tivoli SchedulerCloud Data...


  • Greater Bengaluru Area, India LTIMindtree Full time

    Skills : Informatica PC + SQL + AWS Experience : 3 to 4.11 yrs Location : Pune & Hyderabad Job Description: Design develop and maintain data pipelines using Informatica PowerCenter Work extensively with SQL Server to optimize queries and ensure data integrity Have a working understanding of Unix Manage and schedule data workflows using Tivoli...


  • Greater Bengaluru Area, India LTIMindtree Full time

    Skills : Informatica PC + SQL + AWS Experience : 3 to 4.11 yrs Location : Pune & Hyderabad Job Description: - Design develop and maintain data pipelines using Informatica PowerCenter - Work extensively with SQL Server to optimize queries and ensure data integrity - Have a working understanding of Unix - Manage and schedule data workflows using Tivoli...


  • Kolkata, West Bengal, India Webologix Ltd INC Full time

    Job DescriptionWe are seeking a highly skilled AWS Cloud Data Engineer to join our team at Webologix Ltd/ INC. As an AWS Cloud Data Engineer, you will be responsible for designing, implementing, and managing large-scale data pipelines and architectures on AWS.Key Responsibilities:Data Ingestion and Transformation: Design and implement data ingestion and...


  • Bangalore Metropolitan Area, India LTIMindtree Full time

    Skills : Informatica PC + SQL + AWS Experience : 3 to 4.11 yrsLocation : All LTIM Office LocationsJob Description:Design develop and maintain data pipelines using Informatica PowerCenterWork extensively with SQL Server to optimize queries and ensure data integrityHave a working understanding of UnixManage and schedule data workflows using Tivoli...


  • Bangalore Metropolitan Area, India LTIMindtree Full time

    Skills : Informatica PC + SQL + AWS Experience : 3 to 4.11 yrsLocation : Pune & Hyderabad Job Description:Design develop and maintain data pipelines using Informatica PowerCenterWork extensively with SQL Server to optimize queries and ensure data integrityHave a working understanding of UnixManage and schedule data workflows using Tivoli SchedulerCloud Data...

  • Data Engineer

    3 days ago


    Greater Bengaluru Area, India LTIMindtree Full time

    About UsLTIMindtree is a global technology consulting and services company that partners with clients to drive growth, efficiency, and innovation.Job DescriptionWe are seeking an experienced Data Engineer to join our team. As a Data Engineer at LTIMindtree, you will be responsible for designing, developing, and maintaining data pipelines using Informatica...

  • Sse Big Data

    1 week ago


    Kolkata, India Mindtree Full time

    Batch Engineer (Mandatory skill # AWS Glue ) - Expertise in batch and file-based integrations Experience of performing ETL ELT processes from multiple sources - Hands-on experience of working in AWS cloud environment and using Python, AWS Glue for data integrations - Experience of integrating with Snowflake eco-system and using of tools such as SnowSQL and...

  • AWS+Python Engineer

    4 days ago


    Kolkata, India Tata Consultancy Services Limited Full time

    Job Description Job Title AWS+Python Engineer Location Kolkata Experience 4-10 yrs Skills AWS, Python, SQL2, DevOps Knowledge, Agile Knowledge, Healthcare Domain Knowledge Job Description: - Strong knowledge in Python. - Strong knowledge in SQL. - Candidates should have experience in AWS services like S3, RDS, Lamda, Glue, Step Function, Airflow, EC2 &...


  • Kolkata, West Bengal, India Tata Consultancy Services Limited Full time

    Company OverviewTata Consultancy Services Limited is a global leader in consulting and information technology services. We are the backbone of many organizations, enabling them to transform their businesses.Job DescriptionWe are seeking a skilled AWS+Python Engineer to join our team. As a key member of our development team, you will be responsible for...

  • Data Engineer

    3 days ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Data Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 4+ to 10+ Years Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL. Key Responsibilities: Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step...

  • Data Migration

    4 days ago


    Greater Kolkata Area, India Tata Consultancy Services Full time

    Mark logic Data Migration -10to13yrs only KolkataMust-HaveSolution Designing & architecture, Marklogic, Data Migration and Transformation, OpenSearch, AWSGood-to-HaveSolution Designing & architecture, Marklogic, Data Migration and Transformation, OpenSearch, AWS Responsibility of / Expectations from the Role1Requirement understanding and analysis2Understand...

  • Data Migration

    2 days ago


    Greater Kolkata Area, India Tata Consultancy Services Full time

    Mark logic Data Migration -10to13yrs only Kolkata Must-Have Solution Designing & architecture, Marklogic, Data Migration and Transformation, OpenSearch, AWS Good-to-Have Solution Designing & architecture, Marklogic, Data Migration and Transformation, OpenSearch, AWS Responsibility of / Expectations from the Role 1 Requirement understanding and analysis 2...

  • Data Engineer

    2 days ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Data EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 4+ to 10+ YearsMust Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL.Key Responsibilities:Data Pipeline Development:Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to...