AWS Glue Designer

3 days ago


Greater Kolkata Area, India Tata Consultancy Services Full time

Experience: 15-20years

Location: Kolkata

Notice period should be*(immediate joiners or one month notice period)

Qualifications:

  • 4+ years of hands on experience in development, design, troubleshooting in AWS Glue
  • Know about using AWS glue in streaming solution. Integration of Glue with AWS other services. Data Quality implementation using Glue. Using Spark on Hadoop environment


Responsibility of / Expectations from the Role:

  • Able to implement efficient, scalable and reliable data integration solution using AWS Glue Service. Design and develop ETL workflows using AWS Glue components like Crawlers, Jobs and triggers. He will be able to write and optimize ETL Scripts in PySpark, configure data mapping, transformation using Glue visual interface or code editor.
  • Working experience in processing semi-structured data like json, XML using Glue.
  • Know about metadata management using Glue Data Catalog & Crawler.
  • Know to design custom transformation using AWS Glue development libraries.
  • Managing AWS Glue Costs and DPU Capacity planning.
  • Able to design Data Security and compliance pattern by applying AWS Glue’s security best practices like encrypting data in transit and at rest. Managing Access control and auditing data access and usage.


  • AWS Glue Designer

    5 days ago


    Kolkata, India Tata Consultancy Services Full time

    Experience: 15-20yearsLocation: KolkataNotice period should be*(immediate joiners or one month notice period) Qualifications:4+ years of hands on experience in development, design, troubleshooting in AWS Glue Know about using AWS glue in streaming solution. Integration of Glue with AWS other services. Data Quality implementation using Glue. Using Spark on...


  • Kolkata, India Tata Consultancy Services Full time

    Experience: 15-20yearsLocation: KolkataNotice period should be*(immediate joiners or one month notice period)Qualifications:4+ years of hands on experience in development, design, troubleshooting in AWS GlueKnow about using AWS glue in streaming solution. Integration of Glue with AWS other services. Data Quality implementation using Glue. Using Spark on...


  • kolkata, India Tata Consultancy Services Full time

    Experience: 15-20years Location: Kolkata Notice period should be*(immediate joiners or one month notice period) Qualifications: 4+ years of hands on experience in development, design, troubleshooting in AWS Glue Know about using AWS glue in streaming solution. Integration of Glue with AWS other services. Data Quality implementation using Glue. Using...


  • kolkata, India Tata Consultancy Services Full time

    Experience: 15-20yearsLocation: KolkataNotice period should be*(immediate joiners or one month notice period) Qualifications:4+ years of hands on experience in development, design, troubleshooting in AWS Glue Know about using AWS glue in streaming solution. Integration of Glue with AWS other services. Data Quality implementation using Glue. Using Spark on...


  • kolkata, India Tata Consultancy Services Full time

    Experience: 15-20years Location: Kolkata Notice period should be*(immediate joiners or one month notice period) Qualifications: 4+ years of hands on experience in development, design, troubleshooting in AWS Glue Know about using AWS glue in streaming solution. Integration of Glue with AWS other services. Data Quality implementation using Glue. Using...

  • Data Engineer

    1 month ago


    Mumbai/Kolkata, India Ultimate Digital Solutions Pvt. Ltd. Full time

    We're searching for a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in Python, AWS Glue, SQL, and data pipeline development. You'll be instrumental in designing, building, and maintaining robust data architectures and pipelines, ensuring high-quality data for analysis and insights. Location :...


  • Greater Bengaluru Area, India LTIMindtree Full time

    Skills : Informatica PC + SQL + AWS Hands On ( Lambda, Glue, Athena), Snowflake Experience : 3 to 4.11 yrs Location : All LTIM Office Locations Job Description: Design develop and maintain data pipelines using Informatica PowerCenter Work extensively with SQL Server to optimize queries and ensure data integrity Have a working understanding of Unix...


  • Greater Bengaluru Area, India LTIMindtree Full time

    Skills : Informatica PC + SQL + AWS Hands On ( Lambda, Glue, Athena), Snowflake Experience : 3 to 4.11 yrsLocation : All LTIM Office LocationsJob Description:Design develop and maintain data pipelines using Informatica PowerCenterWork extensively with SQL Server to optimize queries and ensure data integrityHave a working understanding of UnixManage and...


  • Bangalore Metropolitan Area, India LTIMindtree Full time

    Skills : Informatica PC + SQL + AWS Hands On ( Lambda, Glue, Athena), Snowflake Experience : 3 to 4.11 yrsLocation : All LTIM Office LocationsJob Description:Design develop and maintain data pipelines using Informatica PowerCenterWork extensively with SQL Server to optimize queries and ensure data integrityHave a working understanding of UnixManage and...


  • Greater Kolkata Area, India Tata Consultancy Services Full time

    Company OverviewTata Consultancy Services is a leading IT services company that helps clients transform and grow their businesses.


  • Kolkata, West Bengal, India Webologix Ltd INC Full time

    About Webologix LtdWebologix Ltd is a cutting-edge technology company dedicated to delivering innovative solutions that transform businesses.Salary Range:The estimated annual salary for this role is ₹1,500,000 - ₹3,500,000 (approximately $20,000 - $45,000 USD), depending on experience and qualifications.Job DescriptionWe are seeking an experienced AWS...


  • Kolkata, West Bengal, India Webologix Ltd INC Full time

    We are seeking a highly skilled Senior AWS Data Engineering Specialist to join our team at Webologix Ltd/ INC. This is a challenging role that requires strong technical expertise in data engineering, architecture, and development.About the RoleThis position is responsible for designing, implementing, and maintaining robust data pipelines using AWS services...


  • kolkata, India Recro Full time

    Role DetailsPosition: AWS Data EngineerLocation: RemoteExperience: 5+ yearsEducation: Technical degree preferredNotice: Immediate joiners or those currently serving preferreWhat We Need From YouTo move forward, please reply with the following details:Updated CVCompensation: What is your current CTC and expected CTC?Availability: What is your official notice...

  • Snowflake +aws

    7 days ago


    Kolkata, India Blue Ocean Ventures Full time

    **Must have Skills** - Working experience with Redshift /Snowflake - 3+ years of industry experience of working with Data pipelines - Strong understanding of AWS cloud platform - S3, EMR, Glue, Lambda etc. a. ETL/ELT concepts b. SQL- Concepts c. Python programming d. Relational Database (OLTP/OLAP/Data Modeling) concepts e.. Working understanding of...

  • Cloud Data Engineer

    6 days ago


    Greater Bengaluru Area, India LTIMindtree Full time

    Job Description:This position is responsible for designing, developing and maintaining data pipelines using Informatica PowerCenter.The ideal candidate will have a working understanding of Unix and experience with SQL Server to optimize queries and ensure data integrity.You will work extensively with cloud-based technologies such as S3, Glue, Lambda, RDS,...

  • Data Engineer

    2 months ago


    Greater Bengaluru Area, India Kratos Gamer Network Full time

    About KGeN: KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer...

  • Data Engineer

    2 months ago


    Greater Bengaluru Area, India Kratos Gamer Network Full time

    About KGeN:KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer cohorts,...


  • Kolkata, West Bengal, India Webologix Ltd INC Full time

    We are seeking an experienced Cloud Database Engineer and Data Architect to join our team at Webologix Ltd/ INC. In this role, you will design and implement scalable data pipelines using AWS Glue and develop serverless data processing workflows with AWS Lambda.Key Responsibilities:Design and implement data ingestion and transformation workflows using AWS...

  • Software Engineer

    1 month ago


    Greater Bengaluru Area, India Impetus Full time

    Job Description3-5 years of good hands on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive Good hands on experience of python and Bash Scripts Good understanding of SQL and data warehouse concepts Strong analytical, problem-solving, data analysis and research skills Demonstrable ability to think outside of the box...

  • Software Engineer

    1 month ago


    Greater Bengaluru Area, India Impetus Full time

    Job Description 3-5 years of good hands on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive Good hands on experience of python and Bash Scripts Good understanding of SQL and data warehouse concepts Strong analytical, problem-solving, data analysis and research skills Demonstrable ability to think outside of the...