AWS Glue ETL Developer Lead

4 days ago


Chennai, Tamil Nadu, India Cognisol Full time

Cognisol is looking for an experienced AWS Glue ETL Developer Lead to join our team. In this role, you will be responsible for building and maintaining complex ETL pipelines using AWS Glue.

Job Overview:

The successful candidate will have experience in designing, developing, and maintaining large-scale ETL processes using AWS Glue. You will work closely with cross-functional teams to understand data requirements and deliver solutions that meet the needs of our business.

Key Responsibilities:

  • Design and develop complex ETL pipelines using AWS Glue.
  • Collaborate with data architects, data engineers, and business stakeholders to understand data requirements.
  • Develop and maintain scalable data processing solutions using AWS Glue.
  • Implement data quality checks, error handling, and logging mechanisms within AWS Glue jobs.

Required Qualifications:

  • 5-12 years of experience in data engineering and ETL development, with a strong focus on AWS Glue.
  • Expertise in PySpark or Scala for data transformation tasks.
  • Strong knowledge of AWS services: Glue, S3, Redshift, Athena, Lambda, Kinesis, and IAM.

  • AWS Glue Developer

    4 days ago


    Chennai, Tamil Nadu, India Cognisol Full time

    Job DescriptionKey Responsibilities- Design, develop, and maintain ETL pipelines using AWS Glue to support data integration and transformation needs.- Build scalable and efficient data processing solutions leveraging AWS Glue's ETL capabilities.- Write complex PySpark or Scala scripts for data extraction, transformation, and loading processes.- Collaborate...


  • Chennai, Tamil Nadu, India HCLTech Full time

    Key ResponsibilitiesDesign and implement data architectures on AWS, including data pipelines, storage, and security.Collaborate with cross-functional teams to ensure seamless migration and integration.Optimize data architectures for scalability, performance, and cost-effectiveness.Requirements5+ years of experience in Hadoop development and...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Role: AWS Data EngineerJOB LOCATION : Chennai, Indore , PuneEXPERIENCE REQUIREMENT : 4+Required Technical Skill:Strong Knowledge of Aws Glue/AWS REDSHIFT/SQL/ETL. Good knowledge and experience in Pyspark for forming complex Transformation logic.AWS Data Engineer,SQL,ETL, DWH , Secondary : AWS Glue , AirflowMust-HaveGood Knowledge of SQL , ETLA minimum of 3 +...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Role: AWS Data EngineerJOB LOCATION : Chennai, Bangalore, Mumbai, Indore ,PuneEXPERIENCE REQUIREMENT : 4+Required Technical Skill:Strong Knowledge ofAws Glue/AWS REDSHIFT/SQL/ETL.Good knowledge and experience in Pyspark for forming complex Transformation logic.AWS Data Engineer,SQL,ETL,DWH, Secondary : AWS Glue , AirflowMust-HaveGood Knowledge of SQL , ETLA...

  • AWS Data Engineer

    18 hours ago


    Chennai, Tamil Nadu, India Risk Resources LLP Full time

    Role : AWS Data EngineerRequired Technical Skill Set : ETL, SQL & AWSDesired Competencies (Technical/Behavioral Competency) :Must-Have :- Strong Knowledge of Aws Glue/AWS REDSHIFt/SQL/ETL.Good knowledge and experience in Pyspark for forming complex Transformation logic.Good-to-Have : PythonResponsibility of / Expectations from the Role :1. Good knowledge of...


  • Chennai, Tamil Nadu, India Chuwa America Corporation Full time

    Job Title: ETL Automation Test Engineer - Python Job Overview: We are seeking a highly skilled Software Test Engineer with strong expertise in Python development, ETL testing, and CI/CD. Key Responsibilities: Automate manual ETL processes using Python scripting. Design, develop, and execute ETL test cases and test scripts to validate data pipelines. Perform...


  • Chennai, Tamil Nadu, India Chuwa America Corporation Full time

    ETL Automation Test Engineer - Python Fulltime Employment at Chennai or Pune, India Job Overview: We are looking for a highly skilled Software Test Engineer with strong Python development, ETL testing, and CI/CD experience . Our client has a large set of manual ETL scripts that need to be automated using Python , making Python scripting expertise essential ....


  • Chennai, Tamil Nadu, India Chuwa America Corporation Full time

    ETL Automation Test Engineer - PythonFulltime Employment at Chennai or Pune, IndiaJob Overview:We are looking for a highly skilled Software Test Engineer with strong Python development, ETL testing, and CI/CD experience. Our client has a large set of manual ETL scripts that need to be automated using Python, making Python scripting expertise essential. As...


  • Chennai, Tamil Nadu, India Coders Brain Technology Private Limited Full time

    About UsCoders Brain Technology Private Limited is a forward-thinking technology company in the fast-evolving cybersecurity field. We are committed to innovation and continuous learning and development. As a key member of our data engineering team, you will play a vital role in shaping our data architecture and driving impactful data solutions.Job...


  • Chennai, Tamil Nadu, India HexaCorp Full time

    As a Cloud Data Engineering Lead, you will play a pivotal role in designing, developing, and implementing robust data solutions for our clients. You will lead a team of data engineers to deliver high-quality data pipelines and data lakes, ensuring seamless integration with various data sources and business intelligence platforms.Key Responsibilities : -...


  • Chennai, Tamil Nadu, India Cognisol Full time

    Cognisol is seeking an experienced Cloud Data Engineering Specialist to join our team. In this role, you will be responsible for designing, developing, and maintaining scalable data processing solutions using AWS Glue.Key Responsibilities:Design and develop efficient ETL pipelines using AWS Glue to support data integration needs.Collaborate with data...

  • AWS Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Title: AWS Data Engineer Experience: 4-8 years of experience in the field. Key Skills: Proficiency in Python programming and Pyspark Data Engineering expertise using AWS core services (Lambda, Glue, EMR, and RedShift) Familiarity with SQL, Airflow, Snowflake, Hive, and AWS S3 Responsibilities: Design, build, and test complex data pipelines (batch and...

  • AWS - Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Hexaware Technologies Full time

    We are looking for AWS Data Engineer for Chennai , Mumbai , Pune & Bangalore.Exp - 6-12 yearsPlease share your details at Saudaminic@hexaware.com.Name:Contact No:Email id :Current Company:Total Exp:Rel Exp in AWS:Notice period:Current CTC:Expected CTC:Current Location:Preferred Location:AWS Data EngineerPrimary Skillset:Proven experience as a Data Engineer...


  • Chennai, Tamil Nadu, India Photon Full time

    Job description This individual will be part of the data engineering team working on the development of data pipelines, transformations of data, participation in proof of concept of new data patterns, optimization of existing data feeds and enhancements. Primary skills - RDBMS (Snowflake, Postgres), Cloud platforms and Services (AWS – IAM, EC2, S3,...


  • Chennai, Tamil Nadu, India Mphasis Full time

    AWS Data Engineer Lead Responsibilities: Designing and implementing highly performant data ingestion pipelines from multiple sources using AWS services such as AWS Glue, Glue Catalog, AWS Step Functions, AWS EMR, AWS Lambda. Building and maintaining data lakes and data warehouses in AWS to support data analytics and business intelligence....

  • AWS Architect

    1 week ago


    Chennai, Tamil Nadu, India Team1 Consulting Full time

    About Company:Team1 Consulting is a leading System Integrator specializing in IT infrastructure, software, cyber security, cloud solutions, and generative AI domains. We deliver cutting-edge IT solutions tailored to drive innovation and accelerate business growth. Our expertise empowers organizations across industries to thrive in the digital era with...


  • Chennai, Tamil Nadu, India Millims Full time

    Experience: 6+ years in data engineering with a focus on AWS cloud technologies. Technical Skills: o Expertise in AWS Glue, Lambda, EMR, Redshift, Kinesis, and Step Functions. o Proficiency in SQL, Python, and PySpark for data transformations. o Strong understanding of ETL/ELT best practices and data warehousing concepts. o Experience with Apache Airflow...

  • AWS Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India Roshini R (Proprietor of BluePrism Solutions) Full time

    Job DescriptionWe are looking for an experienced AWS Data Engineer with 6+ years of experience, including at least 2+ years of hands-on work with Databricks. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines using AWS services and Databricks. You will play a key role in processing large datasets, enabling...


  • Chennai, Tamil Nadu, India Cognisol Full time

    Cognisol seeks a Big Data Integration Expert to join our team. In this role, you will be responsible for designing, developing, and maintaining efficient data processing solutions using AWS Glue.Job Description:The successful candidate will have experience in designing, developing, and maintaining large-scale data integration processes using AWS Glue. You...

  • Big Data Engineer

    3 days ago


    Chennai, Tamil Nadu, India Coders Brain Technology Private Limited Full time

    Job DescriptionMandatory skillset:1. Apacha Kafka or AWS kinesys.2. Elastic Search or AWS open Search.3. Apacha Spark or aws Glue.4. PythonWe are looking for a skilled and experienced Big Data Engineer with expertise in modern cloud-based technologies, specifically AWS services like Kinesis, Glue, Lambda, and Kafka. The ideal candidate will have hands-on...