Aws De- Airflow

4 days ago

Chennai Tamil Nadu, India Willware Technologies Full time

**Work mode: One week of onboarding at Chennai office and later Remote**
- Design, develop, and deploy complex data pipelines using Apache Airflow on AWS infrastructure.
- Architect, optimize, and automate data workflows to ensure reliability, scalability, and performance.
- Collaborate with data scientists, analysts, and other stakeholders to understand requirements and translate them into technical solutions.
- Implement best practices for data ingestion, processing, transformation, and storage.
- Monitor pipeline performance, troubleshoot issues, and implement enhancements to improve efficiency and reliability.
- Ensure data quality and integrity throughout the data lifecycle by implementing robust validation and error handling mechanisms.
- Stay current with emerging technologies and industry trends in data engineering and contribute to continuous improvement initiatives.
- Mentor junior team members and provide technical guidance and support as needed.

**Qualification**:

- 5-7 years of professional experience in data engineering, with a focus on building and managing data pipelines.
- Extensive hands-on experience with Apache Airflow, including DAG design, scheduling, and orchestration.
- Strong proficiency in AWS services such as S3, EC2, EMR, Glue, Lambda, and Redshift.
- Solid understanding of data warehousing concepts, ETL processes, and data modeling techniques.
- Proficiency in programming languages such as Python, SQL, and Shell scripting.

**Job Type**: Temporary
Contract length: 3-6 months

**Benefits**:

- Work from home

Schedule:

- Monday to Friday

**Experience**:

- total work: 5 years (required)
- Spark Airflow: 5 years (required)

Work Location: In person

**Speak with the employer**

+91 8667001718

  • Snaplogic & Airflow

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    We are seeking a Senior Developer with expertise in SnapLogic and Apache Airflow to design, develop, and maintain enterprise-level data integration solutions. This role requires strong technical expertise in ETL development, workflow orchestration, and cloud technologies. You will be responsible for automating data workflows, optimizing performance, and...

  • Aws De

    16 hours ago

    Chennai, Tamil Nadu, India Virtusa Full time

    P3-C3-TSTS AWS Data Engineer Design and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and QS/SNS/Cloudwatch/Step function/CDK(or Terrafoam.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes. Automate repetitive tasks and build reusable frameworks to improve...

  • Apache Airflow Dev

    2 weeks ago

    Hyderabad, Chennai, Noida, India Growel Softech Private Limited Full time

    Job Description Description We are seeking an experienced Apache Airflow Developer to join our team in India. The ideal candidate will have a strong background in workflow orchestration and data engineering, with a passion for building scalable data pipelines. Responsibilities - Design, develop, and maintain workflows using Apache Airflow. - Implement and...

  • Aws Data Pm

    16 hours ago

    Chennai, Tamil Nadu, India Virtusa Full time

    P3-C3-TSTS AWS DATA PM We are seeking an experienced AWS Data Manager to lead and manage the design, implementation, and optimization of our cloud-based data infrastructure. This role involves overseeing the architecture, governance, and operations of data platforms hosted on Amazon Web Services (AWS), ensuring scalability, security, and performance to...

  • Python+Aws+ETL - AIA

    4 days ago

    Chennai, Tamil Nadu, India Cognizant Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job DescriptionRole: Python+AWS+ETLExperience: 6 to 9 YearsWe are looking for a Software Lead with the following skill set:Strong hands-on experience with Python.Strong hands-on experience with data engineering and ETL/ELT.Good understanding of Big data engineering principles.Good understanding of core networking principles as well as cloud infra model.Good...

  • ▷ [15h Left] Aws Data Engineer- Chennai

    4 weeks ago

    Chennai, Tamil Nadu, India Diverse Lynx Full time

    HIRING FOR AWS DATA ENGINEER- CHENNAI Job Summary We are looking for a highly skilled AWS Data Engineer to join our growing data team In this role you will be responsible for designing building and maintaining scalable and reliable data pipelines and architectures on AWS to support analytics machine learning and business intelligence initiatives The ideal...

  • Python developers, AWS services

    2 days ago

    Chennai, Tamil Nadu, India Suzva Software Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Shift: UK Shift (if applicable)Job SummaryWe are looking for a highly skilled Python Lead Developer with strong expertise in Python, SQL, AWS, and Apache Airflow. The ideal candidate will lead a team of developers to build scalable data pipelines, backend systems, and cloud-based solutions, ensuring high performance, maintainability, and adherence to best...

  • Aws Data Architect

    16 hours ago

    Saidapet, Chennai, Tamil Nadu, India Agilisium Full time

    **Job Information**: Date Opened - 09/08/2025 City - Saidapet Country - India Job Role - Data Engineering State/Province - Tamil Nadu Industry - IT Services Job Type - Full time Zip/Postal Code - 600096 **Introduction to the Role** We are seeking an experienced **Data Architect** with **10-18 years of expertise** in data architecture, engineering, and...

  • Data Architect- Aws-big Data

    6 days ago

    Chennai, Tamil Nadu, India InfoCepts Full time

    **Position**: Data Architect - AWS-Big Data **Purpose of the Position**: As a Data Architect, you will be responsible for designing and optimizing complex Big Data solutions using AWS services, ensuring a balance between cost and performance. Responsibilities include assessing existing technology, performing impact assessments, optimizing designs, and...

  • Python developers, AWS services

    2 days ago

    Chennai, Tamil Nadu, India Suzva Software Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Location: Chennai Hybrid (3 Days a Week in Office)Employment Type: ContractShift: UK Shift (if applicable) Job SummaryWe are looking for a highly skilled Python Lead Developer with strong expertise in Python, SQL, AWS, and Apache Airflow. The ideal candidate will lead a team of developers to build scalable data pipelines, backend systems, and cloud-based...