Python Airflow

1 week ago

Chennai Tamil Nadu, India Virtusa Full time

Role: Python Airflow

Experience: 6 to 9 years

Work Mode: Hybrid

Work Timings: 2pm to 11pm

Location: Chennai and Hyderabad
Primary Skills: Airflow, Autosys, Python

Good to have: Finance domain exp
JD:
1. Design, implement, and maintain Airflow DAGs (Directed Acyclic Graphs) to automate ETL (Extract, Transform, Load) processes and other data workflows.
2. Configure and manage task dependencies, scheduling, retries, and error handling in Airflow.
3. Integrate Apache Airflow with different data sources, processing systems, and storage solutions (e.g., databases, cloud services, data lakes).

Responsibility:
7+ years of experience in managing workflow automation and job scheduling, with at least 3 year focused on Apache Airflow.
Strong background in Autosys (preferably 3+ years), including job scheduling, dependency management, and error handling.
Experience migrating jobs from Autosys to Airflow and automating complex workflows.
Familiarity with Airflow's components, such as operators, sensors, and hooks.
Strong knowledge of Python for writing Airflow tasks and custom operators.
Experience working with cloud environments (AWS, GCP, Azure).
Solid understanding of SQL, databases, and data engineering concepts.
Familiarity with containerization technologies (Docker, Kubernetes) is a plus.
Experience with monitoring, alerting, and logging systems (e.g., Prometheus, Grafana).

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Data Engineer – Airflow | Python | Databricks

    1 hour ago

    Chennai, India InternationalClients Full time

    Location: Chennai, India (Onsite initially, Remote flexibility later)Work Days: Monday to FridayExperience: 4-7 yearsClient: Leading Life Sciences Company – Specialized in the Pharmaceutical IndustryJob Description: We are seeking a skilled Data Engineer with expertise in Apache Airflow , Python , and cloud-based data platforms to support our...

  • Data Engineer – Airflow | Python | Databricks

    19 hours ago

    Chennai, India InternationalClients Full time

    Location: Chennai, India (Onsite initially, Remote flexibility later)Work Days: Monday to FridayExperience: 4-7 yearsClient: Leading Life Sciences Company – Specialized in the Pharmaceutical IndustryJob Description:We are seeking a skilled Data Engineer with expertise in Apache Airflow, Python, and cloud-based data platforms to support our client, a global...

  • Data Engineer – Airflow | Python | Databricks

    7 hours ago

    Chennai, India InternationalClients Full time

    Location: Chennai, India (Onsite initially, Remote flexibility later)Work Days: Monday to FridayExperience: 4-7 yearsClient: Leading Life Sciences Company – Specialized in the Pharmaceutical IndustryJob Description:We are seeking a skilled Data Engineer with expertise in Apache Airflow, Python, and cloud-based data platforms to support our client, a global...

  • Data Engineer – Airflow | Python | Databricks

    2 hours ago

    Chennai, India InternationalClients Full time

    Location: Chennai, India (Onsite initially, Remote flexibility later) Work Days: Monday to Friday Experience: 4-7 years Client: Leading Life Sciences Company – Specialized in the Pharmaceutical Industry Job Description: We are seeking a skilled Data Engineer with expertise in Apache Airflow , Python , and cloud-based data platforms to support our...

  • Dbt + Snowflake + Airflow

    2 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Strong on DBT with Snowflake SQL. Snowflake SQL Writing SQL queries against Snowflake Developing scripts Unix, Python, etc. to do Extract, Load, and Transform data. Hands-on experience with Snowflake utilities such as SnowSQL, SnowPipe, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures. Complex...

  • Python Developer

    2 days ago

    Chennai, Tamil Nadu, India TransUnion Full time

    What We ll Bring This is role is for a Assoc Developer to work on building global plaforms that are hosted across multiple countries in both public and private cloud private cloud environments We value people who are passionate around solving business problems through innovation and engineering practices We embrace a culture of experimentation and...

  • Senior Engineer

    5 days ago

    Chennai, Tamil Nadu, India NielsenIQ Full time

    Senior Engineer ChennaiOur Connect Technology teams are working on our new Connect platform a unified global open data ecosystem powered by Microsoft Azure Our clients around the world rely on Connect data and insights to innovate and grow As a QA Engineer you ll be part of a team of smart highly skilled technologists who are passionate about learning...

  • Data Testing

    1 week ago

    Chennai, Tamil Nadu, India Citi Full time

    The Testing Analyst 2 is a developing professional role. Applies specialty area knowledge in monitoring, assessing, analyzing and/or evaluating processes and data. Identifies policy gaps and formulates policies. Interprets data and makes recommendations. Researches and interprets factual information. Identifies inconsistencies in data or results, defines...

  • Lead Consultant

    3 days ago

    Chennai, Tamil Nadu, India GENPACT Full time

    Ready to build the future with AI At Genpact we don t just keep up with technology we set the pace AI and digital innovation are redefining industries and we re leading the charge Genpact s our industry-first accelerator is an example of how we re scaling advanced technology solutions to help global enterprises work smarter grow faster and...

  • GCP Data engineer

    7 days ago

    Chennai, India Jobted IN C2 Full time

    Overview: GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Responsibilities: GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL Requirements: GCP, Big Query, Composer, Python, Pyspark, Dataproc, Airflow, SQL