python Airflow

4 weeks ago


Hyderabad Bengaluru Chennai, India Coders Brain Technology Private Limited Full time
Job Description

Description

We are looking for a Python Airflow Developer to join our team in India. The ideal candidate will have a strong background in Python and experience in designing and implementing workflows using Apache Airflow to streamline our data processing and ETL tasks.

Responsibilities

- Design, develop, and maintain workflows using Apache Airflow.
- Collaborate with data engineering and data science teams to automate data pipelines.
- Monitor and troubleshoot Airflow tasks, ensuring reliability and performance.
- Implement best practices for code quality, testing, and deployment.
- Document workflows and processes for team knowledge sharing.

Skills and Qualifications

- 3-6 years of experience in Python programming.
- Strong understanding of Mongo DB,Python Airflow, dask, Flask.
- Experience with SQL and database technologies (e.g., PostgreSQL, MySQL).
- Familiarity with cloud platforms (e.g., AWS, GCP) and their services related to data processing.
- Understanding of ETL processes and data warehousing concepts.
- Experience with version control systems (e.g., Git) and CI/CD pipelines.
- Knowledge of containerization technologies like Docker is a plus.

  • Bengaluru, Karnataka, India Achutha Associates Full time

    Big Data Engineer - Airflow & Python Location: Bangalore, India Experience: 5+ years Job Summary: Key Responsibilities: Design, develop, and maintain ETL/ELT pipelines using Apache Airflow. Write efficient, scalable, and reusable Python scripts for data processing. Work with big data technologies (Spark, Hadoop, Hive, etc.) to manage and analyze large...

  • Apache Airflow

    3 weeks ago


    Bengaluru, Karnataka, India People Prime Worldwide Full time

    About Company :They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society.About...

  • Apache Airflow

    2 weeks ago


    Bengaluru, Karnataka, India People Prime Worldwide Full time

    About Company : They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society....

  • Dbt and Airflow

    24 hours ago


    Bengaluru, India Black & White Business Solutions Full time

    **Job Information**: Industry **IT Services** *** Province **Karnataka** *** City **Bangalore North** *** Postal Code **560001** *** Country **India** We have openings for DBT and Airflow requirement with one of our MNC Client. Please find the status below. Location: - Mumbai_ Malad location - Experience: - 4-6years - Notice Period: -...

  • Aws De- Airflow

    24 hours ago


    Chennai, Tamil Nadu, India Willware Technologies Full time

    **Work mode: One week of onboarding at Chennai office and later Remote** - Design, develop, and deploy complex data pipelines using Apache Airflow on AWS infrastructure. - Architect, optimize, and automate data workflows to ensure reliability, scalability, and performance. - Collaborate with data scientists, analysts, and other stakeholders to understand...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 322031NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Snowflake Python Airflow Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job Duties Team...

  • Python

    3 days ago


    Bengaluru, Karnataka, India WARPE JOBS Full time

    Cloud Native Product Development experience with ability to develop new connectors and integrations with Databases, Cloud Data Warehouses, SaaS Platforms using Django, React, Python programming using PostgreSQL as meta store orchestrated through Airflow and compute heavy operations done through Spark clusters. development in Python, Django, React 3....

  • Python for Insights

    2 days ago


    Bengaluru, Karnataka, India Wipro Limited Full time

    **Role Purpose** **͏**: **Position Overview**: Seeking a skilled Python and Airflow Developer with a strong data engineering background. **Key Responsibilities**: - Develop and maintain data pipelines using Apache Airflow and Python. - Collaborate with business managers to understand data requirements. - Optimize existing data workflows for performance...


  • Bengaluru, India Vega Intellisoft Full time

    Job Description: - Strong Python + SQL query and Airflow - Key Skills: - Strong Python + SQL query and Airflow - Location: - Bangalore, Chennai, Delhi, Hyderabad, kochi, Mumbai, Noida, Trivandram - Required Experience: - 5-7 yrs - Positions: - 1


  • Bengaluru, Karnataka, India Unitforce Technologies Consulting Full time

    Job DescriptionRoles and Responsibility- Python/SQL- - Big data technologies (Hadoop data lakes ), SQL, scripting languages (Python, Shell scripting), CI/CD, working Knowledge on Spark/Java/Python Description We are looking for a technically skilled Senior Developer for Big Data development to help prevent financial crime to the benefit of our customers,...