
python Airflow
4 weeks ago
Description
We are looking for a Python Airflow Developer to join our team in India. The ideal candidate will have a strong background in Python and experience in designing and implementing workflows using Apache Airflow to streamline our data processing and ETL tasks.
Responsibilities
- Design, develop, and maintain workflows using Apache Airflow.
- Collaborate with data engineering and data science teams to automate data pipelines.
- Monitor and troubleshoot Airflow tasks, ensuring reliability and performance.
- Implement best practices for code quality, testing, and deployment.
- Document workflows and processes for team knowledge sharing.
Skills and Qualifications
- 3-6 years of experience in Python programming.
- Strong understanding of Mongo DB,Python Airflow, dask, Flask.
- Experience with SQL and database technologies (e.g., PostgreSQL, MySQL).
- Familiarity with cloud platforms (e.g., AWS, GCP) and their services related to data processing.
- Understanding of ETL processes and data warehousing concepts.
- Experience with version control systems (e.g., Git) and CI/CD pipelines.
- Knowledge of containerization technologies like Docker is a plus.
-
Big Data with Airflow Python
3 days ago
Bengaluru, Karnataka, India Achutha Associates Full timeBig Data Engineer - Airflow & Python Location: Bangalore, India Experience: 5+ years Job Summary: Key Responsibilities: Design, develop, and maintain ETL/ELT pipelines using Apache Airflow. Write efficient, scalable, and reusable Python scripts for data processing. Work with big data technologies (Spark, Hadoop, Hive, etc.) to manage and analyze large...
-
Apache Airflow
3 weeks ago
Bengaluru, Karnataka, India People Prime Worldwide Full timeAbout Company :They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society.About...
-
Apache Airflow
2 weeks ago
Bengaluru, Karnataka, India People Prime Worldwide Full timeAbout Company : They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society....
-
Dbt and Airflow
24 hours ago
Bengaluru, India Black & White Business Solutions Full time**Job Information**: Industry **IT Services** *** Province **Karnataka** *** City **Bangalore North** *** Postal Code **560001** *** Country **India** We have openings for DBT and Airflow requirement with one of our MNC Client. Please find the status below. Location: - Mumbai_ Malad location - Experience: - 4-6years - Notice Period: -...
-
Aws De- Airflow
24 hours ago
Chennai, Tamil Nadu, India Willware Technologies Full time**Work mode: One week of onboarding at Chennai office and later Remote** - Design, develop, and deploy complex data pipelines using Apache Airflow on AWS infrastructure. - Architect, optimize, and automate data workflows to ensure reliability, scalability, and performance. - Collaborate with data scientists, analysts, and other stakeholders to understand...
-
Snowflake, Python, Airflow Engineer
5 hours ago
Bengaluru, Karnataka, India NTT DATA Full timeReq ID 322031NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Snowflake Python Airflow Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job Duties Team...
-
Python
3 days ago
Bengaluru, Karnataka, India WARPE JOBS Full timeCloud Native Product Development experience with ability to develop new connectors and integrations with Databases, Cloud Data Warehouses, SaaS Platforms using Django, React, Python programming using PostgreSQL as meta store orchestrated through Airflow and compute heavy operations done through Spark clusters. development in Python, Django, React 3....
-
Python for Insights
2 days ago
Bengaluru, Karnataka, India Wipro Limited Full time**Role Purpose** **͏**: **Position Overview**: Seeking a skilled Python and Airflow Developer with a strong data engineering background. **Key Responsibilities**: - Develop and maintain data pipelines using Apache Airflow and Python. - Collaborate with business managers to understand data requirements. - Optimize existing data workflows for performance...
-
Bengaluru, India Vega Intellisoft Full timeJob Description: - Strong Python + SQL query and Airflow - Key Skills: - Strong Python + SQL query and Airflow - Location: - Bangalore, Chennai, Delhi, Hyderabad, kochi, Mumbai, Noida, Trivandram - Required Experience: - 5-7 yrs - Positions: - 1
-
Python / SQL Professional
3 weeks ago
Bengaluru, Karnataka, India Unitforce Technologies Consulting Full timeJob DescriptionRoles and Responsibility- Python/SQL- - Big data technologies (Hadoop data lakes ), SQL, scripting languages (Python, Shell scripting), CI/CD, working Knowledge on Spark/Java/Python Description We are looking for a technically skilled Senior Developer for Big Data development to help prevent financial crime to the benefit of our customers,...