Python (Airflow/DBT) Engineer
3 days ago
Project Description:This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data accessibility, performance, and governance while enabling advanced analytics and automation.The resource will join an ongoing effort to accelerate the migration and modernization process, contributing to data pipeline development, orchestration, and optimization using tools like Airflow, DBT, and Docker, with strong emphasis on Python scripting and database engineering.Responsibilities:Data Pipeline Development: Build and optimize ETL/ELT pipelines using Python, Airflow, and DBT to ingest, transform, and load data into Snowflake.Cloud Migration Support: Assist in migrating existing on-prem data workflows and databases to Snowflake on Azure, ensuring minimal disruption and high data fidelity.Data Modeling & Transformation: Design and implement robust data models and transformation logic using DBT and SQL, aligned with business requirements.Containerization: Use Docker to containerize data services and workflows for consistent deployment across environments.Database Engineering: Apply strong SQL and Snowflake expertise to optimize queries, manage schemas, and ensure data quality and performance.Version Control & Collaboration: Use Git/GitHub for source control, code reviews, and CI/CD integration.Monitoring & Troubleshooting: Monitor pipeline performance, troubleshoot issues, and implement logging and alerting mechanisms.Security & Governance: Ensure data security, compliance, and governance standards are met throughout the migration process.Mandatory Skills:DockerMandatory Skills Description:Python, Airflow / DBT, Docker, strong database skills (Snowflake), git/GitHub, AzureScope - resource will help expedite work already in progress as part of cloud migration of our on-prem data systems to Cloud (snowflake on Azure).Nice-to-Have Skills Description:CertificationsLanguages:English: Proficient
-
Python (Airflow/DBT) Engineer
2 days ago
uttar pradesh, India Luxoft Full timeProject Description: This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data accessibility, performance, and governance while enabling advanced analytics and automation. The resource will join an ongoing effort to accelerate...
-
Airflow
2 weeks ago
Andhra Pradesh, India Virtusa Full timeMandatory Skills: AWS Data Services, Python, SQL, Data Lake Secondary Skills: DBT, Airflow, DevOps JD: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. Key Responsibilities: Design, develop, and maintain scalable data pipelines and systems on AWS. Implement and manage ETL processes using Python and Apache...
-
Technical Lead Cum Manager Data Engineer
1 week ago
uttar pradesh, India Avivys Consulting Services Full timeAVIVYS is a platform where talent meets opportunities to unlock their potential. A place to learn, upskill, showcase their talents, gain CV points & get hired while unlocking their true potential. This enables professionals to eventually get hired by their dream employers. AVIVYS believes that you can unlock your dreams with genuine efforts What You'll...
-
Principal Consultant-data Engineer
2 weeks ago
Noida, Uttar Pradesh, India GENPACT Full timeReady to shape the future of work At Genpact we don t just adapt to change we drive it AI and digital innovation are redefining industries and we re leading the charge Genpact s our industry-first accelerator is an example of how we re scaling advanced technology solutions to help global enterprises work smarter grow faster and transform at scale From...
-
Data Engineer
1 week ago
uttar pradesh, India OWOW Full timeData Engineer – AI-Powered Marketing Personalization PlatformWe’re seeking an experienced Data Engineer to help build and scale our next-generation AI-powered marketing personalization platform (V2.0). You’ll design and implement a robust multi-database infrastructure that enables real-time personalization, vector search, graph analytics, and...
-
Data Engineer
6 days ago
uttar pradesh, India Talentiser Full timeHiring for a leading Marketing CompanyJob Title : Data EngineerLocation: Mumbai, Noida, Gurgaon or HyderabadExperience: 8+ YearsTHE ROLEEssential Skills:• 8 years of professional experience in data engineering or a similar role.• Hands-on experience with Google Cloud Platform (GCP) services (BigQuery, Cloud Run, cheduler).• Proficiency in SQL for data...
-
Data Engineer
2 days ago
uttar pradesh, India Credgenics Full timeAbout Credgenics:Credgenics is India’s first of its kind NPA resolution platform backed by credible investors including Accel Partners and Titan Capital. We work with financial institutions, Banks, NBFCs & Digital lending firms to improve the efficiency of their collection using technology, automation intelligence and optimal legal routes to facilitate the...
-
Associate Consultant
4 weeks ago
Noida, Uttar Pradesh, India HCLTech Full timeDesignation ASSOCIATE CONSULTANT No of Positions 4 Experience 9-11 Years Skill Primary Technical Skills-Cloud Platform-Google Cloud Platform Qualification Bachelor of Technology Engineering Posting Build and Optimize ELT ETL Pipelines using BigQuery GCS Dataflow PubSub and Orchestration services Composer Airflow Hands-On experience in building ETL ELT...
-
Snowflake & Data Build Tool (Dbt) Architect
3 days ago
Noida, Uttar Pradesh, India Sopra Steria Full timeSnowflake & Data Build Tool (DBT) Architect Full-time- ** Company Description**: - **About Sopra Steria** Sopra Steria, a major Tech player in Europe with 50,000 employees in nearly 30 countries, is recognised for its consulting, digital services and solutions. It helps its clients drive their digital transformation and obtain tangible and sustainable...
-
Head of Platform Architecture
6 days ago
uttar pradesh, India crenovent Full timeLocation: NoidaSeniority: Leadership / PrincipalCrenovent is building a next-generation AI-driven data and automation platform for Revenue Organizations. We’re hiring a Head of Data Platform & Platform Architecture — a senior leader who will own our entire data ecosystem while guiding the architectural direction of the full platform.What You’ll Lead...