Python (Airflow/DBT) Engineer
3 days ago
Project Description:
- This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data accessibility, performance, and governance while enabling advanced analytics and automation.
- The resource will join an ongoing effort to accelerate the migration and modernization process, contributing to data pipeline development, orchestration, and optimization using tools like Airflow, DBT, and Docker, with strong emphasis on Python scripting and database engineering.
Responsibilities:
- Data Pipeline Development: Build and optimize ETL/ELT pipelines using Python, Airflow, and DBT to ingest, transform, and load data into Snowflake.
- Cloud Migration Support: Assist in migrating existing on-prem data workflows and databases to Snowflake on Azure, ensuring minimal disruption and high data fidelity.
- Data Modeling & Transformation: Design and implement robust data models and transformation logic using DBT and SQL, aligned with business requirements.
- Containerization: Use Docker to containerize data services and workflows for consistent deployment across environments.
- Database Engineering: Apply strong SQL and Snowflake expertise to optimize queries, manage schemas, and ensure data quality and performance.
- Version Control & Collaboration: Use Git/GitHub for source control, code reviews, and CI/CD integration.
- Monitoring & Troubleshooting: Monitor pipeline performance, troubleshoot issues, and implement logging and alerting mechanisms.
- Security & Governance: Ensure data security, compliance, and governance standards are met throughout the migration process.
Mandatory Skills:
- Docker
Mandatory Skills Description:
- Python, Airflow / DBT, Docker, strong database skills (Snowflake), git/GitHub, Azure
- Scope - resource will help expedite work already in progress as part of cloud migration of our on-prem data systems to Cloud (snowflake on Azure).
Nice-to-Have Skills Description:
- Certifications
Languages:
- English: Proficient
-
Snowflake + DBT Developer
1 week ago
Hyderabad, Telangana, India DataBeat Full timeJob Title:Snowflake + DBT DeveloperLocation:HyderabadExperience:4+ yearsJob Type:Full-TimeDepartment:Enterprise Data and AnalyticsAbout The RoleWe are looking for an experiencedSnowflake + DBT Developerto join ourTechnology Team .This role demands a deep understanding of data pipeline migration, modeling, and orchestration using modern data stack...
-
Airflow Data Engineer
2 weeks ago
Hyderabad, Telangana, India Virtusa Full time ₹ 20,00,000 - ₹ 25,00,000 per yearDevelops and maintains scalable data pipelines to support continuing increases in data volume and complexity.Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility, and fostering data-driven decision making across the organization.Implement processes and systems to monitor data...
-
DBT Developer
5 days ago
Hyderabad, Telangana, India Zillion Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob Title: DBT DeveloperSkillset required: Design, Develop, Document, Test and ImplementLocations can be Hyderabad, Chennai, KolkataMust-Have Skills: DBT and SnowflakeGood-to-Have skills: Informatica PowerCenterExperience & Skills:Experience in data engineering, specifically with Snowflake and DBT.Key skills required are strong hands-on experience with...
-
Stanra - Databricks Developer - Python/SQL
2 weeks ago
Hyderabad, Telangana, India Stanra Tech Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per yearContract Duration : 4 Months +Exendible based on Performance Job Location : Mumbai, Delhi / NCR, Bengaluru , Kolkata, Chennai, Hyderabad, Ahmedabad, Pune,Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract...
-
Snowflake Data Engineer
2 weeks ago
Hyderabad, Telangana, India Sureminds Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per yearSnowflake Data EngineerCompany Overview:Sureminds Solutions is a leading staffing and recruiting company based in India. We specialize in providing top-notch talent to various industries.Role and Responsibilities:We are seeking a skilled Snowflake Data Engineer to join our team. In this role, you will be responsible for building and optimizing data pipelines...
-
Data Engineer
2 weeks ago
Hyderabad, Telangana, India DevRabbit IT Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout the Role:We are looking for a highly skilledData Engineer / Analytics Engineerto design, develop, and optimize scalable data pipelines and analytics solutions. The ideal candidate will have strong expertise inPython, Advanced SQL, DBT, and Snowflake, with a passion for building efficient and reliable data infrastructure that supports business...
-
DBT Engineer
1 week ago
Hyderabad, Telangana, India 204b32d2-4816-403c-8046-e9133a6cc88a Full time ₹ 9,00,000 - ₹ 12,00,000 per yearResponsibilities:Design, develop & maintain software solutions using DBT, Snowflake & SQL/PSQL.Collaborate with cross-functional teams on project delivery.Ensure data accuracy & security compliance.
-
Data Analyst
1 week ago
Hyderabad, Telangana, India NationsBenefits Full time ₹ 5,00,000 - ₹ 12,00,000 per yearPosition Overview:As a Data Analyst/ Senior Data Analyst, you will be responsible for the Requirement Gathering, Data Analysis, Development and implementation of Automated data reporting solutions to support our organization's datadriven initiatives to ensure data accuracy and enable data-driven decisionmaking across the organization. The ideal candidate...
-
Data Engineer
2 weeks ago
Hyderabad, Telangana, India DevRabbit IT Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Title:Python & DBT Developer Location:Hyderabad Experience:3–4 Years Employment Type:Full-Time, PermanentJob Description:DBT DeveloperPosition SummaryWe are seeking a skilled DBT (Data Build Tool) Developer to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining data transformation workflows...
-
Data Engineer
1 week ago
Hyderabad, Telangana, India Valuelabs Full timePosition - Data EngineerExperience - 3+ yrsLocation - HyderabadNotice Period - Immediate JoinersRoles & Responsibilities:3+ years of hands-on experience in data engineering with strong proficiency in:Python & PySpark (for data transformation and pipeline development)SQL (advanced querying,optimization, window functions, CTEs)Spark (PySpark/Scala) for...