Triunitysoft - Data Engineer - Python/ETL
2 weeks ago
About the Role : We are seeking a highly skilled Data Engineer to design, build, and manage robust data pipelines and frameworks on Google Cloud Platform (GCP). The ideal candidate will have hands-on experience in PySpark, Python, GCP services (BigQuery, Cloud Functions, Pub/Sub), and Terraform, with strong capabilities in pipeline development, monitoring, and documentation (HLD & LLD).Key Responsibilities : Data Pipeline Development : - Design, build, and optimize scalable ETL/ELT data pipelines using PySpark and Python.- Implement GCP-native solutions leveraging BigQuery, Cloud Functions, Pub/Sub, and related services.- Use Terraform to automate infrastructure provisioning and deployments.Pipeline Monitoring & Reliability : - Implement monitoring, logging, and alerting mechanisms to ensure pipeline reliability and data quality.- Troubleshoot pipeline issues and optimize performance.Architecture & Documentation : - Contribute to High-Level Design (HLD) and Low-Level Design (LLD) documents for data solutions.- Collaborate with architects, data scientists, and business teams to translate requirements into technical & Best Practices : - Work with cross-functional teams to integrate pipelines into broader data platforms.- Follow best practices for code quality, version control, CI/CD, and security.Required Skills & Experience : - Strong proficiency in PySpark and Python for data processing.- Hands-on experience with GCP services : BigQuery, Cloud Functions, Pub/Sub.- Infrastructure-as-Code expertise with Terraform.- Experience in building, deploying, and monitoring large-scale data pipelines.- Knowledge of data architecture and ability to prepare HLD and LLD documentation.- Strong problem-solving skills and ability to work in agile environments.Preferred Qualifications : - Experience in technologies such as Hadoop, Hive, kafka, snowflake, Matillion and AWS- Knowledge of CI/CD pipelines (Jenkins, GitLab, Git Actions etc.- Familiarity with data governance, lineage, and security frameworks.- Experience with containerization (Docker, Kubernetes) is a plus (ref:hirist.tech)
-
Data Engineer
3 weeks ago
Pune, India Multicloud4U® Technologies Full timeJob role: Data : Hyderabad / Pune 3-5 years Joining : Immediate or within 15 Required : 3-5 YearsAre you a Python & PySpark expert with hands-on experience in GCP? Passionate about building scalable, high-performance data pipelines? Join our fast-paced team and be part of impactful projects in the cloudData Responsibilities :- Design, build, and maintain...
-
Data Engineer
3 weeks ago
Pune, India TekIT Software Solutions Pvt. Ltd. Full timeDescription :Job Title : Data Engineer.Experience Required : 4+ Years.Location : Pune.Job Description :We are looking for a skilled Data Engineer with strong expertise in Python, PySpark, and Databricks to join our team.The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, ensuring the quality and...
-
NetAnalytiks - Data Engineer - Python/ETL
3 weeks ago
Pune, India NETANALYTIKS TECHNOLOGIES LIMITED Full timeAbout the Role : We are seeking a talented and motivated Data Engineer to join our engineering team. In this role, you will be responsible for designing, developing, and maintaining robust data pipelines that enable the seamless flow of data across our systems. You will work with diverse data sources, ensuring the data is ingested, cleaned, transformed, and...
-
Data Engineer
3 weeks ago
Pune, India NonStop Full timeDescription : About the Role : We are hiring an experienced Data Engineer to design and maintain scalable data pipelines and architectures. Youll play a key role in building robust data infrastructure to support analytics, ML models, and business insights.Key Responsibilities : - Build, optimize, and maintain ETL pipelines for large-scale data ingestion and...
-
GCP Data Engineer
2 weeks ago
Pune, India NPG Consultants Full timeWere looking for a cloud-savvy Data Engineer to architect and optimize data pipelines on Google Cloud Platform. If you thrive in Python and live for scalable solutions, this ones for you.Must-Have Skills :- Python for data wrangling and automation- BigQuery for high-performance analytics- Apache Airflow for orchestration- CloudSQL for relational data...
-
Senior Data Engineer
3 weeks ago
Pune, India Synapse Tech Services Inc Full timeAbout the Role : We are looking for a highly experienced Senior Data Engineer with deep expertise in the AWS ecosystem to design, implement, and manage enterprise-grade data integration solutions.The ideal candidate will have a proven track record in ETL processes, cloud-based data architecture, and building scalable data pipelines.This role will play a...
-
Data Support Engineer
2 days ago
Pune, India Allianz Full timeThe Role :The ideal candidate should be a skilled L2/L3 Data Support Engineer with at least 3 years of relevant experience, with a strong focus on ETL and Data Warehousing in Azure.The candidate should also have good understanding of DevOps practices and ITIL will :- Monitor the daily data pipeline runs, ensure timely data loads by proactively identifying...
-
Bits In Glass
2 days ago
Pune, India Bits In Glass Full timeTitle : Senior Data Engineer / ETL Engineer.Location : Pune / Hyderabad / Mohali.Job Summary : As a Senior Data Engineer / ETL Engineer, you will be instrumental in designing, developing, and optimizing data processing systems that support our organization's data initiatives. Your expertise in Bigdata and Google Cloud Platform (GCP) will be essential in...
-
Data ETL Engineer
3 days ago
Pune, Maharashtra, India IDT Corporation Full time ₹ 5,00,000 - ₹ 12,00,000 per yearIDT ) is a communications and financial services company founded in 1990 and headquartered in New Jersey, US. Today it is an industry leader in prepaid communication and payment services and one of the worlds largest international voice carriers. We are listed on the NYSE, employ over 1500 people across 20+ countries, and have revenues in excess of $1.5...
-
Python ETL Developer/Data Engineer
2 weeks ago
Chennai, Mumbai, Pune, India Hexaware Technologies Full time ₹ 6,00,000 - ₹ 12,00,000 per yearRequired Skills:Strong programming experience in Python.Proficiency in Pandas, NumPy, and working with SQL queries.Experience in working with Data Lake and processing large volumes of data.Ability to parse and consolidate data from Excel, CSV, and plain text formats.Hands-on experience in writing unit tests, performing regression testing, and implementing...