
Python & ETL Engineer - Data Pipeline
2 days ago
Role Overview :
We are seeking a highly skilled Python + ETL Engineer with strong expertise in building data pipelines, automation workflows, and scalable ETL solutions. The ideal candidate will have hands-on experience with Python-based ETL frameworks, data ingestion pipelines, and cloud-native deployments (preferably AWS).
The role involves designing and developing end-to-end data solutions for ingestion, transformation, validation, and reporting, enabling analytics and business intelligence across large Responsibilities :
- Design, develop, and maintain ETL pipelines for structured and unstructured data.
- Build Python-based automation scripts for data ingestion, transformation, and validation.
- Develop and optimize data pipelines on cloud platforms (AWS preferred) using S3, Lambda, ECS, EC2, DynamoDB, and other services.
- Work with databases (MySQL, SQL Server, PL/SQL) for data extraction, transformation, and loading.
- Implement rule-based data validation and ensure high-quality, reliable data flows.
- Collaborate with cross-functional teams to deliver data-driven solutions, dashboards, and reporting tools.
- Support deployment through CI/CD pipelines (Docker, AWS CodeBuild/ECS) for seamless production rollout.
- Ensure scalability, performance, and security of data workflows.
Required Skills & Experience :
- 5+ years of experience in Python development with focus on data processing & ETL pipelines.
- Strong knowledge of Python libraries (Pandas, NumPy, Scikit-learn, TensorFlow preferred).
- Proven experience in ETL development (Python-based or cloud-native pipelines).
- Proficiency in SQL (MySQL, PL/SQL, SQL Server) for data operations.
- Hands-on experience with AWS services (S3, Lambda, ECS, EC2, DynamoDB, CloudWatch).
- Exposure to automation, data validation, and anomaly detection.
- Strong analytical and problem-solving skills.
- Ability to work in Agile environments and deliver sprint-based to Have :
- Experience with traditional ETL tools (Informatica, Talend, SSIS).
- Exposure to data visualization/dashboarding tools.- Knowledge of containerization (Docker, Join Us?
- Opportunity to work on cloud-first, modern ETL pipelines.
- Exposure to end-to-end data engineering workflows from ingestion to reporting.
- Collaborative and innovative work culture with room for creativity.
(ref:hirist.tech)-
Lead ETL Pipeline Developer
2 days ago
Pune, Maharashtra, India beBeeDevelopment Full time ₹ 9,00,000 - ₹ 12,00,000Senior ETL and Power BI SpecialistAs an experienced tester specializing in Azure Data Factory, Python, and Pytest, this role will ensure the accuracy, integrity, and performance of ETL pipelines deployed into cloud environments.Key Responsibilities:Develop automated test cases for Azure Data Factory ETL pipelines using Python and Pytest.Validate data...
-
NetAnalytiks - Data Engineer - Python/ETL
2 days ago
Pune, Maharashtra, India NETANALYTIKS TECHNOLOGIES LIMITED Full timeAbout the Role : We are seeking a talented and motivated Data Engineer to join our engineering team. In this role, you will be responsible for designing, developing, and maintaining robust data pipelines that enable the seamless flow of data across our systems. You will work with diverse data sources, ensuring the data is ingested, cleaned, transformed, and...
-
Senior Data Engineer
4 days ago
Pune, Maharashtra, India beBeeEtlDeveloper Full time ₹ 18,00,000 - ₹ 24,00,000ETL Developer OpportunityWe are seeking a skilled ETL developer to join our team and contribute to the development of scalable and efficient data pipelines.The ideal candidate will have experience working with IBM DataStage, AWS Glue, and Snowflake, and be proficient in SQL, Unix scripting, and Python.Key Responsibilities:Design, develop, and maintain ETL...
-
Expert Data Pipeline Engineer
4 days ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Expert Data Pipeline EngineerAbout the RoleWe are seeking an experienced Data Engineer to craft and maintain robust data pipelines, ensuring efficient extraction, transformation, and loading (ETL) of data.Key Responsibilities:Design, develop, and implement scalable data pipelines using Python and SQL.Collaborate with teams to integrate machine...
-
Data Pipeline Specialist
2 days ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Job OverviewWe are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data pipelines using PySpark and Python in AWS.About the RoleThe successful candidate will have 6+ years of ETL experience and strong knowledge of SQL fundamentals and...
-
ETL Data Tester
1 day ago
Pune, Maharashtra, India ITC Infotech Full time US$ 90,000 - US$ 1,20,000 per yearBelow is the JD.We are seeking a highly skilled ETL Data Tester with strong experience in ETL testing, Data Warehousing, and automation using Python. The ideal candidate should also have hands-on expertise in Cloud Data platforms (AWS/Azure) with exposure to Glue, Redshift, Synapse, or equivalent technologies. This role involves validating end-to-end data...
-
Data Engineer
8 hours ago
Pune, Maharashtra, India Jash Data Sciences Full time ₹ 8,00,000 - ₹ 12,00,000 per yearDo you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...
-
Cloud Data Pipelines Specialist
16 hours ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,000 - ₹ 28,00,000The role of a Data Engineer involves designing, developing and maintaining data pipelines using Python and SQL programming languages on Google Cloud Platform (GCP). The ideal candidate will have experience in Agile methodologies, ETL, ELT, data movement and processing skills. They will work with Cloud Composer to manage and process batch data jobs...
-
Senior Data Pipeline Specialist
2 days ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Job OverviewWe are seeking a seasoned Data Engineer to join our team. This role involves crafting and maintaining robust data pipelines using Python and SQL to ensure efficient extraction, transformation, and loading (ETL) of data.The ideal candidate will have expertise in building and optimizing data pipelines to facilitate seamless data flow across systems...
-
Scalable Data Engineer – Python, SQL, AWS
3 days ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000We are seeking a seasoned data engineering expert to design and build scalable data pipelines using Python, SQL, and AWS.Develop ETL/ELT pipelines with PySpark, AWS, and Databricks.Professionally profile, validate, and transform data using Python and SQL.Optimize workflows for performance, scalability, and cost efficiency.Create automation scripts in...