Python & ETL Engineer - Data Pipeline

7 days ago

Chennai, India Servhigh Global Services Private Limited Full time

Role Overview : We are seeking a highly skilled Python + ETL Engineer with strong expertise in building data pipelines, automation workflows, and scalable ETL solutions. The ideal candidate will have hands-on experience with Python-based ETL frameworks, data ingestion pipelines, and cloud-native deployments (preferably AWS).The role involves designing and developing end-to-end data solutions for ingestion, transformation, validation, and reporting, enabling analytics and business intelligence across large Responsibilities : - Design, develop, and maintain ETL pipelines for structured and unstructured data.- Build Python-based automation scripts for data ingestion, transformation, and validation.- Develop and optimize data pipelines on cloud platforms (AWS preferred) using S3, Lambda, ECS, EC2, DynamoDB, and other services.- Work with databases (MySQL, SQL Server, PL/SQL) for data extraction, transformation, and loading.- Implement rule-based data validation and ensure high-quality, reliable data flows.- Collaborate with cross-functional teams to deliver data-driven solutions, dashboards, and reporting tools.- Support deployment through CI/CD pipelines (Docker, AWS CodeBuild/ECS) for seamless production rollout.- Ensure scalability, performance, and security of data workflows.Required Skills & Experience : - 5+ years of experience in Python development with focus on data processing & ETL pipelines.- Strong knowledge of Python libraries (Pandas, NumPy, Scikit-learn, TensorFlow preferred).- Proven experience in ETL development (Python-based or cloud-native pipelines).- Proficiency in SQL (MySQL, PL/SQL, SQL Server) for data operations.- Hands-on experience with AWS services (S3, Lambda, ECS, EC2, DynamoDB, CloudWatch).- Exposure to automation, data validation, and anomaly detection.- Strong analytical and problem-solving skills.- Ability to work in Agile environments and deliver sprint-based to Have : - Experience with traditional ETL tools (Informatica, Talend, SSIS).- Exposure to data visualization/dashboarding tools.- Knowledge of containerization (Docker, Join Us?- Opportunity to work on cloud-first, modern ETL pipelines.- Exposure to end-to-end data engineering workflows from ingestion to reporting.- Collaborative and innovative work culture with room for creativity. (ref:hirist.tech)

  • Lead Data Engineer

    6 days ago

    Chennai, India Cynosure Corporate Solutions Full time

    Description :About The Role :We are seeking a highly skilled and experienced Senior / Lead Data Engineer to design, develop, and maintain scalable, reliable, and efficient data pipelines and ETL solutions.The role requires strong expertise across multi-cloud environments, modern data warehousing platforms, programming languages, and data orchestration...

  • Lead Data Engineer

    2 days ago

    Chennai, India Cynosure Corporate Solutions Full time

    About the Role : We are seeking a highly skilled and experienced Senior / Lead Data Engineer to design, develop, and maintain scalable, reliable, and efficient data pipelines and ETL solutions. The role requires strong expertise across multi-cloud environments, modern data warehousing platforms, programming languages, and data orchestration tools. You will...

  • ETL Python Data Tester

    2 weeks ago

    Bengaluru, Chennai, Noida, India Helios Placement Solution Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Key Responsibilities:Design, develop, and execute test cases for ETL pipelines and data integration workflows.Perform data validation, data reconciliation, and data quality checks across multiple source and target systems.Develop automated Python scripts for ETL/data pipeline testing.Write and execute complex SQL queries to verify data accuracy and...

  • Azure Data Engineer

    3 weeks ago

    Chennai, India Qrata Consulting Full time

    Position : Azure Data EngineerExperience : 3 to 5 YearsJob Type : Full-timeJob Summary :We are seeking a skilled Azure Data Engineer with 35 years of experience to design, develop, and maintain scalable data pipelines within the Microsoft Azure ecosystem. The ideal candidate will have strong expertise in Azure Data Factory, Azure Databricks, PySpark/Scala...

  • Data Engineer

    2 weeks ago

    Chennai, India BUILDING BLOCKS SOFTWARE SERVICES PRIVATE Full time

    Description : Role Overview : You will own the data pipeline powering our LLM training and fine-tuning. This includes ingestion, cleaning, deduplication, and building high-quality datasets from structured/unstructured sources.Responsibilities : - Design ETL pipelines for text, PDFs, and structured data.- Implement data deduplication, filtering (toxicity,...

  • Python Data Engineer

    2 days ago

    Chennai, India thinQ24 Full time

    Job descriptionNote: Only candidates who meet the eligibility criteria should apply. Others are kindly requested not to apply.Location: Onsite / HybridExperience: 4+ YearsEmployment Type: Contract/Full-TimeCompany DescriptionthinQ24 is a Software Development Company based in Chennai, TN, India, founded in 2019. We focus on going beyond limits to turn...

  • Python Data Engineer

    2 days ago

    Chennai, India thinQ24 Full time

    Job descriptionNote: Only candidates who meet the eligibility criteria should apply. Others are kindly requested not to apply.Location: Onsite / HybridExperience: 4+ YearsEmployment Type: Contract/Full-TimeCompany DescriptionthinQ24 is a Software Development Company based in Chennai, TN, India, founded in 2019. We focus on going beyond limits to turn...

  • Python Data Engineer

    3 days ago

    Chennai, India thinQ24 Full time

    Job descriptionNote: Only candidates who meet the eligibility criteria should apply. Others are kindly requested not to apply.Location: Onsite / HybridExperience: 4+ YearsEmployment Type: Contract/Full-TimeCompany DescriptionthinQ24 is a Software Development Company based in Chennai, TN, India, founded in 2019. We focus on going beyond limits to turn...

  • Python Data Engineer

    2 days ago

    Chennai, India thinQ24 Full time

    Job descriptionNote: Only candidates who meet the eligibility criteria should apply. Others are kindly requested not to apply.Location: Onsite / HybridExperience: 4+ YearsEmployment Type: Contract/Full-TimeCompany DescriptionthinQ24 is a Software Development Company based in Chennai, TN, India, founded in 2019. We focus on going beyond limits to turn...

  • Python Data Engineer

    2 days ago

    Chennai, India thinQ24 Full time

    Job descriptionNote: Only candidates who meet the eligibility criteria should apply. Others are kindly requested not to apply.Location: Onsite / HybridExperience: 4+ YearsEmployment Type: Contract/Full-TimeCompany DescriptionthinQ24 is a Software Development Company based in Chennai, TN, India, founded in 2019. We focus on going beyond limits to turn...