Python Developer, Data Engineer _ Talend To Python Migration

11 hours ago

Hyderabad, Telangana, India Covasant Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Job Description: Python Developer / Data Engineer Talend to Python Migration

About the Role

We are seeking experienced Python Developers/Data Engineers to join our team for a strategic migration project, moving enterprise ETL workloads from Talend to a modern Python-based ingestion framework on Google Cloud Platform (GCP). You will work closely with architects, platform engineers, and automation teams to design, build, and optimize scalable data pipelines, leveraging Airflow, Cloud Run, Dataproc, and BigQuery.

Key Responsibilities

  • 3+ years of experience in Python development, with a focus on data engineering and ETL pipeline design.
  • ETL Migration & Development

Analyze existing Talend jobs/modules and design equivalent Python-based ETL workflows.

Develop, test, and deploy Python scripts/functions for ingestion, preprocessing, file management, and data loading (SFTP to GCS, file unzip, preprocessing, raw/harmonized table loads, DQ checks, view creation).

Implement orchestration using Airflow DAGs and Cloud Run jobs, ensuring modular, maintainable, and scalable solutions.

Integrate with automation tools (Automic) for job triggering, monitoring, and error handling.

  • Platform Configuration & Optimization

Configure and tune serverless workloads (Cloud Run, Dataproc, BigQuery) for performance, stability, and cost efficiency (e.g., retry strategies, timeout settings, CPU/memory sizing, autoscaling).

Apply best practices for resource allocation, parallelism, and batch processing in Python and PySpark jobs.

  • Data Quality & Observability

Implement data quality checks, logging, and monitoring for traceability and operational excellence.

Ensure robust error handling, retry logic, and alerting for ETL pipelines.

  • Security & Compliance

Work with IAM, service accounts, and Secret Manager for secure credential management and access control.

Adhere to data governance, privacy, and compliance requirements.

  • Collaboration & Documentation

Collaborate with cross-functional teams (platform, DevOps, data governance) to align on requirements and deliverables.

Document migration processes, configuration parameters, and operational procedures.

Required Skills & Experience

Hands-on experience with GCP services: Cloud Run, Dataproc, BigQuery, Cloud Composer (Airflow), Cloud Storage.

  • Strong understanding of Talend ETL concepts and experience migrating Talend jobs to Python is highly desirable.
  • Experience with orchestration tools (Airflow, Automic) and automation of data workflows.
  • Proficiency in containerization (Docker), CI/CD, and artifact management.
  • Familiarity with data quality frameworks, logging, and monitoring tools.
  • Solid grasp of IAM, service accounts, and cloud security best practices.
  • Excellent problem-solving, communication, and documentation skills.

Preferred Qualifications

  • Experience with PySpark, serverless Spark jobs, and advanced resource tuning.
  • Exposure to enterprise data platforms, large-scale migrations, and cloud-native architectures.
  • Knowledge of GCP networking, firewall rules, and hybrid connectivity

  • Azure Talend Data Engineer

    10 hours ago

    Hyderabad, Telangana, India Koantek Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Koantek is looking for an experienced Talend Engineer to join our Data Engineering team. The ideal candidate will design, develop, and optimize ETL and data integration pipelines using Talend, PySpark, SQL, and Databricks on Azure Cloud. This role offers an opportunity to work on scalable, high-performance data solutions supporting enterprise analytics and...

  • Data Migration- Consultant

    2 days ago

    Hyderabad, Telangana, India KPMG Global Services Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Data Engineer- ConsultantExperience: 5-7 years of experienceQualifications: * Bachelor's degree in a technical or quantitative field from an accredited college or university (Masters or MBA degree is preferred) Must have: * Strong understanding and experience in data migration using SAP* Good experience in writing and tuning SQL queries. * Good to have...

  • Talend DI Developer

    7 hours ago

    Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Candidate will be responsible for data preparation jobs, data analysis and data reporting.Responsible for performing technical troubleshooting and providing technical expertise for ETL jobsDesigning and Developing the ETL mapping in Talend, SQL, PL SQL, etcPreparing the documentation like: Mapping document, design document, deployment documentCo-ordination...

  • Data Migration- Assistant Manager

    3 days ago

    Hyderabad, Telangana, India KPMG Global Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Data Engineer- ConsultantExperience: 7-10 years of experienceQualifications: * Bachelor's degree in a technical or quantitative field from an accredited college or university (Masters or MBA degree is preferred) Must have: * Strong understanding and experience in Data migration using SAP* Good experience in writing and tuning SQL queries. * Good to have...

  • Python/Hadoop Developer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA, Inc. Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    NTT DATA Services currently seeks Python Hadoop Developer to join our team inResponsibilitiesSkillset: Python, Hadoop, ETL, RDBMS, Unix, GCP Vertex AIResponsibilities:Data Ingestion Pipelines, AIML Model deployments, Data Engineering, ML Engineering with Python.

  • Python Developer

    3 days ago

    Hyderabad, Telangana, India Data Unveil Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Description:Position Title: Python DeveloperExperience: 3Years to 5YearsLocation: Hyderabad, TelanganaHire Type: Full Time, On-siteStart Date: ImmediateJob Summary:We are seeking a Python Developer with 2-3 years of experience, skilled in Python, PySpark, Oracle, MySQL, and basic AWS services. The candidate will work on data processing, ETL pipelines,...

  • Talend/ETL Developer

    6 days ago

    Hyderabad, Telangana, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Description : Role : Talend ETL Developer Location : Hyderabad, India Hybrid (3 days onsite) Experience : 4 - 6 YearsJob Summary : We are seeking a highly motivated and skilled Talend ETL Developer to join our team, focusing on supporting large-scale data transformation initiatives. The Developer will be responsible for the end-to-end design,...

  • Python Developer

    3 weeks ago

    Hyderabad, Telangana, India, Telangana Data Unveil Full time

    Job Description:Position Title: Python DeveloperExperience: 3Years to 5YearsLocation: Hyderabad, TelanganaHire Type: Full Time, On-siteStart Date: Immediate Job Summary:We are seeking a Python Developer with 2-3 years of experience, skilled in Python, PySpark, Oracle, MySQL, and basic AWS services. The candidate will work on data processing, ETL pipelines,...

  • Python Developer with AWS

    1 week ago

    Hyderabad, Telangana, India Ignisov Consulting Services Full time ₹ 1,20,000 - ₹ 5,00,000 per year

    Job Title: Engineer – Python & AWSLocation:Hyderabad (Preferred)Experience:6 – 8 YearsThis is a contract position withTCS - Tata Consultancy ServicesAbout the RoleWe are seeking a highly skilledPython Engineerwith strong experience inAWS Cloud Computingand legacy system modernization. The ideal candidate will be responsible for upgrading existing Python...

  • Python ( Airflow / DBT ) Engineer

    11 hours ago

    Hyderabad, Telangana, India Luxoft Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Project descriptionThis project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data accessibility, performance, and governance while enabling advanced analytics and automation.The resource will join an ongoing effort to accelerate...