Senior Python Data Engineer – ETL

3 weeks ago

Erode, India AIMLEAP Full time

Senior Python Data Engineer – ETL & Pipeline DevelopmentExperience: 5 to 12 YearsLocation: Remote (WFH) / Bangalore / IndiaMode of Engagement: Full-timeNo. of Positions: 5Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / ITIndustry: IT / Data / AI / LegalTech / Enterprise SolutionsNotice Period: Immediate Joiners Preferred What We Are Looking For:5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL).Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers).Ability to write complex SQL queries, optimize performance, and design scalable database schemas.Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines.Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.).Hands-on exposure to Docker, Kubernetes, and CI/CD for deploying ETL & data workloads.Experience building or working with AI-driven / automated data pipelines (preferred).Responsibilities:Design, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading.Develop custom Python-based data automation frameworks to improve quality and speed.Build and optimize SQL queries, tables, and database structures for analytics & AI use cases.Create and manage API-based data ingestion / integration workflows.Deploy and maintain workloads using Docker, Kubernetes, and CI/CD tools.Collaborate with product, AI, and analytics teams to deliver intelligent data solutions.Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines.Continuously optimize pipelines for performance, cost, scalability, and reliability.Qualifications:Bachelor’s or Master’s degree in Computer Science / Engineering / IT.Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development.Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster).Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP/Azure equivalents.Hands-on experience with Docker, Kubernetes, and Git-based CI/CD workflows.Strong debugging, problem-solving, and analytical capabilities with ownership mindset.

  • Senior ETL Engineer – Data Integrity Specialist

    2 weeks ago

    erode, India beBeeInformatica Full time

    Job OverviewWe are seeking an experienced ETL Specialist with strong expertise in ETL/Data Pipeline Testing and API Testing to join our organization. The ideal candidate will possess a deep understanding of data flows, SQL skills, and familiarity with Informatica tools.The selected individual will be responsible for performing end-to-end testing of ETL...

  • Senior Data Engineer

    4 weeks ago

    Erode, India Whatjobs IN C2 Full time

    Job Title: Senior Data Engineer Employment Type: Full-Time Location: Kochi / Trivandrum / Bangalore Experience: Minimum 8 years We are seeking a highly skilled Senior Data Engineer with strong expertise in Spark, Kafka, modern cloud platforms (AWS/GCP/Azure), ETL processes, SQL, and Databricks. The ideal candidate will have hands-on experience building...

  • ETL Specialist

    2 weeks ago

    Erode, India Responsive Full time

    We are seeking a highly skilled ETL Specialist with expertise in building, maintaining, and optimizing data pipelines using Python scripting. The ideal candidate will have experience working in a Linux environment, managing large-scale data ingestion, processing files in S3, and balancing disk space and warehouse storage efficiently. This role will be...

  • ETL Specialist

    2 weeks ago

    Erode, India Responsive Full time

    We are seeking a highly skilled ETL Specialist with expertise in building, maintaining, and optimizing data pipelines using Python scripting. The ideal candidate will have experience working in a Linux environment, managing large-scale data ingestion, processing files in S3, and balancing disk space and warehouse storage efficiently. This role will be...

  • Senior Data Pipeline Architect

    5 days ago

    erode, India beBeeDataPipeline Full time

    Data Pipeline Specialist Role OverviewWe are seeking a seasoned Senior Data Engineer to develop and maintain scalable data pipelines for large language model (LLM) development.Your primary mission is to design, develop, and own robust ETL/ELT pipelines in Python for ingesting and processing terabyte-scale text datasets. You will also implement rigorous data...

  • Data Engineer

    3 weeks ago

    Erode, India Tata Consultancy Services Full time

    TCS is Hiring for Data Engineer -Python with AI/ML,pyspark,AWS Experience : 4 to 10 years Location : Bhubaneswar Experience with ETL/Python/SQL, and data visualization/exploration tools. - Experience in building complex SQL queries. - Familiarity with the Azure Databricks, Azure Data Factory. - Experience in building or maintaining ETL pipelines. -...

  • Cloud-First Data Engineer

    2 weeks ago

    erode, India beBeeDataMigration Full time

    Senior Data Migration SpecialistData migration to cloud platforms is a strategic imperative in today's fast-paced business environment.Migrate data from on-premises environments to cloud-based infrastructure using Databricks, Delta Lake, and Spark.Develop scalable data processing solutions with ETL/ELT pipelines to support large-scale data movement and...

  • Senior Cloud Data Migration Specialist

    2 weeks ago

    erode, India beBeeDataMigration Full time

    Job Title: Senior Azure Data EngineerWe are seeking a skilled data engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem.Key Responsibilities:Migrate large-scale SQL workloads from on-premise environments to Azure, ensuring high data integrity, minimal downtime, and performance optimization.Design,...

  • AWS Data Engineer

    3 weeks ago

    Erode, India People Prime Worldwide Full time

    Data Engineer (L4) – Python & AWS Total Experience: 7–10 yearsLocation : HyderabadJob OverviewWe are looking for a Senior Data Engineer with strong expertise in Python and AWS. You will design and build scalable data pipelines, manage cloud-based data platforms, ensure data quality, and support analytics/AI use cases across the organization.Total...

  • Data Engineering Job for ETL/ELT Experts

    2 weeks ago

    erode, India beBeeAzure Full time

    Job Title:Azure Data Engineer - ETL/ELT SpecialistJob Description:Develop and maintain large-scale data ingestion pipelines using Microsoft Azure services.Design, implement, and monitor ETL/ELT processes to ensure timely and effective incident management, service monitoring, and alert resolution.Troubleshoot and resolve complex issues in Azure services and...