ETL Specialist

3 hours ago

Coimbatore Tamil Nadu India, Tamil Nadu Responsive Full time

We are seeking a highly skilled ETL Specialist with expertise in building, maintaining, and optimizing data pipelines using Python scripting. The ideal candidate will have experience working in a Linux environment, managing large-scale data ingestion, processing files in S3, and balancing disk space and warehouse storage efficiently. This role will be responsible for ensuring seamless data movement across systems while maintaining performance, scalability, and reliability.

Key Responsibilities:

  • ETL Pipeline Development: Design, develop, and maintain efficient ETL workflows using Python to extract, transform, and load data into structured data warehouses.
  • Data Pipeline Optimization: Monitor and optimize data pipeline performance, ensuring scalability and reliability in handling large data volumes.
  • Linux Server Management: Work in a Linux-based environment, executing command-line operations, managing processes, and troubleshooting system performance issues.
  • File Handling & Storage Management: Efficiently manage data files in Amazon S3, ensuring proper storage organization, retrieval, and archiving of data.
  • Disk Space & Warehouse Balancing: Proactively monitor and manage disk space usage, preventing storage bottlenecks and ensuring warehouse efficiency.
  • Error Handling & Logging: Implement robust error-handling mechanisms and logging systems to monitor data pipeline health.
  • Automation & Scheduling: Automate ETL processes using cron jobs, Airflow, or other workflow orchestration tools.
  • Data Quality & Validation: Ensure data integrity and consistency by implementing validation checks and reconciliation processes.
  • Security & Compliance: Follow best practices in data security, access control, and compliance while handling sensitive data.
  • Collaboration with Teams: Work closely with data engineers, analysts, and product teams to align data processing with business needs.

Skills Required:

  • Proficiency in Python: Strong hands-on experience in writing Python scripts for ETL processes.
  • Linux Expertise: Experience working with Linux servers, command-line operations, and system performance tuning.
  • Cloud Storage Management: Hands-on experience with Amazon S3, including handling file storage, retrieval, and lifecycle policies.
  • Data Pipeline Management: Experience with ETL frameworks, data pipeline automation, and workflow scheduling (e.g., Apache Airflow, Luigi, or Prefect).
  • SQL & Database Handling: Strong SQL skills for data extraction, transformation, and loading into relational databases and data warehouses.
  • Disk Space & Storage Optimization: Ability to manage disk space efficiently, balancing usage across different systems.
  • Error Handling & Debugging: Strong problem-solving skills to troubleshoot ETL failures, debug logs, and resolve data inconsistencies.

Nice to Have:

  • Experience with cloud data warehouses (e.g., Snowflake, Redshift, BigQuery).
  • Knowledge of message queues (Kafka, RabbitMQ) for data streaming.
  • Familiarity with containerization tools (Docker, Kubernetes) for deployment.
  • Exposure to infrastructure automation tools (Terraform, Ansible).

Qualifications:

  • Bachelor’s degree in Computer Science, Data Engineering, or a related field.
  • 3+ years of experience in ETL development, data pipeline management, or backend data engineering.
  • Strong analytical mindset and ability to handle large-scale data processing efficiently.
  • Ability to work independently in a fast-paced, product-driven environment.

  • COTS Application Support Specialist

    3 hours ago

    Chennai, Tamil Nadu, India, Tamil Nadu Movate Full time

    Role: COTS Application Support SpecialistExperience: 6 - 8 yearsWork Location: ChennaiJob Summary:We are seeking a COTS Application Support Specialist with strong technical and analytical expertise to support and maintain healthcare and CRM-based commercial off-the-shelf (COTS) applications. The ideal candidate will have hands-on experience with Electronic...

  • COTS Application Support Tech Lead

    3 hours ago

    Chennai, Tamil Nadu, India, Tamil Nadu Movate Full time

    Position: PermanentRole: COTS Application Support SpecialistExperience: 4 - 7 yearsWork Location: ChennaiNotice Period: Immediate to 15 daysJob Summary:We are seeking a COTS Application Support Specialist with strong technical and analytical expertise to support and maintain healthcare and CRM-based commercial off-the-shelf (COTS) applications. The ideal...

  • Informatica Admin

    3 hours ago

    Chennai, Tamil Nadu, India, Tamil Nadu Bahwan CyberTek Full time

    We are looking for Informatica Admin (MDM) Specialist for our IT services division. who is having experience in below technical stack. Please revert if you are interested with below requested information.Required Skills: Informatica Admin, ETL Admin, Informatica MDM, Data WarehousingEmployment: FulltimeExperience: 10+ YearsLocation: Chennai, Coimbatore,...

  • COTS Application Support Tech Lead

    3 hours ago

    Chennai, Tamil Nadu, India, Tamil Nadu Movate Full time

    Job Summary:We are seeking a COTS Application Support Specialist with strong technical and analytical expertise to support and maintain healthcare and CRM-based commercial off-the-shelf (COTS) applications. The ideal candidate will have hands-on experience with Electronic Health Records (EHR), Revenue Cycle Management (RCM), and Customer Relationship...

  • Senior Data Engineer

    3 hours ago

    Chennai, Tamil Nadu, India, Tamil Nadu OptiSol Business Solutions Full time

    Job Title: Senior Data Engineer – L2Experience Level: 3+ YearsLocations: Chennai | Madurai | CoimbatoreAbout the Role:We are seeking a results-driven and technically proficient Senior Data Engineer (L2) to play a dual role in both solutioning-based initiatives and interview-driven ODC projects. This position is ideal for individuals who thrive in...

  • ai/ml engineer

    6 days ago

    Coimbatore, Tamil Nadu, India NovintiX Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    AI/ML & Data Engineering Specialist(MLOps | Data Engineering |MedTech/Pharma/Manufacturing Analytics)Location: Coimbatore, Chennai, Bangalore and Hyderabad Experience: 5–8 years Role Type: Full-time/Hybrid Industry: Medical Devices (MedTech)PharmaceuticalsAdvanced & Smart ManufacturingIndustry 4.0 Keywords: AI/ML Engineering, Data Engineering, Time-Series...

  • Principal Engineer- Data and Analytics

    5 days ago

    Coimbatore, Tamil Nadu, India Harman Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    Location:IN_Coimbatore_Echo Point Plaza_HCSJob Family:Artificial Intelligence & Machine LearningWorker Type Reference:Regular - PermanentPay Rate Type:SalaryCareer Level:T4(A)Job ID:R Description & RequirementsKey Responsibilities of the role include:Principal Engineer- Data and AnalyticsDevelop and implement data engineering project including enterprise...

  • Lead ETL ODI

    2 weeks ago

    Coimbatore, India Vienna Consultancy Full time

    Lead ETL ODIExp: 9+yrsLocation: RemoteContract: 6 month extendableImmediate Joiners onlyWe are seeking a skilled and experienced Data Integration Specialist with over 9 years of experience in designing and developing data solutions using Oracle Data Integrator (ODI). The ideal candidate will have strong expertise in data modeling, ETL/ELT processes, and SQL,...

  • ETL Testing

    3 weeks ago

    Hyderabad, India Cognizant Full time

    Job Description Job Summary Skill: ETL Testing Experiences: 6 to 13 years Location: AIA Kochi We are seeking a highly skilled Test Analyst with 6 to 13 years of experience in SQL Server TOSCA DI EtQ Val Automation Testing and ETL Validation. The ideal candidate will have a strong background in testing methodologies and tools with a preference for those with...

  • Lead ETL ODI

    2 weeks ago

    India Vienna Consultancy Full time

    Lead ETL ODIExp: 9+yrsLocation: RemoteContract: 6 month extendableImmediate Joiners onlyWe are seeking a skilled and experienced Data Integration Specialist with over 9 years of experience in designing and developing data solutions using Oracle Data Integrator (ODI). The ideal candidate will have strong expertise in data modeling, ETL/ELT processes, and SQL,...

  • Lead ETL ODI

    2 weeks ago

    India Vienna Consultancy Full time

    Lead ETL ODI Exp: 9+yrs Location: Remote Contract: 6 month extendable Immediate Joiners only We are seeking a skilled and experienced Data Integration Specialist with over 9 years of experience in designing and developing data solutions using Oracle Data Integrator (ODI). The ideal candidate will have strong expertise in data modeling, ETL/ELT processes, and...

  • Lead ETL ODI

    2 weeks ago

    India Vienna Consultancy Full time

    Lead ETL ODI Exp: 9+yrs Location: Remote Contract: 6 month extendable Immediate Joiners only We are seeking a skilled and experienced Data Integration Specialist with over 9 years of experience in designing and developing data solutions using Oracle Data Integrator (ODI). The ideal candidate will have strong expertise in data modeling, ETL/ELT processes, and...

  • Lead ETL ODI

    7 days ago

    India Vienna Consultancy Full time

    Job Description Lead ETL ODI Exp: 9+yrs Location: Remote Contract: 6 month extendable Immediate Joiners only We are seeking a skilled and experienced Data Integration Specialist with over 9 years of experience in designing and developing data solutions using Oracle Data Integrator (ODI). The ideal candidate will have strong expertise in data modeling,...

  • Efficient SAP Data Migration Expert

    2 weeks ago

    tamil nadu, India beBeeDataMigration Full time

    Expert SAP Data Migration SpecialistWe are seeking an experienced SAP Data Migration Specialist to design and develop efficient ETL processes for seamless data migration.A minimum of 5 years of experience in data migration and integration, with at least 4 years in SAP BODS.Strong expertise in ETL design, job development, and performance tuning using...

  • Data Specialist

    1 week ago

    India Revature Full time

    About the Role: The Data Specialist evaluates learners’ technical proficiency in data engineering, analytics, and cloud data platforms. This role involves comprehensive assessment across SQL, data pipeline development, data modeling, and visualization capabilities, while providing actionable feedback to accelerate learner development. . The specialist...

  • Support Specialist Oracle/SQL +ETL

    1 week ago

    India Meril Full time

    Primary Function The Technical Application Specialist – Orthopedics is responsible for providing technical expertise, clinical support, and training on orthopedic products and solutions to healthcare professionals. This role bridges the gap between clinical needs and product functionality, ensuring optimal product use, successful surgical outcomes, and...

  • Senior SAP Data Migration Specialist

    2 weeks ago

    India MindBrain Full time

    SAP Data Migration Specialist (Syniti) Experience: 5–8 YearsLocation: Remote Shift: 7:00 AM StartJob Description: We are hiring an SAP Data Migration Specialist with strong experience using Syniti tools to handle end-to-end data migration for SAP projects.Responsibilities:Perform ETL activities using Syniti for SAP data migrationExtract data from legacy...