Senior Python Data Engineer – ETL

4 weeks ago

Mangalore, India AIMLEAP Full time

Senior Python Data Engineer – ETL & Pipeline Development Experience: 5 to 12 Years Location: Remote (WFH) / Bangalore / India Mode of Engagement: Full-time No. of Positions: 5 Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / IT Industry: IT / Data / AI / LegalTech / Enterprise Solutions Notice Period: Immediate Joiners Preferred What We Are Looking For: - 5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL). - Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers). - Ability to write complex SQL queries, optimize performance, and design scalable database schemas. - Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines. - Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.). - Hands-on exposure to Docker, Kubernetes, and CI/CD for deploying ETL & data workloads. - Experience building or working with AI-driven / automated data pipelines (preferred). Responsibilities: - Design, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading. - Develop custom Python-based data automation frameworks to improve quality and speed. - Build and optimize SQL queries, tables, and database structures for analytics & AI use cases. - Create and manage API-based data ingestion / integration workflows. - Deploy and maintain workloads using Docker, Kubernetes, and CI/CD tools. - Collaborate with product, AI, and analytics teams to deliver intelligent data solutions. - Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines. - Continuously optimize pipelines for performance, cost, scalability, and reliability. Qualifications: - Bachelor’s or Master’s degree in Computer Science / Engineering / IT. - Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development. - Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster). - Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP/Azure equivalents. - Hands-on experience with Docker, Kubernetes, and Git-based CI/CD workflows. - Strong debugging, problem-solving, and analytical capabilities with ownership mindset.

  • ETL Test Engineer

    1 week ago

    mangalore, India beBeeDataEngineer Full time

    ETL Tester Job DescriptionThis is a role where you will be responsible for designing, developing, and executing test cases, scenarios, and scripts for validation and regression testing. The aim is to validate data extraction, transformation, and loading processes for accuracy and completeness using SQL queries and ETL tools.Key Responsibilities:Design,...

  • Data Engineer

    3 weeks ago

    Mangalore, India Staffingine LLC Full time

    Data EngineerIndia, RemoteFull Time /Contract# of Positions - 3Job SummaryThe Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise in ETL/ELT processes, and deep hands-on experience with AWS cloud services such as S3,...

  • Senior Data Systems Developer

    2 weeks ago

    mangalore, India beBeeData Full time

    Role SummaryWe are seeking a highly skilled Data Engineer to design and build robust data pipelines for our nationwide healthcare analytics.The ideal candidate will have expertise in creating scalable ETL pipelines using Python (Pandas, PySpark) and SQL, orchestrated with Airflow (MWAA). They will also maintain the SAIVA Data Lake/Lakehouse on AWS, ensuring...

  • Data Engineer

    3 weeks ago

    Mangalore, India BLJ Tech Geeks Full time

    Job Title: Data EngineerCompany - Big4 (PERMANENT)Location: Bangalore (Hybrid)Job Type: Full-timeExperience Level: 5Yrs aboveNotice Period - Serving only till 31st Dec not more than thisAbout the Role:We are looking for a skilled and detail-oriented Data Engineer to join our growing data team. You will be responsible for building and maintaining scalable...

  • Data Engineer

    3 weeks ago

    Mangalore, India BLJ Tech Geeks Full time

    Job Title: Data EngineerCompany - Big4 (PERMANENT)Location: Bangalore (Hybrid)Job Type: Full-timeExperience Level: 5Yrs aboveNotice Period - Serving only till 31st Dec not more than thisAbout the Role:We are looking for a skilled and detail-oriented Data Engineer to join our growing data team. You will be responsible for building and maintaining scalable...

  • Remote Senior Azure Data Engineer

    6 days ago

    mangalore, India beBeeAzure Full time

    As a Senior Azure Data Engineer, you will be part of an international project in Chennai and work remotely. Your primary responsibility will be to design and implement data pipelines for enterprise search applications using Azure Data Factory and Databricks.This is an excellent opportunity to leverage your expertise in data modeling, information...

  • Lead data engineer

    4 weeks ago

    Mangalore, India Prophecy Technologies Full time

    ???? We’re Hiring: LEAD DATA ENGINEER ???? Location: HYDERABAD(HYBRID) ???? ???? Experience: 7+ Years ⏳ Notice Period: Immediate to 30 Days Responsibilities Design, build, and optimize scalable data pipelines on Azure Data Lake, Azure Databricks, and Azure Synapse. Develop ETL/ELT workflows using Py Spark, Python, and Databricks notebooks. Implement and...

  • Senior Data Solutions Specialist

    2 weeks ago

    mangalore, India beBeeDataEngineer Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Architect to join our growing data team. You will be responsible for building scalable and reliable data pipelines that drive business insights and operational efficiency.This role requires a deep understanding of data modeling, ETL frameworks, and cloud-based data platforms.Key...

  • Senior Cloud Data Specialist

    2 weeks ago

    mangalore, India beBeeDataEngineer Full time

    Job Title:Python, AWS and SQL DeveloperJob Description:Our organization is seeking a highly skilled Data Engineer with expertise in Python, AWS, and SQL. The ideal candidate will be working fully remotely in India.Work Timings: Mostly 2:30 PM to 10:30 PM ISTThe successful candidate will possess experience with Python, AWS, SQL, and should have reflected such...

  • Chief Data Infrastructure Specialist

    2 weeks ago

    mangalore, India beBeeDataEngineer Full time

    We are looking for a seasoned engineer to design, build and optimize high-performance data pipelines and systems.The ideal candidate will have strong experience with cloud platforms, modern ETL/ELT tools, Python, SQL and distributed data frameworks.Design, develop and maintain scalable and reliable ETL/ELT pipelines.Create data models, marts and warehouses...