Data Engineer – ETL

6 days ago

bangalore, India AIMLEAP Full time

Data Engineer – ETL & Pipeline Development Experience: 5 to 10 YearsLocation: Remote (Work from Home) / Bangalore / IndiaMode of Engagement: Full-timeNo. of Positions: 5Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / ITIndustry: IT / Data / AI / LegalTech / Enterprise SolutionsNotice Period: Immediate Joiners PreferredWhat We Are Looking For:5–10 years of hands-on experience in designing, developing, and deploying end-to-end data pipelines and ETL workflows — not just using prebuilt tools, but building from scratch using Python and SQL.Strong command of Python programming for data transformation, orchestration, and automation (e.g., using Pandas, Airflow, or custom schedulers).Solid experience in writing complex SQL queries, optimizing database performance, and designing schemas for large-scale systems.Proven experience integrating RESTful APIs for data ingestion, transformation, and delivery pipelines.Working knowledge of AWS / GCP / Azure for data storage, processing, and deployment (S3, EC2, Lambda, BigQuery, etc.).Practical exposure to Docker, Kubernetes, and CI/CD pipelines for automating and deploying ETL and data workloads.Familiarity with AI-driven data pipelines or automation workflows is an added advantage.Responsibilities:Design, architect, and build ETL pipelines from the ground up to extract, clean, transform, and load data across multiple systems.Develop and deploy custom Python-based data frameworks to automate workflows and improve data quality.Build and maintain high-performance SQL queries and database structures to support analytics and AI teams.Develop and integrate API-based data ingestion systems (internal and external).Deploy and manage workloads using Docker, Kubernetes, and CI/CD tools ensuring high availability and version control.Work closely with product, AI, and analytics teams to deliver intelligent, automated data solutions.Implement data validation, monitoring, and alerting mechanisms for production pipelines.Continuously optimize pipeline performance, cost efficiency, and scalability in cloud environments.Qualifications:Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.Proficiency in Python (FastAPI, Flask, or Django), SQL, and REST API design.Strong understanding of ETL principles, data modeling, and pipeline orchestration (Airflow / Prefect / Dagster).Experience working with AWS (S3, Lambda, EC2, Glue, Athena) or equivalent GCP/Azure components.Hands-on exposure to Docker, Kubernetes, and Git-based CI/CD workflows.Excellent problem-solving, debugging, and analytical skills with an ownership mindset.

  • Data ETL Engineer

    1 week ago

    Pune / Bangalore, India IDT Full time ₹ 80,00,000 - ₹ 1,50,00,000 per year

    IDT ) is a communications and financial services company founded in 1990 and headquartered in New Jersey, US. Today it is an industry leader in prepaid communication and payment services and one of the world's largest international voice carriers. We are listed on the NYSE, employ over 1500 people across 20+ countries, and have revenues in excess of $1.5...

  • ETL Engineer

    2 days ago

    bangalore, India Akshya Patra Services Full time

    Overview: The ETL Engineer plays a vital role in the organization's data management strategy by designing, developing, and maintaining robust ETL processes. These processes are crucial for transforming raw data into a usable format for analysis, ensuring data integrity, and optimizing data delivery systems. An ETL Engineer collaborates with data architects,...

  • Sr ETL Data Engineer

    2 weeks ago

    bangalore, India BigRio Full time

    Job Title: Sr ETL Data Engineer -HL7Location: Remote – India (UK Shift)Type: Full-TimeAbout BigRio:BigRio is a remote-based, technology consulting firm headquartered in Boston, MA. We specialize in delivering advanced software solutions that include custom development, cloud data platforms, AI/ML integrations, and data analytics. With a diverse portfolio...

  • Sr ETL Data Engineer

    2 weeks ago

    bangalore, India BigRio Full time

    Job Title: Sr ETL Data Engineer -HL7 Location: Remote – India (UK Shift) Type: Full-Time About BigRio: BigRio is a remote-based, technology consulting firm headquartered in Boston, MA. We specialize in delivering advanced software solutions that include custom development, cloud data platforms, AI/ML integrations, and data analytics. With a diverse...

  • ETL Automation Tester

    2 weeks ago

    bangalore, India NTT DATA, Inc. Full time

    Mandatory SkillsSQL,ELT/ETL Testing, Python, Data Validation, Pyspark/Pytest/Junit/TestNG and Azure Data services, Databricks QA, Data Lake QAGood to have SkillsDevops, Azure cloud Devops, Data governance, API testing

  • Data Lake ETL

    2 days ago

    bangalore, India Hewlett Packard Enterprise Full time

    Data Lake ETLThis role has been designed as ''Onsite' with an expectation that you will primarily work from an HPE partner/customer office Who We Are: Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live,...

  • Data Management

    3 weeks ago

    bangalore, India Acies Full time

    Highlight of the engagement opportunity Nature of role: Full time Number of years of experience expected: 5 to 10 years 2+ years of experience in Python. And must know pandas and NumPy libraries Areas of past experience preferred: ETL documentation / Data mapping / ETL development / Python / Risk data / Finance data Educational qualification required: BTech...

  • ETL Data Testing/ Data Quality Engineer

    2 weeks ago

    Bangalore, India Tredence Inc. Full time

    Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, with offices in San Jose, Foster City, Chicago, London, and Toronto, the company embraces a vertical-first approach and an outcome-driven mindset to help...

  • Azure-ETL Engineer

    3 hours ago

    bangalore, India Coforge Full time

    Job DescriptionWe are seeking a seasoned Data Engineer with strong experience in Azure-based ETL pipelines and data architecture. The ideal candidate will be responsible for designing, implementing, and maintaining scalable data solutions that support business intelligence and analytics needs.Key ResponsibilitiesDesign, implement, and maintain data pipelines...

  • ETL Developer

    1 week ago

    bangalore, India Philodesign Technologies Inc Full time

    We’re Hiring: Enterprise Data Engineer Are you passionate about building large-scale, high-performance data solutions? We’re looking for an experienced Enterprise Data Engineer to join our team and play a key role in designing, developing, and optimizing robust data integration and warehouse systems.What You’ll DoDesign, build, and maintain data...