Senior Data Engineer – ETL

1 week ago

bangalore, India AIMLEAP Full time

Senior Data Engineer – ETL & Pipeline Development Experience: 7 to 12 YearsLocation: Remote (Work from Home) / Bangalore / IndiaMode of Engagement: Full-timeNo. of Positions: 2Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / ITIndustry: IT / Data / AI / LegalTech / Enterprise SolutionsNotice Period: Immediate Joiners PreferredWhat We Are Looking For:7–12 years of hands-on experience in designing, developing, and deploying end-to-end data pipelines and ETL workflows — not just using prebuilt tools, but building from scratch using Python and SQL.Strong command of Python programming for data transformation, orchestration, and automation (e.g., using Pandas, Airflow, or custom schedulers).Solid experience in writing complex SQL queries, optimizing database performance, and designing schemas for large-scale systems.Proven experience integrating RESTful APIs for data ingestion, transformation, and delivery pipelines.Working knowledge of AWS / GCP / Azure for data storage, processing, and deployment (S3, EC2, Lambda, BigQuery, etc.).Practical exposure to Docker, Kubernetes, and CI/CD pipelines for automating and deploying ETL and data workloads.Familiarity with AI-driven data pipelines or automation workflows is an added advantage.Responsibilities:Design, architect, and build ETL pipelines from the ground up to extract, clean, transform, and load data across multiple systems.Develop and deploy custom Python-based data frameworks to automate workflows and improve data quality.Build and maintain high-performance SQL queries and database structures to support analytics and AI teams.Develop and integrate API-based data ingestion systems (internal and external).Deploy and manage workloads using Docker, Kubernetes, and CI/CD tools ensuring high availability and version control.Work closely with product, AI, and analytics teams to deliver intelligent, automated data solutions.Implement data validation, monitoring, and alerting mechanisms for production pipelines.Continuously optimize pipeline performance, cost efficiency, and scalability in cloud environments.Qualifications:Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.Proficiency in Python (FastAPI, Flask, or Django), SQL, and REST API design.Strong understanding of ETL principles, data modeling, and pipeline orchestration (Airflow / Prefect / Dagster).Experience working with AWS (S3, Lambda, EC2, Glue, Athena) or equivalent GCP/Azure components.Hands-on exposure to Docker, Kubernetes, and Git-based CI/CD workflows.Excellent problem-solving, debugging, and analytical skills with an ownership mindset.

  • Data ETL Engineer

    1 week ago

    Pune / Bangalore, India IDT Full time ₹ 80,00,000 - ₹ 1,50,00,000 per year

    IDT ) is a communications and financial services company founded in 1990 and headquartered in New Jersey, US. Today it is an industry leader in prepaid communication and payment services and one of the world's largest international voice carriers. We are listed on the NYSE, employ over 1500 people across 20+ countries, and have revenues in excess of $1.5...

  • ETL Engineer

    3 days ago

    bangalore, India Akshya Patra Services Full time

    Overview: The ETL Engineer plays a vital role in the organization's data management strategy by designing, developing, and maintaining robust ETL processes. These processes are crucial for transforming raw data into a usable format for analysis, ensuring data integrity, and optimizing data delivery systems. An ETL Engineer collaborates with data architects,...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India Mastek Full time

    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake/Postgresql, ETL and Streaming Services like Kafka.

  • Senior Data Engineer

    1 week ago

    bangalore, India Mastek Full time

    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake/Postgresql, ETL and Streaming Services like Kafka.

  • Data Management

    3 weeks ago

    bangalore, India Acies Full time

    Highlight of the engagement opportunity Nature of role: Full time Number of years of experience expected: 5 to 10 years 2+ years of experience in Python. And must know pandas and NumPy libraries Areas of past experience preferred: ETL documentation / Data mapping / ETL development / Python / Risk data / Finance data Educational qualification required: BTech...

  • Senior Data Engineer

    3 weeks ago

    bangalore, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA. Job Details: Role: Senior Data Engineer Work Location: Remote Employment Type: Contract – 12 months & extendable Role Summary: The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power...

  • Sr ETL Data Engineer

    2 weeks ago

    bangalore, India BigRio Full time

    Job Title: Sr ETL Data Engineer -HL7Location: Remote – India (UK Shift)Type: Full-TimeAbout BigRio:BigRio is a remote-based, technology consulting firm headquartered in Boston, MA. We specialize in delivering advanced software solutions that include custom development, cloud data platforms, AI/ML integrations, and data analytics. With a diverse portfolio...

  • Sr ETL Data Engineer

    2 weeks ago

    bangalore, India BigRio Full time

    Job Title: Sr ETL Data Engineer -HL7 Location: Remote – India (UK Shift) Type: Full-Time About BigRio: BigRio is a remote-based, technology consulting firm headquartered in Boston, MA. We specialize in delivering advanced software solutions that include custom development, cloud data platforms, AI/ML integrations, and data analytics. With a diverse...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India MeghGen Technologies Full time

    Company DescriptionMeghGen Technologies is a trusted technology solutions partner specializing in data engineering, cloud-native applications, and cloud migrations. We design and implement end-to-end cloud solutions to help businesses modernize infrastructure, scale applications, and harness the power of their data. Our expertise extends to AI-powered...

  • Senior Data Engineer

    2 days ago

    bangalore, India RapidBrains Full time

    Job Title: Senior Data EngineerExperience: 6+ YearsEmployment Type: ContractLocation: Remote OverviewWe are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines. The ideal candidate will have strong experience with Azure Data Factory (ADF), Azure Synapse, PySpark, and SQL,...