Senior Data Engineer – ETL

2 days ago

Moradabad, India AIMLEAP Full time

Senior Data Engineer – ETL & Pipeline Development Experience: 7 to 12 YearsLocation: Remote (Work from Home) / Bangalore / IndiaMode of Engagement: Full-timeNo. of Positions: 2Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / ITIndustry: IT / Data / AI / LegalTech / Enterprise SolutionsNotice Period: Immediate Joiners PreferredWhat We Are Looking For:7–12 years of hands-on experience in designing, developing, and deploying end-to-end data pipelines and ETL workflows — not just using prebuilt tools, but building from scratch using Python and SQL.Strong command of Python programming for data transformation, orchestration, and automation (e.g., using Pandas, Airflow, or custom schedulers).Solid experience in writing complex SQL queries, optimizing database performance, and designing schemas for large-scale systems.Proven experience integrating RESTful APIs for data ingestion, transformation, and delivery pipelines.Working knowledge of AWS / GCP / Azure for data storage, processing, and deployment (S3, EC2, Lambda, BigQuery, etc.).Practical exposure to Docker, Kubernetes, and CI/CD pipelines for automating and deploying ETL and data workloads.Familiarity with AI-driven data pipelines or automation workflows is an added advantage.Responsibilities:Design, architect, and build ETL pipelines from the ground up to extract, clean, transform, and load data across multiple systems.Develop and deploy custom Python-based data frameworks to automate workflows and improve data quality.Build and maintain high-performance SQL queries and database structures to support analytics and AI teams.Develop and integrate API-based data ingestion systems (internal and external).Deploy and manage workloads using Docker, Kubernetes, and CI/CD tools ensuring high availability and version control.Work closely with product, AI, and analytics teams to deliver intelligent, automated data solutions.Implement data validation, monitoring, and alerting mechanisms for production pipelines.Continuously optimize pipeline performance, cost efficiency, and scalability in cloud environments.Qualifications:Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.Proficiency in Python (FastAPI, Flask, or Django), SQL, and REST API design.Strong understanding of ETL principles, data modeling, and pipeline orchestration (Airflow / Prefect / Dagster).Experience working with AWS (S3, Lambda, EC2, Glue, Athena) or equivalent GCP/Azure components.Hands-on exposure to Docker, Kubernetes, and Git-based CI/CD workflows.Excellent problem-solving, debugging, and analytical skills with an ownership mindset.

  • Senior data engineer

    2 days ago

    Moradabad, India Egen Full time

    Senior Data Engineer – GCP Job Overview: We are looking for a skilled and motivated Senior Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data...

  • Senior data engineer

    2 weeks ago

    Moradabad, India Coffeee.io Full time

    Job Title: Lead Data Engineer – Snap LogicLocation: RemoteExperience: 8+ years (with 3+ years in Snap Logic ETL)Employment Type: Full-timeRole Overview:We are seeking a Lead Data Engineer – Snap Logic to design, build, and optimize data integration pipelines across on-premise and cloud platforms. The ideal candidate will have hands-on experience with...

  • Data Engineer

    3 weeks ago

    Moradabad, India Tata Consultancy Services Full time

    Opening - PUNE/Bangalore/Hyd/ChennaiAbout the RoleRole - Data Engineer - Quantexa ,Big Data Hadoop, Spark and ScalaResponsibilitiesDevelop Spark and SCALA code as per requirement.Build efficient and optimized ETLs for data ingestion/transformations.Should be able to customize and update the Quantexa UI as per business requirement.Documentation of the...

  • Senior GCP Data Engineer

    3 weeks ago

    Moradabad, India Adastra Full time

    Job Description We are seeking a results-driven GCP Data Engineer with a proven track record in architecting and delivering end-to-end data migration solutions. The ideal candidate will have extensive experience migrating complex, large-scale on-premises data systems (Oracle, Teradata, SQL Server, etc.) to Google Cloud Platform (GCP), and optimizing...

  • Freelance Data Engineer

    3 weeks ago

    Moradabad, India upGrad Full time

    We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a modern, cloud-native data stack. You'll play a crucial role in transforming raw data into actionable insights, ensuring data...

  • Senior Data

    3 weeks ago

    Moradabad, India Kooner Transport Group - KTG Full time

    Location: Remote/ Uttarakhand - Ramnagar Office Type: 3-Month Contract (extendable based on performance) Work Hours: Must overlap 3–4 hours/day with Eastern Time (Canada) Compensation: ₹100,000 – ₹150,000 INR per month (depending on skill & experience)About the RoleKooner Transport Group (Canada) operates a large cross-border trucking fleet with over...

  • Freelance Data Engineer

    3 weeks ago

    Moradabad, India upGrad Full time

    We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a modern, cloud-native data stack. You'll play a crucial role in transforming raw data into actionable insights, ensuring data...

  • Data Architect

    3 weeks ago

    Moradabad, India People Prime Worldwide Full time

    Important Note (Please Read Before Applying)🚫 Do NOT apply if:You have less than 10 years of experience in data architectureYou do not have hands-on experience in implementing data integrationsYou come from a purely non-architecture background (e.g., only reporting/analyst roles)✅ Apply ONLY if you meet ALL the mandatory requirements listed above....

  • Data Engineering Manager – AI

    2 weeks ago

    Moradabad, India AIMLEAP Full time

    Data Engineering Manager – AI & AutomationExperience: 7 to 12 Years Location: Remote (Work from Home) / Bangalore / India Mode of Engagement: Full-time No of Positions: 2 Educational Qualification: MBA / B.E / B.Tech / M.Tech / MCA / Computer Science / IT Industry: IT / Data / AI / E-commerce / FinTech / Healthcare Notice Period: Immediate  What We...

  • Senior llm engineer

    1 week ago

    Moradabad, India IdeaSouq Full time

    About Us At Idea Souq, we are building the "AI operating system" to transform how private market investors and funds discover, evaluate, and manage their opportunities. Traditional investment workflows are drowning in data silos, manual screening, and overwhelming deal flow. We're a startup building the solution: an AI analyst that turns this deal flow chaos...