Senior Data Engineer – ETL

4 weeks ago

Moradabad, India AIMLEAP Full time

Senior Data Engineer – ETL & Pipeline Development Experience: 7 to 12 YearsLocation: Remote (Work from Home) / Bangalore / IndiaMode of Engagement: Full-timeNo. of Positions: 2Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / ITIndustry: IT / Data / AI / LegalTech / Enterprise SolutionsNotice Period: Immediate Joiners PreferredWhat We Are Looking For:7–12 years of hands-on experience in designing, developing, and deploying end-to-end data pipelines and ETL workflows — not just using prebuilt tools, but building from scratch using Python and SQL.Strong command of Python programming for data transformation, orchestration, and automation (e.g., using Pandas, Airflow, or custom schedulers).Solid experience in writing complex SQL queries, optimizing database performance, and designing schemas for large-scale systems.Proven experience integrating RESTful APIs for data ingestion, transformation, and delivery pipelines.Working knowledge of AWS / GCP / Azure for data storage, processing, and deployment (S3, EC2, Lambda, BigQuery, etc.).Practical exposure to Docker, Kubernetes, and CI/CD pipelines for automating and deploying ETL and data workloads.Familiarity with AI-driven data pipelines or automation workflows is an added advantage.Responsibilities:Design, architect, and build ETL pipelines from the ground up to extract, clean, transform, and load data across multiple systems.Develop and deploy custom Python-based data frameworks to automate workflows and improve data quality.Build and maintain high-performance SQL queries and database structures to support analytics and AI teams.Develop and integrate API-based data ingestion systems (internal and external).Deploy and manage workloads using Docker, Kubernetes, and CI/CD tools ensuring high availability and version control.Work closely with product, AI, and analytics teams to deliver intelligent, automated data solutions.Implement data validation, monitoring, and alerting mechanisms for production pipelines.Continuously optimize pipeline performance, cost efficiency, and scalability in cloud environments.Qualifications:Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.Proficiency in Python (FastAPI, Flask, or Django), SQL, and REST API design.Strong understanding of ETL principles, data modeling, and pipeline orchestration (Airflow / Prefect / Dagster).Experience working with AWS (S3, Lambda, EC2, Glue, Athena) or equivalent GCP/Azure components.Hands-on exposure to Docker, Kubernetes, and Git-based CI/CD workflows.Excellent problem-solving, debugging, and analytical skills with an ownership mindset.

  • Senior data engineer

    4 weeks ago

    Moradabad, India Egen Full time

    Senior Data Engineer – GCP Job Overview: We are looking for a skilled and motivated Senior Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data...

  • Data Engineer

    7 days ago

    Moradabad, India Tata Consultancy Services Full time

    Role : Databricks Senior DeveloperRequired Technical Skill Set : Databricks, Spark and Data Migration experienceExperience : 4 to 10 yearsLocation : KolkataJob Description : Desired Competencies (Technical/Behavioral Competency)Must-Have:-1. 8+ years with strong Databricks, Spark and Data Migration experience2. Should have experience of end-to-end migration...

  • Senior data engineer

    2 weeks ago

    Moradabad, India Intellify Solutions Full time

    Title: Senior Data Engineer Location: Remote, India Total years of experience: 10+ years Requirements : ● Required: Bachelor’s degree or relevant experience ● Required: Prior experience as a software engineer or data engineer in a fast-paced, technical, problem-solving environment ● Required: Cloud Data Warehouse experience - Snowflake ● Required:...

  • Data Specialist

    1 week ago

    Moradabad, India VicTree Solutions Full time

    VicTree Solutions is hiring for a AWS Data Engineer role for an esteemed client in Bengaluru, Karnataka .Job Title: AWS Data EngineerLocation: BengaluruExperience Required: 3-6 yearsPreferred: Immediate JoinersEmployment Type: Full-timeBudget: 25 LPAResponsibilities:Design and implement data pipelines using AWS services such as S3 , Glue , PySpark and EMR...

  • GCP Data Engineer

    14 hours ago

    Moradabad, India Tata Consultancy Services Full time

    Dear ProfessionalsGreetings from TCS!!!Job Title : GCP Data EngineerExperience : 6- 8 YearsLocation : Pune/Hyderabad/bangalore/ chennai/ kolkataSkills: GCP, Big Query, Dataflow, Data Proc, Cloud SQL, Cloud Spanner, Pub/Sub, ETL, Apache airflow, Python, Pandas and NumphyJD: Google Data Engineer (Overall 5+ Years with 3 years relevant hands-on experience)...

  • GCP Data Engineer

    9 hours ago

    Moradabad, India Tata Consultancy Services Full time

    Dear ProfessionalsGreetings from TCS!!!Job Title : GCP Data EngineerExperience : 6- 8 YearsLocation : Pune/Hyderabad/bangalore/ chennai/ kolkataSkills: GCP, Big Query, Dataflow, Data Proc, Cloud SQL, Cloud Spanner, Pub/Sub, ETL, Apache airflow, Python, Pandas and NumphyJD: Google Data Engineer (Overall 5+ Years with 3 years relevant hands-on experience)...

  • Data Support Engineer

    6 days ago

    Moradabad, India Kumaran Systems Full time

    Dear Candidate,Greeting,Experience : 8+ YearsWork Model: WFHWork Timings: Starts from 3pmWe’re looking for a skilled Data Support Engineer with 8+ years of experience . The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stability through proactive monitoring and root-cause...

  • Data Support Engineer

    5 days ago

    Moradabad, India Kumaran Systems Full time

    Dear Candidate,Greeting,Experience : 8+ YearsWork Model: WFHWork Timings: Starts from 3pmWe’re looking for a skilled Data Support Engineer with 8+ years of experience . The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stability through proactive monitoring and root-cause...

  • Senior neo4j developer

    6 days ago

    Moradabad, India KrtrimaIQ Cognitive Solutions Full time

    Company Description krtrima IQ Cognitive Solutions, based in Bengaluru, is an AI startup committed to driving intelligent digital transformation for global businesses. With expertise in cutting-edge technologies like Agentic AI, Generative AI, Conversational AI, Cognitive Process Automation, and Data Science, the company develops innovative AI and data...

  • Data Engineer

    2 weeks ago

    Moradabad, India LanceSoft, Inc. Full time

    Pay Rate: $11.00/hr to $12.00/hrLocation: 100% RemoteThis team is looking to hire a motivated Sr. Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data platform to solve various data-driven use cases across the organization. This marketing platform will host various data products...