Data Engineer – Etl

4 weeks ago

Dombivli, India Whatjobs IN C2 Full time

Data Engineer – ETL & Pipeline Development Experience: 5 to 10 Years Location: Remote (Work from Home) / Bangalore / India Mode of Engagement: Full-time No. of Positions: 5 Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / IT Industry: IT / Data / AI / LegalTech / Enterprise Solutions Notice Period: Immediate Joiners Preferred What We Are Looking For: 5–10 years of hands-on experience in designing, developing, and deploying end-to-end data pipelines and ETL workflows — not just using prebuilt tools, but building from scratch using Python and SQL. Strong command of Python programming for data transformation, orchestration, and automation (e.G., using Pandas, Airflow, or custom schedulers). Solid experience in writing complex SQL queries, optimizing database performance, and designing schemas for large-scale systems. Proven experience integrating RESTful APIs for data ingestion, transformation, and delivery pipelines. Working knowledge of AWS / GCP / Azure for data storage, processing, and deployment (S3, EC2, Lambda, BigQuery, etc.). Practical exposure to Docker, Kubernetes, and CI/CD pipelines for automating and deploying ETL and data workloads. Familiarity with AI-driven data pipelines or automation workflows is an added advantage. Responsibilities: Design, architect, and build ETL pipelines from the ground up to extract, clean, transform, and load data across multiple systems. Develop and deploy custom Python-based data frameworks to automate workflows and improve data quality. Build and maintain high-performance SQL queries and database structures to support analytics and AI teams. Develop and integrate API-based data ingestion systems (internal and external). Deploy and manage workloads using Docker, Kubernetes, and CI/CD tools ensuring high availability and version control. Work closely with product, AI, and analytics teams to deliver intelligent, automated data solutions. Implement data validation, monitoring, and alerting mechanisms for production pipelines. Continuously optimize pipeline performance, cost efficiency, and scalability in cloud environments. Qualifications: Bachelor’s or Master’s degree in Computer Science, Engineering, or related field. Proficiency in Python (FastAPI, Flask, or Django), SQL, and REST API design. Strong understanding of ETL principles, data modeling, and pipeline orchestration (Airflow / Prefect / Dagster). Experience working with AWS (S3, Lambda, EC2, Glue, Athena) or equivalent GCP/Azure components. Hands-on exposure to Docker, Kubernetes, and Git-based CI/CD workflows. Excellent problem-solving, debugging, and analytical skills with an ownership mindset.

  • Data Architect with ETL Expertise

    4 days ago

    dombivli, India beBeeData Full time

    Job Title: Data Architect with ETL ExpertiseAre you a skilled data engineer looking to take your career to the next level? Do you have a passion for designing and developing robust ETL/ELT pipelines?We are seeking an experienced Data Architect with expertise in ETL development to join our team. As a key member of our data engineering team, you will be...

  • ETL Data Specialist

    5 days ago

    dombivli, India beBeeDataTesting Full time

    Job OverviewWe are seeking a skilled Data Testing Professional to perform end-to-end testing of ETL pipelines across cloud/on-prem environments.Validate source-to-target mappings, complex data transformations, and Slowly Changing Dimension (SCD) logic.Perform data completeness, data accuracy, and reconciliation testing to ensure high-quality data.Test...

  • Data Integration Specialist

    6 days ago

    dombivli, India beBeeIntegration Full time

    Oracle Data Integration LeadWe're seeking a seasoned integration expert to lead our Oracle ETL/OIC initiatives.The ideal candidate will have extensive hands-on experience with ODI and OIC, as well as strong background in Oracle ERP Cloud integrations and data migration.Key Responsibilities:Drive end-to-end integration and data migration solutions into Oracle...

  • Data Engineer Position Open

    4 days ago

    dombivli, India beBeeDataEngineer Full time

    Cloud Data Engineer JobWe are seeking a skilled cloud data engineer with strong hands-on experience in Microsoft Azure services. Job Summary:As a cloud data engineer, you will be responsible for managing data ingestion pipelines, handling ETL/ELT processes, and ensuring effective incident management. Responsibilities:Design and implement data ingestion...

  • Data Engineer

    7 days ago

    Dombivli, India Tata Consultancy Services Full time

    Dear Candidate, TCS Walkin Interview - Greetings from TATA CONSULTANCY SERVICES LIMITED!!! Thank you for exploring career opportunities with Asia's largest IT company. Exciting # Job Opportunities for # Experienced Professionals Required Skill# Experience- Azure Data Engineer Job Description- 1. Should have good hands-on experience on building ETL flow using...

  • Senior Data Engineering Specialist

    5 days ago

    dombivli, India beBeeDataEngineer Full time

    Key Roles and ResponsibilitiesLead the design, development, deployment, and maintenance of data pipelines within a microservices architecture.Design and architect scalable data ingestion, processing, and storage solutions for diverse data sources.Develop, configure, test, debug, deploy, document, and maintain back-end services utilizing software toolkits and...

  • Senior Data Engineer

    4 days ago

    Dombivli, India RK HR Management Private Limited Full time

    Key Responsibilities: - Design and build scalable data pipeline architecture that can handle large volumes of data - Develop ELT/ETL pipelines to extract, load and transform data from various sources into our data warehouse - Optimize and maintain the data infrastructure to ensure high availability and performance - Collaborate with data scientists and...

  • Principal Data Engineer

    5 days ago

    dombivli, India beBeeDataEngineer Full time

    Job DescriptionOur team is seeking an experienced professional to serve as the primary point of contact for data-related issues, ensuring high system stability through proactive monitoring and root-cause analysis.Required Skills and Qualifications8+ years of experience in data support engineering with strong expertise in SQL, Python, ETL/ELT pipelines, and...

  • Data Engineer Position

    2 days ago

    dombivli, India beBeeDataArchitect Full time

    Data Architect RoleWe are seeking a skilled Technical Architect with hands-on coding experience to join our team.Key Responsibilities:Design and implement data engineering solutions using cloud native technologies.Develop expertise in graph databases and data lake technologies.Experience with bot detection avoidance techniques and VPN use.Implement ETL...

  • Azure Data Engineer

    4 weeks ago

    Dombivli, India Whatjobs IN C2 Full time

    Position: Azure Data Engineer Location: Remote Duration: Permanent Role Shift Timing: 11:00 AM – 8:00 PM (India Time) Job Description: Looking for 10+ Years experiene in Advanced SQL, Azure Data Factory (ADF), Databricks (with PySpark). Experience with Azure Synapse (added advantage). Strong understanding of Big Data processing approaches and...