Data Pipeline Specialist

3 days ago

erode, India beBeeDataEngineer Full time

About this RoleWe are seeking a skilled Data Engineer to design, develop, and maintain robust ETL/ELT pipelines for various data sources. The ideal candidate will have strong expertise in SQL (PostgreSQL preferred) and Python, with hands-on experience building ETL pipelines and working in Lakehouse architecture.Key ResponsibilitiesData Engineering & ETLDesign and develop ETL/ELT pipelines for structured and unstructured data.Work with Lakehouse architecture to manage data quality, reliability, scalability, and performance.AI Automation & GenAI StackBuild and integrate GenAI-driven automation solutions using frameworks like LangChain and Retrieval-Augmented Generation (RAG).Implement workflows involving model-driven reasoning, orchestration, and tool usage.Programming & APIsWrite clean, efficient, and optimized Python code for data transformation, processing, and automation tasks.Work with REST APIs to extract, ingest, or integrate external datasets and services.Database & SQLWrite and optimize complex SQL queries using PostgreSQL.Design and maintain relational schemas, indexes, and stored procedures for performance efficiency.- 4–5 years of experience in Data Engineering or similar roles.- Strong expertise in SQL (PostgreSQL preferred) and Python.- Hands-on experience with ETL/ELT development and Lakehouse architecture.- Exposure to modern AI/LLM frameworks: LangChain, RAG pipelines, GenAI automation.- Experience working with REST APIs.Nice-to-Have Skills- Experience with cloud platforms (AWS, Azure, GCP).- Familiarity with containerization (Docker).- Experience orchestrating workflows with Airflow, Prefect, or similar.Soft Skills- Strong problem-solving and analytical thinking.- Ability to communicate complex topics clearly.- Independent, proactive, and curious about modern AI tooling.- Team-oriented mindset with a drive for continuous improvement.

  • Data Pipeline Specialist

    5 days ago

    erode, India beBeeData Full time

    Job SummaryWe are seeking a talented Data Pipeline Engineer to join our team. The ideal candidate will have experience in designing, building, and maintaining scalable data pipelines, transformations, and applications within a cloud-based ecosystem.Main Responsibilities:Develop and operationalize AI-powered workflows, copilots, and decision-support agents...

  • Lead Data Pipeline Architect

    5 days ago

    erode, India beBeeDataEngineer Full time

    Job OverviewWe seek a Senior Data Engineer to lead our team in designing, building, and maintaining the data pipelines that power large language model development.The ideal candidate will have 8+ years of professional experience in data engineering, data processing, or backend software engineering, and expert-level proficiency in Python and its data...

  • Data Scientist

    5 days ago

    erode, India beBeeMachineLearning Full time

    Expert Data Scientist OpportunityWe're seeking a seasoned data scientist to own and build end-to-end machine learning pipelines from scratch.Responsibilities:Design and implement scalable data architectures, integrating with various platforms including Shopify, GA4, ESP, and CRM systems.Develop advanced features for predictive modeling, clustering, and...

  • Expert Data Pipeline Developer

    22 hours ago

    erode, India beBeeData Full time

    Job Title: Data Engineering SpecialistOur organization is seeking a highly skilled data engineering professional to join our team. This is an exciting opportunity for an experienced professional in data engineering to design, develop, and optimize large-scale data pipelines.The ideal candidate should have extensive experience with SQL, Ab-Initio, Teradata,...

  • Migrating Complex Data Specialist

    5 days ago

    erode, India beBeeDataMigration Full time

    Data Migration ExpertMigrate complex data from legacy systems to our modern platform with ease. As a Data Migration Specialist, you'll leverage your technical expertise to develop efficient methods for migrating client data into our platform.This role requires collaboration with AI coding assistants to create streamlined processes for transforming large...

  • Senior ETL Engineer – Data Integrity Specialist

    5 days ago

    erode, India beBeeInformatica Full time

    Job OverviewWe are seeking an experienced ETL Specialist with strong expertise in ETL/Data Pipeline Testing and API Testing to join our organization. The ideal candidate will possess a deep understanding of data flows, SQL skills, and familiarity with Informatica tools.The selected individual will be responsible for performing end-to-end testing of ETL...

  • Cloud Data Engineer

    20 hours ago

    erode, India beBeeData Full time

    Cloud Data Engineering SpecialistWe are seeking a skilled Cloud Data Engineering Specialist to join our international data platform team. This is an excellent opportunity for experienced engineers who can build scalable data pipelines, work with modern cloud-native data stacks, and support large-scale enterprise data initiatives.The successful candidate will...

  • Quality Data Analyst

    5 days ago

    erode, India beBeeDataAnalytics Full time

    Job Overview:As a Quality and Analytics Specialist, you will ensure the quality, accuracy, and reliability of data workflows executed through Notebook/JupyterLab and data platforms.Key ResponsibilitiesData & Notebook Assurance: Validate JupyterLab notebooks for logic accuracy, data transformation, and analytical correctness using libraries like Pandas,...

  • Senior Cloud Data Engineer

    5 days ago

    erode, India beBeeData Full time

    Cloud Data SpecialistJob Overview:As a Cloud Data Specialist, you will be responsible for designing and developing scalable data pipelines and cloud-based data solutions.Key ResponsibilitiesDesign and implement data pipelines using AWS servicesDevelop and maintain data models for relational and NoSQL databasesCollaborate with cross-functional teams to ensure...

  • Data Workflow Specialist

    20 hours ago

    erode, India beBeeData Full time

    Job Title: Data Workflow SpecialistAbout the Role: We are seeking a skilled Data Workflow Specialist to join our team.Responsibilities:Develop automated workflows to collect and manage data using PythonWork with large datasets and contribute to AI/ML-driven solutionsUse Excel for data cleaning, wrangling, and analysisCollaborate with teammates to understand...