Senior Data Pipeline Specialist

4 days ago

Dombivli, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

Data Engineering Role

Job Overview

This is a key role within our organization, focusing on designing and developing data pipelines to ingest data from various sources into our data warehouse. The ideal candidate will have experience with AWS services such as Lambda, DMS, and Glue for data ingestion and transformation processes.

Key Responsibilities
  • Design and develop ETL/ELT data pipelines using AWS services.
  • Develop and optimize Snowflake stored procedures for complex business logic and data transformations.
  • Manage and monitor scheduled data workflows using Apache Airflow.
  • Work closely with stakeholders to understand project requirements and translate them into technical solutions.
Requirements
  • Proven experience as a Data Engineer or in a similar role.
  • Strong proficiency in SQL scripting.
  • Proficiency in Python for data manipulation and automation.
  • Experience with Apache Airflow for workflow orchestration.
  • Hands-on experience with AWS Cloud services, including Lambda, DMS, and Glue.
  • Solid understanding of data warehousing concepts, with practical experience using Snowflake.
  • Excellent problem-solving skills and the ability to design and implement solutions based on business requirements.
  • Experience with the full software development lifecycle (SDLC) and project documentation.
  • Familiarity with data quality best practices.
  • Strong communication and collaboration skills.
Benefits

As a Data Engineer, you will be working on a wide range of projects, utilizing your skills to drive business growth and improvement. You will be part of a collaborative team that values innovation and excellence.

What We Offer
  • A competitive salary package.
  • Ongoing training and professional development opportunities.
  • A dynamic work environment that encourages creativity and initiative.
  • Opportunities for career advancement.

  • Data Pipeline Architect

    2 days ago

    Dombivli, Maharashtra, India beBeeAzure Full time ₹ 12,00,000 - ₹ 20,10,000

    Job DescriptionThreatXIntel, a cybersecurity company dedicated to protecting businesses from cyber threats, is seeking an experienced Freelance Azure Data Factory (ADF) Specialist to support our data integration and ETL needs.The ideal consultant will have strong hands-on expertise in Azure ADF pipelines, data orchestration, and transformations to ensure...

  • Senior Data Specialist Position

    5 days ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Senior Data Specialist  We are looking for an experienced Senior Data Specialist to join our team. The successful candidate will be responsible for designing, building and optimizing data pipelines and ETL workflows.  Key Responsibilities include:Designing, building and optimizing data pipelines and ETL workflowsManaging and processing large datasets...

  • Data Pipeline Architect

    3 days ago

    Dombivli, Maharashtra, India beBeePython Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Python EngineerWe are seeking a seasoned Senior Python Engineer to lead our engineering group. As a key member of the team, you will be responsible for designing and developing scalable data pipelines using Python and Pandas.You will work closely with Data Scientists, Analysts, and Engineering teams to support data-driven applications and reporting...

  • Data Pipeline Specialist

    5 days ago

    Dombivli, Maharashtra, India beBeeTalend Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Talend ETL DeveloperWe are seeking a qualified professional to take on the role of a Talend ETL Developer with expertise in Talend Open Studio for an immediate contractual position.Below are the key responsibilities and requirements for this job:Key Responsibilities:- Design and optimize complex ETL pipelines using Talend Data Integration- Debug...

  • Expert Data Pipeline Specialist

    3 days ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 15,00,000

    Job OverviewWe are seeking a skilled Data Engineer to design, develop and maintain large-scale data pipelines that can handle structured and unstructured data.This role involves key responsibilities such as implementing data pipelines, building ETL/ELT workflows and ensuring data quality across all pipelines.

  • Senior Data Pipeline Developer

    3 days ago

    Dombivli, Maharashtra, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleWe are seeking a highly skilled and experienced Platform Engineer to join our team. The ideal candidate will have a strong background in Python, with expertise in performance and concurrency, as well as experience with API engineering and large-scale data pipelines.Design and Build Shared Component Library/SDK: Design, build, and maintain a shared...

  • Data Pipeline Specialist – Cloud Engineering

    3 days ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000

    Freelance Data Engineer OpportunityJoin a collaborative environment where you can utilize your expertise in designing and optimizing large-scale data pipelines.Role OverviewAs an experienced Freelance Data Engineer, you will work closely with internal teams to design, build, and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks. The ideal...

  • Highly Skilled Data Pipeline Architect

    3 days ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About Foodsmart:We are a leading provider of personalized nutrition and foodcare solutions.Our platform is designed to foster healthier eating habits, drive lasting behavior change, and deliver long-term health outcomes.We serve 2.2 million members on a tailored journey to eating well while saving time and money.We partner with national and regional...

  • Senior Data Architecture Specialist

    5 days ago

    Dombivli, Maharashtra, India beBeeDataArchitecture Full time ₹ 15,00,000 - ₹ 25,14,000

    We are seeking a Senior Data Architecture Specialist to join our team of consultants.In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.You will collaborate closely with data scientists, analysts, and other engineers to ensure the...

  • Data Ingestion Specialist

    1 week ago

    Dombivli, Maharashtra, India beBeeIngestion Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Ingestion Engineer Job DescriptionWe are seeking a highly skilled Data Ingestion Specialist to join our team. The successful candidate will have expertise in data ingestion processes and pipelines, with a strong understanding of how to integrate multiple sources into Databricks.The ideal candidate will design, develop, and optimize data ingestion...