Data Pipeline Specialist

2 days ago

Udaipur, Rajasthan, India beBeeFinancial Full time ₹ 20,00,000 - ₹ 25,00,000

We are seeking a highly skilled Big Data Engineer to join our growing team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines that handle high-volume financial data, including stocks, cryptocurrencies, and third-party data sources. You will play a critical role in ensuring data integrity, scalability, and real-time availability across our platforms.

Key Responsibilities :-

  • Design, develop, and manage end-to-end data pipelines for stocks, crypto, and other financial datasets.
  • Integrate third-party APIs and data feeds into internal systems.
  • Build and optimize data ingestion, storage, and transformation workflows (batch and real-time).
  • Ensure data quality, consistency, and reliability across all pipelines.
  • Collaborate with data scientists, analysts, and backend engineers to provide clean, structured, and scalable datasets.
  • Monitor, troubleshoot, and optimize pipeline performance.
  • Implement ETL/ELT best practices, data governance, and security protocols.
  • Contribute to the scalability and automation of our data infrastructure.

Requirements :-

  • Proven experience as a Big Data Engineer / Data Engineer (preferably in financial or crypto domains).
  • Strong expertise in Python, SQL, and distributed data systems.
  • Hands-on experience with data pipeline tools (e.g., Apache Spark, Kafka, Airflow, Flink, Prefect).
  • Experience with cloud platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift, etc.).
  • Knowledge of API integrations and handling real-time streaming data.
  • Familiarity with databases (relational and NoSQL) and data modeling.
  • Solid understanding of stocks, cryptocurrencies, and financial data structures (preferred).
  • Strong problem-solving skills with the ability to handle large-scale data challenges.

  • Data Pipeline Specialist

    4 days ago

    Udaipur, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 22,50,000

    Unlock Your Potential as a Data EngineerWe are seeking an experienced Data Engineer to drive innovation in our data pipeline team.Your expertise in designing, developing, and running complete end-to-end data pipelines on the Azure platform will be invaluable.As a key member of our team, you will work closely with Agile teams to handle data validation,...

  • Data Pipelines Specialist

    4 days ago

    Udaipur, Rajasthan, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewOur organization is seeking a highly skilled Data Engineer to join our team. This individual will be responsible for designing, implementing, and managing CI/CD pipelines using GitHub Actions or equivalent tools. They will also configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.Key...

  • Senior Data Pipeline Specialist

    4 days ago

    Udaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking an experienced Senior Data Engineer to design and develop scalable data pipelines using Databricks and PySpark.Our ideal candidate will have a strong understanding of distributed data processing, CI/CD pipelines, and infrastructure as code using Terraform.The role involves implementing and managing data solutions on AWS, including...

  • Cloud Data Pipeline Specialist

    3 days ago

    Udaipur, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerWe are seeking an experienced data engineer with expertise in designing, building, and optimizing scalable data pipelines and cloud solutions. The ideal candidate will have strong experience in AWS cloud services, data engineering, and knowledge of upstream, midstream or downstream processes to support advanced analytics, reporting,...

  • Building Scalable Data Pipelines

    2 days ago

    Udaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a seasoned Cloud Data Engineer to join our team and take charge of designing and building scalable data pipelines.About the RoleThe ideal candidate will have a strong background in Azure Data Factory, with expertise in ETL/ELT processes and pipeline design.Design and build data pipelines using Azure Data Factory that ensure smooth, secure, and...

  • Data Pipeline Architectural Specialist

    3 days ago

    Udaipur, Rajasthan, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,01,00,000

    About this Opportunity:Our organization is seeking a visionary Lead Engineer to spearhead the development of our data pipelines.We require an exceptional individual with hands-on expertise in Python, architecture, and performance optimization.Key Responsibilities:Platform Engineering:Design and implement a shared component library for ingestion, parsing,...

  • Lead Data Pipeline Architect

    3 days ago

    Udaipur, Rajasthan, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 1,75,000

    Job Description:The Senior Data Engineer plays a pivotal role in constructing and optimizing the data pipeline architecture. This individual will lead the optimization and scalability of data delivery pipelines, ensuring performance and reliability for cross-functional stakeholders. This key position is responsible for architecting, building, and maintaining...

  • Chief Data Pipeline Architect

    3 days ago

    Udaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Key to operational excellence and growth is the role of a Data Engineer. This individual creates seamless interactions between people and technology, responsible for designing and developing robust data pipelines and ETL processes using data platforms for centralized data warehousing.The ideal candidate will have extensive experience in conceptualizing...

  • Senior Cloud Data Pipeline Specialist

    3 days ago

    Udaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 30,00,000

    Cloud Data Engineer Job DescriptionLooking for an opportunity to work on complex data engineering projects and drive innovation in cloud-based data platforms? We are seeking a highly skilled Cloud Data Engineer to join our team. The ideal candidate will have experience designing, developing, and maintaining scalable data pipelines using PySpark.The role...

  • Cloud Data Pipeline Architect

    3 days ago

    Udaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 14,40,000 - ₹ 25,12,000

    Job Title:Data EngineerAbout Us:We're leading the transformation of the insurance industry by developing innovative benefits management solutions.We focus on modernizing complex back-office systems to create scalable, secure, and high-performing platforms that streamline operations for our clients.Position Overview:As a self-driven Data Engineer, you'll...