Financial Data Pipeline Specialist

3 days ago

Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000
Job Title:

Data Engineer for Financial and Crypto Domains

Description:

We are seeking a skilled data engineer to design, build, and maintain robust data pipelines for high-volume financial data. This role involves collaborating with cross-functional teams to provide clean, structured, and scalable datasets.

  • Design end-to-end data pipelines for stocks, crypto, and other financial datasets.
  • Integrate third-party APIs and data feeds into internal systems.
  • Build and optimize data ingestion, storage, and transformation workflows (batch and real-time).
  • Ensure data quality, consistency, and reliability across all pipelines.
  • Collaborate with data scientists, analysts, and backend engineers to provide clean, structured, and scalable datasets.
  • Monitor, troubleshoot, and optimize pipeline performance.
  • Implement ETL/ELT best practices, data governance, and security protocols.
  • Contribute to the scalability and automation of our data infrastructure.
Required Skills and Qualifications:
  • Proven experience as a Big Data Engineer / Data Engineer in financial or crypto domains.
  • Strong expertise in Python, SQL, and distributed data systems.
  • Hands-on experience with data pipeline tools (e.g., Apache Spark, Kafka, Airflow, Flink, Prefect).
  • Experience with cloud platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift, etc.).
  • Knowledge of API integrations and handling real-time streaming data.
  • Familiarity with databases (relational and NoSQL) and data modeling.
  • Solid understanding of stocks, cryptocurrencies, and financial data structures.
  • Strong problem-solving skills with the ability to handle large-scale data challenges.

  • Senior Data Pipelining Expert

    4 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 60,00,000 - ₹ 1,00,00,000

    About this RoleWe're seeking a Data Transformation Specialist to build robust pipelines that transform large, messy data into high-quality structured data.

  • Data Pipeline Specialist

    3 days ago

    Gulbarga, Karnataka, India beBeeValidator Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewA Data Pipeline Validator is responsible for ensuring the integrity and quality of data pipelines. This role requires a strong understanding of data warehouse testing methodologies and ETL concepts.Responsibilities:Develop and execute test plans to validate data quality and integrityCollaborate with cross-functional teams to identify and...

  • Expert Cloud Data Pipeline Engineer

    2 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Integration SpecialistWe are seeking an experienced professional to support our data integration and ETL needs.The ideal candidate will have strong hands-on expertise in designing, building, and maintaining scalable and secure data pipelines across multiple sources and destinations.Design and Build Pipelines: Create efficient Azure Data Factory...

  • Senior Data Pipeline Specialist

    3 days ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,60,00,000

    Key Roles and Responsibilities:Data Engineers are required to design, develop, and maintain ETL/ELT data pipelines. They must be able to ingest data from various sources into our data warehouse.This includes databases and flat files. The ideal candidate will have experience with AWS Cloud services, including Lambda, DMS, and Glue.A solid understanding of...

  • Financial Data Specialist

    1 day ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    We are seeking a skilled professional to fill a Data Analyst role.Job Description:Analyze and onboard data from various sources into our ecosystem.Collaborate with engineering, product management, and data operations teams to deliver high-quality, timely, and reliable data solutions through our platform.Work with third-party providers to integrate their data...

  • Senior Financial Data Specialist

    6 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 23,40,000

    Imagine driving strategic decisions with actionable insights derived from meticulously curated portfolio data.About the Role:Integrate diverse financial datasets into our unified ecosystem, empowering business growth and performance analysis.Collaborate with cross-functional teams to develop innovative data-driven solutions for client success.Pioneer...

  • Data Engineer

    3 days ago

    Gulbarga, Karnataka, India beBeeDatastage Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: ETL Lead with IBM DataStageAbout the RoleWe are seeking a motivated and talented ETL developer to join our data engineering team. As an ETL lead, you will work on building scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key Responsibilities:Design, develop, and maintain ETL pipelines using...

  • Lead Data Pipeline Developer

    4 days ago

    Gulbarga, Karnataka, India beBeeDataGovernance Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Role: Azure Data Engineer - Data Pipelines & GovernanceAbout the PositionWe are seeking a skilled Azure Data Engineer to develop, optimize, and maintain automated data pipelines in support of our data governance and analytics initiatives.Main Responsibilities:Pipeline Development - Design, build, and deploy robust ETL/ELT pipelines in Databricks...

  • Scalable Data Pipeline Expert

    3 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineer RoleWe are seeking a seasoned Senior Data Engineer to spearhead the design, development, and maintenance of scalable data pipelines using PySpark. This is an exceptional opportunity for someone with strong expertise in PySpark and hands-on experience in building robust data pipelines.

  • Lead Data Pipeline Architect

    3 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,60,00,000

    About the RoleWe are seeking an experienced Data Engineer to lead our data pipeline architecture and collaborate with data scientists and analysts.