Building Financial Data Pipelines

2 days ago

Kozhikode, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000
Big Data Specialist

Our organization is seeking a skilled professional to design, develop, and maintain robust data pipelines that handle high-volume financial data.

Key Responsibilities:

  • Design and manage end-to-end data pipelines for stocks, crypto, and other financial datasets.
  • Integrate third-party APIs and data feeds into internal systems.
  • Develop and optimize data ingestion, storage, and transformation workflows (batch and real-time).
  • Ensure data quality, consistency, and reliability across all pipelines.
  • Collaborate with data scientists, analysts, and backend engineers to provide clean, structured, and scalable datasets.
  • Monitor and troubleshoot pipeline performance.
  • Implement ETL/ELT best practices, data governance, and security protocols.
  • Contribute to the scalability and automation of our data infrastructure.

Requirements:

  • Proven experience as a Big Data Engineer or Data Engineer (preferably in financial or crypto domains).
  • Strong expertise in Python, SQL, and distributed data systems.
  • Hands-on experience with data pipeline tools (e.g., Apache Spark, Kafka, Airflow, Flink, Prefect).
  • Experience with cloud platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift, etc.).
  • Knowledge of API integrations and handling real-time streaming data.
  • Familiarity with databases (relational and NoSQL) and data modeling.
  • Solid understanding of stocks, cryptocurrencies, and financial data structures (preferred).
  • Strong problem-solving skills with the ability to handle large-scale data challenges.

The ideal candidate will have a strong background in software development and data engineering, with hands-on experience in building and managing complex data pipelines.

As a Big Data Specialist, you will work closely with our cross-functional teams to design, develop, and deploy innovative solutions that drive business growth and customer satisfaction.

Our ideal candidate is self-motivated, curious, and passionate about learning new technologies and techniques.

  • Building Scalable Data Pipelines

    3 days ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Azure Data EngineerWe are seeking a self-driven professional to build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.The role involves collaborating with cross-functional teams to develop data solutions, ensuring data governance through Unity Catalog, and supporting real-time and batch processing.Main...

  • Data Pipeline Architect

    3 days ago

    Kozhikode, Kerala, India beBeeCloud Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior AWS Glue DeveloperAs a senior developer, you will be responsible for designing and implementing data ingestion and transformation pipelines using serverless and cloud-based services.The ideal candidate will have experience with the Extract-Load-Transform approach, metadata-driven integration design, and Data Build Tool to enable rapid onboarding of...

  • Data Pipeline Architect

    4 days ago

    Kozhikode, Kerala, India beBeeDataEngineering Full time ₹ 90,00,000 - ₹ 1,22,50,000

    Role Overview:">Job DescriptionWe are seeking an experienced Data Engineer to design and implement scalable data pipelines utilizing expertise in Palantir Foundry.Responsibilities will include developing efficient data processing solutions using PySpark and building robust data engineering tools with Typescript.The ideal candidate will have a minimum of 5-8...

  • Data Pipeline Specialist

    1 day ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    Job OpportunityWe are seeking a talented Trainee Engineer to join our team and contribute to building data pipelines, automation scripts, and analytical algorithms.

  • Chief Data Pipeline Architect

    1 day ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Role Overview:We are seeking a highly skilled Data Engineer to develop and implement scalable data pipelines using cloud-based technologies. The ideal candidate will have expertise in cloud services such as GCP, AWS, or Azure, distributed stream processing technology, and strong programming skills.The successful candidate will be responsible for designing,...

  • Data Pipeline Engineer

    3 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 25,00,000 - ₹ 30,00,000

    Data Solutions Architect for Oil & Gas IndustryWe are seeking a senior-level Data Solutions Architect with expertise in designing, building, and optimizing scalable data pipelines and cloud solutions for the Oil & Gas industry. The ideal candidate will have a strong background in AWS cloud services, data engineering, and knowledge of Oil & Gas upstream,...

  • Chief Financial Data Strategist

    1 week ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 60,00,000 - ₹ 1,50,00,000

    Portfolio Data AnalystWe are seeking highly skilled Portfolio Data Analysts to collaborate closely with our founders, financial analysts, product managers, and engineers. In this pivotal role, you'll support our client onboarding and success team, analyzing financial data to drive strategic insights.Collect and onboard portfolio data from various sources...

  • Data Pipeline Quality Assurance Specialist

    3 days ago

    Kozhikode, Kerala, India beBeeSeniorTestEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    About our company:We are a leading provider of business transformation services, leveraging technology to address a wide range of business needs.Our goal is to unleash human energy through technology for an inclusive and sustainable future.We provide various services, including consulting, technology, professional, and outsourcing services.Job Summary:The...

  • ETL Data Engineer with Expertise in Scalable Data Pipelines

    3 days ago

    Kozhikode, Kerala, India beBeeetldeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: ETL Developer - DataStage, AWS, SnowflakeOverview of the PositionWe are seeking a skilled and motivated ETL developer to join our team. You will work on designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Responsibilities

  • Financial Data Analyst

    5 days ago

    Kozhikode, Kerala, India beBeeAccounting Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Financial data analysis requires meticulous attention to detail, and we're looking for a highly skilled professional to help us navigate the complexities of financial statements.About the RoleThis contract remote position involves exceptional AP/AR posting skills, experience with e-commerce chargebacks, and proficiency in preparing and analyzing financial...