Big Data Developer

2 weeks ago

Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000
Financial Data Engineer

We are seeking a highly skilled data professional to join our team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines that handle high-volume financial data, including stocks, cryptocurrencies, and third-party data sources.

Main Responsibilities:

  • Design, develop, and manage end-to-end data pipelines for stocks, crypto, and other financial datasets.
  • Integrate third-party APIs and data feeds into internal systems.
  • Build and optimize data ingestion, storage, and transformation workflows (batch and real-time).
  • Ensure data quality, consistency, and reliability across all pipelines.
  • Collaborate with data scientists, analysts, and backend engineers to provide clean, structured, and scalable datasets.
  • Monitor, troubleshoot, and optimize pipeline performance.
  • Implement ETL/ELT best practices, data governance, and security protocols.
  • Contribute to the scalability and automation of our data infrastructure.

Requirements:

  • Proven experience as a Big Data Engineer / Data Engineer (preferably in financial or crypto domains).
  • Strong expertise in Python, SQL, and distributed data systems.
  • Hands-on experience with data pipeline tools (e.g., Apache Spark, Kafka, Airflow, Flink, Prefect).
  • Experience with cloud platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift, etc.).
  • Knowledge of API integrations and handling real-time streaming data.
  • Familiarity with databases (relational and NoSQL) and data modeling.
  • Solid understanding of stocks, cryptocurrencies, and financial data structures.
  • Strong problem-solving skills with the ability to handle large-scale data challenges.

  • Big Data Strategist

    2 weeks ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    As a leading Big Data Specialist, you will spearhead our data analytics initiatives. Your expertise in leveraging big data technologies such as PySpark and Hive to drive business growth will be instrumental in propelling our company forward.Key Responsibilities:Develop and implement scalable data architectures using Spark, HBase, and DQ tools to enhance data...

  • Senior Big Data Specialist

    7 days ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 21,74,000 - ₹ 26,10,000

    Job Opportunity: Big Data Developer">The company we work with is a leading provider of software services. They have helped numerous businesses meet their IT requirements by utilizing the latest technologies, offering flexible engagement models and rapidly deployable solutions.We are seeking a skilled Big Data Developer to join our team. The ideal candidate...

  • Big Data Systems Developer

    2 weeks ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    OverviewWe are seeking an experienced Data Engineer to join our team. As a key member of the data engineering team, you will play a critical role in designing, building, and maintaining large-scale data systems.ResponsibilitiesCollaborate closely with our data science team to develop complex algorithms that provide actionable insights from large...

  • Data Scientist and Big Data Expert

    7 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    Big Data Engineer RoleWe are seeking a skilled professional with expertise in designing, architecting, and implementing data engineering solutions. The ideal candidate will bring hands-on experience in Big Data technologies and AWS Cloud Services.Key Responsibilities:Data Engineering: Design, develop, and optimize Big Data architectures leveraging AWS...

  • Senior Big Data Specialist

    1 week ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled data professional with strong expertise in SQL, big data processing and modern data platforms.The ideal candidate will have hands-on experience with modern unified data platforms (e.g. Databricks, Snowflake) and exposure to Microsoft Azure Fabric.Key Responsibilities:Drive initiatives to develop and continuously improve the...

  • Big Data Engineering Role

    4 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data Engineer Job\We are seeking a highly skilled Big Data Engineer to lead the implementation of infrastructure via code and provide strategic advice/recommendations for the development and advancement of Microsoft Azure technologies.\\In this role, you will be responsible for integrating and automating the delivery of standardised Azure deployments, in...

  • Big Data Systems Expert

    1 week ago

    Aurangabad, Maharashtra, India beBeeDistributedDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,01,00,000

    Job Title: Distributed Data Systems EngineerJob Description:As a Distributed Data Systems Engineer, you will play a crucial role in designing and executing large-scale distributed data systems.The team is responsible for building and managing complex data platforms that handle high volumes of requests across various topics. Our technologies include...

  • Strategic Cloud and Big Data Engineering Lead

    1 week ago

    Aurangabad, Maharashtra, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleSought after by Digital & Data Solutions (DDS) is a seasoned Cloud and Big Data Architect.This full-time hybrid role offers the ideal candidate flexibility for remote work.Azure certification (AZ-104 / AZ-305 / AZ-204) and DevOps experience are highly valued.The ideal candidate will possess:A profound understanding of Big Data architecture, cloud...

  • Senior Big Data Specialist

    1 week ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineer PositionJob Opportunity: Data Engineers are sought after for various roles across the globe. We're looking for experienced professionals to join our team in Pune, Indore, or Ahmedabad.As a Data Engineer at Einfochips, you will be responsible for designing, developing, and maintaining large-scale data systems.Design and develop data solutions...

  • Senior Data Developer

    2 weeks ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Role Summary:We are seeking a seasoned Data Specialist to spearhead the development of complex data pipelines, collaborate with business stakeholders, and implement scalable data warehouse solutions.Job Description:This is an exciting opportunity to work on a hybrid role that involves designing and building robust ETL workflows using industry-leading tools...