Data Engineering Specialist

3 days ago

Erode, Tamil Nadu, India beBeeDataEngineering Full time US$ 80,000 - US$ 1,50,000
Job Title

We are seeking an experienced Data Engineering specialist to design and develop robust data pipelines handling high-volume financial data. This role is critical in ensuring data integrity, scalability, and real-time availability across our platforms.

Main Responsibilities
  • Data Pipeline Development: Design, develop, and manage end-to-end data pipelines for stocks, crypto, and other financial datasets.
  • API Integrations and Data Feeds: Integrate third-party APIs and data feeds into internal systems.
  • Data Ingestion and Storage: Build and optimize data ingestion, storage, and transformation workflows (batch and real-time).
  • Data Quality and Governance: Ensure data quality, consistency, and reliability across all pipelines.
  • Collaboration and Troubleshooting: Collaborate with data scientists, analysts, and backend engineers to provide clean, structured, and scalable datasets.
Requirements
  • Experience: Proven experience as a Big Data Engineer / Data Engineer (preferably in financial or crypto domains). Strong expertise in Python, SQL, and distributed data systems.
  • Technical Skills:
    • Familiarity with data pipeline tools (e.g., Apache Spark, Kafka, Airflow, Flink, Prefect).
    • Experience with cloud platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift, etc.).
    • Knowledge of API integrations and handling real-time streaming data.
About Us

We're a forward-thinking organization that prioritizes innovation and collaboration. Our team works together to drive business growth and deliver exceptional results.

  • Data Engineering Specialist

    6 days ago

    Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 12,00,000

    Data Engineering SpecialistAttractive job opportunities exist for highly skilled Data Engineering Specialists to create and maintain large-scale data processing systems.Main Responsibilities:We are looking for a professional who can design and develop efficient data pipelines using Azure Data Factory and associated tools.The ideal candidate will have...

  • Data Engineer Specialist

    1 week ago

    Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 40,00,000 - ₹ 50,00,000

    Job Title: Data Engineering Specialist">We are looking for a highly skilled data engineering specialist to join our team. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.You will collaborate closely with data scientists, analysts,...

  • Data Engineering Lead

    7 days ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering SpecialistWe are seeking an experienced data engineer to join our team. The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.

  • Senior Data Engineering Specialist

    6 days ago

    Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled Data Engineering Specialist to design and implement scalable data architectures.The ideal candidate will have expertise in Azure Data Engineering, SQL, Python, PySpark, and other relevant technologies.Main Responsibilities:Data Ingestion: Develop and optimize ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and...

  • Advanced Data Specialist

    1 hour ago

    Erode, Tamil Nadu, India beBeeDataSpecialist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Advanced Data SpecialistWe are seeking a highly skilled and experienced Advanced Data Specialist to join our organization. The ideal candidate will possess in-depth knowledge of Big Data technology and have a proven track record of delivering large-scale data engineering projects.Key Responsibilities:Design, develop, and implement advanced data...

  • Cloud Data Infrastructure Specialist

    2 days ago

    Erode, Tamil Nadu, India beBeeDataInfrastructure Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Cloud Data Infrastructure SpecialistWe are seeking a highly skilled professional to join our team as a Cloud Data Infrastructure Specialist.The ideal candidate will have a strong background in data engineering, cloud computing, and infrastructure design.Key Responsibilities:Design, implement, and manage scalable data infrastructure on cloud...

  • Data Annotation Specialist

    1 week ago

    Erode, Tamil Nadu, India beBeeDataAnnotation Full time ₹ 50,00,000 - ₹ 75,00,000

    Job Title: Data Annotation SpecialistThis is a 100% remote opportunity.Main Responsibilities:Annotate and label data accurately, adhering to project guidelines.Review and validate existing annotations for consistency and quality.Collaborate with data scientists and engineers to understand annotation requirements and feedback.Maintain high accuracy and...

  • Data Ingestion Specialist

    1 day ago

    Erode, Tamil Nadu, India beBeeDataIngestion Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job SummaryData Ingestion Specialist sought after to develop and optimize data ingestion pipelines using CI/CD tools, Kubernetes, and Databricks. Collaborate with cross-functional teams to design efficient data workflows.Main Responsibilities:Create and maintain scalable data ingestion solutions for integrating various data sources into Databricks.Implement...

  • Firmware Engineering Specialist

    7 days ago

    Erode, Tamil Nadu, India beBeeFirmware Full time ₹ 90,00,000 - ₹ 1,50,00,000

    Job Title: Firmware Engineering SpecialistWe are seeking a highly skilled and innovative engineer to drive the development of cutting-edge sensors and edge devices.This role is perfect for a hands-on engineer with expertise in embedded systems, real-time operating systems (RTOS), and firmware development. You will play a critical role in designing,...

  • Enterprise Data Governance Specialist

    7 days ago

    Erode, Tamil Nadu, India beBeeDataGovernance Full time ₹ 21,93,600 - ₹ 26,15,200

    **Job Title:** Enterprise Data Governance SpecialistOverviewThe Enterprise Data Governance Specialist plays a pivotal role in driving strategic data governance initiatives that enhance the integrity and usability of enterprise-level data. This key position is responsible for overseeing the development and implementation of best practices for data governance,...