Big Data Specialist
11 hours ago
We are seeking a skilled Data Engineer to join our growing team.
Main Responsibilities:
- Design and develop end-to-end data pipelines for financial datasets.
- Integrate third-party APIs and data feeds into internal systems.
- Build and optimize data ingestion, storage, and transformation workflows (batch and real-time).
- Ensure data quality, consistency, and reliability across all pipelines.
- Collaborate with data scientists, analysts, and backend engineers to provide clean, structured, and scalable datasets.
- Monitor, troubleshoot, and optimize pipeline performance.
- Implement ETL/ELT best practices, data governance, and security protocols.
- Contribute to the scalability and automation of our data infrastructure.
Requirements:
- Proven experience as a Data Engineer in financial or crypto domains.
- Strong expertise in Python, SQL, and distributed data systems.
- Hands-on experience with data pipeline tools (e.g., Apache Spark, Kafka, Airflow, Flink, Prefect).
- Experience with cloud platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift, etc.).
- Knowledge of API integrations and handling real-time streaming data.
- Familiarity with databases (relational and NoSQL) and data modeling.
- Solid understanding of stocks, cryptocurrencies, and financial data structures.
- Strong problem-solving skills with the ability to handle large-scale data challenges.
-
Leading Big Data Innovator
4 days ago
Palakkad, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Big Data SpecialistWe are seeking a highly skilled Big Data Specialist to drive our business forward.This role involves designing and developing scalable big data architectures using PySpark, Hive, Spark, HBase, and other related tools.The ideal candidate will have experience with data ingestion from disparate sources onto big data platforms and exposure to...
-
Senior Big Data Specialist
5 minutes ago
Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: Senior Big Data SpecialistDescriptionWe are seeking a highly skilled Senior Big Data Specialist to join our team. The ideal candidate will have a minimum of 3-5 years of experience in designing and implementing data pipelines using various technologies.The successful candidate will be responsible for developing and maintaining large-scale data...
-
Big Data Specialist
4 days ago
Palakkad, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 20,00,000We are seeking a Big Data professional to join our team.Key Responsibilities:Analyzing large datasets using PySpark and Hive.Desirable Skills:Proficiency in Spark and HBase for efficient data processing.Data Quality tools expertise for data accuracy and reliability.Awareness of Agile methodologies for effective collaboration.Familiarity with data ingestion...
-
Big Data Engineer
6 hours ago
Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Job OverviewAs a skilled professional in Big Data engineering, you will be responsible for developing and implementing scalable data processing solutions using cutting-edge technologies.With 2+ years of experience in the field, you will have a solid understanding of Big Data concepts, Scala programming language, AWS cloud platform, and either Python or...
-
Big Data Administrator
4 days ago
Palakkad, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000Job OverviewWe are seeking an experienced Big Data Administrator to join our team.The ideal candidate will have a strong background in Hadoop administration, with expertise in designing, building, and maintaining large-scale Hadoop clusters.Key Responsibilities:Design and implement scalable Hadoop architectures to support big data analytics and...
-
Big Data Visionary
6 hours ago
Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job DescriptionWe are seeking a seasoned Big Data professional to lead our data engineering efforts. As a Senior Big Data Engineer, you will be responsible for designing and implementing large-scale data processing systems that drive business growth.Team Leadership: Proven experience in leading high-performing data engineering teams across multiple...
-
Big Data Technical Lead
4 days ago
Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Description">Technical ArchitectWe are seeking a seasoned technical architect to lead our team in building a scalable and extensible big data platform. The ideal candidate will have a strong track record of delivering complex engineering projects and experience working with large, complex data sets.This position reports to an Engineering Manager and...
-
Principal Big Data Engineer
4 days ago
Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: Data Engineer- Apache DruidThis role is a great opportunity to utilize your technical skills and experience in big data technologies. We are seeking a skilled engineer to join our team.Apache Druid Experience:We are looking for someone with strong hands-on experience working with Apache Druid in production environments.Required Skills and...
-
Data Integration Specialist
4 days ago
Palakkad, Kerala, India beBeeInformatica Full time ₹ 15,00,000 - ₹ 20,00,000A data integration specialist is required to drive technological advancements and business growth for clients. The ideal candidate will have experience with Informatica BDM/DEI, big data platforms, and data warehousing concepts.Responsibilities:Design scalable ETL workflows using Informatica BDM/DEI.Integrate data from structured and unstructured...
-
Big Data Solutions Architect
6 days ago
Palakkad, Kerala, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer with hands-on expertise in Python and Pyspark. This role requires someone who can implement a large-scale data engineering application for a prominent retailer.Key Responsibilities:Design, develop, and deploy scalable data processing pipelines using Pyspark.Collaborate with...
