Freelance Data Ingestion Specialist

1 week ago

alwar, India beBeeDataEngineer Full time

About Us:We are a dynamic cybersecurity startup dedicated to protecting businesses against cyber threats.Our company specializes in services such as cloud security, DevSecOps, and vulnerability testing. We offer tailored solutions to meet clients' unique requirements.We're Looking for a Freelance Data EngineerWe seek a skilled Freelance Data Engineer with expertise in Apache NiFi and the Google Cloud Platform (GCP) ecosystem. The successful candidate will design and build real-time data ingestion and processing pipelines.Key Responsibilities:Create real-time data ingestion pipelines using Apache NiFi for structured and unstructured datasets.Integrate ingestion and processing pipelines with GCP ecosystem tools like BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer (Airflow).Maintain low-latency and high-throughput data movement across ingestion, processing, and storage layers.Develop optimized SQL queries for BigQuery and relational databases to support analytics and reporting.Build Python scripts for data transformation, automation, and developing custom NiFi processors.Implement robust error-handling frameworks and data quality checks, validation rules, deduplication, late-arriving data handling.Collaborate with data analysts, data scientists, and platform engineering teams to deliver analytics-ready datasets.Apply data security measures, including GCP IAM policies, VPC Service Controls, and encryption standards to maintain compliance.Monitor and troubleshoot pipeline performance to ensure stability and reliability.Document data flows, architecture diagrams, transformation logic, and operational best practices.Requirements:Expertise in Apache NiFi and GCP ecosystem.Strong knowledge of SQL and database systems.Proficiency in Python programming language.Familiarity with cloud-based technologies.Excellent problem-solving skills and analytical thinking.Ability to work collaboratively in a team environment.Strong communication and documentation skills.

  • Dynamic GCP Data Solutions Specialist

    2 weeks ago

    alwar, India beBeeDataEngineer Full time

    Job OverviewWe are seeking a skilled Freelance GCP Data Engineer to design, implement, and optimize real-time data pipelines.Main Responsibilities:Design and implement real-time data ingestion pipelines using Apache NiFi for structured and unstructured data.Integrate data pipelines with the GCP ecosystem, including BigQuery, Pub/Sub, Dataflow, Dataproc,...

  • Highly Skilled Data Support Professional

    2 days ago

    alwar, India beBeeData Full time

    Data Support Specialist RoleWe are seeking a seasoned Data Support Specialist with 8+ years of experience to serve as the primary point of contact for data ingestion, pipeline, and consumption issues.Support complex technical problems with data ingestion, consumption, and pipelinesMonitor and maintain data pipeline health to ensure high system stability and...

  • Part-Time Data Insights Specialist

    2 weeks ago

    alwar, India beBeeDataInsights Full time

    We're seeking a part-time Data Insights Specialist to join our team. As a key player in data-driven decision making, you'll be responsible for independently developing and maintaining analytics solutions across Power BI, SQL, Google Sheets, and data engineering/integration tasks.You'll play a vital role in supporting multiple ongoing projects by creating...

  • Unified Data Solutions Architect

    2 days ago

    alwar, India beBeeEngineer Full time

    Data Platform SpecialistAs a key member of our organization, we are seeking an experienced Data Platform Specialist to connect and integrate our financial and operational ecosystem into one trusted data platform. The ideal candidate will have a strong background in building ingestion pipelines, unified models, a lakehouse layer, orchestration workflows, and...

  • Highly Skilled Cloud Data Architect

    2 weeks ago

    alwar, India beBeeDataEngineering Full time

    Job Description:We are seeking a highly skilled Data Engineer to join our team of professionals in building and maintaining scalable data pipelines, leveraging modern cloud-native data stacks and large-scale enterprise data initiatives.This is an excellent opportunity for engineers who can work with cutting-edge technologies, collaborate with...

  • Data Engineer Transformation Specialist

    1 week ago

    alwar, India beBeeData Full time

    We are seeking a skilled Data Modeling Expert with strong experience in Python, PySpark, Snowflake and AWS Glue to drive our data growth.About the RoleThis position requires a deep understanding of data modeling, ETL frameworks and cloud-based data platforms.Key Responsibilities:Data Engineering: Design, develop and maintain scalable ETL/ELT pipelines using...

  • Freelance Cloud Platform Specialist

    1 week ago

    alwar, India beBeeOpenshiftengineer Full time

    Job OverviewWe are seeking an experienced and skilled Freelance OpenShift Engineer to join our team on a freelance basis.Deploy, configure, and manage OpenShift clusters, including version upgrades, patching, scaling, and cluster lifecycle management.Deploy, manage, and scale containerized applications using the oc CLI, OpenShift Web Console, and...

  • Python Developer

    2 weeks ago

    alwar, India beBeeDataEngineer Full time

    Senior Data Engineer PositionWe are seeking an accomplished Senior Data Engineer to spearhead the development and maintenance of robust data pipelines that fuel our large language model (LLM) operations.This role requires a seasoned professional with expertise in data ingestion, processing, and quality for all AI training endeavors.The ideal candidate will...

  • Data Quality Specialist

    2 weeks ago

    alwar, India beBeeDataQuality Full time

    Job DescriptionWe are seeking a skilled professional to lead our data quality initiatives, focusing on comprehensive testing support for data pipelines and overall product.This role will involve design, implementation, and execution of test plans and scripts for data ingestion, dbt transformation models, and system functionality. You will ensure data...

  • Data Engineer

    2 weeks ago

    alwar, India beBeeData Full time

    Big Data Engineer OpportunityWe are seeking a skilled engineer with strong hands-on experience in data ingestion pipelines and ETL/ELT processes.The ideal candidate will have expertise in Microsoft Azure services, including Data Factory, Storage, Synapse, and Key Vault.Manage batch and real-time data ingestion pipelines.Ensure effective incident management,...