Cloud Data Engineering Specialist

4 days ago

kochi, India beBeeData Full time

Job Title:Cloud Data Engineering SpecialistJob OverviewThreatXIntel is a startup specializing in cybersecurity, offering tailored and cost-effective solutions for businesses and organizations of all sizes. Our expertise spans cloud security, web and mobile security testing, cloud security assessments, DevSecOps, and more.We are seeking an experienced Cloud Data Engineering Specialist to design, implement, and optimize real-time data pipelines using the Google Cloud Platform (GCP) ecosystem, including BigQuery, Pub/Sub, Dataflow, and Cloud Storage.Develop and implement scalable data ingestion pipelines using Apache NiFi for structured and unstructured data.Integrate data pipelines with GCP services, including BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer/Airflow.Ensure low-latency, high-throughput data delivery to downstream systems for analytics and reporting.Design and develop SQL queries for BigQuery and relational databases to ensure data transformation and analysis.Write Python scripts for data transformation, automation, and custom NiFi processors when required.Implement data quality, validation, and error-handling mechanisms within ingestion pipelines to ensure reliability and accuracy.Collaborate with data analysts, data scientists, and platform engineers to deliver consistent and high-quality datasets.Ensure data security, governance, compliance with GCP IAM, VPC Service Controls, and encryption standards.Monitor, troubleshoot, and optimize data pipeline performance to ensure smooth operations.Document data flows, architecture, and best practices to maintain consistency across teams.RequirementsTo be successful in this role, you will need:Expertise in designing and implementing real-time data ingestion pipelines using Apache NiFi.Proficiency in integrating data pipelines with GCP services, including BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer/Airflow.Experience with SQL query development for BigQuery and relational databases.Strong understanding of data security, governance, and compliance principles.Excellent problem-solving skills and ability to work collaboratively in a team environment.What We OfferAs a Cloud Data Engineering Specialist at ThreatXIntel, you will have the opportunity to work on cutting-edge projects, collaborate with talented professionals, and develop your skills in cloud data engineering.

  • Dedicated Cloud Data Engineer

    6 days ago

    kochi, India beBeeDataEngineering Full time

    Data Engineering SpecialistWe are seeking a skilled Data Engineering Specialist to join our team. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions using Python, ETL/ELT processes, and AWS cloud services.

  • Data Engineer

    4 days ago

    kochi, India beBeeData Full time

    We are seeking a highly skilled Data Migration Specialist to join our team. This role involves collaborating closely with data and reporting teams to ensure seamless migration of data from Teradata to BigQuery.The ideal candidate will have 5-10 years' experience in data engineering and be proficient in GCP – BigQuery, Cloud Storage, SQL, and Power BI.This...

  • Cloud Data Migration Specialist

    6 days ago

    kochi, India beBeeCloudDataMigration Full time

    Job Title: Cloud Data Migration SpecialistWe are seeking an experienced Cloud Data Migration Specialist to support a strategic migration initiative from Teradata to Cerebro (BigQuery). This role requires collaboration with our data and reporting teams to ensure seamless integration and validation of Power BI reports.Key Responsibilities:Support the migration...

  • Mastering Scalable Cloud-Based Data Solutions

    6 days ago

    kochi, India beBeeData Full time

    Cloud Data Specialist Job DescriptionWe are seeking a skilled Cloud Data Specialist to join our data engineering teams. This is an opportunity for experienced engineers who can design and implement scalable cloud-based data solutions.The ideal candidate will have hands-on experience with modern cloud-native data stacks, including AWS Glue, Redshift, EMR,...

  • Cloud Computing Specialist

    6 days ago

    kochi, India beBeeDiscovery Full time

    ServiceNow Discovery Cloud Specialist Role OverviewWe seek a skilled professional to design, implement, and optimize Discovery processes for ServiceNow in cloud environments.Main Responsibilities:Maintain and configure ServiceNow Discovery across data centers, private cloud, and public cloud platforms.Configure and maintain integrations for AWS, Azure, GCP,...

  • Azure Cloud Infrastructure Specialist

    5 days ago

    kochi, India beBeeCloud Full time

    Azure cloud infrastructure specialist responsible for designing and maintaining scalable, secure, and reliable systems.BUILD AND MANAGE CONTINUOUS INTEGRATION AND CONTINUOUS DEPLOYMENT PIPELINES USING GITHUB ACTIONS.LEAD CONTAINERIZATION AND MICROSERVICES USING AKS FOR SCALABLE APPLICATION DEVELOPMENT.DEVELOP AUTOMATION SCRIPTS USING POWERSHELL, BASH, PYTHON...

  • Senior Data Engineer – Cloud Platforms

    3 days ago

    kochi, India beBeeDataEngineering Full time

    About the PositionAs a data engineer on Google Cloud Platform, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Data ingestion using Google Cloud Storage and DataflowData processing using BigQuery and PySpark/PythonAutomating workflows using Apache AirflowCollaboration with...

  • Senior Data Engineer

    2 days ago

    kochi, India beBeeData Full time

    Job Title: Senior Data ArchitectWe are seeking a highly experienced and skilled Data Architecture Specialist to lead the design, implementation, and management of our large-scale data solutions. This role involves architecting complex data systems, ensuring scalability and reliability, and collaborating with cross-functional teams.The ideal candidate must...

  • Data Engineering Specialist

    6 days ago

    kochi, India beBeeDataEngineer Full time

    Job Title: Data Engineering SpecialistWe are seeking a highly skilled and seasoned professional to design, build, and optimize data-driven solutions for our clients.Main Responsibilities:Design scalable and secure architectures using cloud-based technologiesBuild efficient pipelines for batch and streaming data processingImplement robust data quality,...

  • Cloud Infrastructure Specialist

    1 week ago

    kochi, India beBeeInfrastructure Full time

    Empowering Excellence in Cloud Infrastructure ManagementJob DescriptionWe are seeking a seasoned cloud infrastructure specialist to join our team. As a DevOps Engineer, you will play a pivotal role in designing, deploying, and managing scalable and secure cloud-based systems.Key Responsibilities:Automate infrastructure provisioning and configuration...