Senior Data Pipeline Specialist

24 hours ago

Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Key Data Engineering Position

We are seeking a highly skilled Data Engineer to fill this critical role.

The ideal candidate will have a strong background in data engineering, with a proven track record of designing and implementing scalable data pipelines on Google Cloud Platform (GCP).

  • Design and implement highly scalable, reliable, and secure data pipelines on GCP using Google Cloud Storage (GCS), BigQuery, and Airflow.
  • Develop robust ETL/ELT processes using Python and integrate with data orchestration tools (e.g., Airflow).
  • Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver high-quality solutions.
  • Optimize BigQuery performance through efficient schema design, partitioning, clustering, and query optimization.
  • Manage and maintain data lake and data warehouse environments ensuring data integrity and availability.

Mandatory Skills:

  • Google Cloud Platform (GCP): In-depth experience with core services like GCS, BigQuery, IAM, and Cloud Functions.
  • BigQuery (BQ): Expertise in data modeling, performance tuning, and large-scale analytics.
  • Google Cloud Storage (GCS): Strong understanding of data storage, access patterns, and integration.
  • Apache Airflow: Experience in authoring and managing DAGs for complex workflows.
  • Python: Proficient in scripting and automation, including working with APIs, data processing libraries (e.g., pandas, PySpark), and custom operators in Airflow.

  • Senior Data Pipeline Specialist

    2 days ago

    Kozhikode, Kerala, India beBeeEtlTester Full time ₹ 8,00,000 - ₹ 12,00,000

    Senior ETL TesterThis role involves testing large-scale data pipelines to ensure high-quality, consistent and accurate data in event-driven systems.Key Responsibilities:Test ETL processes and reconcile data across systems.Validate data quality and throughput in Kafka/Redpanda pipelines.Write and run MongoDB queries for data verification.Create test cases,...

  • Data Pipeline Architect

    7 days ago

    Kozhikode, Kerala, India beBeeCloud Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior AWS Glue DeveloperAs a senior developer, you will be responsible for designing and implementing data ingestion and transformation pipelines using serverless and cloud-based services.The ideal candidate will have experience with the Extract-Load-Transform approach, metadata-driven integration design, and Data Build Tool to enable rapid onboarding of...

  • Building Financial Data Pipelines

    7 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data SpecialistOur organization is seeking a skilled professional to design, develop, and maintain robust data pipelines that handle high-volume financial data.Key Responsibilities:Design and manage end-to-end data pipelines for stocks, crypto, and other financial datasets.Integrate third-party APIs and data feeds into internal systems.Develop and...

  • Data Pipeline Specialist

    5 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    Job OpportunityWe are seeking a talented Trainee Engineer to join our team and contribute to building data pipelines, automation scripts, and analytical algorithms.

  • Senior Data Pipeline Specialist

    3 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000

    ETL testing professionals are in high demand across various industries due to their expertise in ensuring data pipelines operate smoothly. This critical role plays a pivotal part in delivering accurate and reliable business insights.About the Position:This position involves collaborating with cross-functional teams to develop, test, and validate ETL...

  • Senior Data Pipeline Engineers with SSIS Experience

    2 days ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,50,000

    Job Title: Senior Data Pipeline EngineerWe are seeking experienced senior data pipeline engineers to design and develop efficient, scalable data pipelines using SSIS.The ideal candidate will have strong SQL Server and T-SQL skills, a solid understanding of data warehousing concepts, and hands-on experience with ETL development using SSIS.Key...

  • Data Pipeline Specialist

    8 hours ago

    Kozhikode, Kerala, India beBeeBackendDeveloper Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewAs a skilled professional, you will play a key role in transforming raw on-chain data into actionable insights by decoding smart contract events and implementing pricing logic from decentralized exchanges (DEXs).This position is ideal for someone who enjoys low-level protocol work, understands DeFi mechanics, and can build robust data pipelines...

  • Data Pipeline Quality Assurance Specialist

    7 days ago

    Kozhikode, Kerala, India beBeeSeniorTestEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    About our company:We are a leading provider of business transformation services, leveraging technology to address a wide range of business needs.Our goal is to unleash human energy through technology for an inclusive and sustainable future.We provide various services, including consulting, technology, professional, and outsourcing services.Job Summary:The...

  • Data Pipelines Specialist

    24 hours ago

    Kozhikode, Kerala, India beBeeIntegration Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Azure Integration ExpertJob Summary:We are seeking an experienced Azure Integration Expert to join our team. The ideal candidate will have expertise in designing, developing, and deploying data pipelines and integrations using Azure Data Services.The successful candidate will be responsible for:Troubleshooting and resolving issues related to Azure Synapse...

  • Senior Data Pipeline Architect

    3 days ago

    Kozhikode, Kerala, India beBeeETLDynamo Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    ETL Development OpportunityWe are seeking a skilled ETL Developer to join our team. The ideal candidate will have experience in designing and developing data pipelines using IBM DataStage, AWS Glue, and Snowflake.The chosen candidate will be responsible for designing, developing, and maintaining scalable and efficient ETL pipelines using various tools.They...