Senior Analytics Pipeline Specialist

6 days ago

kannur, India beBeeDataEngineer Full time

We are building the future of healthcare analytics, working on designing and operating robust data pipelines that power nationwide analytics and support our machine learning systems. Our goal is to create pipelines that are reliable, observable, and continuously improving in production.This role is fully remote, open to candidates based in Europe or India, with periodic team gatherings in Mountain View, California.Design, build, and maintain scalable ETL pipelines using Python (Pandas, PySpark) and SQL, orchestrated with Airflow (MWAA).Develop and maintain the Data Lake/Lakehouse architecture on AWS, ensuring quality, governance, scalability, and accessibility.Run and optimize distributed data processing jobs with Spark on AWS EMR and/or EKS.Implement batch and streaming ingestion frameworks (APIs, databases, files, event streams).Enforce validation and quality checks to ensure reliable analytics and ML readiness.Monitor and troubleshoot pipelines with CloudWatch, integrating observability tools like Grafana, Prometheus, or Datadog.Automate infrastructure provisioning with Terraform, following AWS best practices.Manage SQL Server, PostgreSQL, and Snowflake integrations into the Lakehouse.Participate in an on-call rotation to support pipeline health and resolve incidents quickly.Write production-grade code, and contribute to design/code reviews and engineering best practices.Required Skills and Qualifications5+ years in data engineering, ETL pipeline development, or data platform roles (flexible for exceptional candidates).Experience designing and operating data lakes or Lakehouse architectures on AWS (S3, Glue, Lake Formation, Delta Lake, Iceberg).Strong SQL skills with PostgreSQL, SQL Server, and at least one AWS cloud warehouse (Snowflake or Redshift).Proficiency in Python (Pandas, PySpark); Scala or Java a plus.Hands-on with Spark on AWS EMR and/or EKS for distributed processing.Strong background in Airflow (MWAA) for workflow orchestration.Expertise with AWS services: S3, Glue, Lambda, Athena, Step Functions, ECS, CloudWatch.Proficiency with Terraform for IaC; familiarity with Docker, ECS, and CI/CD pipelines.Experience building monitoring, validation, and alerting into pipelines with CloudWatch, Grafana, Prometheus, or Datadog.Strong communication skills and ability to collaborate with data scientists, analysts, and product teams.A track record of delivering production-ready, scalable AWS pipelines, not just prototypes.BenefitsThis role offers a fully remote work arrangement, open to candidates based in Europe or India, with periodic team gatherings in Mountain View, California.

  • Senior Data Specialist

    2 weeks ago

    kannur, India beBeeDataScientist Full time

    Job Title: Data SpecialistA senior data specialist is required to lead predictive model development, deployment, and validation.Predictive Modeling & Machine LearningCandidates should have experience in machine learning, deep learning, or artificial intelligence.Expertise in tools such as AWS SageMaker, Bedrock, LLMs, TensorFlow, and PyTorch for model...

  • Senior Quality Assurance Specialist

    3 days ago

    kannur, India beBeeQuality Full time

    Job OpportunityWe are seeking a Senior Quality Assurance Specialist to join our team.This role requires the ability to work independently and make decisions with minimal supervision.The ideal candidate will have at least 6 years of experience in software testing, including manual and automated testing.Strong knowledge of software testing principles is...

  • Data Pipeline Specialist

    2 weeks ago

    kannur, India beBeeDataEngineer Full time

    About This RoleWe're looking for a skilled professional to design and build scalable data pipelines using Databricks. In this role, you'll be working on real-world projects from day one, taking a hands-on approach to designing, building, and maintaining efficient systems.

  • GCP Data engineer

    2 weeks ago

    Kannur, India LatentView Analytics Full time

    Job Summary:We are seeking a Senior Data Engineer to join a Global Data Analytics & Insights team focused on transforming enterprise data management and democratizing access to insights. This role will lead a large-scale data migration from external agency-managed environments into an internal Google Cloud Platform (GCP) ecosystem. You will drive discovery,...

  • Data Pipeline Tester

    2 weeks ago

    kannur, India beBeeAnalytical Full time

    ETL Testing(SQL+Bigquery) Job OpportunityWe are seeking a meticulous and proactive ETL Tester to ensure the accuracy, reliability, and performance of data pipelines built on Google Cloud Platform.Design and implement comprehensive test plans, test cases, and test scenarios for ETL pipelines using strong attention to detail and analytical thinking...

  • Senior Data Transformation Specialist

    6 days ago

    kannur, India beBeeDataTransformation Full time

    Senior Data Transformation SpecialistJob Overview:We are seeking a seasoned Senior Data Transformation Specialist to lead our data transformation initiatives.The ideal candidate will have in-depth knowledge of ETL/Data Warehouse testing principles and Informatica PowerCenter/Informatica Cloud workflows.Strong SQL skills are necessary for effective data...

  • Senior QA Engineer

    2 weeks ago

    kannur, India beBeeDataTesting Full time

    Job OpportunityWe are seeking a skilled QA professional to perform ETL testing across diverse environments.Conduct end-to-end validation of data pipelines in cloud and on-prem settings.Verify complex transformations, source-to-target mappings, and SCD logic.Test Informatica IDMC/IICS CDI mappings, taskflows, and ingestion patterns.The ideal candidate will...

  • Senior Tax Specialist

    1 week ago

    kannur, India beBeeTaxSpecialist Full time

    Senior Tax Specialist RoleJob OverviewThis is a challenging and rewarding Senior Tax Specialist position that involves expert-level taxation skills and excellent communication abilities. As a key member of our team, you will be responsible for delivering high-quality tax services to our clients.Responsibilities:Develop and maintain in-depth knowledge of US...

  • Chief Data Pipeline Architect

    2 weeks ago

    kannur, India beBeeDataEngineer Full time

    About Our Data Engineering PositionWe are building the future of healthcare analytics to provide quality services to our clients.Design, build, and scale robust data pipelines using Python (Pandas, PySpark) and SQL, orchestrated with Airflow.Develop and maintain a scalable data lake on AWS, ensuring quality, governance, scalability, and accessibility.This is...

  • Senior Transfer Pricing Specialist

    5 days ago

    kannur, India beBeeTransferPricing Full time

    Job OverviewWe are seeking a motivated Senior Transfer Pricing Specialist to join our team in the Middle East. This role is ideal for experienced professionals interested in developing and executing transfer pricing strategies across various industries.Key Responsibilities:Develop and implement transfer pricing strategies,Conduct financial and economic...