Building Scalable Data Pipelines

7 days ago

Malappuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title: Business Intelligence Architect

We are seeking a skilled professional to design, build, and optimize scalable data pipelines using Snowflake, AWS (Lambda, Glue), DBT, and SQL.

The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanced analytics initiatives.

Key Responsibilities:

  • Design, build, and maintain ETL/ELT pipelines using AWS Glue, Lambda, and DBT.
  • Develop and optimize data models in Snowflake for scalability and performance.
  • Write efficient and optimized SQL queries for data extraction, transformation, and loading.
  • Collaborate with business analysts, data scientists, and stakeholders to understand data requirements.
  • Ensure data quality, consistency, and governance across all platforms.
  • Monitor and troubleshoot data pipelines, ensuring timely delivery of data.
  • Automate workflows and integrate data from multiple internal and external sources.
  • Implement best practices for data security, cost optimization, and performance tuning on AWS and Snowflake.

Required Skills & Qualifications:

  • Bachelor's or Master's in Computer Science, Information Systems, or related field.
  • Proven hands-on experience with Snowflake Data Warehouse (data modeling, query optimization, performance tuning).
  • Strong expertise in AWS services: Lambda, Glue, S3, IAM, CloudWatch.
  • Proficiency in DBT (Data Build Tool) for data transformations and modular pipelines.
  • Advanced knowledge of SQL (complex queries, performance optimization).
  • Solid understanding of ETL/ELT design patterns and data integration best practices.
  • Experience with CI/CD pipelines and version control (Git).
  • Knowledge of data governance, lineage, and security best practices.

  • Building Scalable Data Platforms

    2 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerWe are seeking a skilled professional to design, implement, and maintain scalable data platforms using open-source technologies.The ideal candidate will have expertise in PostgreSQL and hands-on experience in building data warehouses and data lakes.Responsibilities:Designing and implementing a PostgreSQL-based data warehouse for...

  • Senior Data Engineer for Scalable Pipelines

    17 hours ago

    Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    ETL Developer/Senior Developer RoleWe are seeking a highly skilled ETL developer to join our data engineering team.About the JobThe successful candidate will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake.Main ResponsibilitiesDesign, develop, and maintain ETL...

  • Building Scalable Cloud Infrastructures

    6 days ago

    Malappuram, Kerala, India beBeeSpecialist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Infrastructure SpecialistJob Description:As a Cloud Infrastructure Specialist, you will play a critical role in designing and deploying scalable, secure, and efficient cloud-based infrastructure solutions.This position requires hands-on expertise in managing and operating production-grade cloud environments using industry-leading technologies such as...

  • Senior Data Pipeline Specialist

    5 days ago

    Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Are you a data expert looking to leverage your skills in designing and building robust data pipelines?We are seeking an experienced Azure Data Engineer to join our team.The ideal candidate will have strong SQL skills, experience with Fabric, and proficiency in Python (PySpark).Additionally, they will have hands-on experience with Azure Data Services, CI/CD...

  • Data Pipeline Architect

    5 days ago

    Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000

    Job DescriptionAs a data engineer, you will play a crucial role in designing and implementing scalable data pipelines to support our business growth.

  • Building Data Driven Solutions

    3 hours ago

    Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 15,00,000

    Data Engineer PositionAs a data engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Develop and implement data pipelines to extract, transform, and load data from various sources.Design and build scalable and efficient data storage solutions using BigQuery and Cloud...

  • Data Engineer: Designing Scalable Data Solutions

    12 hours ago

    Malappuram, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data ArchitectJob Summary:We are seeking a seasoned data engineer to design and optimize data solutions that power analytics, reporting, and business intelligence initiatives.The ideal candidate will have deep expertise in ETL development, data modeling, and financial data domains, particularly within credit unions and banking systems.Key...

  • Data Pipeline Specialist

    12 hours ago

    Malappuram, Kerala, India beBeeDataPipeline Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Data Pipeline SpecialistWe are seeking a skilled Data Pipeline Specialist to design, implement and manage robust data pipelines that ensure seamless integration with modern DevOps tools.Develop and optimize data pipelines using Python, SQL, and Spark jobs in Databricks for large-scale data processing.Automate deployments using Databricks Asset...

  • Data Pipeline Expert

    5 days ago

    Malappuram, Kerala, India beBeeDataIntegration Full time ₹ 18,00,000 - ₹ 25,00,000

    Job TitleThe Data Integration Specialist will play a crucial role in designing and implementing data pipelines, developing data processing scripts using SQL, and collaborating with cross-functional teams to drive business outcomes.The ideal candidate will have at least 5-6 years of experience with strong hands-on experience in ETL processes, proficiency in...

  • Senior Data Pipeline Architect

    4 days ago

    Malappuram, Kerala, India beBeeSoftware Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job OverviewThis role is responsible for leading the design and implementation of a shared component library/SDK for pipelines, including ingestion, parsing/OCR, extraction, validation, enrichment, and publishing. The ideal candidate will have strong expertise in performance and concurrency, with experience in implementing large-scale data pipelines using...