Scalable Data Processing Systems Engineer

3 days ago

Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 25,00,000
Cloud Data Engineer Role

As a skilled professional in cloud data engineering, you will design, build, and maintain scalable data processing systems on the Google Cloud Platform (GCP). This role involves collaboration with cross-functional teams to ensure that data is accessible, reliable, and optimized for analytics and machine learning initiatives.

  • Data Pipeline Development:
    • Design and develop efficient ETL/ELT pipelines using tools such as Cloud Dataflow, Apache Beam, and Cloud Dataprep.
    • Implement real-time data streaming solutions using Cloud Pub/Sub or Apache Kafka.
  • Data Storage & Warehousing:
    • Manage and optimize storage solutions such as BigQuery, Cloud Storage, and Cloud Spanner.
    • Design efficient data models and schemas for structured and unstructured data.
  • Data Integration & Transformation:
    • Integrate data from multiple sources into unified data lakes or warehouses.
    • Cleanse, enrich, and transform raw data into analytics-ready formats.
  • Performance Optimization:
    • Monitor and troubleshoot data pipelines.
    • Optimize workflows for scalability, performance, and cost-efficiency.
  • Security & Compliance:
    • Implement data governance policies.
    • Ensure compliance with data protection regulations.
Required Skills and Qualifications
  • Proficiency in Python, SQL, and optionally Java or Scala.
  • Experience with GCP services: BigQuery, Cloud Dataflow, Cloud Storage, Cloud Composer, etc.
  • Strong understanding of data warehousing, data modeling, and ETL processes.
  • Familiarity with real-time data processing and streaming architectures.
  • Knowledge of data governance, security, and compliance standards.
  • Bachelor's degree in Computer Science, Engineering, or related field.
  • GCP Professional Data Engineer certification (preferred).
  • 2+ years of experience in data engineering, preferably in cloud environments.

  • Data Engineer for Scalable Data Pipelines

    5 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 19,00,000

    We are seeking a highly skilled Data Engineer to lead the design and development of scalable data pipelines. The ideal candidate will have expertise in data engineering principles, with a strong understanding of cloud-based data platforms.Key Responsibilities:Design and develop efficient data pipelines using Airflow and SnowflakeCollaborate with...

  • Scalable Data Architect

    3 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering Role OverviewWe are seeking a skilled Data Engineer to design, develop, and deploy scalable data pipelines and ETL processes. The ideal candidate will have hands-on experience in Scala, Apache Spark, and PySpark, with a strong understanding of functional programming concepts.

  • Building Scalable Data Systems

    1 week ago

    Palakkad, Kerala, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Real-Time Data ArchitectThis is a full-time role for a skilled Real-Time Data Architect who will be responsible for designing, building and maintaining large-scale data systems.We are looking for someone with expertise in Data Engineering and experience with stream processing technologies such as Kafka, Flink and Spark.The ideal candidate should have strong...

  • Build Scalable Data Solutions

    1 week ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data EngineerWe are seeking a self-driven professional to build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.The role involves working across scrum teams to develop data solutions, ensure data governance with Unity Catalog, and support real-time and batch processing.Work with different scrum teams to...

  • Building Scalable Data Solutions

    2 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,01,00,000

    Data ScientistWe are seeking a skilled and motivated data scientist to build scalable data pipelines and cloud-native data solutions on Google Cloud Platform.Main Responsibilities:Design, develop, and optimize robust data ingestion pipelines using GCP services such as Pub/Sub, Dataflow, and Cloud Storage.Architect and manage scalable BigQuery data warehouses...

  • Data Systems Engineer

    1 week ago

    Palakkad, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a skilled professional to lead our data engineering efforts. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business needs.Work closely with our data science team to develop complex algorithms that provide unique insights into our data.Utilize agile...

  • Senior Systems Engineer

    18 hours ago

    Palakkad, Kerala, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Technical Leadership RoleWe seek a seasoned Technical Leader to spearhead the design and development of scalable healthcare claims processing systems. This role demands expertise in distributed systems, system architecture, and leadership skills to drive technical decision-making.Design and Architect: Develop scalable healthcare claims processing systems...

  • Data Engineer

    2 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineer Position This role focuses on developing scalable data engineering solutions using cloud-based platforms.About the Role:The ideal candidate will be responsible for designing, developing, and deploying large-scale data processing and analysis systems.We seek a highly motivated and experienced professional with strong knowledge of cloud computing...

  • Senior Data Engineer

    2 days ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Enterprise Data Architect - Finance SystemsDrive the design and implementation of high-performance data warehouse solutions for finance and accounting use cases.Lead the adoption and best practices in dbt for financial data transformations, lineage, and governance.Collaborate with cross-functional teams to develop robust ETL/ELT pipelines integrating data...

  • Data Engineer

    1 week ago

    Palakkad, Kerala, India Impetus Full time

    Skills: Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark; Good to have : GCP/any cloudRoles/Responsibilities:Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and...