Real-Time Data Engineer for Big Query Projects

17 hours ago

Kollam, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

Senior Data Engineer - Real-Time Big Query Expert

We're seeking a seasoned professional to lead the development of robust data pipelines on the Google Cloud Platform.

  • Experience: 10+ years
  • Work Location: Remote
  • Shift: Flexible hours
  • Notice Period: Immediate

This is an exciting opportunity for a specialist with 10+ years of experience to work on challenging projects for various industries. As a senior data engineer, you'll be at the forefront of our data solutions.

Key Responsibilities:

  • Designing and developing scalable data pipelines for batch and real-time processing using GCP tools.
  • Constructing complex datasets to meet diverse business needs.
  • Translating business requirements into technical specifications.
  • Leveraging GCP services like Big Query, Cloud Dataflow (Apache Beam), Cloud Run, Cloud Functions, Pub/Sub, and Cloud Composer (Apache Airflow) to build integrated systems.
  • Orchestrating workflows to ensure reliability and scalability.
  • Implementing DevOps and CI/CD practices to ensure data pipeline security and governance.

Required Skills:

  • Proficiency in Python and SQL.
  • Experience with structured ERP solutions like SAP, Oracle EBS, and Salesforce.
  • A strong understanding of different file formats.
  • Knowledge of Data Lake concepts.
  • API development and consumption expertise.

What You'll Bring:

  • Deep expertise in GCP services and technical skills.
  • Strong analytical and problem-solving skills.
  • Ability to communicate complex ideas effectively.

Why Work with Us:

At our organization, we empower companies to become truly data-driven by providing comprehensive solutions in Data Strategy, Governance, Advanced Analytics, and Data Visualization. We offer a collaborative environment where professionals can grow and develop their careers.

Ready to Make an Impact?

  • Senior Big Data Engineer

    18 hours ago

    Kollam, Kerala, India beBeeData Full time ₹ 30,00,000 - ₹ 50,00,000

    Big Data Architectures and Scalable SolutionsDrive innovation within the team by designing, architecting, and implementing large-scale data engineering solutions on AWS Cloud Services.Design and develop Big Data architectures leveraging AWS services for complex data processing tasks.Build scalable data pipelines using Spark (Scala) for both structured and...

  • Big Data Expert

    2 days ago

    Kollam, Kerala, India beBeeData Full time ₹ 25,00,000 - ₹ 40,00,000

    Big Data ExpertWe are looking for a Big Data Expert to manage end-to-end project lifecycles, work in onshore-offshore modes, and possess good analytical and verbal communication skills.Key ResponsibilitiesAnalyzing technical specifications of given requirements and providing solutions.Coding using Spark and Scala based on the given requirements and...

  • Big Data Solutions Architect

    2 days ago

    Kollam, Kerala, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Big Data Solutions ArchitectKey Responsibilities include designing and implementing scalable big data solutions, developing efficient ETL processes, leading cross-functional teams in the development of data-driven solutions, and collaborating with stakeholders to design effective data integration strategies.Requirements:5-12 years of experience in...

  • Chief Big Data Architect

    18 hours ago

    Kollam, Kerala, India beBeeDataAnalytics Full time ₹ 1,50,00,000 - ₹ 2,25,00,000

    Job SummaryWe are seeking a seasoned professional with extensive experience in big data technologies and Google Cloud Platform services to design and implement scalable data solutions.Key ResponsibilitiesDesign, develop and optimize data pipelines using GCP BigQuery, Dataflow and Apache Airflow to support large-scale data analytics.Utilize the big data...

  • Data Scientist/ML Engineer

    2 weeks ago

    Kollam, Kerala, India Quant-data Full time

    We're Hiring: Machine Learning Engineer / Data Engineer (Remote | Full-Time) Build AI-powered credit decisioning systems on Microsoft AzureWe're looking for a Machine Learning Engineer / Data Engineer with 5+ years of experience to join our AI-driven credit lending platform team. In this role, you'll design and deploy scalable ML solutions that power loan...

  • Senior Real-Time Data Systems Specialist

    1 week ago

    Kollam, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Overview:We are seeking a skilled Data Engineer to design, develop, and maintain large-scale data infrastructures that support real-time systems.

  • Transformative Leader – Big Data Architecture

    1 week ago

    Kollam, Kerala, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data Engineering ManagerAs a seasoned leader, you will oversee the design and delivery of scalable data pipelines and analytics platforms in the cloud. Your expertise in Big Data platforms, Microsoft Azure, and Databricks will ensure high performance, reliability, and security in a cloud-native environment.Lead and grow a team of data engineers working...

  • Big Data Cloud Solutions Expert

    1 week ago

    Kollam, Kerala, India beBeeCloudDataArchitect Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Cloud Data Solutions ArchitectAbout the Role:We are seeking a self-driven technical expert to design and develop scalable data architectures using cloud-based technologies.Collaborate with cross-functional teams to craft innovative data solutions that drive business growth.Develop robust data pipelines using Azure Databricks, PySpark, and Delta...

  • Big Data Expert

    3 days ago

    Kollam, Kerala, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    We are seeking an experienced data professional to join our team as a Big Data Specialist.The ideal candidate has 6–12 years of experience in handling and processing large datasets, including expertise in Spark technologies such as PySpark/Scala Spark/Java Spark SQL.Key skills include:More than 5.8 years of experience in Big Data projects.A good...

  • Master Data Engineer

    2 days ago

    Kollam, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking an experienced data professional to design, build, and maintain highly available data platforms.The ideal candidate will have hands-on experience with building complex data pipelines, including batch and real-time event-based processing.They should also have strong experience in ETL using Spark (Scala or Python) for event-based...