GCP Data Engineer

2 weeks ago

Morādābād, Uttar Pradesh, India beBeeCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Cloud Engineering Expert

Key Responsibilities:

  • Design, develop and maintain large-scale data pipelines using GCP tools.
  • Construct complex datasets to meet business needs.
  • Translate business requirements into clear technical specifications.
  • Leverage various GCP services including Big Query, Cloud Dataflow, Cloud Run, Cloud Functions, Pub/Sub and Cloud Composer to build integrated systems.
  • Orchestrate workflows using Cloud Composer.
  • Work with SAP SLT to replicate SAP data to Google Cloud.
  • Implement DevOps and CI/CD practices to ensure pipeline reliability and scalability.
  • Ensure data security and governance using IAM roles, policies and data masking techniques.
  • Monitor pipelines using logs and alerts to proactively manage performance.
  • Recommend improvements to enhance data quality, reliability and efficiency.

Requirements:

  • GCP Services:
    • Big Query
    • Cloud Dataflow (Apache Beam)
    • Cloud Run, Cloud Functions, Cloud Storage
    • Pub/Sub, Cloud Composer (Apache Airflow)
    • Experience with Change Data Capture (CDC) and data streaming is a plus.
  • Technical Skills:
    • Proficiency in Python and SQL.
    • Experience with structured ERP solutions like SAP, Oracle EBS and Salesforce.
    • A strong understanding of file formats including CSV, JSON, XML, Parquet, ORC and Avro.
    • Knowledge of Data Lake concepts.
    • Experience with API development and consumption (REST and SOAP).
  • Data Security & Governance:
    • Ability to implement IAM best practices (least privilege, service accounts).
    • Familiarity with data masking and anonymization techniques.

  • Data Engineering Lead

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data Engineer with GCP, ETLWe are seeking an experienced Senior Data Engineer to spearhead large-scale data systems on the Google Cloud Platform (GCP). The ideal candidate will have a proven track record of designing, building, and maintaining complex data pipelines using GCS, PubSub, Dataflow, DataProc, Bigquery, Airflow/Composer, Python, and...

  • Large Scale Data Acquisition Engineer

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineer - Large Scale Data AcquisitionWe are seeking a highly skilled Data Engineer to join our team and help us build, construct, test, and maintain large-scale data acquisition pipelines in the Google Cloud ecosystem.Responsibilities:Design and develop complex datasets based on business requirements.Construct scalable pipeline architecture...

  • Chief Data Architect

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title:Senior Data Solutions EngineerJob Description:We are seeking an experienced Senior Data Solutions Engineer to join our team. This role will involve designing, developing, and optimizing large-scale data pipelines using GCP BigQuery, Dataflow, and Apache Airflow.The ideal candidate will have expertise in the Big Data Hadoop ecosystem, including...

  • Senior Data Engineer

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 20,10,000

    Senior Data Engineer - GCP Looker RoleThis is a unique opportunity for a seasoned Senior Data Engineer to join our organization as a GCP Looker.\We are seeking an experienced professional with a strong background in data engineering, data analysis, and business intelligence.The ideal candidate will have hands-on experience with Tableau, Power BI, ETL...

  • Big Data Engineer Leader

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeBigDataEngineer Full time ₹ 30,00,000 - ₹ 42,00,000

    Job Title: Big Data Engineer LeaderWe are seeking an experienced Big Data Engineer to lead our data engineering team. The ideal candidate will have a strong background in designing and implementing large-scale data pipelines, as well as experience with cloud-based infrastructure.The successful candidate will have a deep understanding of big data technologies...

  • Chief Data Processing Specialist

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 18,00,000

    Senior Data Engineer with GCPWe are seeking a highly skilled data professional to design, develop, and maintain large-scale data processing systems.The ideal candidate will have extensive experience in designing, developing, and maintaining large-scale data processing systems using Google Cloud services.Create efficient ETL pipelines utilizing GCP Cloud...

  • Data Engineer Position

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Specialist RoleJob Overview: We are seeking an experienced Data Engineer to lead our data engineering team.About the Job:We require a skilled Data Specialist who can develop, test, and maintain efficient Python scripts for data collection and transformation. The successful candidate will also design and implement web scraping solutions to extract...

  • Data Engineer

    4 weeks ago

    Morādābād, Uttar Pradesh, India SourceFuse Full time

    SourceFuse Technologies hiring for Data Engineer with 3+ years for experience Job Summary:As a Data Engineer, you'll manage the invisible backbone of our analytics, building scalable data pipelines that fuel real-time insights for 630+ ships worldwide. Your work will turn raw data points into actionable intelligence, propelling machine learning models and...

  • Highly Skilled Data Professional Wanted

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 15,00,000

    Job OpportunityWe are seeking a skilled professional to design and implement scalable data processing systems on Google Cloud Platform (GCP).Key ResponsibilitiesDevelop, deploy, and maintain large-scale data pipelines using Python, GCP Cloud Run, Dataproc, and Dataflow.Collaborate with cross-functional teams to integrate data engineering solutions with...

  • Cloud Engineer

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Driving large-scale Data Engineering and Cloud Platform programs requires a seasoned Delivery Lead/Program Manager. This role entails planning, execution, and delivery of complex data engineering and cloud programs.Key ResponsibilitiesDevelop and implement strategies to optimize and deliver data ecosystems, including data lakes, warehouses, and real-time...