Large Scale Cloud Data Engineer

2 days ago

Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Cloud Data Engineer

As a skilled Cloud Data Engineer, you will be responsible for designing and developing large-scale data pipelines using cloud technologies.

The ideal candidate will have 5-7 years of experience in a data engineering role, with core Google Cloud Platform (GCP) experience of 3-4 years.

Strong communication skills and the ability to work with stakeholders and business clients are essential.

Familiarity with SAP SLT and JSON messaging structure for integrating with various applications is also beneficial.

Key Responsibilities:
  • Develop, construct, test, and maintain data acquisition pipelines for large volumes of structured and unstructured data in GCP.
  • Build complex datasets based on business requirements and leverage a variety of tools in the GCP Ecosystem such as Python, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage.
  • Use logs and alerts to effectively monitor pipelines and design and build an ingestion pipeline using REST API.
  • Leverage DevOps and CI/CD practices (GitHub, Terraform) to ensure the reliability and scalability of data pipelines.
  • Partition/Cluster and retrieve content in Big Query and use IAM roles & Policy Tags to secure the data.
  • Recommend ways to improve data quality, reliability, and efficiency.
Requirements:
  • Experience in designing and implementing scalable data pipelines.
  • Strong understanding of cloud-based data storage solutions.
  • Ability to work in a collaborative environment and communicate effectively with stakeholders.
  • Familiarity with cloud security best practices and compliance regulations.
  • Proficiency in scripting languages such as Python or JavaScript.

  • Large Scale Data Specialist

    2 days ago

    Thiruvananthapuram, Kerala, India beBeeBigDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerOverview:We are seeking a highly skilled Senior Big Data Engineer to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing large-scale data pipelines.Design and develop large-scale data pipelines and distributed data processing systems.Work extensively with Scala,...

  • Large Scale Data Engineer

    7 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description:We are seeking a skilled Data Engineering Specialist to join our team. As a key member, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure technologies.You will design and develop scalable data pipelines, collaborate with cross-functional teams, and stay up-to-date with the latest...

  • Leading Large-Scale Data Engineering Solutions

    6 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 90,00,000 - ₹ 1,75,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to support large-scale data operations across ~200 servers. The role combines data analysis, architecture, and engineering responsibilities to improve data accessibility, performance, and retention.Key Responsibilities:Review and interpret data across ~200 servers, ensuring...

  • Large-Scale Data Processing Specialist

    8 hours ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Data EngineerDesign and implement large-scale data processing systems using Azure technologies.Proficiency in SQL, expertise in Python programming.Experience with Apache Spark for data processing.Understanding of Delta files and Lakehouse architecture.Data warehouse knowledge or experience.Key Responsibilities:Set up pipelines, manage data...

  • Leading Cloud Data Engineer

    2 days ago

    Thiruvananthapuram, Kerala, India beBeeCloudDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About Cloud Data Engineer PositionsTop cloud data engineering positions require highly specialized professionals with extensive knowledge of cloud computing platforms, including Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP).Key skills for these roles include expertise in data warehousing, big data processing, and data analytics,...

  • Cloud Data Engineering Position

    4 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 26,25,000

    Job Title: Cloud Data EngineerJob OverviewWe are seeking a skilled and experienced Cloud Data Engineer to join our dynamic team.Key ResponsibilitiesDesign and Develop Scalable Data Pipelines: Build, deploy, and maintain large-scale data pipelines on Google Cloud Platform (GCP).Develop and Maintain Data Warehouse Solutions: Design, implement, and optimize...

  • Cloud Data Engineer

    2 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000

    Cloud Data Engineering Position","We are looking for a skilled professional to develop and implement large-scale data pipelines using Azure Databricks.","","Design, deploy, and maintain scalable data processing architectures on Azure Databricks.","Collaborate with cross-functional teams to design and implement data warehousing and business intelligence...

  • Cloud-Based Data Engineering Specialist

    4 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,40,00,000

    Job SummaryWe are seeking a highly motivated and experienced Data Engineer to design, build, and maintain robust data pipelines.The ideal candidate will have deep expertise in cloud-based data processing technologies using GCP, AWS, or Azure.Key Responsibilities:Design, develop, and maintain large-scale data systemsCollaborate with cross-functional teams to...

  • Principal Architect

    6 hours ago

    Thiruvananthapuram, Kerala, India beBeeSoftwareDevelopment Full time ₹ 2,00,00,000 - ₹ 3,50,00,000

    Expert Software Development LeadJob Description:As a seasoned software development professional, you will play a pivotal role in shaping the future of technology.You will be responsible for designing and implementing large-scale solutions in production environments, working closely with cross-functional teams to deliver innovative digital products that drive...

  • Azure Cloud Data Migration Specialist

    4 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 26,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to join our team and contribute to the design, development, and management of large-scale data pipelines using modern data engineering tools and platforms within the Azure ecosystem.The ideal candidate will have a strong foundation in data integration, transformation, and...