A Skilled Data Engineer Needed

3 days ago


Gulbarga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000
Job Title: Senior Data Engineer

A skilled data engineer is required to develop, construct, test and maintain large-scale data acquisition pipelines for structured and unstructured data in the Google Cloud ecosystem.

Main Responsibilities:

  • Create complex datasets based on business requirements
  • Design big data pipeline architecture
  • Identify opportunities for data acquisition through stakeholder collaboration
  • Translate business needs into technical specifications
  • Leverage tools in the Google Cloud Ecosystem such as Python, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage to integrate systems and data pipelines
  • Use logs & alerts to effectively monitor pipelines
  • Replicate SAP tables to Google Cloud using SLT
  • Develop JSON messaging structure for integrating with various applications
  • Leverage DevOps and CI/CD practices (GitHub, Terraform) to ensure the reliability and scalability of data pipelines
  • Partition/Cluster and retrieve content in Big Query and use IAM roles & Policy Tags to secure the data
  • Secure access to datasets using roles and authorized views to share data between projects
  • Design and build an ingestion pipeline using Rest API
  • Recommend ways to improve data quality, reliability, and efficiency

Required Skills and Qualifications:

  • Jr DE: 2-3 years of experience in a GCP data engineering role (offshore)
  • Sr DE: 4+ years of experience in a GCP data engineering role (offshore)
  • Atleast 1 year of hands-on experience in GCP tools highlighted(Python, SQL, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage)


  • Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    As a seasoned professional, you will be responsible for designing and implementing scalable data solutions.This role involves translating prototypes into production-ready infrastructure that supports analytics, reporting, and machine learning workflows.Key ResponsibilitiesDevelop robust, high-quality data pipelines that integrate structured and unstructured...


  • Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineer Job Description We are seeking a highly skilled Data Engineer to work on large-scale data engineering solutions for data. The ideal candidate will possess strong knowledge of AWS, Python, and experience in handling data from various sources such as Hadoop and Terradata.The successful candidate will design, build, and maintain robust data...


  • Gulbarga, Karnataka, India beBeeDataExpert Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Query VettersWe are seeking a highly skilled Query Vetter to engage with GEN AI researchers and engineers to understand data collection/evaluation requirements.Key Responsibilities:Work closely with GEN AI researchers and engineers to comprehend data collection/evaluation needs.Transform high-level requirements into detailed workflows,...


  • Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Enterprise Data Engineer (L3)About the RoleWe are seeking a highly skilled Enterprise Data Engineer to join our team. As an L3 data engineer, you will design and implement enterprise data platforms that drive innovation and adoption of new technologies.Key ResponsibilitiesArchitect and oversee scalable, reliable, and secure data infrastructure for large...


  • Gulbarga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a seasoned Data Architect to spearhead the development of our data engineering solutions.Design and develop robust, scalable, and secure data architectures that meet business requirements.Lead the implementation of data solutions on various cloud platforms (AWS, Azure, and GCP).Define and enforce data governance, quality, and...

  • Cloud Data Engineer

    5 days ago


    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Are you a skilled data professional looking for a challenging role in cloud-based data engineering?We are seeking an experienced developer with expertise in AWS serverless technologies, including Athena, Python code, Glue, Lambda, DMS, RDS, Redshift, and Cloud Formation.Key Responsibilities:Data Architecture: Design, implement, and maintain the data...


  • Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    A career-defining opportunity awaits a seasoned data engineer to assume a leadership role in our cutting-edge technology division. About UsWe are a forward-thinking company that has been pioneering innovative solutions for the digital advertising landscape. Our platform empowers major publishers and businesses worldwide by providing transparent and efficient...


  • Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Key Role in Data EngineeringThe organization is enhancing its digital transformation by establishing a cutting-edge technology hub in India.This hub will spearhead innovation and product development for the organization, focusing on developing new capabilities in data science, data analytics, e-commerce, automation, cloud computing, and information security...

  • Cloud Data Engineer

    5 days ago


    Gulbarga, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Data EngineerGreetings from our teamWe are seeking a skilled Cloud Data Engineer to join our team.Job DescriptionThe ideal candidate will have 4 or more years of experience working on Azure Databricks using Scala, PySpark, and have strong knowledge of full Software Development Life Cycle experience.Design and develop reusable software modules that meet...

  • Data Engineer Role

    2 weeks ago


    Gulbarga, Karnataka, India beBeeDataArchitect Full time ₹ 18,00,000 - ₹ 24,00,000

    Senior Data Architect PositionWe are seeking a highly skilled Senior Data Architect to join our team. The ideal candidate will have expertise in designing and implementing scalable data architectures, developing and optimizing ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics.This role involves performing data ingestion,...