Big Data Pipeline Architect

1 week ago

Mysore, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

Job Title:

">

Data Engineering Lead

  • Develop and implement large-scale data pipelines for structured and unstructured data, utilizing batch and real-time processing in the Google Cloud ecosystem.
  • Design and build complex datasets based on business requirements, leveraging tools such as Python, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage, and SAP SLT.
  • Collaborate with stakeholders to identify opportunities for data acquisition and translate business needs into technical requirements.
  • Leverage DevOps and CI/CD practices to ensure the reliability and scalability of data pipelines, including GitHub and Terraform.
  • Secure access to datasets using IAM roles and Policy Tags, and design and build an ingestion pipeline using Rest API.
  • Recommend ways to improve data quality, reliability, and efficiency.
">

Requirements:

">

Experience:

  • At least 4 years of experience in a GCP data engineering role (offshore).
  • Hands-on experience in GCP tools (Python, SQL, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage) is required.
  • Junior DE: 2-3 years of experience in a GCP data engineering role (offshore).
"],

  • Big Data Solutions Specialist

    1 week ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled and experienced data engineer to join our team. The ideal candidate will have a deep understanding of big data technologies and AWS cloud services.Job Responsibilities:Design, develop, and optimize complex big data architectures leveraging AWS services for large-scale data processing.Build and...

  • Big Data Platform Specialist

    2 weeks ago

    Mysore, Karnataka, India beBeeData Full time ₹ 1,89,60,000 - ₹ 2,52,00,000

    Enterprise Data Architect">Confidential Company is seeking a Senior Data Engineer with expertise in building and scaling enterprise-grade data platforms.The successful candidate will be responsible for designing, implementing and maintaining large-scale data pipelines and architectures.This role requires a strong background in cloud and big data solutions,...

  • Lead Big Data Engineer

    2 weeks ago

    Mysore, Karnataka, India beBeeDatabricks Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled Lead Big Data Engineer to join our team as a Databricks expert. This is a key role in our mission to empower clients with data-driven insights and innovative digital solutions.This role requires overall 6+ years of experience in development and maintenance in a data engineering project, including:Collaborating with...

  • Chief Data Architect

    2 weeks ago

    Mysore, Karnataka, India beBeeData Full time US$ 1,80,000 - US$ 2,00,000

    Key Position: Data Architect">Job Overview:">We are seeking a highly skilled Data Architect with 6–8 years of experience in designing, developing and managing enterprise data solutions. The ideal candidate will have a strong background in cloud data architecture, data warehousing, big data processing and data integration.">Key Responsibilities:">Design...

  • Chief Data Pipeline Architect

    2 weeks ago

    Mysore, Karnataka, India beBeeDataEngineer Full time US$ 1,80,000 - US$ 2,20,000

    Cloud Data Engineer Job DescriptionWe are seeking an experienced Cloud Data Engineer to design and develop scalable ETL pipelines using cloud-native tools. The ideal candidate will have extensive experience with cloud platforms (AWS, Azure, GCP), data lakes, and warehouses.Key Responsibilities:Design and Development: Design scalable ETL pipelines, architect...

  • Data Architect

    2 weeks ago

    Mysore, Karnataka, India beBeeDataArchitect Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled Data Engineer to join our organization.The ideal candidate will have a strong background in data engineering and architecture, with expertise in designing and implementing data pipelines, as well as working with stakeholders to gather requirements and deliver automated end-to-end data engineering...

  • Big Data Engineer

    2 weeks ago

    Mysore, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data SpecialistThe ideal candidate will have 6–12 years of experience in big data technologies, including PySpark/Scala Spark/Java Spark SQL. A strong understanding of data structures and algorithms is also required.Required Skills:Big data projects with more than 5.8 years of experienceExperience in implementing data pipelines,...

  • Big Data Solutions Architect

    2 weeks ago

    Mysore, Karnataka, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Title: Big Data Solutions ArchitectAt our organization, we are seeking a highly skilled Senior Data Engineer to join our team.As a key member of our data engineering team, the successful candidate will be responsible for designing and building large-scale data systems, implementing data integration and ingestion solutions, and driving implementation...

  • Senior Data Architect

    2 weeks ago

    Mysore, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data ArchitectWe are seeking an experienced Senior Data Architect to lead the design and implementation of our data infrastructure. The ideal candidate will have a strong background in data warehousing, big data, and cloud computing.The successful candidate will have experience in designing and implementing scalable data solutions using GCP...

  • Chief Big Data Developer

    1 week ago

    Mysore, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Engineer RoleJob Summary:Design and develop scalable data pipelines using Scala, Spark, Python, and Apache Kafka.Key Responsibilities: