Chief Data Infrastructure Specialist

7 days ago

Pushkar, Rajasthan, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000
Senior Data Engineer Job Description

Job Overview:

The Senior Data Engineer will play a pivotal role in the development, implementation, and maintenance of large-scale data acquisition pipelines for structured and unstructured data.

This includes batch and real-time processing, leveraging Google Cloud's ecosystem to integrate systems and data pipelines.

The ideal candidate will have experience working with stakeholders and business clients to identify opportunities for data acquisition and translate business needs into technical requirements.

Key Responsibilities:

  • Develop and maintain data pipelines using Google Cloud tools such as Python, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, and Cloud Storage
  • Build complex datasets based on business requirements and design an ingestion pipeline using Rest API
  • Use logs and alerts to effectively monitor pipelines and recommend ways to improve data quality, reliability, and efficiency
  • Design and build an architecture for 'big data' pipelines and leverage DevOps and CI/CD practices to ensure reliability and scalability
  • Partition and retrieve content in Big Query and use IAM roles and Policy Tags to secure data access

Requirements:

  • 4+ years of experience in a GCP data engineering role (offshore)
  • At least 1 year of hands-on experience in GCP tools highlighted (Python, SQL, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage)

Experience working with stakeholders and business clients to identify opportunities for data acquisition is essential.

What We're Looking For:

  • A strong background in data engineering and cloud-based technologies
  • Proven experience in designing, developing, and maintaining large-scale data pipelines
  • Excellent communication and collaboration skills
  • A passion for staying up-to-date with the latest trends and technologies in data engineering

  • Data Infrastructure Specialist

    2 weeks ago

    Pushkar, Rajasthan, India beBeeDataInfrastructure Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Unlock your potential as a Data Infrastructure SpecialistWe're seeking a skilled professional to design and build scalable, fault-tolerant data infrastructure for large-scale applications.Key ResponsibilitiesCreate high-throughput systems for data ingestion, processing, and transformationDevelop synthetic datasets using state-of-the-art solutionsCollaborate...

  • Data Infrastructure Specialist

    1 week ago

    Pushkar, Rajasthan, India beBeeInfrastructure Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data Infrastructure SpecialistAt our company, we strive to build the best data infrastructure for a more efficient and scalable business. A key component of this strategy is the development of optimized data pipelines that enable seamless data extraction, transformation, and loading from various sources.We are looking for an experienced...

  • Data Infrastructure Specialist

    1 week ago

    Pushkar, Rajasthan, India beBeeInfrastructure Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Data Infrastructure SpecialistRole Summary:We seek an experienced data infrastructure specialist to craft, implement and optimize complex data solutions in a cloud-based environment.Design sophisticated data pipelines for ingestion and egress using Azure services.Build scalable data architectures using Databricks and Apache Spark.Troubleshoot data...

  • Data Infrastructure Architect

    2 weeks ago

    Pushkar, Rajasthan, India beBeeInfrastructure Full time US$ 1,50,000 - US$ 1,80,000

    Intelligent Infrastructure SpecialistWe're seeking a seasoned professional to design, build and maintain the intelligence infrastructure that powers enterprise transformation in complex telecommunications and IT Asset Management (ITAM) environments.This is not your average data role—you'll be creating robust ETL pipelines, building scalable Business...

  • Chief Data Infrastructure Specialist

    1 week ago

    Pushkar, Rajasthan, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock the Future of Data ArchitectureWe are seeking an expert Data Architect to lead our data strategy and design innovative solutions. The ideal candidate will have a strong background in cloud data architecture, data warehousing, big data processing, and data integration.Key Responsibilities:Design end-to-end data solutions that align with business and...

  • Chief Data Architect

    1 week ago

    Pushkar, Rajasthan, India beBeeDataArchitect Full time ₹ 1,75,00,000 - ₹ 2,51,00,000

    Job Title: Chief Data ArchitectAbout the RoleWe are seeking an experienced Chief Data Architect to join our team. The successful candidate will be responsible for designing and developing robust data pipelines that support our business operations.Key ResponsibilitiesDesign and develop scalable data architectures to meet business needs.Collaborate with...

  • Azure Infrastructure Specialist

    6 days ago

    Pushkar, Rajasthan, India beBeeAzure Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Azure Infrastructure SpecialistOur organisation is seeking a skilled Azure Infrastructure Specialist to lead the implementation of cloud-based infrastructure via code and provide strategic advice on the development and advancement of Microsoft Azure technologies.Implement cloud-based infrastructure via code and provide strategic advice on the...

  • Data Infrastructure Specialist

    1 week ago

    Pushkar, Rajasthan, India beBeeDataEngineer Full time ₹ 14,20,000

    Designing Scalable Data Infrastructure is a key aspect of this role. You will be responsible for creating robust and efficient data pipelines to meet business demands.Main ResponsibilitiesDevelop highly available and scalable data pipelines using AWS services like S3, Glue, and Lambda.Maintain ETL processes using Python and PySpark to extract, transform, and...

  • Data Centre Infrastructure Specialist

    1 week ago

    Pushkar, Rajasthan, India beBeeDataCentreEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job TitleA Data Centre Engineer is responsible for the design, implementation, and management of data centre infrastructure.">Key Responsibilities:• Design and implement efficient data centre infrastructure solutions.• Manage and maintain high availability and reliability of data centre systems.• Collaborate with cross-functional teams to achieve...

  • Chief Data Infrastructure Architect

    1 week ago

    Pushkar, Rajasthan, India beBeeDataEngineering Full time US$ 15,00,000 - US$ 20,00,000

    Job Title: Senior Data Engineering LeaderA visionary leader is required to design, develop and manage scalable data infrastructure and pipelines.This role requires a strong focus on Databricks and cloud-based data engineering to lead our data engineering team.The successful candidate will work closely with cross-functional teams including data scientists,...