Data Engineer Specialist

1 day ago

Anand, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

Job Title: Data Engineer Specialist

We are seeking a skilled data engineer to create high-performance, scalable data pipelines and architectures on Google Cloud Platform (GCP).

Main Responsibilities:

  • Data Pipeline Development: Develop highly reliable, efficient, and secure data pipelines on GCP using services like Google Cloud Storage (GCS), BigQuery, and Apache Airflow.
  • ETL/ELT Process Development: Create robust ETL/ELT processes in Python and integrate with data orchestration tools (e.g., Airflow).
  • Collaboration: Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions.
  • BigQuery Performance Optimization: Optimize BigQuery performance through schema design, partitioning, clustering, and query optimization.
  • Data Management: Manage and maintain large-scale data environments ensuring data integrity and availability.
  • Automation and Monitoring: Automate and monitor data pipelines for consistent and reliable data delivery.
  • Architecture Decisions: Contribute to architecture decisions and ensure adherence to data governance and security standards.
  • Mentorship: Mentor junior engineers and promote best practices in data engineering.

Required Skills and Qualifications:

  • GCP Services: In-depth knowledge of core services like GCS, BigQuery, IAM, and Cloud Functions.
  • BigQuery Expertise: Expertise in data modeling, performance tuning, and analytics.
  • GCS Knowledge: Strong understanding of data storage and integration.
  • Apache Airflow Experience: Experience in authoring and managing DAGs for complex workflows.
  • Python Proficiency: Proficient in scripting and automation, including working with APIs and data processing libraries.

Preferred Qualifications:

  • CI/CD Pipeline Experience: Experience with CI/CD pipelines for data workflows.
  • Problem-Solving and Communication Skills: Strong problem-solving and communication skills.
  • GCP Certifications: GCP certifications are a plus.

  • Data Engineering Specialist

    9 hours ago

    Anand, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering SpecialistAbout the RoleThis is an exciting opportunity for a skilled Data Engineering Specialist to join our team. The ideal candidate will have a strong background in machine learning and software engineering, with experience in designing data pipelines and engineering infrastructure to support enterprise machine learning...

  • AWS IoT Data Engineering Specialist

    13 hours ago

    Anand, Gujarat, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Data Engineering SpecialistWe are seeking a Data Engineering Specialist to join our team.

  • Data Engineering Specialist

    3 days ago

    Anand, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 24,00,000

    Job Title: Data Engineering SpecialistJob Overview:This role involves designing and implementing data engineering solutions using GCP Services. If you have expertise in software development, architecture, and team leadership, we would love to hear from you.Main Responsibilities:Maintain data architecture principles, guidelines and standards for data...

  • Data Engineering Specialist

    2 weeks ago

    Anand, Gujarat, India beBeeEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    The primary function of a Data Engineering Specialist involves designing and implementing efficient data pipelines using industry-standard tools.Key Responsibilities include:Designing, developing, and maintaining ETL processes for ingestion from various sourcesCreating optimized data flows for loading curated datasets into cloud-based data...

  • Data Engineering Specialist

    7 days ago

    Anand, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistAbout the Role:This position involves designing data pipelines using AWS Glue, PySpark, and Step Functions. The ideal candidate should have a solid understanding of data engineering principles and be able to implement ETL/ELT processes for ingesting, transforming, and delivering data from multiple sources.Key...

  • Data Engineering Specialist

    3 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time US$ 1,20,000 - US$ 1,80,000

    Job Title: Data Engineering SpecialistAs a seasoned data engineer with deep expertise in AWS Cloud Development, we are seeking an experienced professional to join our team and help drive the design, building, and optimization of large-scale data pipelines and architectures.The ideal candidate will have hands-on experience designing, building, and maintaining...

  • Data Engineer

    7 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    **Job Title:** Data Engineer - Informatica Specialist**Job Description:** We are seeking a highly skilled Data Engineer with expertise in Informatica BDM/DEI to design and develop scalable ETL workflows. The ideal candidate will have 5+ years of experience in ETL pipeline design and development, as well as strong data warehousing concepts and SQL...

  • Scalable Cloud Data Engineer

    3 days ago

    Anand, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Solutions SpecialistWe are seeking a skilled cloud data engineer to design and implement scalable data engineering solutions using Google Cloud Platform (GCP) services.Key Responsibilities:Design, build, and optimize data pipelines leveraging BigQuery, Dataflow, DataProc, and Cloud Composer.Implement big data analytics solutions utilizing Hadoop,...

  • Data Operations Specialist

    3 days ago

    Anand, Gujarat, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000

    Data Specialist Job DescriptionThis is a detail-oriented and tech-savvy role that involves working with data to collaborate with our talented team of engineers who are working at the bleeding edge of data science and data automation.The technical data specialist will play an integral role in ensuring that our clients consistently receive high-quality...

  • Data Architectural Specialist

    2 days ago

    Anand, Gujarat, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are looking for a Data Architectural Specialist to join our team. The ideal candidate will have extensive experience in designing and developing data architectures and logical/physical data models for databases and data warehouses.The selected individual will work closely with the Product Management group, internal stakeholders and the Engineering...