Senior Cloud Data Pipeline Specialist

7 days ago

India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000
Job Title: Google Cloud (GCP) Data Engineer

Location: Remote

Job Type: Full-Time

Experience Level: Minimum 5 years +

  • Mandatory Skills:
  • GCS + Google BigQuery + Airflow/Composer + Python

Company Description:

Tech T7 Innovations is a company that provides IT solutions to clients worldwide. The team consists of highly skilled and experienced professionals who are passionate about IT. Tech T7 Innovations offers a wide range of IT services, including software development, web design, cloud computing, cybersecurity, data engineering, data science and machine learning. The company is committed to staying up-to-date with the latest technologies and best practices to deliver the best solutions to their clients.

Key Responsibilities:

We are looking for a highly experienced GCP Data Engineer with 5+ years in data engineering, and a proven track record of designing, building, and optimizing scalable data pipelines and architectures on Google Cloud Platform (GCP). The ideal candidate is hands-on with Google Cloud Storage (GCS), BigQuery (BQ), Apache Airflow, and Python, and is adept at managing complex data workflows and transformations at scale.

  1. Design and implement highly scalable, reliable, and secure data pipelines on GCP using GCS, BigQuery, and Airflow.
  2. Develop robust ETL/ELT processes using Python and integrate with data orchestration tools (e.g., Airflow).
  3. Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver high-quality solutions.
  4. Optimize BigQuery performance through efficient schema design, partitioning, clustering, and query optimization.
  5. Manage and maintain data lake and data warehouse environments ensuring data integrity and availability.
  6. Automate and monitor data pipelines to ensure consistent and reliable data delivery.
  7. Contribute to architecture decisions and ensure adherence to data governance and security standards.
  8. Mentor junior engineers and promote best practices in data engineering and cloud usage.
Must-Have Skills:

Google Cloud Platform (GCP): In-depth experience with core services like GCS, BigQuery, IAM, and Cloud Functions.

BigQuery (BQ): Expertise in data modeling, performance tuning, and large-scale analytics.

Google Cloud Storage (GCS): Strong understanding of data storage, access patterns, and integration.

Apache Airflow: Experience in authoring and managing DAGs for complex workflows.

Python: Proficient in scripting and automation, including working with APIs, data processing libraries (e.g., pandas, PySpark), and custom operators in Airflow.

Preferred Qualifications:

Experience with CI/CD pipelines for data workflows.

Exposure to Dataflow, Pub/Sub, or other GCP data services.

Familiarity with Terraform or Infrastructure as Code (IaC) on GCP.

Strong problem-solving and communication skills.

GCP certifications (e.g., Professional Data Engineer) are a plus.

  • Data Pipeline Optimization Expert

    2 weeks ago

    India beBeeEtl Full time ₹ 15,00,000 - ₹ 18,00,000

    Senior ETL SpecialistWe are seeking a highly skilled ETL specialist to design and optimize complex data pipelines.Key Skills:Talend Data Integration: Design & optimize complex ETL pipelines, debugging, and deployment using TMCBig Query: Partitioning, clustering, federated queries, advanced SQL (CTEs, arrays, window functions)Python: ETL scripting,...

  • Data Pipeline Architect

    2 weeks ago

    India beBeeAzure Full time US$ 1,04,000 - US$ 1,30,878

    Azure Data Factory Specialist We are seeking an experienced Azure Data Factory specialist to join our team. The ideal candidate will have strong hands-on expertise in designing, building, and maintaining scalable and secure data pipelines using Azure ADF. Design, build, and maintain Azure Data Factory pipelines for ETL and ELT processes. Integrate data...

  • Senior Cloud Data Specialist

    6 days ago

    India beBeeCloudDataSpecialist Full time ₹ 9,00,000 - ₹ 12,00,000

    Job SummaryWe are seeking a highly skilled Senior Cloud Data Specialist to join our team. As a Senior Cloud Data Specialist, you will be responsible for designing, implementing, and maintaining data architecture for all AWS data services.About the RoleThe ideal candidate will have a strong background in cloud computing, particularly AWS, and experience with...

  • Highly Skilled Data Pipelines Architect

    2 weeks ago

    India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878

    Senior Data EngineerAbout the RoleWe are seeking an experienced Senior Data Engineer with in-depth expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will...

  • Cloud Data Architect

    4 days ago

    India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Overview:This is a Senior Data Engineer position focused on designing and building large-scale data pipelines in Google Cloud. The ideal candidate will have expertise in using various tools such as Python, DataFlow, DataStream, CDC, Cloud Functions, Cloud Run, PubSub, BigQuery, and Cloud Storage to integrate systems and data pipelines.Key...

  • Chief Data Pipeline Architect

    2 weeks ago

    India beBeeData Full time US$ 1,50,000 - US$ 1,75,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer with expertise in designing, building, and operating scalable data pipelines that support real-time clinical workflows.The ideal candidate will have 5+ years of experience building and maintaining production-grade data pipelines, strong background in workflow orchestration and...

  • Senior GCP Data Pipeline Specialist

    6 days ago

    India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Summary:We're seeking an experienced Data Engineer to join our team.The ideal candidate will have a strong background in designing, developing, and maintaining scalable data pipelines using GCP tools. They will be responsible for constructing large datasets to meet business needs, translating business requirements into technical specifications, and...

  • Chief Data Pipeline Architect

    2 weeks ago

    India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,75,000

    Job SummaryWe are seeking an experienced senior Data Engineer to design, build and maintain robust data pipelines for processing channel activity data from multiple sources.Utilize AWS cloud infrastructure services like Pyspark, Glue, EMR, Lambda, Redshift, Athena and other services like Iceberg to implement scalable data solutions.Collaborate with...

  • Cloud Data Ingestion Specialist

    1 week ago

    India beBeeDataIngestion Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Cloud Data Ingestion SpecialistOverview:We are seeking an experienced data ingestion specialist to join our team. This role requires a strong understanding of cloud-based data ingestion processes, focusing on integrating various data sources into Databricks.Key Responsibilities:Design, develop, and optimize data ingestion pipelines for integrating...

  • Senior Cloud Data Architect

    2 days ago

    India beBeeDataArchitect Full time ₹ 19,00,000 - ₹ 24,20,000

    Job DescriptionWe are seeking a seasoned Senior Cloud Data Architect to lead the development of our cloud-native data platforms. As a pivotal member of our team, you will shape the architecture of our data warehouse and drive large-scale data initiatives.Key Responsibilities:Design and develop cloud-native data-intensive applications with expertise in...