Cloud Data Scientist

1 day ago

Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000

Job Summary

We are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have experience designing and implementing scalable, reliable, and secure data pipelines on GCP.

The successful candidate will be responsible for developing robust ETL/ELT processes using Python and integrating with data orchestration tools such as Airflow. They will also collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver high-quality solutions.

Key Responsibilities:

  • Design and implement data pipelines on GCP using GCS, BigQuery, and Airflow.
  • Develop ETL/ELT processes using Python and integrate with data orchestration tools.
  • Collaborate with cross-functional teams to deliver high-quality solutions.
  • Optimize BigQuery performance through efficient schema design, partitioning, clustering, and query optimization.
  • Manage and maintain data lake and data warehouse environments ensuring data integrity and availability.
  • Automate and monitor data pipelines to ensure consistent and reliable data delivery.
  • Contribute to architecture decisions and ensure adherence to data governance and security standards.
  • Mentor junior engineers and promote best practices in data engineering and cloud usage.

Requirements:

  • Google Cloud Platform (GCP): In-depth experience with core services like GCS, BigQuery, IAM, and Cloud Functions.
  • BigQuery (BQ): Expertise in data modeling, performance tuning, and large-scale analytics.
  • Google Cloud Storage (GCS): Strong understanding of data storage, access patterns, and integration.
  • Apache Airflow: Experience in authoring and managing DAGs for complex workflows.
  • Python: Proficient in scripting and automation, including working with APIs, data processing libraries, and custom operators in Airflow.

Bonus Points:

  • Experience with data warehousing and business intelligence tools.
  • Knowledge of cloud-based data management platforms.
  • Ability to mentor and lead junior engineers.

  • Data Scientist

    1 week ago

    Gandhinagar, Gujarat, India Alp Consulting Ltd. Full time

    Job SummaryA Data Scientist job description typically outlines the role's responsibilities, which include collecting, analysing, and interpreting data to extract insights that can inform business decisions and improve operations. Data Scientists use programming, statistical analysis, and machine learning techniques to uncover patterns, build predictive...

  • Data Scientist

    3 weeks ago

    Gandhinagar, Gujarat, India SystemBender Full time

    Role: Data Scientist – AWS Location: Gurgaon/Pune/Bengaluru (Remote)Duration: 03-06 Months (Possibility of extension)Job Description: We are seeking a highly skilled and experienced Data Scientist for AWS to join our team and play a crucial role in designing and implementing data analytics solutions on the Amazon Web Services (AWS) platform. The ideal...

  • Business Data Scientist

    20 hours ago

    Gandhinagar, Gujarat, India beBeeDataScientist Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Business Data Scientist PositionThis role involves leveraging data analytics to inform business strategy through the extraction and processing of structured and unstructured data from various sources.Key Responsibilities:Design, develop, and maintain robust data pipelines using Python and other relevant tools to extract data from web platforms.Utilize...

  • Data Scientist

    4 weeks ago

    Gandhinagar, Gujarat, India Protium Full time

    Company DescriptionProtium is a leading engineering-led, risk-focused lender operating in India. With a full stack approach, Protium offers lending services to MSMEs, consumers, and educational institutions through various channels including digital interfaces and dedicated sales teams. Protium uses proprietary models to assess revenues and growth, providing...

  • Cloud Data Engineer

    1 week ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data Engineer Opportunity As a Cloud Data Engineer, you will collaborate closely with data scientists to design and develop innovative algorithms that provide valuable insights into our data. The role involves building complex data pipelines to clean, transform, and aggregate data from diverse sources. Your expertise in big data and cloud technologies...

  • Cloud Data Engineer

    19 hours ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering OpportunityWe are seeking an experienced Data Engineer to join our team in building scalable data pipelines and cloud-native solutions. The ideal candidate will be proficient in designing, developing, and optimizing robust data ingestion pipelines using cloud services such as Pub/Sub, Dataflow, and Cloud Storage.Key Responsibilities:Design...

  • Data Cloud Solutions Professional

    2 days ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data Solutions SpecialistThis is an exciting opportunity to work with cutting-edge technology and contribute to the development of innovative data solutions.Data Management and Storage: We are seeking a highly skilled professional to design and implement scalable, performant, and cost-effective data storage systems using various cloud services.Big Data...

  • Expert Cloud Data Architecture Solutions

    4 days ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Architect SpecialistWe are seeking a skilled and experienced cloud data architect specialist to design, build, and maintain scalable data pipelines and ETL solutions in the cloud environment.Key Responsibilities:Design and implement data architectures using AWS services like EMR, Glue, and S3.Develop and maintain ETL processes utilizing PySpark...

  • Chief Cloud Data Architect

    7 days ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewSenior Data Engineer(Lead)This role involves designing, developing and optimizing ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory. The candidate should have around 6+ years of experience in data engineering or cloud computing data development.The ideal candidate will work with structured and...

  • Principal Cloud Data Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 40,00,000

    Senior Data EngineerWe are seeking a highly skilled professional to lead our data engineering efforts.This role requires expertise in building scalable real-time and batch processing workflows using Azure Databricks, PySpark, and Apache Spark.The ideal candidate will possess strong skills in data pre-processing, including cleaning, transformation,...