Senior Cloud Data Architect

18 hours ago

Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,75,00,000 - ₹ 2,25,00,000
Cloud Data Engineer

Job Description:

We seek an experienced Cloud Data Engineer to design, develop and maintain scalable data pipelines and ETL/ELT solutions using cloud services.

The ideal candidate will have expertise in S3, Redshift, Glue, Athena, EMR, Lake Formation, Lambda, Kinesis, Step Functions, CloudWatch, RDS and DynamoDB.

They will also possess strong skills in ETL/ELT development using PySpark, Python or SQL as well as experience with data modeling, warehousing and performance tuning.

Additionally, the candidate should have knowledge of data lakes and modern data architecture, strong SQL skills and ability to work with large datasets.

Main Responsibilities:

  • Design, develop and maintain scalable data pipelines and ETL/ELT solutions using cloud services.
  • Ingest, process and store structured/unstructured data from multiple sources (IoT devices, sensors, ERP systems, drilling logs, production data, etc.).
  • Implement data lake and data warehouse solutions.
  • Optimize data pipelines for performance, cost and scalability.
  • Collaborate with domain experts, data scientists and business analysts to translate Oil & Gas business requirements into data solutions.
  • Ensure data governance, data quality and security compliance.
  • Support real-time data streaming and analytics using cloud services (Kinesis, Kafka, Lambda).
  • Document technical solutions and provide knowledge transfer to the team.

Requirements:

  • Proficiency in AWS services: S3, Redshift, Glue, Athena, EMR, Lake Formation, Lambda, Kinesis, Step Functions, CloudWatch, RDS, DynamoDB (optional)
  • Expertise in ETL/ELT development using PySpark, Python or SQL.
  • Experience with data modeling, warehousing and performance tuning.
  • Knowledge of data lakes and modern data architecture.
  • Strong SQL skills and ability to work with large datasets.
  • Hands-on with CI/CD and DevOps practices for data solutions.
  • Familiarity with Oil & Gas industry datasets and use cases (production, drilling, exploration, sensor/IoT data).

Skills Assessment:

  • Understanding of data ingestion pattern.
  • Extensive knowledge of data bricks & Azure Data Factory.
  • SQL Knowledge.
  • Incremental & Append data load.

  • Senior Enterprise Data Solutions Architect

    4 days ago

    Kolkata, West Bengal, India beBeeData Architect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a seasoned data architect to lead the design and implementation of robust data solutions for our clients.Main Responsibilities:Develop and maintain complex data models for large-scale enterprise applications.Collaborate with cross-functional teams, including data architects, business analysts, and IT professionals, to deliver...

  • Cloud Data Architect

    2 hours ago

    Kolkata, West Bengal, India beBeeDataEngineering Full time ₹ 2,50,00,000 - ₹ 3,00,00,000

    Senior Data Engineering LeadWe are seeking a highly experienced leader to oversee our data engineering team. The ideal candidate will have a strong focus on cloud-based data engineering, specifically with Databricks.This leadership role requires a visionary who can design, develop, and manage scalable data infrastructure and pipelines, while mentoring and...

  • Senior Cloud Data Architect

    18 hours ago

    Kolkata, West Bengal, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Data ArchitectPosition Overview:We seek a seasoned data architect to design and implement large-scale cloud data solutions.Key Responsibilities:Data Ingestion & Transformation: Architect and implement scalable data pipelines on Snowflake, leveraging data sharing, events, and lakehouse patterns.Data Migration & Optimization: Proven experience migrating...

  • Cloud Data Architect

    2 hours ago

    Kolkata, West Bengal, India beBeeExpertise Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Snowflake ConsultantPosition: Cloud Data Architect We are seeking a highly skilled Snowflake Expert with hands-on experience in Matillion ETL and proven expertise in the Banking, Financial Services domain. The ideal candidate will design, develop, and optimize scalable data pipelines, data models, and analytics solutions on Snowflake,...

  • Senior Cloud Solutions Architect

    16 hours ago

    Kolkata, West Bengal, India beBeeCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Cloud Solutions ArchitectOur organization is seeking a highly experienced and skilled Senior Cloud Solutions Architect to lead the design and implementation of scalable multi-tenant software solutions on cloud platforms such as AWS or GCP. The successful candidate will have expertise in designing and constructing interactive, service-based...

  • Cloud Data Architect

    2 days ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000

    Drive innovation in our cloud-first data architecture team as a skilled Cloud Data Architect. This role requires expertise in designing, building and maintaining scalable data pipelines and ETL solutions on AWS.About the RoleDesign and implement large-scale data systems on AWS, utilizing services like EMR, Glue and PySpark to deliver high-performance data...

  • Cloud Data Architect

    19 hours ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 19,97,000 - ₹ 24,99,000

    Cloud Data ArchitectA highly skilled professional with 5+ years of experience in designing and implementing data storage solutions, ensuring scalability, performance, and cost-effectiveness using Azure SQL Database, Azure Data Lake Storage, and Azure Blob Storage.Data Management and Storage StrategiesDevelop efficient data storage systems using cloud-based...

  • Senior Cloud Data Architect

    7 days ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a highly skilled Senior Databricks Data Engineer to join our dynamic data engineering team. The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code.Main Responsibilities:Develop and maintain scalable and high-performance data pipelines using Databricks and PySpark.Implement and...

  • Experienced Data Architect Wanted

    2 days ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Senior Data ArchitectJoin us in a dynamic role that enables you to be at the forefront of innovation, shaping data solutions for businesses worldwide.">Job Description:We are seeking an experienced Senior Data Architect who will lead the design and implementation of large-scale data architectures across multiple business domains.As a Senior Data Architect,...

  • Cloud Architect

    2 days ago

    Kolkata, West Bengal, India beBeeCloud Full time ₹ 18,00,000 - ₹ 25,00,000

    Cloud Architect Role OverviewThis role involves designing and implementing scalable cloud-based solutions using cutting-edge technologies. The ideal candidate will have hands-on experience with Big Data Technologies, including Hadoop, Spark, Scala, and NoSQL databases. Experience with cloud-based streaming data platforms like Kafka, Kinesis, and Glue is also...