Senior Cloud Data Architect

2 weeks ago

Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Description

This is a remote contract position that seeks a highly skilled Data Engineer with experience in building and maintaining large-scale data processing solutions using PySpark, Python, SQL, and real-time data streaming.

The ideal candidate will design, develop, and optimize data pipelines in cloud environments like Azure and contribute to the implementation of scalable data pipelines.

Key Responsibilities include:

  • Designing, developing, and optimizing data pipelines using PySpark, Spark, and Python.
  • Implementing ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Developing and maintaining Hive queries and ensuring seamless data transformations.
  • Writing and optimizing SQL queries for large datasets.
  • Building, monitoring, and supporting real-time streaming solutions using Apache Kafka.
  • Working on Databricks to create, manage, and optimize data workflows.
  • Deploying and managing solutions in Azure cloud services (e.g., Data Lake, Synapse, Azure Databricks).
  • Debugging, troubleshooting, and optimizing code for performance and scalability.
  • Collaborating with cross-functional teams to deliver data-driven solutions.
Required Skills & Qualifications

Strong knowledge of Spark, Hive, SQL, and Unix shell scripting is required. 3–4 years of experience in data engineering with a focus on PySpark and Python is necessary.

Experience with Databricks in a production environment is preferred, as well as hands-on experience with Azure cloud services (Data Lake, Synapse, Databricks). Strong problem-solving and debugging skills are also required.

Excellent written and verbal communication skills are essential, as well as the ability to work independently in a fast-paced environment and adapt to new technologies quickly.

  • Cloud Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineering Full time ₹ 2,50,00,000 - ₹ 3,00,00,000

    Senior Data Engineering LeadWe are seeking a highly experienced leader to oversee our data engineering team. The ideal candidate will have a strong focus on cloud-based data engineering, specifically with Databricks.This leadership role requires a visionary who can design, develop, and manage scalable data infrastructure and pipelines, while mentoring and...

  • Chief Cloud Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataMigration Full time ₹ 15,71,250 - ₹ 20,25,000

    Senior Cloud EngineerWe are looking for a seasoned Senior Cloud Engineer to lead the end-to-end migration of data warehousing and ETL processes from legacy systems to modern cloud platforms. The ideal candidate will have 5-10 years of professional experience in data engineering, data warehousing, or a related field.Main Responsibilities:Design, develop, and...

  • Cloud Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeExpertise Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Snowflake ConsultantPosition: Cloud Data Architect We are seeking a highly skilled Snowflake Expert with hands-on experience in Matillion ETL and proven expertise in the Banking, Financial Services domain. The ideal candidate will design, develop, and optimize scalable data pipelines, data models, and analytics solutions on Snowflake,...

  • Cloud Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Cloud Data ArchitectWe are seeking an accomplished professional to fill the role of Cloud Data Architect.Key Responsibilities:This position involves designing and implementing scalable data solutions on cloud platforms such as AWS, Azure, or GCP.The successful candidate will have expertise in programming languages such as Python, Scala, or SQL.A...

  • AWS Cloud Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Information ArchitectJob Description:We are seeking an experienced Cloud Data Information Architect to join our team. As a Cloud Data Information Architect, you will be responsible for designing and implementing cloud data pipelines using AWS Databricks.Key Responsibilities:Identify and define foundational business data domains and...

  • Senior Cloud Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Are you a data visionary looking to shape the future of our organization?Data Architect Job DescriptionWe are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have in-depth knowledge of building scalable data pipelines using Apache Spark, PySpark, SQL, and Python, along with hands-on experience in the AWS ecosystem.

  • Senior Cloud Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Opportunity:We are seeking a seasoned Cloud Data Architect to lead the design and development of scalable ETL pipelines using Azure services and integrate data into AWS Datalake or other modern data platforms.Key Responsibilities:Develop, maintain, and optimize cloud-based ETL pipelines using Azure Data Factory and related services.Process, transform,...

  • Cloud Data Architect Lead

    2 weeks ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 1,80,00,000 - ₹ 3,00,00,000

    Job Opportunity:We are seeking a skilled Cloud Data Architect to lead the development and deployment of scalable data solutions.Key Responsibilities:Oversee the design, implementation, and maintenance of cloud-based data processing systems using Java and Apache Spark.Design and implement big data processing pipelines utilizing technologies such as Apache...

  • Chief Cloud Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataArchitect Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data Architect RoleAt the forefront of data innovation, we seek a visionary Cloud Data Architect to drive our organization's strategic data initiatives forward.Key Responsibilities:Develop and implement cutting-edge cloud-based data architectures that seamlessly integrate with our AWS infrastructure.Collaborate closely with stakeholders to identify and...

  • Chief Cloud Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 19,99,000 - ₹ 25,19,999

    Senior Data Engineer with GCP, ETLWelcome to this challenging role as a senior data engineer specializing in Google Cloud Platform (GCP) and Extract, Transform, Load (ETL) expertise. This is an exciting opportunity for you to work on designing and implementing end-to-end data pipelines on GCP.The ideal candidate will have strong technical skills in GCP...