Highly Motivated Cloud Data Solutions Architect

3 days ago

Kannur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
PySpark Data Engineer

A contract remote opportunity is available for a highly motivated PySpark Data Engineer with 3–4 years of experience in building, optimizing, and maintaining large-scale data processing solutions.

The ideal candidate will bring hands-on expertise in PySpark, Python, SQL, and real-time data streaming and contribute to the design and implementation of scalable data pipelines in cloud environments such as Azure.

Key Responsibilities:

  • Design, develop, and optimize data pipelines using PySpark, Spark, and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage, and optimize data workflows.
  • Deploy and manage solutions in Azure cloud services (e.g., Data Lake, Synapse, Azure Databricks).
  • Debug, troubleshoot, and optimize code for performance and scalability.
  • Collaborate with cross-functional teams to deliver data-driven solutions.
  • Adhere to best practices for coding, testing, and deployment.
Required Skills & Qualifications
  • 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services (preferred: Data Lake, Synapse, Databricks).
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.
  • Ability to work independently in a fast-paced environment and adapt to new technologies quickly.
Nice-to-Have Skills
  • Exposure to CI/CD pipelines for data solutions.
  • Knowledge of data governance and security best practices.
  • Experience with Agile/Scrum methodology.

  • Cloud Data Solutions Architect

    3 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data EngineerWe are seeking a highly skilled data engineer to design, develop and optimize data pipelines and integration solutions in a cloud-based environment.

  • Cloud Solutions Architect

    1 week ago

    Kannur, Kerala, India beBeeCloud Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Solutions ArchitectRole Description:We are seeking a highly experienced and visionary Cloud Engineer to join our team as a Cloud Solutions Architect. The successful candidate will play a key role in shaping the overall architecture of our cloud solutions, ensuring they align with business goals, scalability requirements, and industry best practices.Key...

  • Senior Data Solutions Architect

    4 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Job OpportunityWe are seeking a highly skilled Data Engineer to design and build high-availability data and analytics platforms.The ideal candidate will have a strong background in cloud-based solutions, particularly AWS or similar platforms.Develop and maintain complex data pipelines using batch and/or real-time event-based processing techniques.Create ETL...

  • Senior Cloud Data Architect

    3 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    About this role:We are seeking a highly skilled Senior Cloud Data Architect to drive business transformation and deliver cutting-edge data engineering solutions.Key Responsibilities:Mastery of cloud technologies including AWS/Azure/SAPExpertise in ELT, data modeling, and data integration & ingestionProficiency in data manipulation and processing using...

  • Senior Cloud Data Solutions Specialist

    5 days ago

    Kannur, Kerala, India beBeeDataArchitect Full time ₹ 90,00,000 - ₹ 1,50,00,000

    Cloud Data ArchitectSnowflake Cloud Data Architects design and implement scalable cloud-based data architectures to support business growth.Key Responsibilities:Design and implement ETL/ELT pipelines using Snowflake Tasks, Streams, and Stored Procedures for efficient data ingestion and processing.Develop scalable data models with clustering keys and optimize...

  • Enterprise Cloud Architect

    5 days ago

    Kannur, Kerala, India beBeeArchitect Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Architect LeaderWe are seeking a highly experienced Cloud Architect to lead the design and implementation of scalable, secure cloud solutions.The ideal candidate will have a strong background in cloud-native architectures, data integration strategies, and DevOps practices. They should be proficient in at least one major cloud platform (e.g., AWS,...

  • Data Solutions Architect

    4 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 3,60,000 - ₹ 6,00,000

    Job OverviewWe are seeking a skilled Data Engineer to design and build scalable data solutions using cutting-edge technologies. The ideal candidate will have proficiency in Python, SQL, APIs, and OAuth, with hands-on experience with cloud platforms.Key Responsibilities:Develop robust data pipelines with Python and advanced SQL techniques.Integrate data using...

  • Cloud Data Engineer

    2 weeks ago

    Kannur, Kerala, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Title: Cloud Data ArchitectWe are seeking a highly skilled Cloud Data Architect to lead our data engineering efforts.Key Responsibilities:Design, develop and optimize cloud-based data pipelines using Azure and Databricks.Mentor team members to improve overall team productivity and technical capability.Deliver high-quality solutions with speed and...

  • Data Architect

    1 week ago

    Kannur, Kerala, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled and motivated data architect to design, develop, and maintain scalable data pipelines that process and transform large volumes of structured and unstructured data.Key Responsibilities:Design and implement scalable data architectures for processing structured and unstructured data.Develop and maintain...

  • Chief Cloud Data Architect

    6 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    About Data EngineersHighly skilled data engineers are in high demand as organizations seek to leverage data to drive business decisions.We are looking for an experienced cloud data engineer with a strong background in AWS, Azure, and GCP. Our ideal candidate will have expertise in designing and developing scalable data pipelines, architecting and...