Big Data Architect

10 hours ago

Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

Job Description

We are seeking an experienced Data Engineer to join our team in Malappuram, India.

  • The successful candidate will be responsible for designing, developing, and deploying scalable data pipelines and ETL processes using Databricks.

About the Role

As a Data Engineer, you will collaborate with stakeholders to understand data requirements and translate them into technical solutions. Your expertise in writing complex SQL queries and knowledge of SQL Analytical functions will help optimize Spark jobs and ensure efficient data processing and storage.

Key Responsibilities:

  • Design, develop, and deploy scalable data pipelines and ETL processes using Databricks.
  • Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
  • Optimize Spark jobs and ensure efficient data processing and storage.
  • Develop and maintain Databricks notebooks, workflows, and dashboards.
  • Troubleshoot and resolve data pipeline issues and performance bottlenecks.
  • Monitor and manage data processing jobs to ensure high availability and reliability.
  • Work with cloud platforms such as AWS, Azure, or Google Cloud to integrate Databricks with other services.
  • Stay current with the latest Databricks and big data technologies and trends.

Requirements:

  • 6+ years of experience in development and maintenance in a data engineering project.
  • Proficient in building and optimizing data pipelines and workflows in Databricks.
  • Experience working in cloud platforms (Azure/AWS platforms) and familiar with cloud tools and technologies.
  • Knowledge of programming languages such as Python, Scala.

What We Offer:

  • A challenging role that will help you grow professionally.
  • The opportunity to work with a talented team of engineers.
  • A dynamic and collaborative work environment.

How to Apply:

If you're passionate about data engineering and want to take your career to the next level, we encourage you to apply now to become a part of our team at Hyrhub.

  • Big Data Architect with Fabric

    3 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title:Big Data Architect with FabricThe ideal candidate for this role will be a highly motivated and skilled data engineer who is passionate about designing, building, and maintaining large-scale data systems. This position requires expertise in big data technologies such as Hadoop, Spark, and NoSQL databases.

  • Big Data Solutions Architect

    3 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Opportunity:We are seeking an experienced Big Data Developer to drive data insights and inform business decisions.The ideal candidate will have a strong background in big data technologies, including Scala, AWS, and Python or Java.Key Responsibilities:Design and develop scalable big data architectures using Hadoop and Spark.Analyze large datasets to...

  • Big Data Solutions Architect

    6 days ago

    Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,00,000

    Job OpportunityWe are seeking a highly skilled data engineering professional to join our team.The ideal candidate will have a strong background in big data technologies and experience with PySpark, Hive, Spark, HBase, DQ tool, and Agile Scrum methodologies.Key responsibilities include designing, developing, and maintaining large-scale data processing...

  • Big Data Specialist

    11 hours ago

    Malappuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title:Big Data SpecialistJob Description:We are seeking a highly skilled Big Data Specialist to lead the design, development, and deployment of large-scale data systems. The ideal candidate will have expertise in Python and cloud technologies, preferably Azure.Responsibilities:Design, develop, and deploy big data systems to drive business growth and...

  • Cloud Data Solutions Architect

    3 days ago

    Malappuram, Kerala, India beBeeDataArchitect Full time ₹ 18,00,000 - ₹ 20,40,000

    Job Title: Cloud Data Solutions ArchitectAbout the Role:We are seeking an experienced cloud data solutions architect to design and implement scalable data architectures.The ideal candidate will have hands-on experience in designing and implementing solutions in data warehousing, big data, data analytics, and Google Cloud Platform (GCP) services.Key...

  • Expert Big Data Hadoop Scala Professional

    3 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Big Data Hadoop Scala EngineerWe're seeking a skilled Data Architect to design and implement large-scale data processing systems.Key Responsibilities:Develop and optimize data pipelines using Scala, Spark, and Hadoop tools.Design efficient database schemas for seamless data storage and retrieval.Work on performance enhancement and query...

  • Big Data Analytics Expert

    6 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    ETL Developer PositionRole Description:This is a full-time on-site role for an ETL Developer, based in Bengaluru for one of our esteemed overseas clients. The role involves understanding requirements, designing, developing and testing of ETL architecture, transformation jobs and workflow schedules.Key Responsibilities:Design and develop scalable ETL...

  • Senior Cloud Data Solutions Architect

    1 week ago

    Malappuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data ArchitectOverview of the Role:We are seeking a skilled Data Architect with over 8 years of experience in technical, solutioning, and analytical roles to join our team. The ideal candidate will have expertise in designing and implementing end-to-end data pipelines and integration solutions for structured and unstructured data sources and...

  • Data Architect Specialist

    3 days ago

    Malappuram, Kerala, India beBeeCloud Full time ₹ 17,50,000 - ₹ 2,51,20,000

    Job Title: Cloud and Big Data ArchitectWe are seeking a skilled Azure Cloud professional with strong focus on Big Data management and data quality skills.This is a full-time hybrid role offering flexibility for remote work.Key Responsibilities:Hands-on experience in Azure for a minimum of 3–4 years, with overall professional experience of less than 10...

  • Cloud Data Architect

    1 day ago

    Malappuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data ArchitectThis is a challenging and rewarding role that requires strong technical skills, excellent communication and collaboration skills, and a passion for innovation and problem-solving.Job SummaryDesign and Implement Cloud Storage Solutions: Utilize cloud-based platforms to create scalable, performant, and cost-effective data storage...