Big Data Architect

20 hours ago

Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

Job Title: Data Engineering Professional

We are seeking a highly skilled data engineer with expertise in designing, developing, and optimizing large-scale data pipelines and distributed data processing systems.

  • Design, develop, and optimize complex data pipelines using Scala, Spark, and Python.
  • Work extensively with big data technologies such as Apache Kafka, NiFi, and Jupyter Notebooks for data analysis and transformation.
  • Develop and integrate real-time streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using SQL and query optimization techniques.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
Required Skills:
  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python programming languages.
  • Hands-on experience with Apache Kafka messaging technology.
  • Knowledge of NiFi / Airflow for workflow automation.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization techniques.
  • Good understanding of Cloud Architecture principles.

Preferred Skills:

  • Exposure to message queuing technologies like Apache Kafka.
  • Experience in designing intuitive user interfaces for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with Continuous Integration/Continuous Deployment (CI/CD) tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Senior Big Data Architect

    4 days ago

    Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineer OpportunityWe are seeking a highly skilled Big Data Engineer to design and develop scalable data architectures, process large datasets, and implement efficient data storage solutions.

  • Big Data Analyst

    4 days ago

    Salem, Tamil Nadu, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Unlock the Power of Big Data AnalyticsJob OverviewWe are seeking highly skilled professionals to join our team as big data analysts. In this role, you will have the opportunity to work on various projects related to big data analytics and contribute to the development of scalable and efficient big data solutions.Key ResponsibilitiesDesign, develop, and...

  • Cloud Data Architect

    6 hours ago

    Salem, Tamil Nadu, India beBeeCloudDataArchitect Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Cloud Data ArchitectWe are seeking a highly experienced Cloud Data Architect to lead our data architecture initiatives. The ideal candidate will have a strong background in designing and implementing scalable cloud-based data architectures.Key Responsibilities:Maintain architecture principles, guidelines, and standardsDesign and implement data...

  • Big Data Engineer

    3 days ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a skilled Data Systems Architect with expertise in big data technologies to lead our data engineering team.The ideal candidate will have a proven track record in designing, developing, and optimizing large-scale data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.Main...

  • Big Data Engineer Position

    3 days ago

    Salem, Tamil Nadu, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 20,20,000

    Job Title:Data ArchitectDesign, develop and maintain large-scale data pipelines for ingestion, transformation and storage.Key Responsibilities:Work with Big Data ecosystems (Hadoop, Spark, Hive, or similar) to process structured and unstructured data.Develop efficient ETL processes to integrate data from multiple sources into data warehouses/lakes.Write and...

  • Big Data and Cloud Solutions Professional

    7 hours ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data ArchitectWe are seeking a skilled and passionate Azure Cloud expert with strong focus on Big Data management and data quality skills to join our organization.This is a full-time hybrid role offering flexibility for remote work, allowing professionals to achieve a better balance between personal and professional life.Role Overview:Hands-on...

  • Cloud Data Architect

    4 days ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job DescriptionWe are seeking a highly skilled Data Architect with 6–8 years of experience in designing, developing, and managing enterprise data solutions on Google Cloud Platform (GCP). The ideal candidate will have a strong background in cloud data architecture, data warehousing, big data processing, and data integration, with proven expertise in...

  • Big Data Engineer

    3 days ago

    Salem, Tamil Nadu, India Idyllic Services Full time

    Job Title: Big Data Engineer – ScalaLocation: Bangalore, Chennai, Gurgaon, Pune, Mumbai.Experience: 7–10 Years (Minimum 3+ years in Scala)Notice Period: Immediate to 30 DaysMode of Work: Hybrid Click the link below to learn more about the role and take the AI Interview to begin your application journey: https://sl1nk.com/XiPeNRole OverviewWe are looking...

  • Senior Big Data Engineer

    5 days ago

    Salem, Tamil Nadu, India beBeeBigDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking an accomplished professional to lead the development of a scalable and extensible big data platform. This individual will be responsible for designing, developing, and evolving highly distributed components using big data technologies.The successful candidate will have a proven track record of building and shipping large-scale...

  • Big Data Pipeline Specialist

    12 hours ago

    Salem, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    GCP Data Engineering ExpertThe ideal candidate will possess in-depth knowledge of data engineering principles and practices, specifically within the Google Cloud Platform (GCP) ecosystem. They will be responsible for designing, building, and maintaining large-scale data pipelines that cater to various business requirements.The GCP Data Engineer will work...