Big Data Architect

2 weeks ago

Pushkar, Rajasthan, India beBeeData Full time ₹ 17,29,400 - ₹ 21,43,700
Job Title: Big Data Architect

At our organization, you will play a key role in designing and managing large-scale data systems.

The team is responsible for building and managing platforms that handle high-scale services and host millions of unique topics. To achieve this, we utilize cutting-edge Machine Learning and AI technologies on a large Hadoop cluster.

Our tech stack includes Java, Elastic Search/Solr, Kafka, Spark, Machine Learning, NLP, Deep Learning, Redis, and Big Data technologies like Hadoop, HBase, YARN.

Key Responsibilities:

  • Design and execution of large and complex distributed data systems.
  • Monitoring of performance and optimization of existing projects.
  • Researching and integrating new Big Data tools and frameworks.
  • Implementing scalable solutions based on business/data requirements.
  • Creating reusable components and data tools for the company's data platform.

Requirements:

  • 2-4 years of experience in big data technologies (Apache Hadoop) and relational databases (ms sql server/oracle/MySQL/postgres).
  • Proficiency in at least one of the following programming languages - Java, Python or Scala.
  • Expertise in SQL (T-SQL/PL-SQL/SPARK-SQL/HIVE-QL).
  • Proficiency in Apache Spark, including hands-on knowledge of working with Data Frames, Data Sets, RDDs, Spark SQL/PySpark/Scala APIs with deep understanding of Performance Optimizations.
  • Good understanding of Distributed Storage (HDFS/S3).
  • Strong analytical/quantitative skills and comfortable working with very large sets of data.
  • Experience with integration of data across multiple data sources.
  • Good understanding of distributed computing principles.

Desirable Skills:

  • Experience with Message Queues (e.g., Apache Kafka).
  • Experience with MPP systems (e.g., Redshift/Snowflake).
  • Experience with NoSQL storage (e.g., MongoDB).

  • Big Data Solutions Architect

    1 week ago

    Pushkar, Rajasthan, India beBeeData Full time ₹ 15,40,400 - ₹ 25,42,200

    Cloud Data ArchitectWe are seeking a seasoned professional with extensive experience in Big Data technologies and Google Cloud Platform services to design and implement scalable data solutions.Design, develop, and optimize data pipelines using GCP BigQuery, Dataflow, and Apache Airflow to support large-scale data analytics.Utilize the Big Data Hadoop...

  • Big Data Engineering Lead

    2 weeks ago

    Pushkar, Rajasthan, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 3,00,00,000

    We are seeking an experienced Big Data Engineering Lead to join our team.About the RoleLead a team of data engineers across multiple geographies and time zones.Collaborate with cross-functional teams, including architects, product managers, and operations.Design and implement scalable big data solutions using Apache Spark and Python.Develop data pipelines...

  • Senior Big Data Architect

    1 week ago

    Pushkar, Rajasthan, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Big Data Engineer Job OverviewThe role of Big Data Engineer involves designing, developing, and optimizing large-scale data pipelines and distributed data processing systems. This position requires strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team.Key Responsibilities:Data Pipeline Development: Design and...

  • Data Solutions Architect

    2 weeks ago

    Pushkar, Rajasthan, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Data Solutions ArchitectRelevant Skills:Maintain architecture principles, guidelines and standardsBig Data, ETL, ELT systems and Data Flow computeKey Responsibilities:Design and implement data solutions in cloud environmentsDevelop software code in one or more languages such as Java and PythonImplement technology projects within a professional...

  • Chief Data Architect

    1 week ago

    Pushkar, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Data EngineerAs a key member of our data team, you will play a vital role in designing and optimizing complex data pipelines, infrastructure, and tools to deliver insights across multiple products and projects.With a focus on scalability, security, and efficiency, you will collaborate closely with developers, architects, analysts, and data scientists to...

  • Big Data Engineer

    7 days ago

    Pushkar, Rajasthan, India Idyllic Services Full time

    Job Title: Big Data Engineer – ScalaLocation: Bangalore, Chennai, Gurgaon, Pune, Mumbai.Experience: 7–10 Years (Minimum 3+ years in Scala)Notice Period: Immediate to 30 DaysMode of Work: Hybrid Role OverviewWe are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data...

  • Senior Big Data Developer

    2 weeks ago

    Pushkar, Rajasthan, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking an experienced Big Data Engineer to join our team. As a Cloud Engineer, you will be responsible for designing and implementing scalable big data architectures, developing and deploying data pipelines for structured and unstructured data, and collaborating with cross-functional teams to deliver high-quality solutions.Required...

  • Expert Data Architect Wanted

    1 week ago

    Pushkar, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled Data Architect to lead our data strategy.The ideal candidate will have 3-6 years of experience in designing scalable data architectures and working on modern cloud & big data platforms.Key Responsibilities:Design, develop, and maintain large-scale data processing systems using Python, SQL, PySpark, and...

  • Data Architect

    1 week ago

    Pushkar, Rajasthan, India beBeeDataEngineer Full time ₹ 1,85,00,000 - ₹ 2,15,00,000

    Job Summary:We are seeking a highly skilled data architect to join our organization. The successful candidate will be responsible for designing, coding, testing, debugging, and documenting software solutions associated with technology domains.The ideal candidate will have hands-on experience in Python, Spark (Apache Spark or Pyspark), big query (GCP) and...

  • Big Data Engineering Lead

    1 week ago

    Pushkar, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Lead Data Engineer PositionWe are seeking an experienced data engineer to deliver roadmap features for our Enterprise TruRisk Platform. This platform helps customers measure, communicate, and eliminate cyber risks.You will work closely with engineers and architects to prototype, design, develop, and support a highly scalable, distributed SaaS-based Security...