Big Data Architecture Specialist

2 days ago

Alwar, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Overview

A seasoned data engineer with technical leadership expertise oversees the development of big data architectures that meet client needs.

Collaborating closely with clients and team members to understand requirements and provide guidance on technical solutions is a key responsibility.

  • Developing data pipelines for new sources, transforming data within a data lake, implementing GraphQL, working with NoSQL databases, CI/CD, and data delivery in accordance with business requirements is a major task.
  • Building pipelines to ingest diverse data from internal and external sources, ensuring effective data availability for downstream consumption requires strong analytical skills.
  • Collaborating with cross-functional teams to source and make data available for use is also essential.

Key Responsibilities:

Designing Solution Architectures

Designing solution architectures that meet business needs, ensuring regular communication with stakeholders is a critical skill required.

Responsibilities:

  • Developing big data architectures that meet client needs
  • Overseeing the development of data pipelines for new sources
  • Transforming data within a data lake
  • Implementing GraphQL
  • Working with NoSQL databases
  • CI/CD and data delivery in accordance with business requirements
Required Skills & Qualifications

Azure Databricks, cloud infrastructure providers (Azure/AWS), batch processing (Apache Spark) or Hive query language (HQL), streaming data pipeline experience using Apache Spark Structured Streaming or Apache Flink on Kafka & Delta Lake, NOSQL databases, Big data ETL processing tools, data modeling, mapping, multiple data sources, relational databases, NoSQL/document databases, flat files, scripting (shell/bash), CI/CD tools (Jenkins, JIRA, Bitbucket, Artifactory, Bamboo, Azure Dev-ops), Git version control are some of the required skills and qualifications.

Requirements:

  • Strong problem-solving skills
  • Excellent understanding of Azure Databricks
  • Experience with cloud infrastructure providers (Azure/AWS)
  • Proficiency in building data pipelines using batch processing (Apache Spark) or Hive query language (HQL)
  • Streaming data pipeline experience using Apache Spark Structured Streaming or Apache Flink on Kafka & Delta Lake
  • Familiarity with NOSQL databases, Big data ETL processing tools, data modeling, and mapping
  • Experience working with multiple data sources, relational databases, NoSQL/document databases, flat files, and basic knowledge of scripting (shell/bash)
  • Understanding of CI/CD tools (Jenkins, JIRA, Bitbucket, Artifactory, Bamboo, Azure Dev-ops) and DevOps practices using Git version control

  • Senior Data Scientist

    2 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Engineer Job OpportunityWelcome to our job opening for a Big Data Engineer. As a key member of our team, you will be responsible for designing and developing large-scale data processing systems.Key Responsibilities:Design and develop big data architectures using PySpark and HiveWork with good-to-have skills such as Spark, HBase, DQ tools, and Agile...

  • Big Data Insights Specialist

    3 days ago

    Alwar, Rajasthan, India beBeeDataDriven Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Business Intelligence Data AnalystThe ideal candidate will play a pivotal role in driving business growth through strategic data insights.Job Description:We seek an experienced and innovative Business Intelligence professional to lead our data-driven initiatives. Key responsibilities include:Developing and maintaining large-scale data processing systems...

  • Data Architectural Leader

    15 hours ago

    Alwar, Rajasthan, India beBeeDataManagement Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Management Team LeadWe are seeking an experienced and accomplished Data Management Team Lead to spearhead our data management efforts.The ideal candidate will have a proven track record of leading teams and projects in data management, with a strong background in big data technologies, SQL, and data warehousing solutions.The successful...

  • Senior Big Data Developer

    5 days ago

    Alwar, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Databricks Engineer Job DescriptionOur ideal candidate will have a strong background in designing, developing, and maintaining data pipelines and ETL processes on Databricks. They should be able to lead the architecture and implementation of scalable, secure, and high-performance data solutions.Key Responsibilities:Design, develop, and maintain complex data...

  • Data Architecture Specialist

    3 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job Title: Data Architecture SpecialistWe are seeking a highly skilled professional with 4+ years of experience in designing, building, and optimizing large-scale data processing workflows. The ideal candidate will have hands-on experience working with Azure Cloud technologies, including Azure Data Lake, Azure Data Factory, Azure Databricks, and Azure SQL...

  • Data Architecture Specialist

    3 days ago

    Alwar, Rajasthan, India beBeeSnowflake Full time ₹ 20,47,963 - ₹ 25,59,896

    Data Architect OpportunityAbout the Role - The role is responsible for leading the design, implementation, and optimization of scalable data solutions on Snowflake Data Cloud. The ideal candidate will excel in Snowflake architecture, data warehousing, data lakes, serverless/cloud automation, and AI/LLM concepts.Key Responsibilities:Architect and deliver...

  • Data Architecture Specialist

    10 hours ago

    Alwar, Rajasthan, India beBeeDataArchitect Full time ₹ 18,75,000 - ₹ 25,30,000

    Enterprise Data ArchitectWe are seeking a seasoned professional to lead the development of our data architecture strategy. As an Enterprise Data Architect, you will play a pivotal role in defining and implementing data solutions that drive business outcomes.The ideal candidate will have a deep understanding of data warehousing design, dimensional modeling,...

  • Big Data Engineer

    5 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Data ScientistAs a skilled Data Engineer, you will be responsible for designing and building scalable data pipelines to support business initiatives. This role involves working with large datasets, streaming data, and collaborating with cross-functional teams to deliver high-quality solutions.About the RoleThis is an excellent opportunity for individuals who...

  • Architectural Visualization Specialist

    2 days ago

    Alwar, Rajasthan, India beBeeArchitectural Full time ₹ 9,00,000 - ₹ 12,00,000

    Architectural Visualization SpecialistWe are seeking a highly skilled Architectural Visualization Specialist to join our team.Develop high-quality 3D visualizations and models for architectural projects.Collaborate with designers, engineers, and architects to create detailed and accurate visualizations.Utilize software such as 3ds Max and Photoshop to create...

  • Highly Skilled Big Data Professional

    5 days ago

    Alwar, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data EngineerWe seek a highly skilled Senior Data Engineer to join our world-class team.The role involves designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.You will collaborate closely with data scientists, analysts, and other engineers to ensure the availability,...