Senior Data Architect

13 hours ago

Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Big Data Engineer Position

We are seeking a highly skilled and experienced Big Data Engineer to join our team at Alp Consulting Ltd.

Job Description:

Our ideal candidate will have 5-12 years of experience in designing and implementing Big Data solutions using distributed computing principles, Apache Spark, and related technologies. They will also have hands-on programming skills with Python, proficiency in Hadoop v2, Map Reduce, HDFS, Sqoop, and experience with building stream-processing systems using technologies such as Apache Storm or Spark-Streaming.

The successful candidate will have a good understanding of Big Data querying tools like Hive and Impala, experience with integrating data from multiple sources, and expertise in SQL queries, joins, stored procedures, and relational schemas.

Additionally, they will have experience with NoSQL databases, knowledge of ETL techniques and frameworks, performance tuning of Spark Jobs, and experience with native Cloud data services AZURE Databricks.

Key Responsibilities:

  • Designing and implementing scalable Big Data architectures
  • Developing and deploying efficient data processing pipelines
  • Collaborating with cross-functional teams to integrate data from multiple sources
  • Ensuring data quality, security, and compliance
  • Leading the development of new features and technologies

Requirements:

  • 8-12 years of experience in Big Data & Data related technology
  • Expert level understanding of distributed computing principles
  • Expert level knowledge and experience in Apache Spark
  • Hands on programming with Python
  • Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop
  • Experience with building stream-processing systems
  • Experience with messaging systems
  • Good understanding of Big Data querying tools
  • Experience with integration of data from multiple data sources
  • Good understanding of SQL queries
  • Experience with NoSQL databases
  • Knowledge of ETL techniques and frameworks
  • Performance tuning of Spark Jobs
  • Experience with native Cloud data services AZURE Databricks
  • Ability to lead a team efficiently
  • Experience with designing and implementing Big data solutions
  • Practitioner of AGILE methodology

  • Senior Data Systems Architect

    5 days ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Systems ArchitectWe are excited to announce an opportunity for a skilled data architect to join our team.About the Role: As a senior data systems architect, you will play a crucial role in designing, developing, and deploying large-scale data processing systems using cutting-edge technologies like PySpark and...

  • Senior Big Data Architect

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data ArchitectJob Summary:About this Role:We are seeking an experienced and strategic technology leader with expertise in designing and delivering scalable data solutions using Microsoft Azure, Databricks, and Big Data platforms.The ideal candidate will lead a team of talented engineers to architect and oversee the development of...

  • Data Platform Architect

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeInnovation Full time US$ 1,80,000 - US$ 2,50,000

    Finance Innovation LeadWe're seeking a skilled Finance Innovation Lead to join our mission-driven team. This role involves architecting and developing platforms for financial data, providing technical structure to teams, and working closely with management and stakeholders to define strategic roadmaps.The ideal candidate will have 8+ years of experience in...

  • Senior Data Architect

    6 days ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data ArchitectA key player in our team, the ideal candidate will design and implement scalable data architectures using Medallion Architecture principles.Main Responsibilities:Develop data lake solutions in Azure Data Lake Storage (ADLS) Gen2 to store and process large datasets.Create optimized SQL queries for data extraction, transformation, and...

  • Data Architect

    2 days ago

    Tirupati, Andhra Pradesh, India Teamware Solutions Full time

    About the CompanyGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdAbout the RoleWe are hiring a Data ArchitectLocation: PAN India Work Model: HybridExperience: 10+ yearsNotice Period: Immediate- 15 daysOpen roles: 4Role Summary: Data Architect – Oracle & Microservices Data ModelingFocus Area: Oracle, Data Modeling, PL/SQL,...

  • High-Performance Data Architect

    4 days ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our product development and delivery team.This is an exciting opportunity to build the intelligence infrastructure that powers enterprise transformation in complex telecommunications and IT Asset Management (ITAM) environments.Design high-performance database...

  • Cloud Data Architect

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeCloudDataArchitect Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Cloud Data ArchitectAbout the Role:We are seeking a skilled Cloud Data Architect to design and implement large-scale data processing systems using AWS technologies.The ideal candidate will have strong expertise in architecting and delivering highly scalable, distributed, cloud-based enterprise data solutions. They should be proficient in Lambda or...

  • Cloud Data Architect

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeIntegration Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Title:Senior Integration SpecialistSeeking an experienced Senior Integration Specialist with strong expertise in Cloud Data Integration (CDI), Cloud Application Integration (CAI), and SaaS Master Data Management (MDM).The ideal candidate will have proven experience in developing, configuring, and troubleshooting MDM data models, reference codelists, and...

  • Principal Data Architect

    13 hours ago

    Tirupati, Andhra Pradesh, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    **Job Title:** Data Architect We are seeking a highly skilled Data Architect to join our team. The successful candidate will have experience in designing and developing scalable data processing systems using algorithms, data structures, and design patterns. They will also have the ability to process and analyze large datasets using data pipelines and data...

  • Cloud Data Architect

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeBigData Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud and Big Data ArchitectWe are seeking a skilled Cloud and Big Data Architect to join our team.This is a full-time role offering flexibility for remote work. The ideal candidate will have hands-on experience in Azure, proficient in Big Data technologies, and a strong understanding of data management principles and best practices.Key responsibilities...