Expert Large Scale Data System Architect

2 days ago

Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,00,000
Key Data Engineer Roles and Responsibilities

A data engineer is responsible for designing, building, and maintaining large-scale data systems. The role involves working with distributed computing frameworks like Apache Spark to optimize data processing pipelines.

The ideal candidate will have experience in setting up and managing CI/CD pipelines using Git and DevOps tools. Strong knowledge of Databricks and its ecosystem is required, including Unity Catalog for governance and security.

Azure data engineers should have a solid understanding of ETL pipeline development using Azure Data Factory or Informatica. Experience with cloud-based data warehousing and lakehouse architecture is also necessary.

We are looking for a skilled professional who can lead Databricks architecture, development, and operations. This includes designing scalable data lakes, warehouses, and lakehouses, as well as optimizing Databricks clusters, jobs, and workflows.

Requirements:
  • 5+ years of experience in data engineering
  • Strong expertise in Databricks and Apache Spark
  • Hands-on experience with Unity Catalog for governance and security
  • Proven track record of building and optimizing ETL pipelines
  • Solid understanding of CI/CD practices and automation for Databricks

  • Data Engineer for Large Scale Data Processing

    1 day ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 1,73,37,500 - ₹ 2,51,25,000

    Data Engineer RoleJob DescriptionWe are seeking a highly skilled data engineer to design and implement large-scale data processing systems. This includes architecting data pipelines, developing data warehouses, and ensuring data quality and integrity.Key Responsibilities:Design and implement scalable data processing systems using cloud-based platformsDevelop...

  • Large-Scale Enterprise System Developer

    15 hours ago

    Davangere, Karnataka, India beBeeSystemDevelopment Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: System Development SpecialistWe are seeking a highly skilled and experienced System Development Specialist to join our team. The ideal candidate will have a strong background in system development, preferably in large-scale enterprise environments.Key Responsibilities:Design, develop, test, and implement large-scale system solutions using IBM...

  • Master Designer

    14 hours ago

    Davangere, Karnataka, India beBeeArchitecture Full time ₹ 10,00,000 - ₹ 24,00,000

    About the OpportunityWe are seeking a skilled Architect II to join our team and contribute to the development of large-scale, integrated design projects across various sectors.

  • AI Engineer

    1 day ago

    Davangere, Karnataka, India beBeeMachineLearning Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: AI Engineer - Large Language Model ExpertWe are seeking a seasoned professional with expertise in deep machine learning and hands-on experience in generative AI systems. This role is ideal for someone who can drive technical direction, ensuring AI products deliver measurable business value.Key Responsibilities:Design and develop next-generation...

  • Cloud Data Architect

    1 week ago

    Davangere, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Cloud Data ArchitectWe are seeking a seasoned Cloud Data Architect to lead the design and implementation of large-scale data infrastructures on cloud platforms.About the Role:The ideal candidate will have extensive experience with cloud-based data engineering, including development, deployment, and management of scalable data pipelines using...

  • Data Systems Specialist

    1 week ago

    Davangere, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    About the RoleWe are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, building and maintaining large-scale data systems.

  • Senior Data Architect Position

    1 day ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking an experienced Data Engineer to fill a key role in our organization.A minimum of 5+ years of experience as a Data Engineer is required.Proficiency in Python and cloud-based technologies, preferably Azure, is essential.The ideal candidate will possess strong problem-solving skills, excellent communication abilities, and the...

  • Data Architect Position

    7 days ago

    Davangere, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to drive our company's data strategy.Design, implement and manage large-scale data pipelines using modern DevOps/configuration management tools.Configure and maintain branch protection rules and workflows to ensure smooth code integration and deployment.Develop and optimize data...

  • Senior Data Architecture Expert

    3 days ago

    Davangere, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Architect SpecialistWe are currently hiring for a Data Architect Specialist with expertise in data management and warehousing technologies.About the RoleThe ideal candidate should have 6-12 years of experience in large-scale data projects.Strong experience in database design, data structures, and algorithms is required.Implementation project experience...

  • Data Solutions Architect

    1 day ago

    Davangere, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Snowflake ConsultantJob Position: Data Architect We are seeking an experienced Snowflake professional to lead the design, development and optimization of scalable data pipelines, data models and analytics solutions.The ideal candidate will design, develop and optimize large-scale data warehouses, schemas and data-sharing solutions on...