Building Scalable Data Architectures

3 days ago


Gulbarga, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 3,00,00,000
Senior Data Engineer Job Description

As a Senior Data Engineer, you will play a pivotal role in designing and maintaining cloud-based data architectures. Your primary responsibility will be to build scalable real-time and batch processing workflows using Azure Databricks, PySpark, and Apache Spark.

  • Designing and implementing data pipelines that meet business requirements for high availability and reliability.
  • Collaborating with the automation team, data scientists, and engineers to provide clean, structured data for AI/ML models.
  • Deploying and optimizing data solutions on Azure (preferred), AWS, or GCP with a focus on performance, security, and scalability.

Required Skills and Qualifications:

  • 4+ years of experience in building ETL/ELT pipelines for structured and unstructured data from IoT, MES, SCADA, LIMS, and ERP systems.
  • Strong understanding of data pre-processing, including cleaning, transformation, deduplication, normalization, encoding, and scaling.
  • Experience with Docker and Kubernetes is highly desirable.

Benefits:

  • Opportunity to work with cutting-edge technologies and tools.
  • Collaborative and dynamic work environment.
  • Professional growth and development opportunities.


  • Gulbarga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 30,00,000

    Job OverviewWe are seeking a skilled professional to join our team as a Data Engineer. As a key member of our data engineering team, you will be responsible for designing, building, and managing scalable data pipelines and enterprise data solutions.Our ideal candidate has a deep understanding of Azure, SQL Server, and Databricks, with experience in ETL/ELT...


  • Gulbarga, Karnataka, India beBeeInfrastructure Full time ₹ 80,00,000 - ₹ 1,45,00,000

    Platform Infrastructure SpecialistWe are seeking an exceptional Platform Infrastructure Specialist to build our infrastructure from the ground up. As our first dedicated specialist, you will have the rare opportunity to make architectural decisions that will impact the company for years to come.Main ResponsibilitiesCreate and implement a cloud platform on...


  • Gulbarga, Karnataka, India beBeeCloudEngineer Full time ₹ 1,60,00,000 - ₹ 2,20,00,000

    Cloud Platform Engineer PositionAs a seasoned cloud platform engineer, you will be responsible for designing and building scalable, secure, and reliable cloud platforms.Key Responsibilities:Implement and maintain cloud-based compute offerings based on industry best practices.Manage subscriptions, resource groups, and resources following architecture...


  • Gulbarga, Karnataka, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Backend Developer RoleWe are seeking a highly skilled senior backend developer who can independently design and deliver scalable, high-performance systems. The selected candidate will collaborate with our core team to create robust APIs, optimize infrastructure, and build real-time functionality that powers a platform used by hundreds of thousands of...


  • Gulbarga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineer RoleWe are seeking a seasoned Senior Data Engineer to spearhead the design, development, and maintenance of scalable data pipelines using PySpark. This is an exceptional opportunity for someone with strong expertise in PySpark and hands-on experience in building robust data pipelines.


  • Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking an experienced Data Engineer to design, build, and optimize scalable data solutions using Google Cloud Platform (GCP) and AtScale.The ideal candidate will have hands-on experience in developing robust data pipelines, implementing efficient data models, and ensuring performance optimization for enterprise-level analytics.Key...


  • Gulbarga, Karnataka, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,20,00,000

    Job Title: Cloud Data ArchitectWe are seeking an experienced Cloud Data Architect to join our team.Responsibilities:Design and implement scalable, secure, and highly available cloud-based data architectures.Collaborate with cross-functional teams to develop and maintain data pipelines, ensuring seamless integration with existing systems.Analyze business...


  • Gulbarga, Karnataka, India beBeeDatabase Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Architecture SpecialistWe are seeking a skilled Data Architecture Specialist to join our managed services team in Kalaburagi for a 1-year BAU support role. This position requires expertise in database engineering, automation, performance optimization, and cloud integration.Design and manage scalable database configurations, including...


  • Gulbarga, Karnataka, India beBeeBackendEngineer Full time US$ 1,20,000 - US$ 1,80,000

    Backend Engineer Job DescriptionWe are looking for a skilled Backend Engineer to join our team. The ideal candidate will have a strong grasp of data flows, infrastructure, and integration patterns.The successful candidate will be responsible for designing, building, and maintaining backend components, APIs, and integrations. They will work on the backbone of...


  • Gulbarga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 3,00,00,000

    Job Title: Data Architect SpecialistWe are seeking a highly skilled Data Architect to lead the design and implementation of our data pipeline architecture. As a key member of our team, you will be responsible for designing, developing, and maintaining large-scale data systems that support our business operations.Key ResponsibilitiesDesign and develop...