Senior Backend Data Architect

1 week ago

Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Title:

 

Job Summary:

We are seeking an exceptional Data Engineer to join our organization. As a Data Engineer, you will be responsible for designing and building optimal data pipeline architectures, creating and maintaining events/streaming based architecture/design, and identifying, designing, and implementing internal process improvements.

 

Responsibilities:

  • Design and build optimal data pipeline architectures
  • Create and maintain events/streaming based architecture/design
  • Identify, design, and implement internal process improvements
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Work with data scientists to strive for greater functionality in our data systems.

 

Requirements:

  • Proficiency in either Scala or Python, expertise in Spark, and experience with performance tuning and optimization. DBT is also Mandatory.
  • Experience with big data tools: HDFS/S3, Spark/Flink, Hive, Hbase, Kafka/Kinesis, etc.
  • Experience with relational SQL and NoSQL databases, including Elasticsearch and Cassandra/Mongodb.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS/GCP cloud services
  • Experience with stream-processing systems: Spark-Streaming/Flink etc.
  • Experience with object-oriented/object function scripting languages: Java, Scala, etc.
  • Experience building and optimizing 'big data' data pipelines, architectures and data sets.
  • Strong analytic skills related to working with structured/unstructured datasets.
  • Build processes supporting data transformation, data structures, dimensional modeling, metadata, dependency, schema registration/evolution and workload management.
  • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Have a few weekend side projects up on GitHub.
  • Have contributed to an open-source project.
  • Have worked at a product company.
  • Have a working knowledge of a backend programming language.
  • Programming Language (Mandatory) → Candidate should be really good in either Scala OR Python (not necessarily both).
  • Big Data Framework (Mandatory) → Strong hands-on expertise in Apache Spark.
  • Must know how to write Spark jobs and also tune/optimize them for better performance (not just basic Spark usage).
  • Performance Tuning & Optimization (Mandatory) → Able to handle large datasets efficiently.
  • Optimize Spark jobs (partitions, shuffles, caching, memory usage, etc.)
  • DBT (Mandatory) → Must have hands-on experience with dbt (Data Build Tool) for data transformations and data modeling.

 

Preferred Qualifications:

  • Experience with AWS/GCP cloud services.
  • Experience with stream-processing systems: Spark-Streaming/Flink etc.

  • Senior Backend Developer

    1 week ago

    Kannur, Kerala, India beBeeBackend Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Lead Backend DeveloperWe are seeking an experienced Lead Backend Developer to be the primary architect of our digital real estate platform.This is a complex initiative to build a comprehensive ecosystem integrating long-term sales, short-term stays, and advanced technologies including AI/ML, data analytics, Web3/blockchain, and conversational...

  • Senior Backend Developer

    2 weeks ago

    Kannur, Kerala, India RuDo Wealth Full time

    Location: Bangalore, KarnatakaExperience: 2+ yearsEmployment Type: Full-Time (On-site)About RuDo WealthRuDo is a digital wealth platform designed for mass affluent NRIs who want to build long-term wealth effortlessly. Our app combines automated portfolio management, with hyper-personalized experience through data-driven investing and dynamic approach to help...

  • Senior Data Architect

    2 weeks ago

    Kannur, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data ArchitectWe are seeking a highly skilled and experienced Data Architect to join our organization.This role is critical in designing, developing, and maintaining large-scale data pipelines that support our business operations.Strong Experience in PySpark:Hands-on expertise in building scalable data pipelines using PySpark.Proficiency in...

  • Backend Data Migration Expert

    1 week ago

    Kannur, Kerala, India beBeeBackend Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Backend Data Migration SpecialistOverviewWe are seeking a seasoned professional to spearhead the migration of data solutions from Azure Synapse Analytics to SQL-based systems. The ideal candidate will possess strong expertise in SQL, backed by at least 2+ years of experience in backend development and SQL database management.Key...

  • Senior Backend Engineer

    1 week ago

    Kannur, Kerala, India beBeeBackend Full time US$ 1,20,000 - US$ 1,80,000

    Job Summary:\We are seeking a highly experienced Backend Software Architect to design and build scalable backend systems.\The ideal candidate will be proficient in Node.js (NestJS framework preferred) and TypeScript, with strong experience in GraphQL API design and implementation.\This role requires architectural expertise across monolithic and...

  • High-Scale Backend Engineer

    1 week ago

    Kannur, Kerala, India beBeeBackend Full time ₹ 2,50,00,000 - ₹ 3,50,00,000

    Senior Backend Engineering Manager Job DescriptionAbout Us:We are a rapidly growing company that provides Bulk SMS, WhatsApp Business API, and RCS messaging services. Our goal is to build a professional tech team in Bangalore to power our next phase of growth.Job OverviewWe are looking for an experienced Senior Backend Engineering Manager who can lead our...

  • Advanced Backend Infrastructure Architect

    7 days ago

    Kannur, Kerala, India beBeeBackendDeveloper Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title:">Back End Developer">There is a high demand for experienced and skilled Back End Developers in the industry. The company is looking for talented individuals to architect and build the backend infrastructure that powers its platform.">">System Architecture & Design: Build secure and scalable backend services for real-time video/audio consultations,...

  • Senior Backend Systems Engineer

    1 week ago

    Kannur, Kerala, India beBeeBackend Full time ₹ 18,50,000 - ₹ 21,50,000

    Job Title: Technical Lead DeveloperLocation: Kannur, IndiaWe are seeking a highly skilled technical lead developer to take charge of our backend systems at MResult. As a key member of our team, you will be responsible for designing and developing scalable and efficient backend systems using Python and AWS.Main Responsibilities:Develop high-quality backend...

  • Senior Backend Developer

    1 week ago

    Kannur, Kerala, India beBeeBackend Full time ₹ 2,50,00,000 - ₹ 3,00,00,000

    Backend Engineering OpportunitiesWe are currently seeking a talented Backend Engineer to join our team. This role is ideal for individuals who possess in-depth knowledge of designing and implementing scalable backend systems.The successful candidate will be proficient in Node.js, with strong experience in GraphQL API design and implementation using the...

  • Senior Backend Developer

    2 weeks ago

    Kannur, Kerala, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Backend Expert WantedWe are seeking a seasoned developer to join our team as we build the next generation of digital wealth management platforms. This is an opportunity for you to utilize your technical expertise and passion for innovative solutions to drive business success.Architect High-Performance Systems: Design and develop robust backend services that...