Petabyte-Scale Data Architecture Specialist

1 week ago

Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 3,00,00,000
Senior Data Engineer Position

The Senior Data Engineer will be responsible for designing and implementing petabyte-scale data architectures to unify data lakes and warehouses.

Key Responsibilities:
  • Design & Develop Scalable Systems: Design and implement lakehouse architectures using Apache Iceberg and Delta Lake.
  • Real-Time Data Engineering: Develop and optimize streaming pipelines using Kafka, Pulsar, and Flink to process structured/unstructured data with low latency.
  • High-Performance Applications: Leverage Java to build scalable, high-throughput data applications and services.
  • Modern Data Infrastructure: Leverage modern data warehouses and query engines like Trino and Spark for sub-second operations and analytics on real-time data.
  • Database Expertise: Work with RDBMS (PostgreSQL, MySQL, SQL Server) and NoSQL systems (Cassandra, MongoDB) to manage diverse data workloads.
  • Data Governance: Ensure data integrity, security, and compliance across multi-tenant systems.
  • Cost & Performance Optimization: Manage production infrastructure for reliability, scalability, and cost efficiency.
  • Innovation: Stay ahead of trends in the data ecosystem to drive technical excellence.
  • API Development (Optional): Build and maintain Web APIs (REST/GraphQL) to expose data services internally and externally.

Requirements:

  • 8+ years of data engineering experience with large-scale systems (petabyte-level).
  • Expert proficiency in Java for data-intensive applications.
  • Hands-on experience with lakehouse architectures, stream processing (Flink), and event streaming (Kafka/Pulsar).
  • Strong SQL skills and familiarity with RDBMS/NoSQL databases.
  • Proven track record in optimizing query engines (e.g., Spark, Presto) and data pipelines.
  • Knowledge of data governance, security frameworks, and multi-tenant systems.
  • Experience with cloud platforms (AWS, GCP, Azure) and infrastructure-as-code (Terraform).

  • Cloud-Scale Data Specialist

    2 weeks ago

    Vellore, Tamil Nadu, India beBeeExpertise Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title:Azure Data Expert\Drive the technical depth and instructional value of our training content.\Required Skills & Qualifications\\Deep expertise in Azure Synapse, Data Factory, Databricks, Data Lake Gen2, Cosmos DB, Event Hub\Strong knowledge of AI: Azure OpenAI, Cognitive Services, Azure Machine Learning Studio, Responsible AI\7+ years in roles such...

  • Data Systems Architectural Lead

    1 week ago

    Vellore, Tamil Nadu, India beBeeArchitectural Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Lead Data Systems ArchitectAbout the Role:The Lead Data Systems Architect will oversee a team of data engineers, architects, and performance engineers in designing, implementing, and maintaining high-performance, scalable data solutions for critical applications.This role requires strong technical expertise in advanced data systems, data architecture, and AI...

  • Data Engineering Specialist

    2 weeks ago

    Vellore, Tamil Nadu, India beBeeData Full time US$ 1,20,000 - US$ 1,50,000

    Senior Cloud Data Migration SpecialistWe seek an experienced Senior Cloud Data Migration Specialist to lead complex data migration projects in the Azure ecosystem.The ideal candidate will possess hands-on expertise in modern cloud-based data engineering tools and platforms, with a strong background in orchestrating seamless data migrations within hybrid...

  • Data Architecture Specialist

    1 week ago

    Vellore, Tamil Nadu, India beBeeFinancial Full time ₹ 1,80,00,000 - ₹ 2,10,00,000

    Lead Financial Data ArchitectWe are seeking a highly skilled professional to lead the development of our financial data architecture. This role involves designing and implementing scalable, trusted, and cost-optimized financial data solutions using Snowflake, dbt, and modern data engineering practices.This position requires strong technical leadership,...

  • Architectural Design Specialist

    1 week ago

    Vellore, Tamil Nadu, India beBeeDesign Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job Title: Architectural Design SpecialistWe are seeking a skilled and detail-oriented Architectural Design Specialist to join our team.The successful candidate will be responsible for planning and designing functional and aesthetically pleasing interior spaces, including creating detailed design plans and collaborating with clients to understand their...

  • Cloud Data Architecture Specialist

    1 week ago

    Vellore, Tamil Nadu, India beBeeCloudDataArchitect Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Job SummaryA Cloud Data Architect plays a pivotal role in designing and implementing cloud data pipelines using their core skill set.Job DescriptionIn this position, you will be responsible for developing scalable cloud data architectures, integrating multiple data sources, and ensuring seamless data flow. Your expertise in AWS Databricks, Snowflake, Python,...

  • AWS Cloud Data Specialist

    1 week ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: AWS Cloud Data SpecialistThe ideal candidate will have a strong understanding of cloud-based data architectures and experience working with AWS services such as Aurora, Glue, Lambda, EC2, S3, EMR, Step Functions, CloudTrail, and CloudWatch. They should be proficient in building and maintaining data pipelines using Python, Spark, and Kafka/Kinesis...

  • Cloud Architecture Specialist

    1 week ago

    Vellore, Tamil Nadu, India beBeeCloud Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Scalable Systems EngineerWe are seeking experienced engineers with a startup mindset who can design, build, and maintain scalable systems. Our culture values fast, data-driven innovation.The Observability team needs skilled engineers in cloud-native design, legacy maintenance, and SRE best practices. We collaborate across Tech to ensure platforms and...

  • Data Architecture Leader

    1 week ago

    Vellore, Tamil Nadu, India beBeeCloudStrategist Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Platform StrategistWe are seeking an experienced Cloud Platform Strategist to lead our cloud engineering team and develop a clear platform vision to enable business growth and operational efficiency.Key Responsibilities:Partner with cross-functional teams (engineering, product, business, and security) to define priorities and solve...

  • Advanced Data Architecture Specialist

    1 week ago

    Vellore, Tamil Nadu, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 18,00,000

    About the RoleAs a highly skilled Data Engineer, you'll have the opportunity to design and develop cutting-edge solutions that drive business growth. You'll work closely with cross-functional teams to deliver impactful projects that leverage the latest technologies and innovations.Main Responsibilities:Design and implement new features and enhancements for...