Principal Real-Time Data Integration Architect

2 weeks ago

Ahmedabad, Gujarat, India beBeeDataIntegration Full time ₹ 9,00,000 - ₹ 12,00,000

Real-Time Data Integration Specialist

We are seeking a highly skilled expert to design, develop and integrate robust real-time data integration solutions using Apache Kafka. This role requires a strong understanding of distributed systems and data streaming concepts.

Key Responsibilities:

  • Design, implement and maintain real-time data pipelines using Apache Kafka.
  • Develop integration solutions using Kafka Streams and other related technologies.
  • Manage Apache Kafka clusters ensuring high availability, scalability and performance.
  • Collaborate with cross-functional teams to understand integration requirements and deliver robust solutions.
  • Implement best practices for data streaming, including message serialization, partitioning and replication.
  • Monitor and troubleshoot Kafka performance, latency and security issues.
  • Ensure data integrity and implement failover strategies for critical data pipelines.

Required Skills and Qualifications:

  • Strong experience in Apache Kafka (Kafka Streams, Kafka Connect).
  • Proficiency in programming languages like Java, Python or Scala.
  • Experience with distributed systems and data streaming concepts.
  • Familiarity with Zookeeper, Confluent Kafka and Kafka Broker configurations.
  • Expertise in creating and managing topics, partitions and consumer groups.
  • Hands-on experience with integration tools such as REST APIs, MQ or ESB.
  • Knowledge of cloud platforms like AWS, Azure or GCP for Kafka deployment.
  • Experience with monitoring tools like Prometheus, Grafana or Datadog is a plus.
  • Exposure to DevOps practices, CI/CD pipelines and infrastructure automation is a plus.
  • Knowledge of data serialization formats like Avro, Protobuf or JSON is a plus.
  • Bachelor's degree in Computer Science, Information Technology or a related field.

  • Principal Data Architect

    2 weeks ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    As a seasoned professional, you will lead the development of scalable data pipelines and ETL processes to support downstream analytics and AI applications.Key ResponsibilitiesDesign and develop efficient data pipelines to ensure seamless integration with machine learning models and workflows.Collaborate with data scientists to integrate data solutions into...

  • Senior Enterprise Solutions Architect

    2 weeks ago

    Ahmedabad, Gujarat, India beBeePrincipal Full time US$ 2,00,000 - US$ 2,50,000

    Job Description:We are seeking a highly skilled Principal Architect to design and architect complex, scalable workflows and solutions that align with business needs and technology goals.The successful candidate will develop cloud-native architectures, ensuring scalability, performance, and security for enterprise applications. They will lead initiatives to...

  • Principal Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Cygnet Infotech Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Please find the company profile and job description as below:Company name: Cygnet OneWebsite: Designation: Principal Software EngineerWork Mode: Remote (WFH)Work Timings: 4 PM to 1 AM (IST)Availability to join: Immediate to 15 DaysWe are seeking a highly experienced technologist with deep expertise in C#.NET, Angular, and cloud technologies (AWS) who thrives...

  • Databricks Data Architect

    4 weeks ago

    Ahmedabad, Gujarat, India Celebal Technologies Full time

    Databricks Data Architect Location- Navi Mumbai (onsite) Looking for someone who can start IMMEDIATELYJob Summary: We are seeking an experienced Databricks Data Architect with a strong background in designing scalable data platforms in the manufacturing or energy sector. The ideal candidate will have over 10 years of experience in designing and implementing...

  • Solution Architect

    1 week ago

    Ahmedabad, Gujarat, India RK Hr Management Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    • Design scalable, secure & optimized mobile app architectures.• Lead multi-account, VoIP & video streaming system design.• Define API contracts, VPE integration & cross-platform patterns.• Ensure compliance with FCC, E911 & WCAG standards. Required Candidate profile• Principal level with 10+ yrs architecture experience.• Strong in iOS, Android,...

  • Visionary Data Architect

    2 weeks ago

    Ahmedabad, Gujarat, India beBeeAnalytics Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a Unified Analytics Architect to play a key role in designing and scaling next-generation analytics platforms. This is an exciting opportunity where you will define architecture, guide implementation, and enable data teams to deliver insights faster with enterprise-grade governance.The ideal candidate will have 8-12 years of experience in data...

  • Senior Financial Data Architect

    1 week ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 2,13,03,781 - ₹ 2,54,77,119

    Job Summary:We are seeking a seasoned data engineering professional to join our team as a Principal Engineer.The successful candidate will have extensive experience in designing and building scalable, trusted, and cost-optimized financial data solutions using Snowflake, dbt, and modern data engineering practices.Key Responsibilities:Architecting and leading...

  • Real-Time Performance Manager

    2 weeks ago

    Ahmedabad, Gujarat, India beBeeAnalyst Full time ₹ 6,00,000 - ₹ 12,00,000

    Real-Time Operations SpecialistThis role serves as the first line of defense to ensure service levels and performance metrics are achieved, while supporting operations with timely and accurate reporting, issue escalation, and actionable insights.The ideal candidate will have strong analytical skills with proficiency in MS Excel, WFM tools, and excellent...

  • Data Specialist

    1 week ago

    Ahmedabad, Gujarat, India beBeeDatabase Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Database ArchitectAbout the RoleWe are seeking a skilled and experienced Database Architect to design, develop and maintain high-performance database systems that handle large volumes of data.Main ResponsibilitiesData Management:Design and implement database schemas for storing and retrieving financial data.Develop and optimize ETL processes for...

  • Fabric Data Solutions Architect

    2 weeks ago

    Ahmedabad, Gujarat, India beBeeFabric Full time US$ 70,000 - US$ 85,000

    Job SummaryWe are seeking a skilled Fabric Data Solutions Architect to join our team. This is an exciting opportunity for a seasoned professional with expertise in designing and implementing data solutions using Microsoft Fabric.DescriptionThe successful candidate will lead the design and implementation of scalable and secure data solutions, collaborating...