<?xml version="1.0" encoding="UTF-8"?>
<article article-type="research-article" xml:lang="en" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher">global-journal-of-computer-science-and-technology-c-software-data-engineering</journal-id>
<journal-title-group>
<journal-title>Global Journal of Computer Science and Technology - C: Software &amp; Data Engineering</journal-title>
</journal-title-group>
<issn publication-format="print">0975-4350</issn>
<issn publication-format="electronic">0975-4172</issn>
<publisher><publisher-name>Global Journals Publishing Group Incorporated</publisher-name></publisher>
<self-uri xlink:href="https://globaljournals.org/journal-seo-export/jats/276970.xml" />
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">276970</article-id>
<title-group>
<article-title>Real-Time Stream Processing for Live Hybrid System of Batch Processing Architecture for Central Information Systems</article-title>
<subtitle>Hybrid Batch-Stream Architecture for CIS</subtitle>
</title-group>
<contrib-group>
<contrib contrib-type="author"><name><surname>AlMahmeed</surname><given-names>Ahmed</given-names></name><contrib-id contrib-id-type="orcid">0009-0000-0044-4814</contrib-id><xref ref-type="aff" rid="aff1" />
</contrib>
</contrib-group>
<aff id="aff1">Kuwait, PAAET</aff>
<volume>26</volume>
<abstract><p>Central Information Systems (CIS) face a structural tension between the correctness of batch processing and the immediacy of stream processing. This paper presents a complete reference architecture for a live hybrid batch-stream system that unifies both paradigms for CIS workloads. We review the evolution from Lambda to Kappa to modern lakehouse-unified architectures, evaluate state-of-the-art technologies including Apache Kafka 3.8, Flink 1.19, Spark Structured Streaming 4.0, Kafka Streams 3.8, Debezium CDC, and open table formats (Iceberg, Delta Lake, Hudi, Paimon), and formalize consistency, fault-tolerance, and performance models. We propose a live hybrid architecture centered on a Kafka-based central event log with tiered infinite retention, a single Flink codebase with dual-mode execution (live and backfill via Iceberg-as-source using Source API), and a medallion-structured lakehouse serving layer with Redis, Druid, and vector stores. Benchmark synthesis from Halputt 2025 shows Flink achieving 1.82M events/sec with 120ms p99 latency for windowed aggregation, 2.1× Spark and 3.2× Kafka Streams, while unaligned checkpoints eliminate backpressure-induced timeouts. The architecture meets sub-500ms operational SLA and 5-15 min analytical freshness, designed for GJCST and global journal submission compliance.</p></abstract>
<kwd-group kwd-group-type="author-generated">
<kwd>Apache Flink</kwd>
<kwd>Apache Kafka</kwd>
<kwd>CDC</kwd>
<kwd>Central Information Systems</kwd>
<kwd>Change Data Capture</kwd>
<kwd>Event-Time Processing</kwd>
<kwd>exactly-once</kwd>
<kwd>hybrid architecture</kwd>
<kwd>Kappa</kwd>
<kwd>lakehouse</kwd>
<kwd>Lambda</kwd>
<kwd>Real-time stream processing</kwd>
<kwd>watermarks</kwd>
</kwd-group>
<self-uri content-type="html" xlink:href="https://globaljournals.org/scholarly-articles/manuscript-by-dr-ahmed-saleh-almahmeed/" />
</article-meta>
</front>
<body>
<sec>
<title>Full Text</title>
<p></p>
</sec>
</body>
</article>