Adaptive Replication for Low Latency Distributed Clusters
Keywords:
Distributed, Replication, Latency, Clusters, Networking, Throughput, Optimization, Scalability, Consistency, Performance, Storage, Algorithms, Fault Tolerance, Topology, Coordination.Abstract
Distributed systems increasingly rely on data replication to ensure availability, fault tolerance, and consistency across geographically dispersed clusters. These approaches struggle to adapt to heterogeneous network conditions, fluctuating workloads, and diverse latency profiles across nodes. As a result, many real world distributed clusters encounter performance bottlenecks such as high read/write latency, inefficient placement of replicas, unnecessary network hops, and elevated cross region communication overhead. The existing process generally relies on uniform replication factors and deterministic policies that treat all nodes equivalently, regardless of their real time network conditions. Under dynamic workloads, these policies fail to minimize tail latency or prioritize fast network paths. Moreover, cluster operators have limited visibility into how replica placement interacts with network congestion, link asymmetry, and node level I/O performance. This creates scenarios where replicas are placed far from the nodes that access them most frequently, causing avoidable delays in distributed transactions and read heavy operations. This paper proposes an adaptive replication strategy that continuously adjusts replica placement and synchronization behavior based on real time telemetry, including network latency measurements, node access patterns, I/O throughput trends, and communication path dynamics. Instead of using fixed rules, the approach analyzes cluster conditions and derives optimal replica layouts that reduce cross node communication delays. The solution incorporates lightweight monitoring, latency aware scoring models, and dynamic replica migration techniques that shift replicas closer to frequently accessing nodes. By integrating adaptive decision logic, the system aims to decrease median and tail latency, improve read locality, and reduce inter cluster traffic without compromising consistency guarantees. The objective of this work is to demonstrate how adaptive replication enables distributed clusters to react intelligently to changing conditions, ensuring that data remains closer to demand while reducing network overhead. The paper outlines the architecture, decision engine, and telemetry signals used in the proposed approach, providing a practical method to enhance performance in modern distributed environments.
Downloads
References
A. Enrico, & L. Martin. Distributed replication strategies for low latency systems. Journal of Distributed Computing, 45(3), 112–124, 2019
R. Thomas, & K. Varghese. Adaptive data placement in large scale distributed clusters. IEEE Transactions on Cloud Computing, 7(4), 985–998, 2019
S. Patel, & D. Mishra. Predictive replication algorithms for high availability storage. ACM Computing Surveys, 52(6), 1–28, 2019
M. Howard, & J. Benson. Network aware replication approaches in distributed file systems. Future Generation Computer Systems, 100, 160–174, 2019
T. Ramakrishna, & A. Babu. Latency optimization in cloud data stores using dynamic replica control. International Journal of Cloud Applications, 8(1), 45–57, 2019
N. Kannan, & R. Prasad. Analytical models for communication delays in distributed systems. Computer Networks, 163, 106880, 2019
G. Silva, & P. Gomez. Machine learning assisted network latency prediction. IEEE Access, 8, 10345–10356, 2020
B. Wilson, & A. Grant. Optimized replica selection for large scale distributed storage. Cluster Computing, 23(2), 789–804, 2020
J. Miller, & V. Kumar. Intelligent caching frameworks for distributed I/O. Journal of Parallel and Distributed Systems, 140, 72–85, 2020
C. Ortega, & D. Franklin. Anomaly detection for distributed storage workloads. IEEE Transactions on Dependable and Secure Computing, 17(5), 980–991, 2020
P. Casey, & R. Allen. Multi node data synchronization models for distributed environments. Concurrency and Computation: Practice and Experience, 32(12), e5674, 2020
L. Varun, & J. Harrison. Heuristics for network latency minimization in replicated systems. IEEE Systems Journal, 14(3), 3250–3260, 2020
S. Ibrahim, & M. Qureshi. Adaptive load balancing for distributed storage clusters. Journal of Grid Computing, 18(3), 451–468, 2020
A. Walter, & R. Silva. Latency driven replica distribution strategies. ACM SIGOPS Review, 54(2), 33–47, 2020
Y. Fang, & T. Zhang. Intelligent predictive models for distributed database performance. Knowledge Based Systems, 204, 106195, 2020
J. Carter, & L. Chang. Communication overhead reduction in large distributed clusters. Computer Communications, 165, 85–98, 2020
P. Nelson, & K. Wright. Scalable replication under dynamic workloads. IEEE International Conference on Cloud Engineering, 1–10, 2021
R. Arora, & N. Shukla. A study of data replication challenges in distributed architectures. Journal of Cloud Computing, 10(1), 1–20, 2021
E. Daniel, & H. Monroe. Learning based latency prediction strategies for clustered databases. Journal of Big Data, 8(3), 45–60, 2021
Z. Li, & H. Wu. Efficient communication models for multi region distributed systems. IEEE Access, 9, 45670–45682, 2021
A. Samuels, & D. Ray. A comparative study on replica management techniques. International Journal of Distributed Systems, 12(4), 330–344, 2021
K. Banerjee, & M. Roy. Evaluating replication overhead in resource constrained clusters. Journal of Systems Architecture, 118, 102182, 2021
J. Romero, & A. Singh. Distributed consistency protocols with adaptive replication. Information Systems, 101, 101762, 2021
Downloads
Published
How to Cite
Issue
Section
License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.


