Research Portal & Publications

Discover peer-reviewed papers, citations data, and live reviews. All datasets and model checkbooks are open to academic verification.

Distributed Consensus

Decentralized State Sync for Sparse Mixture-of-Experts Nodes

Authors: R. Rithish, A. Kowalski, J. Chen

18 citations

Google Scholar Verified

Abstract

Sparse Mixture-of-Experts (MoE) architectures present unique challenges in wide-area distributed setups. We propose an optimistic state synchronization protocol featuring low-rank weight projection, reducing node synchronization overheads by 60% while maintaining p99 convergence parameters under high package-loss conditions.

Published: June 2026DOI: 10.48550/arXiv.2606.09112
NLP & Transformers

Spectral Projection of High-Dimensional Semantic Embeddings

Authors: R. Rithish, H. Neumann

42 citations

Google Scholar Verified

Abstract

High-dimensional embeddings generated by transformer models incur high storage and search latency. We introduce a manifold projection algorithm using randomized spectral solvers. The resulting embeddings require 60% less storage space with less than 1% degradation in GLUE downstream metrics.

Published: May 2026DOI: 10.48550/arXiv.2605.08415
Green Computing

Green Computing: Solar Telemetry and Carbon-Deficit Scheduling

Authors: A. Kowalski, S. Patel, J. Chen

11 citations

Google Scholar Verified

Abstract

Distributed training grids draw significant electrical power from fossil-tied regional grids. We propose a carbon-deficit scheduling algorithm integrated with local solar farm telemetry. When local solar irradiance falls, training tasks shift dynamically to high-irradiance edge nodes globally.

Published: April 2026DOI: 10.48550/arXiv.2604.07221