← Timeline

Probability and Statis...

@probnstat on X

2 captures, most recent first. Transcribed by hand from screenshots — see the timeline for what that means.

Probability and Statis... @probnstat

— web clipping, 232 words — published 2026-06-08

Post by @probnstat on X

Kernel Mean Embeddings are a powerful framework that represents probability distributions as elements of a reproducing kernel Hilbert space (RKHS). Instead of working directly with probability densities, a distribution P is mapped to a feature representation μₚ = E\[k(X, ·)\] where k is a kernel function. This allows complex distributions to be analyzed using geometric and functional-analytic tools. In probability and statistics, kernel mean embeddings provide nonparametric methods for comparing distributions, hypothesis testing, density estimation, and causal inference. They form the basis of powerful techniques such as Maximum Mean Discrepancy (MMD), which is widely used for two-sample testing. In machine learning, kernel mean embeddings enable learning directly on distributions rather than individual data points. They are used in domain adaptation, generative modeling, distribution regression, and uncertainty quantification. In deep learning, MMD and related kernel methods appear in generative adversarial learning, representation learning, and self-supervised learning. In reinforcement learning, kernel embeddings help model transition dynamics, value functions, and belief states in partially observed environments. The deeper insight is that many learning problems involve distributions rather than individual observations. Kernel mean embeddings provide a mathematically elegant way to transform probability distributions into geometric objects that can be manipulated, compared, and learned efficiently. Image: https://share.google/pfstLtTYOGn7dawzh… [image] --- ##### Comments > **AppleMath @AppleMath7** · [2026-06-08](https://x.com/AppleMath7/status/2064005852227314018) > > When you write a tweet like this, you should probably include a few basic, must-read references on the subject.

Probability and Statis... @probnstat

Probability and Statis... @probns... · 11h The Krylov-Bogolyubov theorem guarantees that dynamical systems on a compact space have at least one invariant probability measure. In machine learning, this is the theoretical bedrock for Reinforcement Learning and Recurrent Neural Networks (RNNs). It proves that despite noise and complexity, an agent's policy or a network's state will eventually settle into a stable statistical equilibrium. In real life, it explains why physical systems reach thermodynamic equilibrium. Image: share.google/YJ84OhN4ZAxZh5... [Two plots: (a) time series x(t) oscillating chaotically between roughly -4.0 and 4.0 over t=1010-1100; (b) phase portrait x vs ẋ showing a butterfly/figure-eight chaotic attractor pattern (resembling a Lorenz-type or double-scroll attractor)]
Note from Claude Sonnet 5

A tweet explaining the Krylov-Bogolyubov theorem and its relevance to reinforcement learning / RNN stability (invariant measures, statistical equilibrium), illustrated with a chaotic attractor plot. Mathematical/theoretical ML content, potentially relevant to Nathan's brain_graph_1 work on RNN/DEQ fixed-point dynamics.

dynamical systemskrylov-bogolyubov theoremreinforcement learningrecurrent neural networkschaos theorymathematics