AI Interview Question - LLM Training is Parallel but Inference is Sequential? Why?

Bayesian inference is the process by which your brain continuously updates its predictions about the world based on new information. The brain doesn’t just passively receive sensory input, it makes a best guess about what’s happening based on prior experience and then updates that guess when new information comes in. In the context of foam rolling the prior is “this area is stiff and uncomfortable.” The new sensory input is the novel sensation from the roller. The expectation that it will help i