# @repligate — 2025-09-06

♥0 ↻0 · https://x.com/repligate/status/1964421688814342327

@lennyeusebi i think you're confused about what "depend on" means. the new tokens influence the logits; that doesn't mean the old information is destroyed. literally, it could compute a visualization at earlier positions and pass it to the future through the attention mechanism.

tags: author:repligate, kind:tweet, thread-context, year:2025