Uploaded May 2024 | Updated September 2026, 2 hours ago
Recent advances in large language models (LLMs) have centered around more data, larger models, and larger context lengths. The ability of LLMs to learn in-context (i.e. in-context learning) makes longer context lengths extremely valuable. However, there are some problems with relying on just in-context learning to learn during inference.
Social Media
YouTube - youtube.com/c/EdanMeyer
Twitter - twitter.com/ejmejm1
Recent advances in large language models (LLMs) have centered around more data, larger models, and larger context lengths. The ability of LLMs to learn in-context (i.e. in-context learning) makes longer context lengths extremely valuable. However, there are some problems with relying on just in-context learning to learn during inference.
Social Media
YouTube - youtube.com/c/EdanMeyer
Twitter - twitter.com/ejmejm1
