“why don't we just use long context?”

“Achieved for input models.”

“The ability of AI models to process and retain very large amounts of information, discussed for its future development.”