“this library is the one that started AI alto together coupnn the the library on top of it called megatron core made it possible for us to simulate and train extremely large language models.”

“using uh KUDNN”

“Kudin Nan is actually also really good.”