lucidrains/ring-attention-pytorch

Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch

Language: Python - Size: 1.01 MB - Last synced at: 27 days ago - Pushed at: about 1 month ago - Stars: 513 - Forks: 31