emasters

joined 2 years ago
sorted by: new top controversial old
Salesforce gets into the open source LLM game in c/localllama@sh.itjust.works
[–] emasters@sh.itjust.works 1 points 2 years ago

Seems like they're sticking with the 7b series for the time being.

13
Salesforce gets into the open source LLM game (sh.itjust.works)
 

Long Sequence Modeling with XGen: A 7B LLM Trained on 8K Input Sequence Length -- https://blog.salesforceairesearch.com/xgen/