Grok's AI’s source code including model weights has been released as a massive 318GB torrents the mad man did it.
Grok-1 is a 314B parameter Mixture of Experts model
Base model (not fine tuned)
8 experts (2 active)
86B active parameters
Apache 2.0 license
Code: https://github.com/xai-org/grok
Happy coding!
Grok-1 is a 314B parameter Mixture of Experts model
Base model (not fine tuned)
8 experts (2 active)
86B active parameters
Apache 2.0 license
Code: https://github.com/xai-org/grok
Happy coding!
