Inkling is a Mixture-of-Experts transformer with 975B total parameters and 41B active, an Apache-2.0 licensed multimodal model trained on 45 trillion tokens of text, images, audio and video.
Thinking Machines Lab released Inkling, a large Apache-2.0 licensed open-weights MoE multimodal model.
transcript
Simon Willison: Inkling is "a Mixture-of-Experts transformer with 975B total parameters, 41B active" - an Apache-2.0 licensed multimodal model trained on 45 trillion tokens of text, images, audio and video.