TL;DR
Thinking Machines has released its first foundation model, Inkling, openly available on Hugging Face under Apache 2.0. This marks a notable shift toward transparency and ownership in AI development, though some details remain uncertain.
Thinking Machines, a relatively new AI lab founded by former OpenAI CTOs, has released its first foundation model, Inkling, which is part of Murati’s Thinking Machines releases openly available on Hugging Face under the Apache 2.0 license. This is a significant development in the AI field, emphasizing transparency and ownership, and marks a departure from the industry norm of closed models.
Inkling is a 975-billion-parameter mixture-of-experts transformer supporting multimodal inputs (text, images, audio) with a 1-million-token context window. It was trained on 45 trillion tokens of diverse data, including text, images, audio, and video, and was pretrained using a hybrid optimizer on NVIDIA systems. For more on large language models, see our coverage of Murati’s Thinking Machines release of the Open-Weights 975B model. The model’s weights are now available openly, allowing organizations to download, modify, and deploy it independently.
Unlike typical releases, the model’s weights are under Apache 2.0, granting broad usage rights, but the training data and pipeline are not publicly disclosed. Additionally, reports suggest Thinking Machines maintains a separate Acceptable Use Policy (AUP) restricting surveillance, deception, and automated decision-making, which could conflict with the open-source licensing. This layered policy raises questions about the scope of open access and permissible modifications.
Implications of Open-Source Model Release for AI Development
This release signals a shift toward greater transparency and control in AI development, allowing users to own and modify models without relying on API access. It challenges the industry trend of closed models, potentially accelerating innovation and democratization of AI technology. However, the layered restrictions via AUP may complicate open-source expectations, prompting industry debate about the balance between openness and responsible use.
As an affiliate, we earn on qualifying purchases.
Background on AI Model Releases and Industry Norms
Historically, most large AI models have been released with restricted access, often via APIs, to control usage and prevent misuse. Open-source releases have been rare and typically limited to smaller models or with significant restrictions. The recent trend has been toward proprietary models from major tech companies, with limited transparency about training data and methods.
Thinking Machines, founded 17 months ago by ex-OpenAI executives, has taken a different approach by releasing its weights openly, emphasizing ownership and transparency. This move comes amid ongoing debates about AI safety, data privacy, and the ethics of model deployment.
“We believe in empowering developers with ownership of the models they build upon, while maintaining responsible use through clear policies.”
— Thinking Machines spokesperson
open-source AI model training kits
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Uncertainties About Model Licensing and Usage Restrictions
It remains unclear how enforceable the separate Model Acceptable Use Policy (AUP) is, and whether it significantly limits the open-source potential of Inkling. The exact scope of restrictions and how they will be monitored or enforced by Thinking Machines is still unknown. Additionally, the impact of not releasing training data or pipeline details on transparency and reproducibility remains a concern among industry observers.
Local LLM Inference Optimization: A Comprehensive Guide to Quantization, Hardware Acceleration, and Efficient Private AI Deployment
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Next Steps for Industry Adoption and Independent Testing
Independent researchers and organizations are expected to evaluate Inkling’s performance across various benchmarks and real-world applications. Further scrutiny of the AUP and its enforcement will likely follow, alongside discussions about the implications of layered licensing on open-source models. The model’s adoption and adaptation by the broader AI community will reveal how this approach influences future releases.
As an affiliate, we earn on qualifying purchases.
Key Questions
What makes Inkling different from other foundation models?
Inkling is notable for being openly available under the Apache 2.0 license, supporting multimodal inputs, and being trained on a diverse dataset with a large context window. Its open weights allow for independent modification and deployment, unlike most proprietary models.
Does the layered Acceptable Use Policy restrict the model’s openness?
Reports suggest there are restrictions via a separate AUP, which may limit certain uses such as surveillance or deceptive practices. The enforceability and scope of these restrictions are still unclear, raising questions about true openness.
What are the risks of releasing such a large model openly?
Risks include misuse for malicious purposes, potential safety concerns, and challenges in monitoring compliance with usage policies. The layered restrictions aim to mitigate some risks, but their effectiveness remains to be seen.
Will other companies follow Thinking Machines’ approach?
It is uncertain. While some may adopt more open models, many industry players remain cautious due to safety, legal, and competitive considerations. The impact of Inkling’s release will influence future openness strategies.
When will more details about the training data and pipeline be released?
There has been no official timeline. Transparency about training data and pipeline remains a concern, and further disclosures may depend on community feedback and regulatory developments.
Source: ThorstenMeyerAI.com
