@opensauceAI
Policy @bfl_ai. Affiliate @BKCHarvard. ex-Stability AI (weights), GoogleX (drones), Uber (rides), Coinbase (magic beans). Views my own
@DavidSacks bUt cHiNa wILL gEt tHe dAta!!!!
I deeply respect the Pope, but we should be mindful of the Church's legislative instincts for technology diffusion. "The art of printing can be of great service insofar as it furthers the circulation of useful and tested books, but it can bring about serious evils if it is permitted to widen the influence of pernicious works. It will, therefore, be necessary to maintain full control over the printers so that they may be prevented from bringing into print writings which are antagonistic to the Catholic faith, or which are likely to cause trouble to believers." Alexander VI to the dioceses of Germany, 1501
Pope Leo XIV@Pontifex·Sound legislation should encourage scientific and technological creativity while safeguarding fundamental human rights and freedoms. It should protect users from exploitation, preserve personal privacy, ensure transparency in the use of emerging technologies and guarantee that they strengthen democratic institutions. t.co/h4uTCWWvsk
An unnamed official is mooting pre-release controls on open models past a certain threshold. Just my friendly tri-annual reminder that the Biden Diffusion Rule exempted models from export control if they were released openly. BIS dropped that Rule in 2025 because it "stifled... saddled... undermined" American innovation. Hard to square the circle.
The NYT gets open weights! I love to see the press amplifying the voice of actual developers: Using Chinese models was like owning a house while using U.S. models was like renting one, they said... “I don’t think people should worry so much about who built it,” he said. “The focus should be, does it deliver the capability you need?”... Developers are building systems controlled elsewhere, which means the technology can be yanked, altered or re-priced without warning.
An excellent piece from @satariano @paulmozur Adam Krolik: nytimes.com/2026/08/05/tec…
From latent diffusion to FLUX 3, it's been a wild ride 🥹 Open weights coming soon! x.com/bfl_ai/status/…
One characteristic of anti-open hysteria (open source, open weights, open data, open web) is a tendency to ignore the massive diffuse benefits, and concentrate on limited acute harms. Deeply condescending to describe the beneficiaries of openness as "bored 19 year olds".
In their defense, when this debate really kicked off in 2023, Anthropic was basically the only frontier lab that wasn't pushing some cockamamie scheme to "license model developers" or "send in the AI peacekeepers" or whatever. Don't get me wrong, their "FDA / FAA for weights" is still a bad idea. But Anthropic has been commendably consistent about what it believes, and how it would weigh the competing interests.
The new House FRONTIER Act has the same old problems as before. Public authorities have a hard time deciding when the benefits of drugs, vehicles, and financial products outweigh the risk (not to mention the Internet). Each of these has decades / centuries of actuarial history. But under this bill, the federal government would also need to approve the methodologies that auditors will use to determine the acceptable catastrophic risk posed by 1e26 FLOP models, which have ~1 year of actuarial history. Two likely outcomes: 1. These methodologies are conservative. They overweight speculative risks and underweight diffuse benefits. Auditors cry wolf, obtaining emergency restriction orders at the slightest hint of a capability breakthrough or offense-defense lag. It becomes difficult to release a frontier model publicly via API, and impossible to release one open-weights. or 2. The Department of Commerce is mindful of that ^ possibility, and gives auditors wide latitude to determine their own methodologies. Standards are lax, developers can forum shop, and nothing really changes from the status quo. If you believe that AI is an important technology with dual-use properties, either scenario would seem to be undesirable. This is the problem with proposals that go beyond transparency and try to prescribe acceptable risk thresholds. They jump the gun. We simply do not know enough about the risk-utility profile of this technology to form a consensus view of acceptable catastrophic risk. Drawing a new line in the sand could chill the widespread release of legitimate technology (whether through export controls, liability reforms, or these private-audits-with-public-licensing proposals). To be clear, in my view, a regulatory determination of acceptable catastrophic risk is vastly preferable to the tortious approach endorsed by e.g. the original SB1047 / RAISE Act. Regulatory thresholds can be inspected, contested, and adjusted based on broad public input. State jury verdicts cannot so easily. But even so, we are way over the skis here.
Bill text as introduced: obernolte.house.gov/sites/evo-subs…
Our @bfl_ai researchers co-developed 3 of the 5 most popular open models on @huggingface. Open R&D is in our DNA. But open innovation faces major headwinds. We're glad to rally together with industry to champion open weights for transparency, competition & security in AI. x.com/JensenHuang/st…
Et tu, Demis? "Once the assessment protocol is shown to be effective and robust, formalisation could quickly follow, meaning that Frontier Models would be required to pass it to be deployed in the US market." Ask ten different AI CEOs, godfathers, and safety institutes when a model release is acceptable (or when it's OK to publish frontier weights on Hugging Face), and you'll get ten different answers. That was the problem with these ideas in 2022, and it's still the problem today.
The steady provision of models will encourage global dependency on the labs and countries that share them. And vice versa. x.com/nathanbenaich/…
@wrwagox @robrombach The same way we handle every other capable, versatile, composable technology: layers of mitigation up and down the supply chain. There's more work to be done at the model layer. For most AI risks, there is more work to be done downstream too.
At the G7 today, sitting across from Presidents Trump and von der Leyen, our @robrombach made the case for open innovation in AI. "...It’s crucial that we strike the right balance. A climate of fear around open technology, or a focus on suppression over diffusion, will leave the world reliant on a handful of firms for critical infrastructure. @bfl_ai is ready to work with you all to make open and responsible innovation the norm, not the exception."
It will be ironic if AI's big "code is speech" war is fought by Anthropic. The reluctant Bernstein of our times.
What Anthropic wanted: a federal authority vetting model releases What Anthropic got: a federal authority vetting model releases
ARGH. This is so, so, so frustrating. Unlike 99.9% of the Hayes Valley chattering class, I've actually worked with the FAA and its 3-letter friends. I cannot imagine a better way to kill off open innovation in AI than "FAA for weights". But it's also disappointing because I x.com/DarioAmodei/st…
Anthropic already told us that with the right system prompt, Claude would SWAT its own user. That was a generous warning: i.e. model behavior can be amplified, modified, or suppressed based on features hidden from the user. Nothing about these Fable 5 guardrails is surprising. x.com/ahall_research…
You wouldn't guess it from all the "light touch" rhetoric, but the Obernolte-Trahan AI bill is uncomfortably close to FDA-for-models. CAISI will license auditors, who must verify the "adequacy" of the developer's safety framework for achieving an "acceptable" levels of risk.
I guess they need to offer a big carrot to justify federal preemption, although I'd prefer neither tbh.
I signed this call for mandatory DNA synthesis screening because it showcases how AI regulation is meant to work: (1) A tightly scoped intervention that (2) mitigates a credible risk (3) at the most proximate chokepoint, (4) preserving open access to versatile models. x.com/AlecStapp/stat…
A concrete example includes the Cotton-Klobuchar bill: cotton.senate.gov/news/press-rel…
Glad to see the distinction between model evaluation with & without pre-clearance is becoming clearer in industry advocacy, eg. @OpenAI's paper today. These are very different propositions. Conflating the two is why earlier proposals floundered (e.g. mandatory UKAISI testing).
Delighted that Martin Scorsese has joined us to explore how AI can be thoughtfully applied to storytelling. We're also sensitive to the depth of feeling on AI in Hollywood. That's understandable! It would be odd if folks didn't have strong views. A few personal reflections on x.com/bfl_ai/status/…
Per @WHOSTP47: "We are NOT conducting oversight of all new models, as that level of government overreach would have chilling effects on free speech and innovation"
Pope Leo is an open-source champion
Here's the thing: you don't need an EO to set up a voluntary beta release, nor do you need to define a "covered frontier model" for a voluntary beta. As @DavidSacks & POTUS correctly surmised, this EO was just one adjective and one sentence away from endorsing "FDA for weights". x.com/SophiaCai99/st…
