OpenAI just open sourced a new 1.5B (50m active) model on HuggingFace with Apache 2.0 license!

It's not a new LLM, this one is called Privacy Filter, and it's a PII detection model (checking if text has private information)

A few interesting tidbits from the release + links: The goal of this model to first detect and then remove personally identifiable information (PII) in text. This definitely helps OpenAI to anonymize the prompts they train on.

The model is focused on scale and speed, with a very high accuracy scores on recall and precision!

If you, like me, just woke up, let me catch you up on the Claude Code Leak (I know nothing, all conjecture):

> Someone inside Anthropic, got switched to Adaptive reasoning mode
> Their Claude Code switched to Sonnet
> Committed the .map file of Claude Code
> Effectively leaking the ENTIRE CC Source Code
> @realsigridjin was tired after running 2 south korean hackathons in SF, saw the leak
> Rules in Korea are different, he cloned the repo, went to sleep
> Wakes up to 25K stars, and his GF begging him to take it down (she's a copyright lawyer)
> Their team decided - how about we have agents rewrite this in Python!? Surely... this is more legal
> Rewrite in Py
> Board a plane to SK🇰🇷
> One of the guys decides python is slow, is now rewriting ALL OF CLAUDE CODE into Rust.
> Anthropic cannot take down, cannot sue
> Is this "fair use?"
> TL;DR - we're about to have open source Claude Code in Rust We're going to cover this and a BUNCH more on the weekly @thursdai_pod spaces, join us, don't miss out.

x.com/i/spaces/1qGoN…

PSA: If you've been running out of Claude session quotas on Max tier, you're not alone. Read this.

Some insane Redditor reverse engineered the Claude binaries with MITM to find 2 bugs that could have caused cache-invalidation. Tokens that aren't cached are 10x-20x more expensive and are killing your quota.

If you're using your API keys with Claude this is even worse. This is also likely why this isn't uniform, while over 500 folks replied to me and said "me too", many (including me) didn't see this issue.

There are 2 issues that are compounded here (per Redditor, I haven't independently confirmed this) :

1s bug he found is a string replacement bug in bun that invalidates cache. Apparently this has to do with the custom @bunjavascript binary that ships with standalone Claude CLI.

The workaround there is to use Claude with `npx @anthropic-ai/claude-code`

2nd bug is worse, he claims that --resume always breaks cache. And there doesn't seem to be a workaround there, except pinning to a very old version (that will miss on tons of features)

This bug is also documented on Github and confirmed by other folks.

I won't entertain the conspiracy theories there that Anthropic "chooses" to ignore these bugs because it gets them more $$$, they are actively benefiting from everyone hitting as much cached tokens as possible, so this is absolutely a great find and it does align with my thoughts earlier.

The very sudden spike in reporting for this, the non-uniform nature (some folks are completely fine, some folks are hitting quotas after saying "hey") definitely points to a bug.

cc @trq212 @bcherny @_catwu for visibility in case this helps all of us. Original Reddit thread with credits to u/skibidi-toaleta-2137 😂

reddit.com/r/ClaudeAI/com…

IT'S HERE! The new state of the art AI intelligence in the form of Gemini 3-pro - and it's available in Search AI mode, API, @GoogleAIStudio and Vertex today!

Plus:

🧩 Generative UIs!
🤖 Agent mode
🧑‍💻 VSCode clone
🤔 3 Deep Think

And lots more! Let's break it down 👇 Evals are nuts 📈

With a massive 1501 @arena (+50 on 2.5 pro), 91.9% on GPQA diamond and 37.5% on HLE, this is the most powerful LLM intelligence we've had access to yet.

And w/ DeepThink + tools an even more impressive 41.1% on HLE and an unprecedented 45.1% on @arcprize

We had a "Cursor tips & tricks" meeting today with my colleagues at @weights_biases and I figured I'd share what we 'discovered' & shared between us in a 🧵

If you haven't chatted with your team about how YOU all use Cursor, you def should, but meanwhile here are our insights 👇 First we chatted about what features each of us uses and how to edit, the summary is, some folks have tried but are not super comfortable with Composer, CMD+K is useful but often lacks context, and chat sidebar is really great all around.

Takeaways:
Use Command+K to edit inline functions
User Composer when there's a need to edit multiple files
Use Chat with (cmd+shift+L) for everything else

Got my new mac from @weights_biases and it's been a while since I installed one, so will do a X setup thread cause why not?

As always, I never transfer anything, start from scratch every time, this way I get to re-decide what I use!

Thread mostly for me but follow along if u like I'm already a bit into this, but just barely.

First up as always, @1Password, undeniably the most important app to get on your mac first, so than everything else will become easier 🫡

@1Password also holds my SSH certificates for a while now, and has an SSH agent, so I no longer have to send my keys over from the older mac.

My Watchtower security score in @1Password is 358 (Weak) 🤪 🚧 🚜 (but keep in mind I've been using 1P for well over a decade and a BUNCH of these are old accounts I no longer use, my important accounts are all unique long passwords and 2 step protected with no sms, and slowly moving to passkeys, which 1P supports!)

watchtower.1password.com/score/358/

Welcome to LK-99 superconductor twitX corner, new here? Here are a few folks to pay attention to (or follow the list) :



@alexkaplan0 - broke the story w/ 29M views, the king of "we're so back, it's over, we're back? " rollercoastertwitter.com/i/lists/168444… .@andrewmccalip from Varda space took X by storm, announcing that they have the expertise, tools and most of the materials to start replicating this, and is live streaming the replication attempt on X/Twitch

https://twitter.com/andrewmccalip/status/1684821396411809792

#CodeInterpreter - "It's a very fast, coding intern, that's both really smart and really stupid, but the biggest advantage is, it never gets frustrated and never gives up" - @simonw

Here's my evergreen #CodeInterpreterCan thread, w examples, tips, use-cases, and ideas👇

1/ Open AI released Code Interpreter to every paying customer on #ThursdAI Jul 6. It's a watershed moment.

However not until @swyx pinged me and @simonw to discuss it on spaces, did I dive in.

And we're all in agreement, this is groundbreaking!

Checkout the space recording:

2/

https://twitter.com/swyx/status/1677754490055950337

Whoah ok, @OpenAI has just answered tons of developer requests, let's dig into this.

You know how many folks struggled to get a JSON output consistently? For the use of agents and other stuff?

Well, OpenAI took it 1 step further and gave us function calls! How do they work👇 First of all, many developers have struggled with consistent JSON output to their models (yes including me)

This led to hacks like trAI/except and other methods, I saw folks switching to yaml and xml among other solutions

So having native JSON response is just awesome 💯

https://twitter.com/altryne/status/1632253117827010566

Watching @karpathy presentation from today and taking twitter notes, come along for the ride:

If you're like only the practical tips, skip to #32

@karpathy starts with stages:
1 - Pre-training - months x thousands of GPUs
2, 3, 4 - Finetuning stages that take hours or days

1/ Before pre-training happens, there are 2 preparation steps.

Data collection - Get tons of data from different sources (here Andrej LLaMa mixture)

Tokenization - a lossless translations between pieces of words and integers.

2/

Captain... it's only tuesday 😅

As always we are coming to your ears on Thursday to cover the major things that happened in AI for the past week.

twitter.com/i/spaces/1lPKq…

First hour: recap of AI insanity
Second hour: Talking #genAI inside @Photoshop with @jnack !

More in🧵

https://twitter.com/Adobe/status/1660972295949811713

GANs are back! DragGAN enables dragging control points to change the image in ways not possible before!

https://twitter.com/Rainmaker1973/status/1659550279807688707

🇮🇱🇯🇵🇩🇪🇪🇸🇮🇳 x 1000
This is MASSIVE folks! (blind reaction)

TTS and STT in one model, that understands 1100 languages, better than whisper! and is able to generate audio in those languages?

Incredible thanks to @ylecun @boztank and tons of other folks who made this happen and… twitter.com/i/web/status/1… @ylecun @boztank And we get force alignment tooling open source as well to help with the quality of longer transcriptions??

fMRI modality is coming 🧐

https://twitter.com/_akhaliq/status/1660453496804741120

This quote is from ImageBind by @MetaAI seemed like science fiction just a short few weeks ago!

And now we have... MindVideo.

My 🧵 of the @lexfridman and @sama pod (which is incredible by the way, I'm having a hard time selecting the clips!) got...twittered.

Starting a new thread with Sam talking about @elonmusk being a sometimes funny Jerk on Twitter

Oh and reacting to the "GPT is woke" takes… twitter.com/i/web/status/1… @lexfridman @sama @elonmusk This is one powerful quote:

"Despite @elonmusk being a jerk on Twitter,
or whatever, I'm happy he exists in the world.
But I wish he would do more to look at the
hard work we're doing to get this stuff right."

- @sama

https://twitter.com/vidtranslator/status/1639830154599096320?s=20

.@sama thinks that the fact that you can chat with GPT-4 about your code, is a "really big deal" only after 6 days (before plugin system was released) @sama .@sama on the pressure from outrage journalism as it comes to AI

I just finished watching @ilyasut with @nvidia CEO Jensen, and I was really expecting the discussion about GPT-4 and multi-modality 🤯

Posting a few highlights, of what I think is going to be a huge, HUGE change in everyone's life soon:
(transcribed w/ Targum of course)
1/

https://twitter.com/altryne/status/1635736338397020160

.@ilyasut explains everything in simple terms:
Multimodality is important for two reasons: 1) It's useful, as vision enhances the practicality and value of neural networks. 2) It allows us to learn more about the world through images, in addition to text.
targum.video/v/2023/3/22/a6…

I've been wanting to draft this for a while.

There's so much more to twitter than just scrolling through your "for you" page, and getting farmed for engagement by it's algo!

I finally caved and drafted a #twitterDwellerManifesto (w/ help duh)

poe.com/s/Z0ebopUdKAAJ… The Twitter Dweller's Manifesto: Unleashing Your Social Superpowers

Welcome, fellow Twitter Dwellers! You've taken the first step toward unlocking the true potential of your Twitter experience.

היי #פידטק, אני אלכס, "מומחה" לבינה מלאכותית (לא מילים שלי 😂) והמתלהב הראשי מכל מה שבנוי מסיליקון ומקיא טקסט!

כמה מחשבות אחרי יום שהרגיש כמו שנה
אולי עקבתם, אולי לא,
קרו כמה דברים ב 14 במרץ, 2023,
πAI day 2023

ת'רד ארווווך מאוד - רק למשקיעים או משעוממים מאוד, מוזמנים 👇 היום בבום, נפלו עלינו 2 מודלי שפה ענקיים, והכרזה של אחת הענקיות בעולם הטק על זה שהם הולכים להכניס AI בכל מקום, בג'ימייל, באופיס, בכל דבר שרק המשתמשים יבקשו.

רק שבין שלושת ההכרזות (שלדעתי לא סתם קרו באותו יום) הבדל קטן...

Ok this is my AI new coding paradigms thread, I'll try to keep this updated with things that were not possible before.

Not only tools (god knows there's tons of those) but actual coding paradigms that show a glimpse of the future.

1/n First up, we have the incredible "GPT is all you need for backend" which is a hack-a-thon submission, that let's you set up a fake server and it'll just spit out things formatted based on your request. Super cool!

https://twitter.com/karpathy/status/1618311660539904002

BTW building @shortenai bot, have most of the twitter streaming code copied, now building the prompting pipeline on a @jposhaughnessy nudge.

Better to straight up ask chatGPT to respond with a JSON inside, this way, even if it answers with "as a large...bla bla" it will likely… twitter.com/i/web/status/1… @shortenai @jposhaughnessy Twitter API is being... sassy

I just had a great experience with @Tesla Littleton.

Our Model Y stopped heating the car and showed a notification to take it into service.

This + two small kids in a 25F weather, no bueno. I scheduled service via the app and the closest appointment was 5 days away.

/1 But I texted them through the App and asked to make sure they have a loaner (they usually give Uber credits) as I need to prepare for a kid weekend, and see if they can squeeze me in. Louis reached out the next day and said to come in immediately and that a loaner is waiting

/2