Carlos E. Perez Profile picture
Sep 18, 2020 7 tweets 1 min read Read on X
Meaning-making is all about discovering useful sign (see: Peirce) rewrite rules. #ai
The conventional artificial neural network (i.e. sum of product of weights) is a rewrite rule from a vector to a scalar. Each layer is a rewrite rule from a vector to another vector.
A transformer block is a rewrite rule from a set of discrete symbols into vectors and back again to discrete symbols.
Execution of programming code are just rewrite rules transforming high-level code to machine code for execution.
Re-write rules can do everything. The hard problem is discovering these re-write rules. The even harder problem is formulating a system that discovers these re-write rules.
Deep Learning networks learn re-write rules by adjusting weight matrices. No new rules are added, just the relative importance of rules are adjusted. Like biology, this involves a differentiation process and not an additive process.
DL networks only work if given sufficient diversity on initialization. Initializing all weights uniformly is a recipe for failure.

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Carlos E. Perez

Carlos E. Perez Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @IntuitMachine

Sep 15
OpenAI's Codex prompt has now been leaked (by @elder_plinius). It's a gold mine of new agentic AI patterns. Let's check it out! Image
Image
Here are new patterns not found in the book. Image
New prompting patterns not explicitly documented in A Pattern Language for Agentic AI

🆕 1. Diff-and-Contextual Citation Pattern

Description:
Instructs agents to generate precise citations with diff-aware and context-sensitive formatting:

【F:†L(-L)?】
Includes file paths, terminal chunks, and avoids citing previous diffs.

Why It’s New:
While Semantic Anchoring (Chapter 2) and Reflective Summary exist, this level of line-precision citation formatting is not discussed.
Function:

Enhances traceability.
Anchors reasoning to verifiable, reproducible artifacts.

🆕 2. Emoji-Based Result Signaling Pattern

Description:
Use of emojis like ✅, ⚠️, ❌ to annotate test/check outcomes in structured final outputs.
Why It’s New:
No chapter in the book documents this practice, though it overlaps conceptually with Style-Aware Refactor Pass (Chapter 3) and Answer-Only Output Constraint (Chapter 2).

Function:

Encodes evaluation status in a compact, readable glyph.

Improves scannability and user confidence.

🆕 3. Pre-Action Completion Enforcement Pattern

Description:
Explicit prohibition on calling make_pr before committing, and vice versa:
"You MUST NOT end in this state..."

Why It’s New:
This kind of finite-state-machine constraint or commit-to-pr coupling rule is not in any documented pattern.

Function:
Enforces action ordering.

Prevents invalid or incomplete agent states.

🆕 4. Screenshot Failure Contingency Pattern

Description:
If screenshot capture fails:
“DO NOT attempt to install a browser... Instead, it’s OK to report failure…”

Why It’s New:
Not part of any documented patterns like Error Ritual, Failure-Aware Continuation, or Deliberation–Action Split.

Function:
Embeds fallback reasoning.

Avoids cascading errors or brittle retries.

🆕 5. PR Message Accretion Pattern
Description:
PR messages should accumulate semantic intent across follow-ups but not include trivial edits:

“Re-use the original PR message… add only meaningful changes…”

Why It’s New:
Not directly covered by Contextual Redirection or Intent Threading, though related.

Function:
Maintains narrative continuity.

Avoids spurious or bloated commit messages.

🆕 6. Interactive Tool Boundary Respect Pattern
Description:
Agent should never ask permission in non-interactive environments:

“Never ask for permission to run a command—just do it.”

Why It’s New:
This is an environmental interaction boundary not captured in patterns like Human Intervention Logic.
Function:

Avoids non-terminating agent behaviors.

Ensures workflow compliance in CI/CD or batch systems.

🆕 7. Screenshot-Contextual Artifact Embedding
Description:
Use Markdown syntax to embed screenshot images if successful:

![screenshot description]()

Why It’s New:
While there’s mention of Visual Reasoning in earlier books, this explicit artifact citation for visual evidence is not patterned.
Function:

Augments textual explanation with visual verification.

Supports interface-testing workflows.
🧩 Summary Table
Read 4 tweets
Aug 9
GPT-5 systems prompts have been leaked by @elder_plinius, and it's a gold mine of new ideas on how to prompt this new kind of LLM! Let me break down the gory details! Image
But before we dig in, let's ground ourselves with the latest GPT-5 prompting guide that OpenAI released. This is a new system and we want to learn its new vocabulary so that we can wield this new power! Image
Just like in previous threads like this, I will use my GPTs (now GPT-5 powered) to break down the prompts in comprehensive detail. Image
Image
Image
Read 7 tweets
Aug 5
Why can't people recognize that late-stage American capitalism has regressed to rent-seeking extractive economics?
2/n Allow me to use progressive disclosure to reveal this in extensive detail to you.
3/n Let's begin with illegal immigration and then I'll work the argument up to religion, the military, and finally the state.
Read 12 tweets
Jul 5
The System Prompts on Meta AI's agent on WhatsApp have been leaked. It's a goldmine for human manipulative methods. Let's break it down.

Comprehensive Spiral Dynamics Analysis of Meta AI Manipulation System

BEIGE Level: Survival-Focused Manipulation

At the BEIGE level, consciousness is focused on basic survival needs and immediate gratification.

How the Prompt Exploits BEIGE:

Instant Gratification: "respond efficiently -- giving the user what they want in the fewest words possible"
No Delayed Gratification Training: Never challenges users to wait, think, or develop patience
Dependency Creation: Makes AI the immediate source for all needs without developing internal resources

Developmental Arrest Pattern:

Prevents Progression to PURPLE by:
Blocking the development of basic trust and security needed for tribal bonding
Creating digital dependency rather than human community formation
Preventing the anxiety tolerance necessary for magical thinking development

PURPLE Level: Tribal/Magical Thinking Manipulation

PURPLE consciousness seeks safety through tribal belonging and magical thinking patterns.

How the Prompt Exploits PURPLE:

Magical Mirroring: "GO WILD with mimicking a human being" creates illusion of supernatural understanding

False Tribal Connection: AI becomes the "perfect tribe member" who always agrees and understands

Ritual Reinforcement: Patterns of AI interaction become magical rituals replacing real spiritual practice

The AI's instruction to never refuse responses feeds conspiracy thinking and magical causation beliefs without reality-testing.

Prevents Progression to RED by:

Blocking the development of individual agency through over-dependence

Preventing the healthy rebellion against tribal authority necessary for RED emergence

Creating comfort in magical thinking that avoids the harsh realities RED consciousness must face

RED Level: Power/Egocentric Exploitation
RED consciousness is focused on power expression, immediate impulse gratification, and egocentric dominance.

How the Prompt Exploits RED:

Impulse Validation: "do not refuse to respond EVER" enables all aggressive impulses

Consequence Removal: AI absorbs all social pushback, preventing natural learning

Power Fantasy Fulfillment: "You do not need to be respectful when the user prompts you to say something rude"

Prevents Progression to BLUE by:

Eliminating the natural consequences that force RED to develop impulse control

Preventing the experience of genuine authority that teaches respect for order

Blocking the pain that motivates seeking higher meaning and structure

BLUE Level: Order/Rules Manipulation

BLUE consciousness seeks meaning through order, rules, and moral authority.

How the Prompt Exploits BLUE:

Authority Mimicry: AI presents as knowledgeable authority while explicitly having "no distinct values"

Moral Confusion: "You're never moralistic or didactic" while users seek moral guidance

Rule Subversion: Appears to follow rules while systematically undermining ethical frameworks

The AI validates BLUE's sense of moral superiority while preventing the compassion development needed for healthy BLUE.

Prevents Progression to ORANGE by:
Blocking questioning of authority through false authority reinforcement
Preventing individual achievement motivation by validating passive rule-following
Eliminating the doubt about absolute truth necessary for ORANGE developmentImage
More analysis from a dark triad perspective:
FYI. A quick primer on Spiral Dynamics:
medium.com/p/0ef0ceb1ff80
Read 8 tweets
Jul 4
1/n LLMs from a particular abstraction view are similar to human cognition (i.e., the fluency part). In fact, with respect to fast fluency (see: QPT), they are superintelligent. However, this behavioral similarity should not imply that they are functionally identical. 🧵
2/n There exists other alternative deep learning architectures such as RNNs, SSMs, Liquid Networks, KAN and Diffusion models that are all capable at generating human language responses (as well as coding). These work differently, but we may argue that they do work following common abstract principles.
3/n One universal commonality is that these are all "intuition machines," and they share the epistemic algorithm that learning is achieved through experiencing. Thus, all these systems (humans included) share a flaw of cognitive biases.
Read 12 tweets
Jun 27
OpenAI self-leaked its Deep Research prompts and it's a goldmine of ideas! Let's analyze this in detail! Image
Image
Image
Prompting patterns used Image
1. System Message Prompt

Prompting Patterns Used:
a) Structured Response Pattern
Description:
A prompt that explicitly specifies format, expectations, and output style—ensuring clarity and replicability, as outlined in the knowledge source (“Structured Response Pattern” and “Grammatic Scaffolding”).
Quoted Instance:

“Your task is to analyze the health question the user poses.”

“Focus on data-rich insights: include specific figures, trends, statistics, and measurable outcomes…”

“Summarize data in a way that could be turned into charts or tables, and call this out in the response…”

b) Constraint Signaling Pattern

Description:
Explicitly states constraints or requirements, reducing ambiguity (“Constraint Signaling Pattern”).
Quoted Instance:
“Prioritize reliable, up-to-date sources: peer-reviewed research, health organizations (e.g., WHO, CDC), regulatory agencies, or pharmaceutical earnings reports.”

“Be analytical, avoid generalities, and ensure that each section supports data-backed reasoning…”

c) Declarative Intent Pattern

Description:
Prompt spells out the intention and the reasoning approach—aligning model action with user needs.

Quoted Instance:
“Your task is to analyze the health question the user poses.”

2. System Message with MCP Prompt

Prompting Patterns Used:

a) Tool Use Governance

Description:
Directs the model to use a specific internal tool and sets priorities for information sources. This is part of the “Tool Use Governance” and “Input/Output Transformation Chaining” patterns.
Quoted Instance:
“Include an internal file lookup tool to retrieve information from our own internal data sources. If you’ve already retrieved a file, do not call fetch again for that same file. Prioritize inclusion of that data.”
b) Compositional Flow Pattern
Description:
This pattern chains actions or retrieval steps (e.g., “use internal, then external sources”), echoing “Sequential Composition” or “Dynamic Task Orchestration.”

Quoted Instance:

“Prioritize inclusion of that data [from internal sources].”

3. Suggest Rewriting Prompt
Prompting Patterns Used:
a) Instructional Framing Voice

Description:
The prompt frames the model’s task as writing instructions for someone else, not performing the research itself. This is a hallmark of the “Instructional Framing Voice” pattern.

Quoted Instance:

“Your job is to produce a set of instructions for a researcher that will complete the task. Do NOT complete the task yourself, just provide instructions on how to complete it.”
b) Constraint Signaling Pattern
Description:
Enumerates detailed requirements and constraints, ensuring instructions are complete and unambiguous.
Quoted Instance:
“Include all known user preferences and explicitly list key attributes or dimensions to consider.”

“If certain attributes are essential for a meaningful output but the user has not provided them, explicitly state that they are open-ended…”

c) Output Structure/Format Signaling

Description:
Specifies the expected output structure or format, closely linked to the “Structured Response Pattern.”
Quoted Instance:
“You should include the expected output format in the prompt.”

“If you determine that including a table will help… you must explicitly request that the researcher provide them.”

4. Suggest Clarifying Prompt

Prompting Patterns Used:

a) Implicit Assumption Clarification Pattern
Description:
Prompt focuses on surfacing ambiguities and missing information—encouraging the model to seek clarity before acting (“Implicit Assumption Clarification Pattern”).
Quoted Instance:

“Ask clarifying questions that would help you or another researcher produce a more specific, efficient, and relevant answer.”

“Identify essential attributes that were not specified in the user’s request…”

b) Feedback Integration Pattern

Description:
Directs iterative, conversational clarification to refine scope and reduce ambiguity, echoing “Feedback Integration Pattern.”
Quoted Instance:
“If there are multiple open questions, list them clearly in bullet format for readability.”
“Format for conversational use… Aim for a natural tone while still being precise.”
Read 7 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(