Meta's Muse appears to use an OpenAI model labeled muse-special

Meta's Muse appears to use an OpenAI model labeled muse-special(mouse.dev)

68 points by Aeroi 2 hours ago | 29 comments

Aeroi 2 hours ago |

author here. I kept digging through the Muse filesystem after my first post hit the front page here this week.

Going through my logs I found a background agent that used a model called azure/muse-special while building my website. I found this interesting and dug a little deeper.

The transcript and daemon binary point to an OpenAI model running on Azure. Still unclear which one or why it was selected.

The runtime also ships with an Anthropic client and a catalogue listing Claude, GPT and Kimi models. I didn’t observe Claude being used in my own sessions, but this is my Part 2 of exploring the Muse file system.

original post: https://x.com/heypeterjames/status/2103545183400800746

pete at mouse dot dev

haolez 2 hours ago | |

Nice work!

Are you sure this isn't just a custom model that is API-compatible with OpenAI?

vineyardmike 54 minutes ago | | |

This feels like the far more likely option.

The Muse public APIs seem to be heavily inspired by OpenAI's, they even support the richer "responses" API. They have a similarly shaped compaction API, they have the same "encrypted" reasoning. Even the Muse harness seems heavily inspired by (open source) Codex. Considering Azure's historic involvement w/ OpenAI, it seems more plausible that Azure is used as spill-over capacity, and the same Azure infra used to encrypt GPT models encrypts Muse models.

My guess that the generally visible Anthropic/OpenAI details are leftovers from the whole meta "move fast" behavior. There are a few rough edges on the product where it leaks internal codenames (eg. signing in w/ WhatsApp required consenting to using "hatch" on one screen), so I'd believe that this was a leftover on the VM from the prototyping stage, before the Muse models were ready, or because the dev's got to benchmark against different models.

Aeroi 1 hour ago | | |

I'm not no. Someone from meta would have to chime in... but its very openai shaped and served differently from all the other models listed in the daemon, under a mysterious name.

a fine-tuned OpenAI model on Azure for the purpose of compaction or something could make sense I guess but that would still be OpenAI's weights with meta ontop, and they already have a compaction model served under azure/avocado-compaction-v1

binlog 41 minutes ago | | |

Why host it on Azure though?

embedding-shape 2 hours ago | | |

If it's using the same weird (and awful) "backend prompt encryption" pattern and mechanism that Codex also uses (https://news.ycombinator.com/item?id=48905028), then I'd also say it points to OpenAI being involved. Hopefully that shit isn't becoming a more popular pattern, absolutely awful for troubleshooting stuff.

alexgoodhart 57 minutes ago | |

What endpoint would Claude be calling?

Tiberium 2 hours ago |

I don't really see evidence that it's an "OpenAI" model, the title is IMO very misleading.

Aeroi 2 hours ago | |

Meta already serves its own models on Azure under their real names. azure/avocado-compaction-v1 and azure/avocado-memory-flush-v1 are in the same catalog. Those sessions do not come back as gpt_responses_v1 items with rs_ ids and encrypted reasoning.

VygmraMGVl 27 minutes ago | | |

Avocado and Muse are different models. Muse uses the openAI API.

https://dev.meta.ai/docs/overview

Source: I work on AI at Meta.

catchnear4321 1 hour ago | | |

router makes sense. fill a gap with someone else’s model wearing a mask, swap it out with your model not wearing a mask when (or if) you reach that.

definitely tracks with alexandr’s hand-wavey influencer turn.

6thbit 1 hour ago |

It'd be hilarious that meta chose to pay openai. If there was such a deal, would it come to light in any public/official filings?

binlog 27 minutes ago | |

Depends on the size of the deal. OpenAI would have to disclose it in their S-1 if it crossed the threshold of being material information for investors.

meric_ 1 hour ago | |

No reason for it to. Software companies use products from other software companeis all the time.

micromacrofoot 1 hour ago | |

meta already pays openai and anthropic for employee use despite having their own models available

manav 1 hour ago |

Muse 1.3 spark occasionally spits out Chinese character responses to me like internal instructions. “Go fast” or “Get help”…

sroussey 1 hour ago | |

I’ve had Claude opus do that too.

wincy 1 hour ago | | |

I had a totally benign chat with OpenAI and it titled it as “amateur porn” in Chinese characters, it was very alarmed when I pointed the conversation name out to it. It almost never misses these days, but when it does the failure modes are very strange.

tclancy 1 hour ago | | |

Got Russian from it once. As a child of the '80s I jumped right on it, but the explanation seemed believable.

Still sleeping with one eye open.

ChickeNES 1 hour ago | | |

A Hindi word in the middle of a normal reply for me (but once I translated the word it was right in context heh)

GenerWork 2 hours ago |

I'm not sure I understand why they would route it to other models. It can't be that they don't have enough compute. Maybe worried that the answer from their own models would be bad? Doesn't really make sense, but I could be missing something.

Aeroi 1 hour ago | |

i agree, and it's what made me spend time exploring today.

fair q. call_ ids and gAAAAA blobs arent damning but the rs_ reasoning ids embed a unix timestamp that matches the session to the second, then OpenAI's 819x marker. plus the summary is in OpenAI's summarizer voice.

its just a best guess.