Tsukuyomi Space Agent OS User Guide: From First Login to Yachiyo Age

Agent OS It was an experiment in Tsukuyomi Space on "Web OS + AI Agent + Live2D".
You can understand it as an AI desktop that runs on a web page: opens the application, uses the tool, chats with Yachiyo, even connects the local Agent even further, and turns AI from "talking with you" to "work with you."

This paper will introduce the basic use of Agent OS from scratch.

This is mainly for ordinary users.
If you just want to experience Yachiyo, the music player and the web application, you don't need to do a complete local Agent environment.


What's Agent OS?

Agent OS is based on the existing front end of Tsukuyomi Space, the Live2D system and Yachiyo Live2D Studio About LLM Control Live2D Some Technology explores Web OS pages.

It is not an operating system in the traditional sense, but a web application that is interactive with the desktop operating system.

You'll see something like a computer desktop:

  • Desktop and Application Icon
  • Dragable, Scaled Window
  • Start Menu
  • Task Bar
  • Control.
  • Live2D Yachiyo
  • AI Dialogue
  • Music, weather, browser, notebook, etc.
  • HermesAgent Interface

My goal is not just to put a chat box in a web page, but to try and get AI, roles and applications really exist in the same interactive environment.。

Agent OS has been opened:

👉 Agent OS GitHub repository

The submission of Issue, PR and the various proposals and comments are welcome.


Before starting: Do you need Hermes?

This is the most confusing place for many users who first use Age OS.

In short:

What do I want to do? Do you need Hermes?
Browse Agent OS desktop No need.
Use web application No need.
Talk to Yachiyo on the bottom right. No need.
Let Yachiyo operate the application in Agent OS No need.
Let Agent perform a more complete task Recommendations
Operation of local programs, windows, files, etc. Local / Bridge

So:

If you're just having the first experience of Agent OS, you can completely leave Hermes uninstalled.

Let's play, then we'll decide if we want to get high-level.


1. Access to Agent OS

You can enter Agent OS from the Tsukuyomi Space home page.

The entry points are as follows:

Agent OS entrance

You can also directly access:

👉 Enter Tsukuyomi Space Age OS


2. First entry

The first time you enter Age OS, you need to use your Account registered on the homepage of Tsukuyomi Space Login.

Agent OS uses the same account system as Tsukuyomi Space and therefore does not need to re-register the new account number.

When login is successful, the page enters the first configuration process.

Agent OS first configured guide 1

Continue with the guidance on the page.

Agent OS first configuration guide 2


3. Configure AI models

If you want to use Yachiyo ' s AI dialogue capacity, you need to configure a large, available model API.

Agent OS model configuration

Agent OS uses OpenAI Compatible API Form.

Usually:

  • API URL
  • API Key
  • Model / Model Name

Different API service providers may fill out different addresses and model names, depending on the document provided by the corresponding platform.

can be saved after configuration has been completed.

Agent OS configuration complete

⚠️ About API Key

API Key is essentially similar to the password. Please do not send your own Key screenshot, public release or to anyone else.

If third-party model services are used, it is also recommended to be informed in advance of the counterpart ' s billing and privacy policies.

Once these steps are completed, you can formally enter Agent OS.


4. Simplest play: direct dialogue with Yachiyo

If you don't need the full Agent function, you can actually start using it here.

Agent OS provides a permanent presence at the bottom right corner. Yachiyo table pet。

Yachiyo table pet

You can send messages by clicking on the conversation area next to her.

Unlike the normal AI chat page, Yachiyo in Agent OS is more than just a chat box.

She was able to call the interface provided by the Agent OS application.

For example:

  • Open Application
  • Create Noteboard Contents
  • Use calculator
  • Query weather
  • Open Web
  • View selected page information
  • Open Settings
  • Operation Agent OS Internal Noodles.

So you can just say:

Open my notebook.

Or:

Count 114 x 514.

Alternatively:

Check the weather in Shanghai.

This is also where Agent OS is more interesting than regular chat pages:

AI is not just an answer; it can interact with this web-based world.


5. Progress: Connect Hermes Agent

If you want to further use the real Agent, you need to connect to a local run. Hermes Agent / Hermes Desktop。

Hermes Agent

Hermes Agent is an AI Agent of Nous Research.

You can go to the official page download and install:

👉 Hermes Desktop Page

Currently:

  • Windows
  • macOS
  • Linux

The way the platform is installed.


What can Hermes bring?

Yachiyo on the web page is responsible for:

Controls Agent OS's own web environment.

The local Hermes / Systems Bridge can be connected to further system layer capabilities.

For example:

  • Activate this application
  • Get Current Window
  • Switch Window
  • Execute Shortcuts
  • Enter Text
  • Get Screenshot
  • Access to files in specified directory
  • Implement authorized system operations

So the whole relationship basically becomes:

text
你
 ↓
Agent OS
 ↓
八千代 / Hermes Agent
 ↓
本地 System Bridge
 ↓
Windows / 文件 / 应用

At this point, Agent OS is no longer just a "page that looks like an operating system."

It started to be... The control boundary between AI and its own environment Noodles.。


🔐 On System Permissions

When it comes to this operation, pay attention to the issue of privileges.

Agent OS has introduced additional restrictions on some hazardous capabilities, such as document writing and Shell, which can be controlled independently.

If you just experience:

Do not open all system privileges at will for the sake of “more functionality”.

Just open up what you really need.


6. Application in Age OS is really useful

App on the desktop is not a "fake icon" made simply for good-looking.

Many of these applications are functional.

For example:

  • Music
  • Notebook
  • Calculator
  • Weather
  • 🌐 Browser
  • Clock
  • Settings
  • 🤖 Hermes

In which the music App can connect services such as web-enabled music, QQQ music, get your own list and play it.

In the music section, reference is made to and the projects of the big man in the paper are used:

👉 firefly20041001/yachiyo

Here again, thanks go to the original author for his open source work.


Live2D is not just decoration.

Live2D Yachiyo in Age OS is not just a role model on the desktop.

Agent OS inherited part of it. Yachiyo Live2D Studio The design idea:

text
用户输入
   ↓
LLM
   ↓
回复内容 + 情绪 + 语义动作
   ↓
Agent OS
   ↓
Live2D 行为控制

For example, models can express:

text
happy
smile
look_at_chat
head_tilt

And then the Live2D control layer converts these semantic actions into real role actions.

The purpose of this is to allow Yachiyo ' s actions to be as relevant as possible to what is being said, rather than simply shaking his head and blinking.

That's what I was at:

👉 Yachiyo Live2D Studio

I've been exploring the direction.


8. Recommended sequence of new hands experience

If for the first time you open Agent OS, I would recommend the following sequence:

text
① 登录月读空间账号

        ↓

② 完成模型 API 配置

        ↓

③ 先体验 Agent OS 桌面

        ↓

④ 和右下角八千代聊天

        ↓

⑤ 尝试让她打开应用、计算、查询天气

        ↓

⑥ 体验音乐等桌面 App

        ↓

⑦ 对 Agent 功能感兴趣后

        ↓

⑧ 再安装 Hermes Desktop

        ↓

⑨ 尝试本机 Agent 能力

There is no need to configure everything when the page is opened for the first time.

First experience, then shit.


9. Common issues

Q: No Hermes, can you use Age OS?

Yes.

Both desktops, applications, Live2D and the AI interface on the Yachiyo web page can be experienced independently.

Configure Hermes if more complete Agent and in-house controls are needed.


Q: Why can Yachiyo operate a web application?

Some applications in Agent OS will expose specific operational interfaces to AI.

Yachiyo can request these interfaces in your natural language.

It is simply understood that:

text
“帮我打开记事本”
        ↓
       LLM
        ↓
识别为「打开记事本」
        ↓
调用 Agent OS 的应用接口
        ↓
打开记事本

So she didn't do it by Simulating Mouse Breakpoint.


Q: Can Agent OS control my computer?

The web page itself does not allow access to computer system controls in a vacuum.

Local Agent / Systems Bridge needs to be run, with a user-driven counterpart.


API?

Currently Agent OS is more like an open experimental platform, so the AI model is user-configured.

So you can choose different models according to your needs, instead of binding a model service.


Q:Agent OS is a complete operating system?

Nope.

It's still essentially Web application.

“OS” represents more of an interactive approach to desktop operating systems and attempts to:

text
AI
+
Agent
+
Live2D
+
网页应用
+
本地系统能力

Integration into the same environment.


10. Why did you do it?

There are now a lot of very mature AI chat products.

So if just do one more:

text
左边历史记录
+
中间聊天框
+
右下角发送按钮

It doesn't seem to mean much to me.

I'd rather try another thing:

What if AI is no longer just a chat box in a web page, but a real "life" in a digital space?

So there's now Agent OS.

Yachiyo can be on the desktop.

There are really usable applications on the desktop.

AI understands these applications.

Agent can further connect to the computer.

Live2D can generate action based on the emotions and semantics of AI.

These functions are far from ripe for the moment, but for me this is an interesting attempt.


11. Open-source projects and thanks

Agent OS has many functions that are inseparable from open source communities.

Related items:

Thanks to authors and contributors to all open source projects.


12. Final

Agent OS is still in a state of constant renewal.

I will continue to optimize:

  • Page Performance
  • Live2D Interactive
  • Agent Capabilities
  • Apply connection
  • Move End Experience
  • AI Control capacity for applications
  • Yachiyo's interactive approach
  • More interesting little features.

I hope it wasn't just one:

"Looks like the web page of the operating system."

And it really turns into one:

A small space to connect AI, role, application and personal digital life.

If you meet Bug in the process, or have some strange but interesting ideas, you're welcome to mention Issue or Message at GitHub.

Tsukuyomi Space is growing up.

Thank you for coming.


🎬Agent OS presentation video

If you don't want to look at such a long curriculum, you can look at the actual results:

Station B video