Handing Blender to an AI Agent: A New Division of Labor in 3D Work

KANA writes (in Japanese) that handing Blender over to Opus 5.5 wholesale usually stops at "looks about right," and promises to share everything that helped push the result further ¹. Here is that tutorial, plus a few posts about the tools around AI agents, read together with the official documentation of the tools involved.

Most numbers and impressions come from the creators themselves, so they are attributed to them rather than stated as fact.

Past "looks about right": KANA's tricks

KANA published a tutorial of about 6 minutes made with Claude Opus 5.5 and Blender 5.1 EEVEE ².

The creator writes (in Japanese) that handing Blender to Opus 5.5 usually stops at "looks about right" ¹. As what helped from there, the creator lists:

• Show the AI its own render and have it measure the result in numbers [[C71]]
• Have the scoring done by a different AI that did not make it [[C72]]
• Have it look up how fallen leaves really fall [[C73]]
• Do not paint the dappled sunlight; project the shadows of the trees instead [[C74]]

The interesting part is the split of roles: one AI builds, another one judges. "Looks right" is replaced by yardsticks: numbers and real-world behavior. And projecting tree shadows rather than drawing light is a very CG way to think.

Blender is released under the GNU General Public License ³.

Image to model, motion in Blender, finish in AE: AI Studio One Room

The next example is a video made without any video generation AI.

The creator behind @studio_oneroom (the name translates as "AI Studio One Room") writes (in Japanese) that this video used no video generation AI at all ⁴. The process: turn an image into 3D with Tripo, bring it into Blender and add motion, then add text and effects in After Effects (AE) ⁵. The creator says most of that work was done by Opus 5.5 ⁶. The creator also asks whether this can be called "full CG," a question we leave open ⁷.

What the creator stresses is that every step can be fine-tuned, and that you can build a little at a time, telling Opus 5.5 what to change ⁸.

To be fair, the creator's own assessment matters too. Because the approach gives so much freedom, the result depends on the maker's skill and taste, and for now the creator thinks generative AI can produce better-looking video ⁹.

On the tools: Tripo runs entirely in the browser with nothing to install ¹⁰. The free tier on the pricing page reads "Public Models · Non-Commercial Use" ¹¹; check the plan terms before any commercial use. After Effects publishes system requirements for Windows and macOS ^{12 13}.

When you want to hand-draw a touch onto a scene, a pen tablet is a natural companion.

A library of expressions for your agent: NANKA DEKIRU

The creator behind the @boke_ai account announced NANKA DEKIRU, a library of expressions that can be used with Claude Code or Codex ¹⁴. It collects video expressions, motion and editing, with a feature to pick the expression you want and copy-paste it to your agent, according to the post ¹⁵.

When you are not sure what to ask an agent for, choosing from samples is a handy idea. It is released free of charge ¹⁶.

Adding guardrails to an agent: Mordred

Leona's post introduces Mordred. According to the post, it is a plugin that adds encryption, communication settings, and limits on tool use to the Hermes agent ¹⁷. The post also says you can install it just by telling the chat, in Japanese, to install Mordred ¹⁸.

Here is what the primary sources confirm. Mordred is under the MIT license ¹⁹. It requires macOS or Linux, and Windows and mobile support are deferred ²⁰. Hermes Agent is under the MIT license ²¹ and supports Windows natively ²². NVIDIA has also announced that OpenShell and Microsoft's security primitives will be integrated into Hermes Agent's new Windows application ²³. That is a plan, and worth watching as one.

If you want to do this at your own desk

These examples suggest what you would want in a machine.

According to NVIDIA, RTX Spark offers up to 128 GB of unified memory that handles 3D scenes up to 90 GB ²⁴. NVIDIA also says that running locally gives you instant iteration and data that stays on your machine ²⁵.

Blender itself is compatible with Windows on Arm ²⁶. NVIDIA has announced that Blender is adding DLSS 4.5 Ray Reconstruction, arriving this fall with RTX Spark ²⁷. NVIDIA's Japanese blog says it is planned for Blender 5.3 ²⁸. These are plans. KANA's example used Blender 5.1 ², so read it as separate from the planned feature ²⁸.

Cautions. Claude Opus 5.5 is officially offered in Claude's own products and through cloud platforms such as the Claude Platform and Amazon Web Services ²⁹. And for After Effects on Windows on Arm, Adobe's requirements list only the Qualcomm Snapdragon X series ³⁰. Adobe's official requirements are the place to check After Effects support on a given machine.

If you are considering an RTX Spark machine, check the official supported environments of the tools you want to run first. Here are some RTX Spark machines (some are announced or on pre-order).

When project files pile up, a portable SSD lets you carry or back up a project.

Read next

For the audio side, see the YuE2 music article. For images, video and music made with local models, see the article on images, video and music made at home. Start from 3D and look for combinations you can wire together on a single machine.