We're going to do
- create an avatar with VRoid Studio
- use Blender to fix up the model
- finish with Unity and upload to VRChat
VRoid Studio related
- VRoid Studio: https://vroid.com/en/studio I have it installed through Steam.
- Booth: https://booth.pm/en Online marketplace for several kinds of goods, but lots of things for VRoid.
- HP4VR: https://booth.pm/en/items/2939379 This software merges VRoid hair presets.
- Blender 2.83: https://www.blender.org/download/lts/ Cats works with a few verisons, this has been ok to me.
- Cats: https://github.com/GiveMeAllYourCats/cats-blender-plugin Blender plugin that can automatically apply fixes to popular model types.
- VRM addon: https://github.com/saturday06/VRM_Addon_for_Blender Blender plugin so it knows how to VRM.
- Unity hub: https://unity3d.com/get-unity/download Makes it easy to manage Unity projects.
- Unity 2018.4.20: https://unity3d.com/unity/qa/lts-releases?version=2018.4 Check the VRChat docs to make sure this is still the current supported version.
- VRCSDK3 for avatars: https://vrchat.com/home/download You'll have to log in to download.
- Dynamic bones: https://assetstore.unity.com/packages/tools/animation/dynamic-bone-16743 This addon makes the bone wiggles.
- VRM converter: https://pokemori.booth.pm/items/1025226 This addon teaches Unity how to VRM.
- Pumpkin's avatar tools: https://github.com/rurre/PumkinsAvatarTools This addon makes setting up avatars easy.
- VRChat editor: https://gatosyocora.booth.pm/items/1258744 This addon makes setting up face expressions easy.
How to VRoid
- Face Editor
- Hair Editor
- Body Editor
- Clothing Editor
- General Editor
Design: Use the sliders to shape the head and face. - Nothing crazy here, just a lot of sliders to work through.
Expression: Use the sliders to adjust the eyes, mouth, and eyebrows. - Expressions with open mouths usually result in jaw and chin clipping when talking. You'll want to adjust them. - The default BLINK value usually results in clipping eyelids. You'll want to adjust that. - After adjusting BLINK, take that adjusted Closed value and apply it to BLINK_R and BLINK_L to the closed eye. - If the NEUTRAL expression has the eyes closed at all, that value will need added in BLINK_R and BLINK_L as well.
Texture: Import and edit face and eye textures. - Search 'vroid' on Booth for textures. - All outfits share the same face, so give layers good names and toggle transparancy on textures you're not using.
Design: Load and save presets, and edit hair. - By default, presets are located here: C:\Users\YOUR USER\AppData\LocalLow\pixiv\VRoidStudio\hair_presets - To add a downloaded preset, put the acquired 'preset##' folder into that Windows folder. Folders have to be named in that fashion. - To edit the preset name, open preset.json in the preset## folder. Searching for 'preset' or 'プリセット' should find it.
Bone: Makes the hair wiggle.
Texture: Import and edit hair textures.
People use the hair tool to make accessories use HP4VR to merge them with another hair preset (or merge two hairs together, whatever) hpvr will find your hair_presets and expects accessories to be in the folder with the program by default you can change and edit the color of the hair and set them to use same or different materials mine is personally a mess and i'm not sure how to clean it up selecting the hair by group doesn't seem to always change the textures on all the children so i just click each hair one by one to check after setting them all minimize the bone usage and save as hair different preset, use full one for export to vroidhub and fewer bones for vr
Design: Use the sliders to shape the body.
Texture: Import and edit body textures.
use ur program of choice to crop out bodyparts that might clip thru clothes will link with outfit default sized hands, thin fingers
Design: Load presets, select clothing and shoes, and use sliders to adjust shape.
Texture: Import and edit clothing textures.
you make outfits into a single slot and can switch between them after that the body textures will change along with the outfit similar to within the outfits, when you make a clothing piece, you can use it again later i dont know how to rename clothing presets or clothing items just be sure to go thru the clothes and delete duplicates and stuff so the list isnt too longer when moving to the shoes section for the first time, it tends to show the names of the tops theyre associated with instead of the names of the shoes going to another section and back a few times seems to fix it
adjust lighting if you want in the general area, i dont know how this affects stuff in unity later, but its probably obvious i just haven't bothered, i built my vroid with no lights, no outline
Pose & Animation: Test movement of hair bones and check for body and clothes clipping.
Export: Export your model in VRM format.
check option to delete transparent meshes, leave the sliders alone export with 8 textures, 4k rez (wish there was like 4 textures version, if you know what ur doing you can remap this stuff to fewer textures) save vrm file somewhere, note a vrm cannot be edited in vroid studio again, one way process not a big deal though, just save and keep a backup of your vroidstudio file
How to Blender
- install blender and addons
- cats: import vrm and fix model
- cats: eye tracking and visemes
- rotate legs
- maybe remap textures
install blender and addons
install 2.83 import / enable cats and vrm addon Edit > Preferences > Add-ons > Install... pick the zip file to bring it in there's a pull down you can use to pick just user add-ons to make them easier to find check the boxes to enable them press N or click the TINY arrow tab towards the top right by the compass to see the menu with cats it pops out to the side
cats: import vrm and fix model
in CATS > Import Model, and import your vrm in CATS > click the wrench next to fix model, uncheck Combine Same Materials, click OK, then Fix Model that will get rid of unused bones on clothing mesh thats been disabled, combine the mesh pieces, auto switch the view so you can see the texture. it won't look perfect, thats okay sometimes cats will crash here (and at many other points), more so if you've done anything else to the file before pushing the buttons it seems to just expect very specific things
cats: eye tracking and visemes
in CATS > open Eye Tracking Head and eyes should autofill. if not fix them for blink left and right select close l and close rad ignore lowerlid. if your model did have shapes for the lower lid, you can put them here. otherwise leave at basis i like to change eye movment range to 1.0 (from .8) click Create Eye Tracking, it should think and make it happen Click Start Eye Testing and use the sliders to test it out in CATS > open Visemes for AA i pick MTH_A, OH - MTH_O, CH - MTH_I click Create Visemes, it will just say at the bottom of the blender window that it did it, nothing else really happens this will make a set of all the needed visemes for vrchat and similar programs cause vroids only have AEIOU (there's like 20 visemes) you can play with using different shapes, i assume it uses those three and the shape key mix intensity number to generate the other ones. they're mostly not accurate to the sound they should be making, but the primary vowels are (you can OOO and AAA with some accuracy)
the vroid model by default is probably too straight up and down for vrchats auto ik to figure out how to move the joints scooting the joints in the right direction lets it know what to do in CATS > Start Pose Mode click right thigh (its called leg) (need to double check, but basically, you want to gently rotate the leg out to the side, up to the front, and rotated out. you may also get this working by moving the location of the legs out a bit. if you know what you're doing, this is probably no brainer stuff. hitting just the letter is kidna different than shift letter. im not sure how or if it matters which way you select the direction to go. again, i know how to make it work, not what i'm doingS) R shift X 5- enter R shift Y 5 enter R shift Z 5- enter (i tried using 1deg, but that didn't seem to be enough to fix the knee issue. 5 seems okay if a little big. the minuses might be wrong depending on what leg youre doing, just make sure its going the right way and if it's not, hit minus) right click copy pose, right click other leg and paste x flipped pose click right shin (its called knee) (here you just need the leg to bend backwards the correct direction) r shift X 5 enter on both (or copy paste x flipped pose) in CATS > Apply as Rest Pose
maybe remap textures
you may have to adjust what parts of the textures are on what materials to make sure transparancy and cutouts are correct in unity later for example, vroid exports the eye texture on the same texture as the face and mouth. normally, cutout is fine for the face, mouth, and eyes but i was using an eye with a soft edge. i needed to move the eye mesh texture target to another texture that would be using the same transparancy mode. in this case, i moved the eye texture in with the same material as the lower eyelashes in edit mode, and with face select on drill down to the body, and its probalby hair001 (merged) (cause it merged all the meshes into the hair) in the checkboard sphere tab, and the uv editing section, using ctrl+ to select the eyes, picking the faceeyelash instance and assign button it deselect and select and it should show what was moved im still at the point where im usually moving them all over instead of just the eyes i can't tell you exactly what to do here cause i honestly dont know myself i'll eventually write it down
in CATS > Export Model Contine to Export when it complains about having too many textures Save it somewhere, don't change any of the other settings. using the cats button to export will set them correctly
How to Unity
- install, import addons, log into vrchat sdk
- import vrm, convert for vrchat, check/fix materials
- import fbx, humanoid rig, apply materials, add to scene
- pumpkins to copy all settings to fbx from converted vrm, set view point, tpose
- vrctools to set gender, adjust order of emotes, make more expressions, test blend shapes
- set up dynamic bones
- upload, use pumpkins to pose or use image
install, import addons, log into vrchat sdk
you probably dont need unity hub, but it makes it easy to manage projects make a new 2018.4.20 project (or current required version), default settings is good import all those unity packages (vrcsdk, vrm tools, pumpkins, vrctools, dynamicbones) log into vrchat sdk, itll need ur 2factor and you need to be at least new user (i think, i'm user atm) save the project, and then save a backup of this clean project with just the logged in sdk and tools for later when ur project is a mess and you want to start over
import vrm, convert for vrchat, check/fix materials
use vrm tools to import the vrm from the first steps select the vrm in the inventory and pick option to convert for vrchat in vrm tools some option about shape normals, i check it, idk what it is i leave the option of suprised in there uncheck any quest options you can use the imbeded dynamic bone values if you want, pick in the pull down the values from the vrm are WAY jiggly tho, you'll probably want to change at least the boobs if you copy the dynamic bones, it'll make a new component of the avatar that holds all the details normally we put the script in the bone we're dealing with itll automatically put a copy of the av in the scene but we wont be using it, but dont delete yet (you could actually upload it at this point, but it will be meh) it will make anims for expressions (joy, fun, anger, sorrow, suprise), but mine always calls suprise Unknown, you can edit that it will make the gesture controller things for it and put them in the right spot on the descriptor get rid of one of the extra sets of materials so you dont mix them up ive done more than once inspect materials, itll use mtoon and make sure cutout/transparancy/opaque and face culling is correct copy the first texture into the emmission section, adjust the HDR white color to something darker to be less full bright check out textures, i've been changing the fitlering from michael something to bilinear, 4k size, high quality compression, check crunch and leave slider as is all the solid color textures (rim lights, matcaps) i set to minimum size, leave the filtering the same in the materials is where you would fix the tints and rim lighting and matcaps and stuff but like i said i havent messed with this yet
import fbx, humanoid rig, apply materials, add to scene
import the fbx set the rig to humanoid, ignore errors after applying, configure, check out the head, most likely will need to set the jaw to NONE cause vroid uses blendshapes/visemes no jaw bone and unity tries to guess and will often stick a hair bone in there or duplicate an eye bone in there look over the rest of the bones, its normally okay but sometimes its weird if you kept the upper chest bone there are sliders to test it, but these dont reflect what vrchats locomotion/inverse kinematics/idk do to your joints. thats why we did the little rotates in blender, so it knows what direction to move ur hips/knees. without that change, the knees point in by default i think cause of the small hips on the material tab, drag the set of mats ur using to the spaces and apply drag a copy of the fbx into the scene, move the location forward a bit
pumpkins to copy all settings to fbx from converted vrm, set view point, tpose
use pumpkins to copy all the stuff from the vrm avatar to the fbx, really its for the descriptor and it can be done manually but that should put the FX and expression menus in the right spots after doing that, you can remove the vrm model from the scene if it doesnt, you drag the sitting and standing anims from the vrchat folder to the fbx's descriptor continue to use the same set of FX and expression menus if your face mesh blend shapes haven't changed between avatars use pumpkins to auto set the eye height, tpose
vrctools to set gender, adjust order of emotes, make more expressions, test blend shapes
sdk2 has a gender picker for anims, thats not in the sdk3 layout? but using vrctools you can edit it it controls default animation set, but i dont think sdk3 avs have gendered walks? idk vrctools makes it easy to check the face emotes and what hand gesture they're assigned to create new emotes as well you can set the default emotion here or manually on the body element of the fbx with the skinned mesh renderer part
set up dynamic bones
drill down in the fbx's tree in the scene get to the highest boob bone and select it, it should show its info hit button to add component, add dynamic bone enter the numbers you want and check distant disable drag the boob bone into the top space hit the gear to copy component, click the other boob, paste component as new drag the correct bone into the new top space drill down to the head, eyes and hairbones should be under there make a new component, at the bottom an option for exclustions, change the 0 to 4 drag the 4 eye bones into those slots drag the head bone into the top slot adjust the values as wanted same with clothes bones you wanna move cats fixing might get rid of a few too many bones on clothes like the hood on the hoodie, it doesnt seem to wiggle right? can probably just manually merge bones in cats instead of doing it automatically but something else i need to mess with can test by hitting play, swapping back to the scene, and moving the av around from the root boneBONE VALUES I FOUND ONLINE BUT U CAN MAKE UP YOUR OWN
|Boobs||0.2||0.1||0.8||0.5||0.006||End Offset: (-0.1,-0.1,0.3)|
upload, use pumpkins to pose or use image
before uploading, fix any issues the vrcsdk menu brings up ignore the thing about the lights at the top, maybe if your computer is bad several of the issues can just be fixed by hitting the fix button the one about shader keywords, check the boxes and remove they keywords or dont, idk how much it matters or how much you may need them depending on your matcaps rimlights and stuff using pumpkin tools, you can add an overlay, a background, adjust the position of the camera, adjust your pose, adjust your face expression. once you have it how you like, you can save it as a preset. optional tho if you don't care ur dude is tposed or just upload a solid image as an overlay put in the name and info and check the boxes and upload with sdk3, you can save some time testing by choosing to test locally. sdk2 didn't have that option and u had to wait the whole time every change. in the vrcsdk window, there is a tab to show your uploads you can delete avatars and copy the ID of them to paste into the pipeline manager option to keep them related if you want to update a public avatar without breaking the link ppl already have favorited to it