UE Plugin HumanOkGeneratorMesh

●Link

1.  Demo video               YouTube

2.  Plugins Ue5.0-Ue5.5Fab

 

●Credits for plugin

●Features of plugin

1.  1 to 3 images to generate a 3d head model

2.  Image generation 3d hair

3.  Random generate

4.  Export the generated 3d model to a local disk

5.  Load the generated 3d model from a local disk

6.  Import Images

7.  Albedo texture generation

8.  Complete texture using diffusion model(To be developed)

9.  Support cartoon style input(To be developed)

10.  Generate hair from multiple images(To be developed)

11.  Generate 3d model from text(To be developed)

●Conditions for plugins

1.  You need to buy the right to use the plugin

●Blueprint node

1.  GenerateInit:  Initialize plugins and create plugin object

 

2.  LoadImages:  Import JPG/PNG images from local disk

 

3.  GenerateByImage:  Generate a model from a Texture2D * array containing facial information from various angles (up to 3 images)

 

Input
	Target	UObject	Plugin object
	Images	TArray<Texture2D*>	Texture2D* array containing facial information input
	RequestSetting		Set request parameters SymmetryType int32 Whether to generate a symmetric model about the X-axis, 0 asymmetry, 1 symmetry UseSmooth int32 Whether to generate a smooth model, 0 smooth, 1 detail model KeepMouth int32 Whether to keep the mouth shape, 0 keep, 1 the mouth closed HaveBrow int32 Whether the texture has eyebrows, 0 with, 1 without eyebrows FillType int32 Fill the map type, which will be canceled when the diffusion model comes out AlbedoType int32 Albedo texture, 0 disable, 1 albedo, 2 raw WithHair int32 Hair density, 0 bald, 1 sparse, 2 normal, 3 thick
Output
	Proccess Message	FString	Current generation progress
	Return Message	FString	Server return message
	Return Success	Bool	Whether the current generation was successful
	Return Result		Current generated result Textures TMap<FString, UTexture2D*> The generated texture, input the Key to obtain the corresponding texture, where the Key includes {"headColor", "headNormal", "hairColor", "hairNormal", "eyeColorL", "eyeColorR"}, etc Meshs TMap<FString, FHGMeshData> The generated model, input the Key to obtain the corresponding model, where the Key contains {"hairObj",  “headObj”, ”eyeObjL”, “eyeObjR”}, etc

4.  FileExport:  Export generated 3d model resources from engine memory to local disk

 

Input
	Target	UObject	Plugin object
	Path	FString	Need to save the absolute path of model resources on the local disk
Output

5.  FileLoad, GenerateByFile:  Runtime import of models into the engine from the save path of ExportFile, Two nodes implement local import, Or you can create a LoadFileResult struct, And implementing network loading through FileGenerate node, It's no longer local

 

Input
LoadFile	Path		Need to load the absolute path of model resources on the local disk
FileGenrate	LoadFileResult		FHOGBinaryData TArray<uint8> File binary data, You can use Ue's own function FFileHelper::LoadFileToArray() to load the file, And get TArray<uint8> TextureFiles TMap<FString, FHOGBinaryData> Texture name, Texture binary data ObjFiles TMap<FString, FString> Obj name, Obj str data FbxFiles TMap<FString, FHOGBinaryData> Fbx name, Fbx binary data, It can be empty MtlFiles TMap<FString, FString> Mtl name, Mtl str data, It can be empty
	Other		Same parameters as above

6.  GenrateStop:  Stop generation

 

7.  GenerateByRandom:  Random generate

 

Input
	RequestSetting		SymmetryType int32 Whether to generate a symmetric model about the X-axis, 0 asymmetry, 1 symmetry HaveBrow int32 Whether the texture has eyebrows, 0 with, 1 without eyebrows Gender int32 0, 1 TopModel int32 0, 1, 2, 3
	Other		Same parameters as above

●Demo

1.  CreateMesh function

 

2.  Generate 3D face by images

 

3.  See more details