unity-technologies / synthdet Goto Github PK

Currently, the capture package (com.unity.simulation.capture) fix is pinned by changing the dependency lock file. Once the perception package added a new release with this fix, we should remove this pin and update perception package dependency.

Hi, I'm playing around with SynthDet and I want to train a small classification model. Without changing the parameters, this is the example result I'm getting:

I'd like to turn off random hue shift to match as closely as possible training (synthetic) and validation (real) data, how do I do that?

Hi @
Why are SynthDet scripts so heavily loaded with the code, when we can directly use the UnityEngine.Experimental.Perception.*? Is SynthDet a precursor to Perception package?

I believe this tutorial achieves the same : https://github.com/Unity-Technologies/com.unity.perception/tree/master/com.unity.perception/Documentation~/Tutorial

Thanks!

Hi team, I noticed you use torchserve to run inferences

I'm a maintainer on torchserve and we're looking to showcase more how people are using torchserve. So I was wondering if you'd be open to us featuring your project in our repo? I'll send you a draft PR so you can review the wording. Your use case is very informative of how we need to manage our scale out story and work under harsh latency requirements. I've always joked to my friends that a slow game isn't considered a game.

The game dev + ML story is still fragmented today and I'm glad Unity is working so actively to make it saner, so please let me know if you have any feedback or features requests for torchserve so I can make your life easier

In general I'm a big fan of Unity, I've written tutorials about ML agents, ECS and have many Unity tutorials on Youtube https://www.youtube.com/user/marksaroufim/videos

I added my own 3d models as described in CreatingAssets.md. Now I want to change the background images and remove the background objects. I tried setting the BackgroundObjectResourcesDirectory attribute to "" and set the BackgroundImageResourcesDirectory to a folder with some background images inside, but now the background is just blue and there sometimes are also some objects in the background.

Hi

I'm on Win 10 with 2019.4.4f1 Personal. I downloaded the zip file (not cloned by command line) and upgraded the Perception package to Preview 0.2.0 but I have a bunch of errors e.g.

Failed to load 'ProjectSettings/EditorSettings.asset'. File may be corrupted or was serialized with a newer version of Unity.

and a 'Display 1 No cameras rendering' message in the Game view.

Do I need to use 2019.3? Do I also need to clone the package with the command line (e.g. not use the zip file)?

Please let me know if I can provide more info.

Thanks

Hey! Great work there!
I have an issue that I want to generate masks for semantic segmentation image, and output labels like COCO dataset.

I only found how to generate mask photos like above, but cannot generate a proper json file which include the mask information. Can you guys demonstrate it for me? Many thanks to you~

Hi! I was going over the real dataset of groceries and I think some annotations have a wrong label_id.

For instance, image IMG_4188.JPG has 3 annotations, one of them being of label_id: 36, which according to the annotation_definitions.json should correspond to snack_chips_pringles. However, by looking at the image I don't see pringles but a snack_coffeecakes_hostess. The other 2 annotations in this image are fine (cereal_rice_krispies and cereal_korn_flakes). I hope I am not missing anything and I am bothering you guys for nothing, but it might be worth looking into this if it is indeed the case that some labels are wrong. This behaviour repeats for other objects and images, not only IMG_4188.JPG.

I am trying to run the SynthDet simulation in the Unity Editor, but it fails with this error before finishing after about 3775 frames.

System
Ubuntu 18.04

Console logs / stack trace

System.IndexOutOfRangeException: Index {0} is out of range of '{1}' Length.
Thrown from job: ForegroundObjectPlacer.ComputePlacementsJob
This Exception was thrown from a job compiled with Burst, which has limited exception support. Turn off burst (Jobs -> Burst -> Enable Compilation) to inspect full exceptions & stacktraces.

UnityEngine.Debug:Log(Object)
EndSimulationSystem:OnUpdate() (at Assets/Scripts/EndSimulationSystem.cs:26)
Unity.Entities.ComponentSystem:Update() (at Library/PackageCache/[email protected]/Unity.Entities/ComponentSystem.cs:108)
Unity.Entities.ComponentSystemGroup:UpdateAllSystems() (at Library/PackageCache/[email protected]/Unity.Entities/ComponentSystemGroup.cs:134)
Unity.Entities.ComponentSystemGroup:OnUpdate() (at Library/PackageCache/[email protected]/Unity.Entities/ComponentSystemGroup.cs:114)
Unity.Entities.ComponentSystem:Update() (at Library/PackageCache/[email protected]/Unity.Entities/ComponentSystem.cs:108)
Unity.Entities.DummyDelegateWrapper:TriggerUpdate() (at Library/PackageCache/[email protected]/Unity.Entities/ScriptBehaviourUpdateOrder.cs:152)

DC[V]: Application quit
UnityEngine.Debug:Log(Object)
Unity.Simulation.Log:Write(Level, String, Boolean) (at Library/PackageCache/[email protected]/Runtime/Log.cs:80)
Unity.Simulation.Log:V(String, Boolean) (at Library/PackageCache/[email protected]/Runtime/Log.cs:135)
Unity.Simulation.Manager:Update(Single) (at Library/PackageCache/[email protected]/Runtime/Manager.cs:401)
Unity.Simulation.Manager:Shutdown() (at Library/PackageCache/[email protected]/Runtime/Manager.cs:341)
Unity.Simulation.<>c:<.cctor>b__0_0(PlayModeStateChange) (at Library/PackageCache/[email protected]/Editor/ExitPlaymode.cs:17)
UnityEditor.EditorApplication:ExitPlaymode()
EndSimulationSystem:OnUpdate() (at Assets/Scripts/EndSimulationSystem.cs:28)
Unity.Entities.ComponentSystem:Update() (at Library/PackageCache/[email protected]/Unity.Entities/ComponentSystem.cs:108)
Unity.Entities.ComponentSystemGroup:UpdateAllSystems() (at Library/PackageCache/[email protected]/Unity.Entities/ComponentSystemGroup.cs:134)
Unity.Entities.ComponentSystemGroup:OnUpdate() (at Library/PackageCache/[email protected]/Unity.Entities/ComponentSystemGroup.cs:114)
Unity.Entities.ComponentSystem:Update() (at Library/PackageCache/[email protected]/Unity.Entities/ComponentSystem.cs:108)
Unity.Entities.DummyDelegateWrapper:TriggerUpdate() (at Library/PackageCache/[email protected]/Unity.Entities/ScriptBehaviourUpdateOrder.cs:152)

Testing intergration and comment detection

Hi Unity team,

Firstly, thank you for your contributions to the field of synthetic data.

I've added some new features (PBR materials, HDRI lighting, and ray tracing rendering) and recreated this project using Blender.

If anyone has a need, feel free to refer to this repo.