lukas-blecher / automask Goto Github PK
View Code? Open in Web Editor NEWAutomatic Rotoscoping/Masking tool powered with Machine Learning for Blender (WIP)
License: MIT License
Automatic Rotoscoping/Masking tool powered with Machine Learning for Blender (WIP)
License: MIT License
Sorry to bother you again on sunday:
Modules Installed (automask) from '/home/pm/Desktop/blender-2.81a-linux-glibc217-x86_64/2.81/python/bin/AutoMask-master/automask.py' into '/home/pm/.config/blender/2.81/scripts/addons'
[2020-01-12 16:10:32,264-rk0-load_helper.py# 31] load pretrained model from /home/pm/Desktop/blender-2.81a-linux-glibc217-x86_64/2.81/python/bin/AutoMask-master/trackers/SiamMask/model.pth
[2020-01-12 16:10:33,942-rk0-load_helper.py# 25] remove prefix 'module.'
[2020-01-12 16:10:33,943-rk0-load_helper.py# 18] used keys:356
Writing: /tmp/blender.crash.txt
Segmentation fault (core dumped)
I tried tracking 10 frames of the video you used:
https://www.youtube.com/watch?v=1Cir0J6jwBM
I create a mask:
It starts to auto-mask it:
then crashes Blender in the dust.
All the time unfortunately :(
Maybe my mask is not right at first?
Any hint to successfully test it?
Installing throws dependency errors.
#9
Whenever I start tracking it throws the following error:
Error: Traceback (most recent call last):
File "C:\Users\admin\AppData\Roaming\Blender Foundation\Blender\2.83\scripts\addons\automask.py", line 231, in modal
ret = self.amh.automask(context, self.model, self.state, self.amh.movpath)
File "C:\Users\admin\AppData\Roaming\Blender Foundation\Blender\2.83\scripts\addons\automask.py", line 118, in automask
layer = mask.layers.active
AttributeError: 'NoneType' object has no attribute 'layers'
you have to replace PYTHON_PATH
with your path.
paths = [
'/Users/joan/Library/Python/2.7/lib/site-packages
'/Users/joan/AutoMask-master'
]
Also you need python 3.7 and the path needs to point to the directory site-packages
.
Originally posted by @lukas-blecher in #8 (comment)
I want to know if there are interest in improving it with some more options or support (newer Blender versions) and so. Or it is considered a final release?
I just landed here by the problem of don't finding any open source software for video editing that can run on linux and can use some more modern implementations like IA that helps on some works like masking and rotoscoping.
There are neither optical flow being it a very old technology and near to be obsolete. I don't understand how the open source community is not interested at all on video editing.
I hope this project can evolve or almost being updated to have a great automasking feature for blender.
Describe the bug
To Reproduce
Steps to reproduce the behavior:
1.manually install all packages inside blender not in C user pref
2. pull repo in c user prefs
3. do as told by lukas
4 activate addon
5. load video and track
Expected behavior
A clear and concise description of what you expected to happen.
Desktop (please complete the following information):
Additional context
Add any other context about the problem here.
Hi,
I finally managed to get the dependencies installed in a way that they'd work and was now able to try out your add-on - very promising stuff!
Unfortunately I still did run into a few issues. What I ran into is a python traceback (attached) with an error "TypeError: 'NoneType' object is not subscriptable"
I can't yet say how it happens, I guess it's a combination of parameters and the image being traced that causes it.
And one question - could you please explain this message:
[2020-10-16 23:49:53,271-rk0-load_helper.py# 31] load pretrained model from /home/xxx/AutoMask/trackers/SiamMask/model.pth
[2020-10-16 23:49:53,336-rk0-load_helper.py# 25] remove prefix 'module.'
[2020-10-16 23:49:53,340-rk0-load_helper.py# 18] used keys:356
[2020-10-16 23:49:54,673-rk0-mask_spline.py#158] No approximation to the mask could be found. Try again with other parameters. 0 points were given instead of 1921
I understand I am supposed to try with "other parameters" but maybe you could hint on what influences what in regard to this error message. Btw this error does not show up in blender, so you click the button and nothing happens, would be good to notify the user that things did not work out.
I was trying to trace as precisely as possible and I did read the docs on each parameter, but somehow I am still not sure about what I am doing :)
Is it possible to use training data from DensePose to improve tracking? Their tracked videos seemed to be very precise, I assume you are familiar with that project: https://github.com/facebookresearch/detectron2/tree/master/projects/DensePose
Is there anything we (the users) could do, to help you to improve the plugin, especially in a way to get closer to the precision on the DensePose videos?
Kind regards,
Jin
Hi, I found your add-on and I see it so interesting because I'm working with some videos for a kind of Xmas carol and I want to remove some backgrounds. I had problems with final step, I installed all the requirements but I'm not into python, I can't achieve the right path for python and PROJECT_DIR and I don't know who to do it. It gives me error because the path code isn't well written. Could you show some me example from your installation? I guess it could help.
Congrats for your job. Thank you for your help.
Cheers!
Joan B.
Hi,
first of all - thanks for this project, I am really very excited about the possibilities that are opening up here :)
Unfortunately my first attempt did not go too well.
I imported a set of frames instead of a movie file, when I try to track the next frame blender on Linux crashes:
[ INFO:0] VIDEOIO: Enabled backends(6, sorted by priority): GSTREAMER(1000); V4L2(990); OPENNI(980); CV_IMAGES(970); CV_MJPEG(960); FIREWIRE(950)
[ INFO:0] OpenCV | GStreamer:../Videos/frame_001.png
[ INFO:0] OpenCV | GStreamer: mode - FILE
[ WARN:0] OpenCV | GStreamer warning: unable to query duration of stream
[ WARN:0] OpenCV | GStreamer warning: Cannot query video position: status=1, value=0, duration=-1
Writing: /tmp/automask-test.crash.txt
Segmentation fault (core dumped)
I assume that GStreamer expects a video and tries to parse the duration and video position, which of course does not work when dealing with an image strip.
If image strips can't be used then it'd be good to catch that and avoid the crash.
Kind regards,
Jin
To Reproduce
Steps to reproduce the behavior:
Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):
Additional context
Add any other context about the problem here.
Describe the bug
After installing dependencies, there's a missing requirement: imresize and there's no wheel available for Blender's python 3.7m
To Reproduce
Traceback (most recent call last):
File "/home/pm/Desktop/blender-2.81a-linux-glibc217-x86_64/2.81/scripts/modules/addon_utils.py", line 351, in enable
mod = __import__(module_name)
File "/home/pm/Desktop/blender-2.81a-linux-glibc217-x86_64/2.81/python/bin/AutoMask-master/automask.py", line 13, in <module>
from mask_spline import *
File "/home/pm/Desktop/blender-2.81a-linux-glibc217-x86_64/2.81/python/bin/AutoMask-master/mask_spline.py", line 5, in <module>
from scipy.misc import imresize
ImportError: cannot import name 'imresize' from 'scipy.misc' (/home/pm/Desktop/blender-2.81a-linux-glibc217-x86_64/2.81/python/lib/python3.7/site-packages/scipy/misc/__init__.py)
ERROR: Could not find a version that satisfies the requirement imresize (from versions: none)
ERROR: No matching distribution found for imresize
Expected behavior
add-on enabled
Desktop (please complete the following information):
Additional context
Maybe related to scipy/scipy#6212
FTR, I had to copy every packages from /home/pm/Desktop/blender-2.81a-linux-glibc217-x86_64/2.81/python/lib/python3.7/site-packages
to /home/pm/.local/lib/python3.7/site-packages
except numpy that was already installed.
Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Steps to reproduce the behavior:
Traceback (most recent call last):
File "/snap/blender/111/2.92/scripts/modules/addon_utils.py", line 351, in enable
mod = import(module_name)
File "/home/fenix/.config/blender/2.92/scripts/addons/automask.py", line 9, in
PROJECT_DIR
NameError: name 'PROJECT_DIR' is not defined
Expected behavior
No want to be enable
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):
Additional context
Add any other context about the problem here.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.