trahay / bbb-downloader Goto Github PK

Hi,
can you add multiple downloads from .txt files input?

Thanks
Regards

hello i am trying to use your code in order to download my presentation from bbb, The code says that the link is not a bbb URL. Do you have any suggestion ?? my link is

http://msc.pe.uth.gr/playback/presentation/0.9.0/playback.html?meetingId=b0762acfe0ffc56b8d3cf224d8c25f11b0b0cf1d-1479275870903&fbclid=IwAR0K_s98dJNJq8dlI1Qzzx6AZ0WqmuwmHcB0Pt1LSPIGXSu9ttsQbCHJNFY

It seems that the chat may be displayed only if its input form element #exposechat is checked... to be tested

As stated in the title, I tried downloading a university presentation, for which I need a username and password to access.Trying to download the presentation resulted in the next error (I included thw whole process, from the command to the error):

sudo bash capture-full-replay.sh https://manager.didaktik-bigblue.rwu.de/playback/presentation/2.0/playback.html?meetingId=fa8c2d3e6b6816ea4fa13adcc3f0f4fed44469c5-1587016732599
Traceback (most recent call last):
File "/home/nhd/bbb-downloader/bbb.py", line 127, in
extractor._real_extract(url)
File "/home/nhd/bbb-downloader/bbb.py", line 69, in _real_extract
root = ET.fromstring(metadata)
File "/usr/lib/python3.8/xml/etree/ElementTree.py", line 1320, in XML
parser.feed(text)
xml.etree.ElementTree.ParseError: mismatched tag: line 8, column 6

Any ideas guys?

The capture of the replays made with Selenium captures the whole of the X display, including the Firefox windows, decorations, etc.

Unfortunately, there doesn't seem to be a way to switch the Firefox window contents to fullscreen with the Selenium marionette driver (or I haven't check well).

An option would then be to automatically crop the video to only deliver the inner part of the window.
Haven't investigated the post-processing options.

Of course, there would also be a need for cutting start/end of screen capture.

Hello,

I got an error since I updated Docker, here it is :

Waiting for docker-selenium to be ready...
...................................................
Container docker internal IP: 172.17.0.2
Selenium all done and ready for testing!

Please wait for 5117 seconds, while we capture the playback...

/opt/bbb-downloader/node_modules/selenium-webdriver/lib/promise.js:2626
throw error;
^

Error: ECONNREFUSED connect ECONNREFUSED 127.0.0.1:49159
at ClientRequest. (/opt/bbb-downloader/node_modules/selenium-webdriver/http/index.js:238:15)
at ClientRequest.emit (events.js:198:13)
at Socket.socketErrorListener (_http_client.js:401:9)
at Socket.emit (events.js:198:13)
at emitErrorNT (internal/streams/destroy.js:91:8)
at emitErrorAndCloseNT (internal/streams/destroy.js:59:3)
at process._tickCallback (internal/process/next_tick.js:63:19)
From: Task: WebDriver.createSession()
at Function.createSession (/opt/bbb-downloader/node_modules/selenium-webdriver/lib/webdriver.js:769:24)
at Function.createSession (/opt/bbb-downloader/node_modules/selenium-webdriver/firefox/index.js:521:41)
at createDriver (/opt/bbb-downloader/node_modules/selenium-webdriver/index.js:170:33)
at Builder.build (/opt/bbb-downloader/node_modules/selenium-webdriver/index.js:632:16)
at Object. (/opt/bbb-downloader/bbb-downloader/selenium-play-bbb-recording.js:21:6)
at Module._compile (internal/modules/cjs/loader.js:778:30)
at Object.Module._extensions..js (internal/modules/cjs/loader.js:789:10)
at Module.load (internal/modules/cjs/loader.js:653:32)
at tryModuleLoad (internal/modules/cjs/loader.js:593:12)
at Function.Module._load (internal/modules/cjs/loader.js:585:3)

getting error while downloading file. Check the screenshot

Thank you very much.
Can I set higher resolution and h.264 main profile?
After a download I have only 520 pixels like vertical resolution and I can open the file only with vlc (due to high 4:4:4 profile).
I can convert them manually with commamd "ffmpeg -i input.mp4 -profile:v main -pix_fmt yuv420p out.mp4" to solve the issue, but can you do anything while downloading?

Originally posted by @gioluca2 in #16 (comment)

I tried implementing the steps mentioned in the readme section, after I reach the "pip3 install -r python-requirements.txt" command, I get the following error:
ERROR: Could not open requirements file: [Errno 2] No such file or directory: 'python-requirements.txt'
I have Ubuntu 20.04.2 LTS.
Any solution guys ?
Thanks in advance.

I have this issue when using capture-full-replay.sh on mac OSX,

Can any one help please :(

Thanks in advance

Please wait for 4288 seconds, while we capture the playback...

/Users/user/node_modules/selenium-webdriver/lib/error.js:539
let err = new ctor(data.message)
^

NoSuchElementError: Unable to locate element: .acorn-play-button
at Object.throwDecodedError (/Users/user/node_modules/selenium-webdriver/lib/error.js:539:15)
at parseHttpResponse (/Users/user/node_modules/selenium-webdriver/lib/http.js:647:13)
at Executor.execute (/Users/user/node_modules/selenium-webdriver/lib/http.js:573:28)
at processTicksAndRejections (node:internal/process/task_queues:96:5)
at async thenableWebDriverProxy.execute (/Users/user/node_modules/selenium-webdriver/lib/webdriver.js:735:17)
at async toWireValue (/Users/user/node_modules/selenium-webdriver/lib/webdriver.js:140:15)
at async /Users/user/node_modules/selenium-webdriver/lib/webdriver.js:190:16
at async forEachKey (/Users/user/node_modules/selenium-webdriver/lib/webdriver.js:184:9)
at async convertKeys (/Users/user/node_modules/selenium-webdriver/lib/webdriver.js:189:3)
at async thenableWebDriverProxy.execute (/Users/user/node_modules/selenium-webdriver/lib/webdriver.js:733:22) {
remoteStacktrace: 'WebDriverError@chrome://marionette/content/error.js:181:5\n' +
'NoSuchElementError@chrome://marionette/content/error.js:393:5\n' +
'element.find/</<@chrome://marionette/content/element.js:306:16\n'
}

I used bbb-downloader for capturing the full playback with the elgalu/selenium Docker image, But a problem arose with the conversion from mkv to mp4, When the conversion ends the output file do not .
screenshot about error.pdf
Thanks.

Hi, i was using this script to download and make mp4 recordings from openstreetmap bbb server https://osmvideo.cloud68.co ... Now i cant download videos ( maybe url change? )... Last video have this link:

https://osmrecordings.cloud68.co/playback/presentation/2.3/2ed32e8865ca5e0a7690b4727eefcd01c4a6540b-1643466260318

Thanks for any help.

Hello

If the video stored on bbb serveur use mp4 and not webm nothing is downloaded and there is an error.
To solve this problem you just need to replace all the webm by mp4 call in the bbb.py file
same thing to do in capture-full-replay.sh file

Probably it could be intersting to add a parameter to select webm/mp4 from command line
Regards
Fabrice

Hello,

I tried the download script but I am getting this error:

./download_bbb_data.py https://bigbluebutton.cosmonetgroup.com/playback/presentation/2.0/playback.html?meetingId=805ad66d939b0d3b324892f010a8c331594eb699-1598200572904

Traceback (most recent call last):
  File "./download_bbb_data.py", line 9, in <module>
    import numpy as np
ImportError: No module named 'numpy'

Originally posted by @andygr in #12 (comment)

Running several instances of capture-full-replay.sh causes the recorded videos to be buggous.
It seems that this is due to the naming of the container that is constant.

Hello everyone,

Is it possible to add slide's timestamp (or chapter) from bbb meeting to the downloaded mp4 ? The videos I'm downloading are very long and it can be a very useful to jump from one slide to another. It will be a nice feature too if it isn't too difficult to implement.

Thanks again for those nice scripts !

Hello
If you have this error :

node_modules/selenium-webdriver/lib/promise.js:2626                                                                                                     │ 0%
        throw error;
        ^
ElementNotInteractableError: Element <button class="acorn-play-button"> could not be scrolled into view

it's because the browser didn't display the replay page, you need to increase the delay before record and wait the replay page is correctly show, just increase this parameter in the file selenium-play-bbb-recording.js on line 35

driver.sleep(1000 * 4);
Regards
Fabrice

It would be great to be able to capture a complete replay of the plaback of the recording, with everything like slides (see #1), annotations, etc.

Should be feasable using a scripted audio/video capture of a browser, maybe using Selenium running a browser in a docker container (see https://github.com/elgalu/docker-selenium/blob/master/docs/videos.md)

May be working on that soon

Using crop script generated a too much cropped video for me.

I had to change line 60 (previously upper_window=144 to upper_window=50) to have a full content output.

Thanks for the scripts by the way!

Hi!

I get this error while trying
./capture-full-replay.sh -o testJu005.mp4 https://scalelite.cloud68.co/playback/presentation/2.0/playback.html\?meetingId\=1b1aacc345b2050c4d62b2f1475734f89494a8e8-1590695733699

│(standard_in) 1: parse error
progress_bar.sh: line 38: [: -gt: unary operator expected
(standard_in) 1: parse error
progress_bar.sh: line 48: [: -ne: unary operator expected
(standard_in) 1: parse error                                              │ 0%
(standard_in) 1: illegal character: N
(standard_in) 1: illegal character: N
usage: sleep seconds
progress_bar.sh: line 29: [: -lt: unary operator expected

i ended up with an empty mp4 file, and i can’t find how to make it work.

running on osx catalina, using python 3

The slides aren't in the video recordings, but captured via PNG files indexed from an SVG file, with additional animations replayed live when watching the recording.

At least, it should be rather easy to download the slides.

See my code around https://github.com/ytdl-org/youtube-dl/pull/25092/files#diff-62587d5fd10a07aa60c1ee0a4383581eR92 where I'm extracting the PNG filenames from the shapes.svg associated file.

Hello,

I tried to download a video using the script capture-full-replay.sh but it failed: it creates a 4 seconds video containing only the image "Docker Selenium". This is the command I launched:

./capture-full-replay.sh 'https://scalelite.lal.cloud.math.cnrs.fr/playback/presentation/2.0/playback.html?meetingId=7773cd6626d11404b2918c757753225938c246b0-1610022254792'

I tried to comment everything concerning progressbar.sh, but this didn't solve my problem (don't really know what I'm doing but anyway :) )

There are somes error in the logs:

Container docker internal IP: 172.17.0.2
Selenium all done and ready for testing!

Please wait for 3997 seconds, while we capture the playback...

internal/modules/cjs/loader.js:638
    throw err;
    ^

Error: Cannot find module 'selenium-webdriver'

And

Error response from daemon: Cannot kill container: grid66361: No such container: grid66361

Here is a pastebin of the logfile

Does someone has an idea? Thanks a lot!

Should it helps, I'm on Ubuntu 20.04.

Hello,
I can't run the scripts
I tried "download_bbb_data.py https://bbb-1.wsweet.cloud/playback/presentation/2.0/playback.html?meetingId=5be6398e0ccb303cf079a3cb52a6ba4f2bd26a81-1592392602906" et
"capture-full-replay.sh https://bbb-1.wsweet.cloud/playback/presentation/2.0/playback.html?meetingId=5be6398e0ccb303cf079a3cb52a6ba4f2bd26a81-1592392602906"
sans succès.
Le README.sh dit "To download BBB videos and slides, simply pass its URL to the download_bbb_data.py:" mais pas quel URL utiliser fourni par greenlight. Et dans celui-ci la vidéo de Olivier n'est pas claire non plus.
Idée par exempe :

• une doc avec un exemple qui marche
• une vidéo d'aide sur cet exemple que chacun peut tester en partant juste de greenlight
  Merci bcp

bbb.py uses the metadata to compute the duration of a video. In some cases, the duration does not correspond to the actual video duration.
For instance, with this video:
https://rooms.imtbs-tsp.eu/playback/presentation/2.0/playback.html?meetingId=20c59579a50a715e8d6dc692df996dceb8d788f8-1588578942194

bbb.py computes 406 seconds, while the actual duration is 99 minutes.

Here's a subset of the metadata for this video:

<recording>
  <id>20c59579a50a715e8d6dc692df996dceb8d788f8-1588578942194</id>
  <state>published</state>
  <published>true</published>
  <start_time>1588578942194</start_time>
  <end_time>1588591047175</end_time>
  <participants>30</participants>
  <raw_size>156982456</raw_size>
  <meeting 
  id="20c59579a50a715e8d6dc692df996dceb8d788f8-1588578942194" externalId="3cd33a0d0288664ed51ffe5082eaa892fcc548c8-157-538" name="Salle de TP ASR" breakout="false">
</meeting>
  <meta>
    <bbb-origin-tag>moodle-mod_bigbluebuttonbn (2019042008)</bbb-origin-tag>
    <bbb-recording-tags/>
    <bbb-origin-server-common-name/>
    <bbb-origin-version>3.8.2 (Build: 20200309)</bbb-origin-version>
    <bbb-recording-name>CI3 - cours et corrigé du TP</bbb-recording-name>
    <bbb-context>Systèmes d’exploitation</bbb-context>
    <meetingName>Salle de TP ASR</meetingName>
    <meetingId>3cd33a0d0288664ed51ffe5082eaa892fcc548c8-157-538</meetingId>
    <bbb-recording-description/>
    <bbb-origin>Moodle</bbb-origin>
    <isBreakout>false</isBreakout>
    <bbb-origin-server-name>moodle.imtbs-tsp.eu</bbb-origin-server-name>
  </meta>
  <playback>
    <format>presentation</format>
    <link>
      https://rooms.imtbs-tsp.eu/playback/presentation/2.0/playback.html?meetingId=20c59579a50a715e8d6dc692df996dceb8d788f8-1588578942194
    </link>
    <processing_time>5453648</processing_time>
    <duration>5955342</duration>
    <size>151506934</size>

The following doesn't seem to work (URL from the bbb regular web viewer):

./bbb_downloader.sh 'https://bbb.some.where/playback/presentation/2.0/playback.html?meetingId=xxx-yyy

What URL should be provided to bbb_downloader.sh ?

Just for the record, creating a new issue, instead of a discussion in another one

Originally posted by @trahay in #11 (comment)

Hi,
This looks like a problem similar to this one:
mozilla/geckodriver#1470

You can try upgrading selenium, which may fixe the problem:
$ docker pull elgalu/selenium

François

On 18/07/2020 19:33, @vebp wrote:

Hi, good day.

First of all, thanks a lot fro this wonderful tool.

Having said that, I though I was having the same problem described up
but it is somehow different.

I have a bigbluebutton test server with a test recording. When I do

sudo bash capture-full-replay.sh
https://bbb-example.cl/playback/presentation/2.0/playback.html?meetingId=6dfe6c3d663317795e670804599375901b91b849-1594864176258

a video does appear, but it only has the docker selenium logo.
I changed to

/sleep $(echo "$seconds - 10" | bc)/

but it didn’t work

the error that I get is:

_Please wait for 36 seconds, while we capture the playback...

/home/vito/respaldo_proyectos_lin/p-software/about_bbb/test_mp4/bbb-downloader/node_modules/selenium-webdriver/lib/promise.js:2626
throw error;
^

TimeoutError: Socket timeout reading Marionette handshake data: Resource
temporarily unavailable (os error 11)
Build info: version: '3.141.59', revision: '82b03c358b', time:
'2019-04-30T22:04:50'

Driver info: driver.version: unknown
remote stacktrace:
at Object.checkLegacyResponse
(/home/vito/respaldo_proyectos_lin/p-software/about_bbb/test_mp4/bbb-downloader/node_modules/selenium-webdriver/lib/error.js:546:15)
at parseHttpResponse
(/home/vito/respaldo_proyectos_lin/p-software/about_bbb/test_mp4/bbb-downloader/node_modules/selenium-webdriver/lib/http.js:509:13)
at
/home/vito/respaldo_proyectos_lin/p-software/about_bbb/test_mp4/bbb-downloader/node_modules/selenium-webdriver/lib/http.js:441:30
at processTicksAndRejections (internal/process/task_queues.js:93:5)
From: Task: WebDriver.createSession()
at Function.createSession
(/home/vito/respaldo_proyectos_lin/p-software/about_bbb/test_mp4/bbb-downloader/node_modules/selenium-webdriver/lib/webdriver.js:769:24)
at Function.createSession
(/home/vito/respaldo_proyectos_lin/p-software/about_bbb/test_mp4/bbb-downloader/node_modules/selenium-webdriver/firefox/index.js:521:41)
at createDriver
(/home/vito/respaldo_proyectos_lin/p-software/about_bbb/test_mp4/bbb-downloader/node_modules/selenium-webdriver/index.js:170:33)
at Builder.build
(/home/vito/respaldo_proyectos_lin/p-software/about_bbb/test_mp4/bbb-downloader/node_modules/selenium-webdriver/index.js:632:16)
at Object.
(/home/vito/respaldo_proyectos_lin/p-software/about_bbb/test_mp4/bbb-downloader/selenium-play-bbb-recording.js:21:6)
at Module._compile (internal/modules/cjs/loader.js:1121:30)
at Object.Module._extensions..js (internal/modules/cjs/loader.js:1160:10)
at Module.load (internal/modules/cjs/loader.js:976:32)
at Function.Module./load (internal/modules/cjs/loader.js:884:14)
at Function.executeUserEntryPoint [as runMain]
(internal/modules/run_main.js:67:12) {
name: 'TimeoutError',
remoteStacktrace: ''
}
video-rec: stopped
Waiting for video to stop recording...
video-rec STOPPED Jul 18 07:24 PM
Done waiting for video recording to stop.
Video recording stopped/

I’m using an ubuntu 18.04

Thanks a lot for the time

Hi all,

When integrating soundtrack by ./integrate_soundtrack command, I get an error from ffmpeg.

First, I download:
./download_bbb_data.py https://bbb-aep2.ulpgc.es/playback/presentation/2.0/playback.html\?meetingId\=bbb32bb487132b4493676126412c2a4c2d37771e-1614796183868

Then, I integrate soundtrack:
./integrate_soundtrack.sh bbb32bb487132b4493676126412c2a4c2d37771e-1614796183868/Videos last
And I get:

# Extracting sound from bbb32bb487132b4493676126412c2a4c2d37771e-1614796183868/Videos/webcams.webm to bbb32bb487132b4493676126412c2a4c2d37771e-1614796183868/Videos/output.opus
# running ffmpeg -i bbb32bb487132b4493676126412c2a4c2d37771e-1614796183868/Videos/webcams.webm -vn -acodec copy bbb32bb487132b4493676126412c2a4c2d37771e-1614796183868/Videos/output.opus
# Merging video (bbb32bb487132b4493676126412c2a4c2d37771e-1614796183868/Videos/deskshare.webm) and audio (bbb32bb487132b4493676126412c2a4c2d37771e-1614796183868/Videos/output.opus) into last
# Running ffmpeg -i bbb32bb487132b4493676126412c2a4c2d37771e-1614796183868/Videos/deskshare.webm -i bbb32bb487132b4493676126412c2a4c2d37771e-1614796183868/Videos/output.opus -map 0:v -map 1:a -c copy -y last
Failed !

Can anyone help?
thanks!