GDown don't retrieve and don't download entire folder contents about gdown

[wkentaro]

Yes, 50 limit is hard set due to the behavior of Google Drive.

It returns the first 50 files, and gdown can't know what's the rest.

To resolve this, probably we need to use browser emulator like Selenium to let the Javascript to load the rest of files.
(Loading more than 50 works in Incognito mode in a browser)

[Kaushik-Iyer-skima]

It has a limit of downloading 50 files from a folder link

[ilentt]

It has a limit of downloading 50 files from a folder link

Maybe, although I already considered 50 files limitation by below command but It still do not work as my expectation. Do you have any idea to solve this problem?

// Folder with count of files more than 50
gdown <google_drive_folder_url> -O <location_for_download> --folder --remaining-ok

https://medium.com/@saurabh.sde/fast-and-easy-ways-to-download-large-google-drive-files-or-folders-ad9985a04ed9

[Kaushik-Iyer-skima]

the --remaining-ok flag just allows you to download the first 50 files without giving an error I think. There is no way to download more than 50 files in a folder using gdown

[ilentt]

Can we split the list file into several part, each part have maximum 50 files. By this ways we can download whole folder regardless how many file in folder. Why we can't do by this way?

[okkymabruri]

Can we split the list file into several part, each part have maximum 50 files. By this ways we can download whole folder regardless how many file in folder. Why we can't do by this way?

The reason only able to download 50 files is that the gdown library, by default, uses the "cookie" method to access Google Drive files, and Google Drive has a limitation of 50 for direct downloads using cookies. You can use the Google Drive API along to download >50 files with the google-api-python-client library.

https://stackoverflow.com/a/76740603

[mercifulboss]

Can we split the list file into several part, each part have maximum 50 files. By this ways we can download whole folder regardless how many file in folder. Why we can't do by this way?

The reason only able to download 50 files is that the gdown library, by default, uses the "cookie" method to access Google Drive files, and Google Drive has a limitation of 50 for direct downloads using cookies. You can use the Google Drive API along to download >50 files with the google-api-python-client library.

https://stackoverflow.com/a/76740603

Once you make the python file, what do you do?

[overcast07]

Using the below URL format, it seems to be possible to list more than 50 files without using cookies or the API. The output is in plain HTML. I'm not sure whether this method is officially supported or deprecated.

https://drive.google.com/embeddedfolderview?id=16bB1g_gq7KDiJX2j9H323LyTxXjbg1S2

The main limitation I can see is that it takes a while for the server to generate the list (it may show more entries when you reload the page), and the page can render well before the folder has been fully indexed. The folder linked above contains 5,000 files, and it took several minutes for them all to be listed correctly. I don't know if there is a maximum number of files that can be shown.

Note that the order shown on the page also doesn't match the order in which the files were indexed, i.e. "empty_file_999" was indexed before "empty_file_1000", but the latter is shown at the top of the list.