Comments (10)
@Jleagle while certainly technically possible I doubt potentially identifying individual Google accounts of users who are deploying youtube-dl
or TubeSync is a great idea given it almost certainly violates some sort of ToS somewhere subjecting them to potential random account suspensions. Identifying users by, for example, client access pattern of some API key listing YouTube channel subscriptions every X hours or other fingerprints.
I also don't have a Google account, which is part of the reason I'm working on TubeSync in the first place so building such a tool would be difficult.
I'll add a CSV import option once the URL parsing is rebuilt into something more sensible, but I doubt TubeSync is likely to ever "officially" talk to any authenticated Google APIs.
from tubesync.
Seems a reasonable request to me. You may encounter some throttling issues from YouTube with that many channels being indexed so this may need a "index weekly only" schedule option added to make this feasible. This would also likely require #33 to be completed first as this should probably be a text file or CSV of URLs to be sensible which requires better URL parsing to work first. These are the first few issues in the queue to get worked on when I next get time so probably should make it into the next release.
from tubesync.
What about fetching your channels automatically with OAuth?
from tubesync.
Sorry for taking a while to reply. No there hasn't been much work on this for now. Mostly because the current tasks system likely wouldn't be able to cope with a few hundred channels so it'll be blocked until that's replaced.
from tubesync.
I've not tested with hundreds of channels myself. However you can do some back of an envelope maths to make a very rough guess. For example if a reasonably sized channel takes 3 minutes to index and you don't want to spend more than 50% of the time indexing channels to allow for a sensible number of downloads it would be in the 200-250 range. However, the ceiling here (once some changes are made to TubeSync) is far more likely to be YouTube getting miffed at your activity and rate limiting or blocking your IP.
from tubesync.
Fair enough. I might add a warning then if you add over 50 channels that you'll probably need proxies or similar measures to avoid issues.
from tubesync.
Sorry, but I would like to know if that feature was successfully added or not yet. As the last change is: meeb added the enhancement (2021/02/24).
from tubesync.
do you know what "too many channels" would be? I use a hacky self built solution to keep up to date with 139 channels. i found this issue because i was hoping there was a bulk import ( i have the full list of channel IDs) and i was hoping to not hand enter all 139 of them
from tubesync.
@meeb you'll find people that're archiving loads of channels such as myself have access to proxies for load balancing. So I don't think the rate limiting would be much of an issue.
from tubesync.
any update on this @meeb ?
facing a situation where i have hundreds of playlists URLs. is there any way of applying a features/settings config to a list of playlists ?
might be useful to anyone
./yt-dlp_linux -O "%(playlist_title)s %(playlist_id)s" --no-warnings --ignore-no-formats-error -i https://www.youtube.com/@uploader_id/playlists | uniq
from tubesync.
Related Issues (20)
- Delete removed media option not working HOT 2
- Feature Request: Dark Mode 🕶 HOT 2
- FileNotFoundError: [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/app'] HOT 2
- All video downloads stalled HOT 11
- youtube.com/c/ No Longer Valid?? HOT 5
- Incorrect Time HOT 11
- Add playlist position media variable HOT 1
- Current docker images are using a vulnerable glibc library `ldd (Debian GLIBC 2.36-9+deb12u3) 2.36` with severe privilege escalation exploits HOT 2
- Error: "Failed to extract_info for xxx HOT 2
- Add Rumble Support HOT 1
- New Videos Not Downloading, No apparent Log Error in Docker HOT 17
- Processing when a downloaded video is changed to private HOT 1
- Best way to adjust or lightweight metadata in 'media_sync' table HOT 1
- gunicorn on native installation HOT 3
- Personal Public Playlists - Error: "'NoneType' object has no attribute 'get'" HOT 1
- tubesync suddenly Stopped Indexing HOT 1
- Please forgive me, I am an idiot: Error: "Failed to extract_info HOT 8
- Unable to download API page: HTTP Error 404: Not Found HOT 1
- TubeSync skipping all downloads HOT 23
- Precondition check failed HOT 20
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tubesync.