eltonchou / twittermediaharvest Goto Github PK

Describe the solution you'd like
More customization in Filename Pattern, Like a textbox I can type the layout of the text, the order and also more info.

Example post:
https://twitter.com/saltastic_/status/1658472020735303690

Example Filename pattern:
twitter_{user-name}(@{user-id})_{date-time}_{status-id}_{file-type}

output:
twitter_shio(@saltastic_)_20230516-135837_1658472020735303690_photo.jpg

https://twitter.com/StellaR54036353

Extension will crash at this page.

Describe the bug
Unable to download video inside a Card.

To Reproduce
Steps to reproduce the behavior:

1. Go to https://twitter.com/DMMTV_ANIME_PR/status/1679687160398479362
2. Click on download button

Expected behavior
Download the vid

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

• OS: Windows 10
• Browser: Chrome
• Version: 114.0.5735.199

This was caused by the autoplay feature.

Is your feature request related to a problem? Please describe.

When the amount of files are growing up, the file management in file explorer become more tricky.
It is especially the windows file explorer has bad performance when the folder contains too many files. Although users can use the filename pattern they set to ditinguish the source of the file, group files from the same user in same folder might be a good idea.

Describe the solution you'd like

• Deeper sub-directory support. e.g. {default-directory}/sns/twitter/twitter_media_harvest/
• Aggreagate the files in the folder by user account or id. e.g. {default_directory}/twitter_media_harvest/{user-account}

Media Harvest : twitter Media Downloader

Issues1 found

Clear all
Error reason: Error: Please contact with developer.(statusCode: 401)

Context

extension://mfnidfilcaemmhecljklecmhepohapio/_generated_background_page.html

Stack Trace

sw.js:1 (anonymous function)
sw.js:1 (anonymous function)

Is your feature request related to a problem? Please describe.

Set the modified time of downloaded items to its tweet time.

Additional context

It is very useful to manage large amount of medias. You can sort by filename to group files by username and sort by modified date to order them in chronological order.

I don't know if it's even possible with download API, though.

Describe the bug
Advertisement tweet would be opened when Auto reveal NSFW is enable.

To Reproduce
In any advertisement tweet has button to click.

Expected behavior
This feature should only work on normal tweet.

Screenshots
Omit.

Desktop (please complete the following information):

• OS: Windows 10
• Browser 114.0.5735.199 (Official Build) (64-bit) (cohort: Stable)
• Version >=v4.0.0

Additional context
Add any other context about the problem here.

Describe the bug
Whether on the homepage or in a specific tweet, if the tweet is viewed and the tweet is a video and the video contains a link, the link will automatically be opened in a new tab.
If the extension is turned off, there is no such problem.

To Reproduce
https://twitter.com/caijinglengyan/status/1679001055647137792

Desktop (please complete the following information):

• OS: [e.g. iOS] Windows10 x64
• Browser [e.g. chrome, safari] Firefox
• Version [e.g. 22] 115

Describe the bug

The download behavior of this extension has a naming conflict with another extension called RegExp Download Organizer.

To Reproduce

When the two extensions are used together, the suffix of the downloaded image will be named jpg_orig.
The troublesome point is that the path where I store the file is the default ‘download address/website/twitter’. This download path is supported by RegExp Download Organizer but TwitterMediaHarvest not support.
Also, once I enable the Aggressive Mode RegExp Download Organizer, it will fail. So I am now in a dilemma.

Expected behavior

I suggest that the developers can allow files to be saved in a deeper path, or try to fix this naming conflict.

Desktop (please complete the following information):

• OS: Windows10
• Browser: Edge
• Version: 114.0.1823.51

Additional context

Just a matter of file naming and saving, not really a big deal. Developers please handle as appropriate.

It seems twitter changed the layout, the media detector was failed.

Also, not working when the url is with the lang query.
https://twitter.com/yoracrab/media?lang=zh-Hant

Auto-reveal sensitive content.
This would be NSFW related features.

This settings would be saved in the local storage to prevent some unexpected troubles.

Four entrypoints to observe

• Column stream
• Pulling stream
• Modal
• Adding new steram

Twitter automatically convert GIFs into video-files. I would like to be able to download the file in its original format.
The closest example:
https://github.com/Flkalas/TwitterMediaAssist

Describe the bug
Right clicking on any image from any website and choosing 'save image as...' causes a long delay, about 5-8 seconds, before the save as box appears. Disabling the extension stops the delay.

Desktop (please complete the following information):

• OS: Windows 11
• Browser Chrome 114.0.5735.110 (Official Build) (64-bit)
• Version 4.1.0

Describe the bug
version4.1.3.
When the download button is clicked, the button turns red and no download window pops up.

Screenshots

Desktop (please complete the following information):

• OS: [e.g. iOS] Windows10 x64
• Browser [e.g. chrome, safari] Firefox
• Version [e.g. 22] 114

Additional context

If you open a tweet from an image so that the URL becomes /photo/1 (e.g. https://twitter.com/JakeChams/status/1576615422987685888/photo/1) and then begin typing a reply that contains the letter "d", the extension downloads the media because of the shortcut. This doesn't seem to be the case when opening the tweet normally (without the /photo/1).

Issue reference

w3c/webextensions#93

API reference

https://developer.chrome.com/docs/extensions/reference/i18n/#method-getMessage

Due to the design of onDeterminingFilename,
It will cause many conflicts with other extensions.

This should be a optional listener for users.

The previous version did not overwrite files that already exist in the download directory. The current version will overwrite any existing files. This can mess with file order especially if file are sorted by date downloaded.

Could you make a version available for the Firefox browser? Thanks for the excellent extension!

YouTube video embed tweet will put a media-like placeholder before loading.
Should prevent add the download button or filter it when fetching.

Describe the bug

If a tweet contains 2 vids, or different kinds of media (eg. photo and vids), only the first media item is downloaded.

To Reproduce

Steps to reproduce the behavior:

1. Example tweet with 2 vids: https://twitter.com/taliaotg/status/1679987354579136513
2. Click the download button, only the first vid is downloaded

Expected behavior

Both vids should download, eg. I should have 2 files:

1. taliaotg-1679987354579136513-01.mp4
2. taliaotg-1679987354579136513-02.mp4

Desktop (please complete the following information):

• OS: Win 10
• Browser: Firefox
• Version: 115.0.2 (64-bit)

Is your feature request related to a problem? Please describe.

I archive threads for research. Currently a manual process:

1. Create text file (eg. {op_tweet_id}.txt)
2. Copy paste over the tweet URLs and their text
3. Also download media for each tweet
4. Save text file upon reaching end of thread

Describe the solution you'd like

1. Right-click download button in a thread (see also: #88)
2. Choose "Archive" from pop-up menu
3. All tweets in thread from that author are compiled in to a text file, and the media from those tweets is also downloaded

Example text file:

https://twitter.com/{user_id}/status/{tweet_id}

{tweet_text}

https://twitter.com/{user_id}/status/{tweet_id}

{tweet_text}

...

If it could continue archiving past the "show more" boundary that would be ideal.

Describe alternatives you've considered

I've tried web archive (both wayback machine and archive.today) but they are not good with videos. They also tend to archive a bunch of stuff I'm not interested in such as replies, ads, etc.

I've tried save as PDF which kinda works but is cumbersome to use (eg. large file size and embedded media is a PITA to work with)

Hence I just do it manually. Text file is nice and small, and easily searchable, and having vids/images as sepaerate files makes them easy to work with.

Additional context

Ability to customise media resolution (small, medium, large) in settings - see #88

Also, maybe change border of archived tweets so I can visually see what's been saved to disk. Sometimes threads break or author will reply 2+ times to a tweet in the thread which can cause confusion - so I'd need to go in and manually deal with that.

If you found the download failed. (the icon became red)
Please go to the options page of this extension and open DevTools (F12).
Run the script below in console. (Only work on >=v4.0.0)

UPDATE

• In >=v4.1.6, the extension will try to save your quota of tweet view if you use v1

Chrome, Edge or any Chromium based browser

await chrome.storage.local.set({twitterApiVersion: 'gql'})

This method shares the same rate limit with current API restriction.

You can also try another script, but it not works on some tweets.

await chrome.storage.local.set({twitterApiVersion: 'v1'})

Firefox

await browser.storage.local.set({twitterApiVersion: 'gql'})

or

await browser.storage.local.set({twitterApiVersion: 'v1'})

I would like to see a function about download to a specified folder without a confirmation screen.
I don't know if this is a bug, or if it was originally intended that way, but in version 3.2.8 for Firefox, that's media was downloading like this, but since version 4.0.0 it started asking for a save path.
For Twitter, I'm more comfortable with the first option, and I think this feature would be useful.

Legacy tweetdeck is back

Is your feature request related to a problem? Please describe.
A filter option to remove the advertisement-tweet.

Describe the solution you'd like
The users can filter out the advertisement-tweets.

Hello.

For the past few weeks the download button has not been showing up on twitter posts with images or videos. I am uncertain if this started occurring around the same time as the 1.3.0 update, because I didn't track when I stopped seeing it.

I recently removed the extension from Chrome and then added it again to see if that would fix it, and it didn't.

I think I have the latest version of Chrome (Version 87.0.4280.66 (Official Build) (64-bit)).

Thanks.

Download history

Record the download, this feature might need additional storage space.

Attributes to record

Related features

• Download button can be changed if this tweet was in record.

https://crbug.com/1288041

Firefox has different behavior on download prompt.

Is your feature request related to a problem? Please describe.
i like saving gifs a lot, but theyre always downloaded as .mp4 instead of .gif

Describe the solution you'd like
it'd be awesome if i (and im sure many other people) could download them without having to convert them from the .mp4 file theyre saved as to .gif

Since the medias might be image or video, the parser of media-info should deal with it.

In the version v4, options page would be renew with React.
Focus on UI/UX.

Should use like or retweet as sample button.

Is your feature request related to a problem? Please describe.

Currently it seems to always download the highest resolution of a video.

Describe the solution you'd like

I archive twitter threads on certain themes, and media download is a key component of that. So is file size mangement.

If I understand correctly, twitter has three versions of a vid to choose from - small, medium, large.

I'd like to set default choice in settings, eg. default to the medium video size.

But also to be able to override for any specific tweet download - eg. right-click the download button to show a menu listing the resolutions, then click the desired resolution to download it.

Describe alternatives you've considered

Currently I have to use external website which is extremely time consuming when archiving threads.

Eg. On this site you enter tweet URL, then on next page it shows the three resolutions to choose from (it also handles tweets with multiple vids, etc): https://www.twitsave.com/

Is your feature request related to a problem? Please describe.
Sometimes all I really want is to extract a video link but I don't want to download it. Previously extensions existed that would open a new tab with a direct URL to the video on Twitter's server - usually video.twimg.com - which I personally found surprisingly useful for a quick, easy share of a video. If I have to download that adds a layer of friction (have to work out where it saved to, find it, re-upload it in Discord/Slack/etc.) when I could just drop the direct video URL in a message previously.

Describe the solution you'd like
I propose an option could be added to TwitterMediaHarvest to output the video URL instead of downloading it locally. It should not be the default, but would be an excellently useful option. Either it could copy the video's direct URL to clipboard or just open it in a new tab so I can copy that URL from there.

Describe alternatives you've considered
The exact feature I describe here was previously supported by twMediaDownloader, which had the ability to just open a direct video URL in a new tab instead of downloading it, but this broke when Twitter turned off the guest API key that extension used (I think? I'm not sure).

Additional context
So far as I can tell this could be a useful and unique feature to TMH if it were added. In my hunt for an extension that offers this functionality I've so far found nothing. All Twitter video downloaders only offer the ability to download, none offer the ability to just extract the link.

I'd be happy to donate to the extension if this got added. I sincerely miss it from twMediaDownloader!

Seems to be hit and miss with the new twitter UI change for me. Sometimes the button will show up, Sometimes it won't. Happy to help debug!

attribute dir='ltr' is layout direction, prevent using it as query.

TypeError
Cannot read properties of undefined (reading 'dataset')

Error occurred when make harvester.

but I don't want to download images to subdirectory.

I am facing two issues when downloading images