depado / goploader

Easy file sharing with server-side encryption, curl/httpie/wget compliant

goploader

Introduction

Goploader's ultimate goal is to make file sharing easy and painless. This project is composed of a server and a client, both written in Go. The main things to remember about the project are :

• Sharing stuff from your terminal should be easy
• Sharing stuff without a terminal should be easy
• Privacy matters

Build from source

Make sure you have Go installed on your machine.

Client

$ go get github.com/Depado/goploader/client
$ go build -o $GOPATH/bin/goploader github.com/Depado/goploader/client

Server

$ # Move to a new directory that will be used to run the server
$ go get github.com/Depado/goploader/server
$ # The following steps are optional
$ # Execute those if you wish to embed the assets and templates into the binary
$ go get github.com/GeertJohan/go.rice/rice
$ rice embed-go -i=github.com/Depado/goploader/server
$ # End of the optional steps
$ go build github.com/Depado/goploader/server
$ # If you did not embed the resources, make sure to copy the assets and templates directories
$ cp -r $GOPATH/src/github.com/Depado/goploader/server/{assets,templates} .
$ # Execute the binary a first time to trigger the setup
$ # Or write your own conf.yml file
$ ./server

Downloads

All the downloads are available at gpldr.in in the clients and server sections.

Client

Linux	FreeBSD	Mac OS	Windows
Linux 64bit	FreeBSD 64bit	Mac OS 64bit	Windows 64bit
Linux 32bit	FreeBSD 32bit	Mac OS 32bit	Windows 32bit
Linux ARMv7

Documentation

All the documentation is available at gpldr.in. I intend to write a proper README.md file, but it takes a lot of work to transpose the existing documentation to the markdown format. So, work in progress.

License

All the software in this repository is released under the MIT License. See LICENSE for details.

goploader's Issues

Server stops :-/

Hi once again :)
Because I wanted to change some parts of the start page (text, maybe Logo, color) I compiled a version of goploader instead of using the standalone binary. Everything looks good, but when I start goploader it does one run and exists immediately. So this is no standalone version? How can I create one?

DEBUG |     server | 2016/06/10 - 12:04:58 |                 | Started Initialize on statistics object
 INFO |     server | 2016/06/10 - 12:04:58 |                 | Total   2 (5.4GB)
 INFO |     server | 2016/06/10 - 12:04:58 |                 | Current 0 (0)
DEBUG |     server | 2016/06/10 - 12:04:58 |                 | Done Initialize on statistics object
 INFO |     server | 2016/06/10 - 12:04:58 |                 | Started goploader server on port : 80
 INFO | monitoring | 2016/06/10 - 12:04:58 |                 | Started Monitoring
DEBUG | monitoring | 2016/06/10 - 12:04:58 |                 | Started Monit on Resources
DEBUG | monitoring | 2016/06/10 - 12:04:58 |                 | Serving 0 (0) files
DEBUG | monitoring | 2016/06/10 - 12:04:58 |                 | Done Monit on Resources (2.337783ms)
DEBUG |     server | 2016/06/10 - 12:04:58 |                 | Loaded templates from "templates" box
DEBUG |     server | 2016/06/10 - 12:04:58 |                 | Loaded assets from "assets" box

Thanks in advance

Switch from SQLite to BoltDB

The model is quite simple, and the SQLite dependency makes it really annoying to deploy on an ARM architecture.
In addition this would make a pure Go project without external dependencies

Add a daemon mode

Caddyfile review

The Caddyfile for Caddy web server should be:

up.example.com {
	proxy / 127.0.0.1:8002 {
		transparent
	}
	gzip
}

Improve monitoring error handling

Add a way to paste text in web interface

Handle either http or https

Withtout adding a parameter to conf.yml, make the server handle any protocol, either http or https.

Right now, only https URI is returned after upload.

Better error handling

As for now a standard message is sent whenever an error happen during the setup or during a file upload. Would be great to handle form errors, returning them as JSON to highlight fields that are wrong. Also using defaults as the placeholders. (If the field isn't filled, then use the default instead)

Parse human readable size_limit conf

size_limit: 30  # Parses as 30*utils.MegaByte
size_limit: 30GB # Parses as 30*utils.GigaByte

Specify output for log

DEMAIN BOXE

DEMAIN BOXE

Implement one-shot uploads

One nice feature would be to allow the users to specify that the uploaded file should be available only once. (One GET request, then the file gets deleted from disk and database)

Feature Request: lifetime restrictions in server config

Hi once again :)
It would be nice - I think not only for my requirements - to set the lifetime more restrictive by the admin. So the admin could say maybe it is only allowed to set 1d and 1w . Maybe another admin would like to have that files are generally and only available for 1 day (1d).
If this could be set in the server config - that would really be cool. The client must not really be changed. If he selects a time that is not supported by the server, the file lifetime is set to default.

For the upload by the webui, I changed the template to only support 1w . That works, but not for the terminal client ;) (I do not know programing in go :-/ )

Thank you very much!

Cannot compile latest version from master

Hi,

It seems that I can't compile anymore the Goploader server from master:

$ go build
# github.com/Depado/goploader/server/database
../../go/src/github.com/Depado/goploader/server/database/database.go:7:2: imported and not used: "go.etcd.io/bbolt"
../../go/src/github.com/Depado/goploader/server/database/database.go:18:59: undefined: bolt

Is it intended (for tests, as it seems that this commit is recent: ffb8518#diff-1e777cb518a26cf47f4e216b8725ce93)?

Thanks anyway for your product!

How can i make it support the format of SWF?

The title says it all.....
In addition , I wonder if i could watch SWF format on Browser without downloading it.

Client : Specify hostname from the command line

Uploaded text downloads as STDIN

Hello again i know i asked way back for this feature. But can we have an exeption so that files download as files (no browser open), but uploaded text still opens in the browser?
Turns out this feature is awesome for sharing passwords but its a bit problematic to explain ppl every time :)

Thanks for your hard work 👍

Do not open in browser

Hello,

First i would like to thank you for your hard work this is an awesome project :)

Is it possible to have the downloads not open in the browser, Like txt and video files ?

Server - Curl compliant response

When a curl client GET the front page, return the documentation in a friendly text-only way. Maybe with some colors. 💥

Investigate on IPFS

Proxy with Apache

Proxy with Apache allows me to upload fine . But on download, the link to the file goes to http://example.com:8008/filename, which isn't exposed (because it is proxying).

Random 502 Bad Gateway when someone cancels an upload

That's highly annoying and I don't know what causes that. Needs investigation.

Flexible mode for large uploads ?

The idea would be that the larger the file uploaded is, the shorter the time it will live on the server. Would need some calculation, and set a ratio in the configuration file

Example :

• 1KB → 1MB : 1 Month
• 1MB → 100MB : 1 Week
• 100MB → 1GB : 1 Day
• 1GB → xGB : 1 Hour

Where x is the maximum size allowed by the server.

Implement smart-delete feature

Principle would be that a file that wasn't fetched at least once in a TimeLimit span can be safely deleted. A user uploads a file that will live for 48 hours. Someone fetches the files 3 hours later. The counter is resetted to 48 hours.

Implement storage limit

As of today there is no limit for the total size of files that are stored on the server. Would be a nice feature to limit to a certain size, and delete older files if that limit is broken

See uploaded files in the web client

Like using localstorage to remember the file name and URL of the uploaded files, maybe a delete link.

change temporarily folder?

Hi,
I am just testing goploader. Now, I will use it for uploading big files (~20GB-50GB).

On my first test I figured out, that the files are temporarily stored in /tmp (using Debian 8). Is there a way to change this to another directory?

Thanks in advance and really thank you for this piece of software!!

Ronny

Server - Customise database check timing

Related #35

Disable encryption to speed up?

Hi once again :)
Does it make sense to disable encryption if not needed to speed up the down/upload? Actually I cannot disable encryption - so I cannot test this :-/

Best regards
Ronny

Protect upload with password

Do you plan to add a way to restrict the uploads, for example with a password? I have a shared server with friends and I don't want the entire internet to be able to upload files to it.

Built-In HTTPS Support

Feature Request: Show upload progress?

As you can see I'm really working on goploader :)

Is there a possibility to show a progress bar (or something like) on a running upload?

THX and have a nice weekend

Language support

If its not a huge work maybe there could be a language file so we can have all the visible parts there then its easy to manage in the future.

Question: Using a database on another server

What would be the method of using a database on another server?

language and lines option

Hello,

is there a way to disable these options when uploading files? (Just not show them)

I'm sorry if its a noob question :)

Add resumable download ?

Implement rolling storage

Didn't know how to name that.

• Time limit becomes optionnal
• Adding a maximum storage space for all the uploaded files
• Maximum storage space allocated is also optionnal
• If both settings are used, both should work.
• At least one of these two arguments is required.

When someone uploads a file, if the said file makes the maximum storage space overflow, then the oldest files gets deleted until the maxium storage space isn't overflowed anymore. This would force the user to have a SizeMax+SizeLimit free disk space.

Server setup : Add cli mode and better error handling

Quota Exceeded although no files are currently served

There is a problem with the quota limit thing.

Don't use absolute path as name in client

Installation error - cannot use "github.com/boltdb/bolt".Options literal

Hello,
I've installed Go 1.10, following this tutorial (For Debian 9)
https://tecadmin.net/install-go-on-debian/
and I'm trying now to install goploader, however when I run
go get github.com/Depado/goploader/server
or
go build github.com/Depado/goploader/server

I have the following error:

# github.com/Depado/goploader/server/database
Projects/Proj1/src/github.com/Depado/goploader/server/database/database.go:18:79: cannot use "github.com/boltdb/bolt".Options literal (type *"github.com/boltdb/bolt".Options) as type *"github.com/coreos/bbolt".Options in argument to storm.BoltOptions

And thus I don't see the .server binary.

Any advice?

Thank you

README.md Documentation

As for now the only documentation available is on gpldr.in, that would be better to have a real documentation in the README.md file in the repo, in case gpldr.in is taken down for whatever reason.

Implement key size setting

The size of the generated key should be configurable by the host. (8, 16, 32, etc...)

Client - Set defaults in config file

Implement statistics

• Total size of stuff that has been uploaded on the service
• Total number of files uploaded
• Total number of file views

Mailing capabilities ?

Previous filename remains after upload

After uploading a file, the filename of the uploaded file remains, so the next step isn't evident. Strong recommendation, after a file is uploaded, the button changes to Choose a File. See:

DEMAIN BOXE

DEMAIN BOXE

UX change to add a textarea, allowing upload of texts

support for subdirs

Hi!
To protect the goploader page via reverse proxy, I would like so work in a subfolder. This does not work, because goploader does not support relative links / subdirs. Is it possible to create a parameter to configure a "base url" ?

Same thing using https. The link presented by goploader is always http. If you want to use https, the link does not work. Would be great to have a parameter to support https, too.

Have a nice weekend!!!