2017-03-22 22:48:08 +01:00
|
|
|
# transfer.sh [![Gitter](https://badges.gitter.im/Join%20Chat.svg)](https://gitter.im/dutchcoders/transfer.sh?utm_source=badge&utm_medium=badge&utm_campaign=&utm_campaign=pr-badge&utm_content=badge) [![Go Report Card](https://goreportcard.com/badge/github.com/dutchcoders/transfer.sh)](https://goreportcard.com/report/github.com/dutchcoders/transfer.sh) [![Docker pulls](https://img.shields.io/docker/pulls/dutchcoders/transfer.sh.svg)](https://hub.docker.com/r/dutchcoders/transfer.sh/) [![Build Status](https://travis-ci.org/dutchcoders/transfer.sh.svg?branch=master)](https://travis-ci.org/dutchcoders/transfer.sh)
|
2014-10-16 20:01:43 +02:00
|
|
|
|
2014-10-20 14:54:42 +02:00
|
|
|
Easy and fast file sharing from the command-line. This code contains the server with everything you need to create your own instance.
|
|
|
|
|
2018-07-01 23:44:54 +02:00
|
|
|
Transfer.sh currently supports the s3 (Amazon S3), gdrive (Google Drive) providers, and local file system (local).
|
2014-10-16 20:01:43 +02:00
|
|
|
|
2019-05-08 09:13:28 +02:00
|
|
|
## Disclaimer
|
2019-05-08 09:12:40 +02:00
|
|
|
This project repository has no relation with the service at https://transfer.sh that's managed by https://storj.io.
|
2019-05-08 09:13:28 +02:00
|
|
|
So far we cannot address any issue related to the service at https://transfer.sh.
|
2019-05-08 09:12:40 +02:00
|
|
|
|
|
|
|
|
2014-10-16 20:08:40 +02:00
|
|
|
## Usage
|
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
### Upload:
|
|
|
|
```bash
|
2014-10-16 20:08:40 +02:00
|
|
|
$ curl --upload-file ./hello.txt https://transfer.sh/hello.txt
|
2018-08-13 22:14:54 +02:00
|
|
|
```
|
2014-10-16 20:08:40 +02:00
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
### Encrypt & upload:
|
|
|
|
```bash
|
2014-10-16 20:08:40 +02:00
|
|
|
$ cat /tmp/hello.txt|gpg -ac -o-|curl -X PUT --upload-file "-" https://transfer.sh/test.txt
|
2018-08-13 22:14:54 +02:00
|
|
|
````
|
2014-10-16 20:08:40 +02:00
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
### Download & decrypt:
|
|
|
|
```bash
|
2014-10-16 20:08:40 +02:00
|
|
|
$ curl https://transfer.sh/1lDau/test.txt|gpg -o- > /tmp/hello.txt
|
2018-08-13 22:14:54 +02:00
|
|
|
```
|
2014-10-16 20:08:40 +02:00
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
### Upload to virustotal:
|
|
|
|
```bash
|
2014-10-16 20:08:40 +02:00
|
|
|
$ curl -X PUT --upload-file nhgbhhj https://transfer.sh/test.txt/virustotal
|
2017-04-25 00:01:39 +02:00
|
|
|
```
|
2018-08-13 22:14:54 +02:00
|
|
|
|
2019-05-11 23:49:16 +02:00
|
|
|
### Deleting
|
|
|
|
```bash
|
|
|
|
$ curl -X DELETE <X-Url-Delete Response Header URL>
|
|
|
|
```
|
|
|
|
|
|
|
|
## Request Headers
|
|
|
|
|
|
|
|
### Max-Downloads
|
|
|
|
```bash
|
|
|
|
$ curl --upload-file ./hello.txt https://transfer.sh/hello.txt -H "Max-Downloads: 1" # Limit the number of downloads
|
|
|
|
```
|
|
|
|
|
|
|
|
### Max-Days
|
|
|
|
```bash
|
|
|
|
$ curl --upload-file ./hello.txt https://transfer.sh/hello.txt -H "Max-Days: 1" # Set the number of days before deletion
|
|
|
|
```
|
|
|
|
|
|
|
|
## Response Headers
|
|
|
|
|
|
|
|
### X-Url-Delete
|
|
|
|
|
|
|
|
The URL used to request the deletion of a file. Returned as a response header.
|
|
|
|
```bash
|
|
|
|
curl -sD - --upload-file ./hello https://transfer.sh/hello.txt | grep 'X-Url-Delete'
|
|
|
|
X-Url-Delete: https://transfer.sh/hello.txt/BAYh0/hello.txt/PDw0NHPcqU
|
|
|
|
```
|
|
|
|
|
2017-04-25 00:01:39 +02:00
|
|
|
## Add alias to .bashrc or .zshrc
|
2018-08-13 22:14:54 +02:00
|
|
|
|
|
|
|
### Using curl
|
|
|
|
```bash
|
2014-10-16 20:08:40 +02:00
|
|
|
transfer() {
|
2019-05-15 17:25:27 +02:00
|
|
|
curl --progress-bar --upload-file "$1" https://transfer.sh/$(basename "$1") | tee /dev/null;
|
|
|
|
echo
|
2014-10-16 20:08:40 +02:00
|
|
|
}
|
|
|
|
|
|
|
|
alias transfer=transfer
|
2017-04-25 00:01:39 +02:00
|
|
|
```
|
2014-10-16 20:08:40 +02:00
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
### Using wget
|
|
|
|
```bash
|
|
|
|
transfer() {
|
2019-05-15 17:25:27 +02:00
|
|
|
wget -t 1 -qO - --method=PUT --body-file="$1" --header="Content-Type: $(file -b --mime-type "$1")" https://transfer.sh/$(basename "$1");
|
|
|
|
echo
|
2018-08-13 22:14:54 +02:00
|
|
|
}
|
2018-08-13 08:56:08 +02:00
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
alias transfer=transfer
|
|
|
|
```
|
2018-08-13 08:56:08 +02:00
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
## Add alias for fish-shell
|
|
|
|
|
|
|
|
### Using curl
|
2019-04-24 12:45:39 +02:00
|
|
|
```fish
|
2018-08-13 22:14:54 +02:00
|
|
|
function transfer --description 'Upload a file to transfer.sh'
|
|
|
|
if [ $argv[1] ]
|
|
|
|
# write to output to tmpfile because of progress bar
|
2019-07-29 20:27:43 +02:00
|
|
|
set -l tmpfile ( mktemp -t transferXXXXXX )
|
2018-08-13 22:14:54 +02:00
|
|
|
curl --progress-bar --upload-file "$argv[1]" https://transfer.sh/(basename $argv[1]) >> $tmpfile
|
|
|
|
cat $tmpfile
|
|
|
|
command rm -f $tmpfile
|
|
|
|
else
|
|
|
|
echo 'usage: transfer FILE_TO_TRANSFER'
|
|
|
|
end
|
|
|
|
end
|
|
|
|
|
|
|
|
funcsave transfer
|
|
|
|
```
|
2018-08-13 08:56:08 +02:00
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
### Using wget
|
2019-04-24 12:45:39 +02:00
|
|
|
```fish
|
2018-08-13 22:14:54 +02:00
|
|
|
function transfer --description 'Upload a file to transfer.sh'
|
|
|
|
if [ $argv[1] ]
|
2018-09-22 10:46:28 +02:00
|
|
|
wget -t 1 -qO - --method=PUT --body-file="$argv[1]" --header="Content-Type: (file -b --mime-type $argv[1])" https://transfer.sh/(basename $argv[1])
|
2018-08-13 22:14:54 +02:00
|
|
|
else
|
|
|
|
echo 'usage: transfer FILE_TO_TRANSFER'
|
|
|
|
end
|
|
|
|
end
|
|
|
|
|
|
|
|
funcsave transfer
|
|
|
|
```
|
2018-08-13 08:56:08 +02:00
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
Now run it like this:
|
|
|
|
```bash
|
|
|
|
$ transfer test.txt
|
|
|
|
```
|
2018-08-13 08:56:08 +02:00
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
## Add alias on Windows
|
2017-10-11 10:21:10 +02:00
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
Put a file called `transfer.cmd` somewhere in your PATH with this inside it:
|
|
|
|
```cmd
|
2017-10-11 10:21:10 +02:00
|
|
|
@echo off
|
|
|
|
setlocal
|
2018-06-18 08:36:44 +02:00
|
|
|
:: use env vars to pass names to PS, to avoid escaping issues
|
|
|
|
set FN=%~nx1
|
|
|
|
set FULL=%1
|
|
|
|
powershell -noprofile -command "$(Invoke-Webrequest -Method put -Infile $Env:FULL https://transfer.sh/$Env:FN).Content"
|
2017-10-11 10:21:10 +02:00
|
|
|
```
|
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
## Link aliases
|
|
|
|
|
|
|
|
Create direct download link:
|
|
|
|
|
|
|
|
https://transfer.sh/1lDau/test.txt --> https://transfer.sh/get/1lDau/test.txt
|
|
|
|
|
|
|
|
Inline file:
|
|
|
|
|
|
|
|
https://transfer.sh/1lDau/test.txt --> https://transfer.sh/inline/1lDau/test.txt
|
|
|
|
|
2017-03-22 22:44:56 +01:00
|
|
|
## Usage
|
2014-10-16 20:01:43 +02:00
|
|
|
|
2017-03-22 22:50:17 +01:00
|
|
|
Parameter | Description | Value | Env
|
|
|
|
--- | --- | --- | ---
|
|
|
|
listener | port to use for http (:80) | |
|
|
|
|
profile-listener | port to use for profiler (:6060)| |
|
|
|
|
force-https | redirect to https | false |
|
|
|
|
tls-listener | port to use for https (:443) | |
|
2018-07-07 19:05:16 +02:00
|
|
|
tls-listener-only | flag to enable tls listener only | |
|
|
|
|
tls-cert-file | path to tls certificate | |
|
2017-03-22 22:50:17 +01:00
|
|
|
tls-private-key | path to tls private key | |
|
2018-06-23 18:46:28 +02:00
|
|
|
http-auth-user | user for basic http auth on upload | |
|
|
|
|
http-auth-pass | pass for basic http auth on upload | |
|
2019-05-11 14:42:59 +02:00
|
|
|
ip-whitelist | comma separated list of ips allowed to connect to the service | |
|
|
|
|
ip-blacklist | comma separated list of ips not allowed to connect to the service | |
|
2017-03-22 22:50:17 +01:00
|
|
|
temp-path | path to temp folder | system temp |
|
2019-03-30 12:35:57 +01:00
|
|
|
web-path | path to static web files (for development or custom front end) | |
|
|
|
|
proxy-path | path prefix when service is run behind a proxy | |
|
2018-06-26 18:39:56 +02:00
|
|
|
ga-key | google analytics key for the front end | |
|
|
|
|
uservoice-key | user voice key for the front end | |
|
2018-06-19 15:30:26 +02:00
|
|
|
provider | which storage provider to use | (s3, grdrive or local) |
|
2017-03-22 22:44:56 +01:00
|
|
|
aws-access-key | aws access key | | AWS_ACCESS_KEY
|
|
|
|
aws-secret-key | aws access key | | AWS_SECRET_KEY
|
|
|
|
bucket | aws bucket | | BUCKET
|
2019-06-23 20:48:52 +02:00
|
|
|
s3-region | region of the s3 bucket | eu-west-1 | S3_REGION
|
2019-03-19 18:48:28 +01:00
|
|
|
s3-no-multipart | disables s3 multipart upload | false | |
|
2019-07-21 16:01:02 +02:00
|
|
|
s3-path-style | Forces path style URLs, required for Minio. | false | |
|
2018-06-19 15:30:26 +02:00
|
|
|
basedir | path storage for local/gdrive provider| |
|
2018-09-22 10:55:02 +02:00
|
|
|
gdrive-client-json-filepath | path to oauth client json config for gdrive provider| |
|
|
|
|
gdrive-local-config-path | path to store local transfer.sh config cache for gdrive provider| |
|
2019-03-18 20:52:38 +01:00
|
|
|
gdrive-chunk-size | chunk size for gdrive upload in megabytes, must be lower than available memory (8 MB) | |
|
2018-06-19 15:30:26 +02:00
|
|
|
lets-encrypt-hosts | hosts to use for lets encrypt certificates (comma seperated) | |
|
2018-08-13 08:56:08 +02:00
|
|
|
log | path to log file| |
|
2017-03-22 22:44:56 +01:00
|
|
|
|
|
|
|
If you want to use TLS using lets encrypt certificates, set lets-encrypt-hosts to your domain, set tls-listener to :443 and enable force-https.
|
|
|
|
|
|
|
|
If you want to use TLS using your own certificates, set tls-listener to :443, force-https, tls-cert=file and tls-private-key.
|
2014-10-16 20:48:07 +02:00
|
|
|
|
2017-03-22 22:44:56 +01:00
|
|
|
## Development
|
2014-10-16 20:48:07 +02:00
|
|
|
|
2019-05-11 14:42:59 +02:00
|
|
|
Switched to GO111MODULE
|
2014-10-16 20:48:07 +02:00
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
```bash
|
2018-10-26 23:28:47 +02:00
|
|
|
go run main.go --provider=local --listener :8080 --temp-path=/tmp/ --basedir=/tmp/
|
2014-10-16 20:48:07 +02:00
|
|
|
```
|
|
|
|
|
|
|
|
## Build
|
2014-10-16 20:08:40 +02:00
|
|
|
|
2019-05-11 14:42:59 +02:00
|
|
|
If on go < 1.11
|
|
|
|
```bash
|
|
|
|
go get -u -v ./...
|
|
|
|
```
|
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
```bash
|
2017-03-22 22:44:56 +01:00
|
|
|
go build -o transfersh main.go
|
2014-10-16 20:48:07 +02:00
|
|
|
```
|
2014-10-16 20:08:40 +02:00
|
|
|
|
2014-11-13 21:41:43 +01:00
|
|
|
## Docker
|
|
|
|
|
2018-07-01 23:44:54 +02:00
|
|
|
For easy deployment, we've created a Docker container.
|
2014-11-13 21:41:43 +01:00
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
```bash
|
2017-03-22 22:44:56 +01:00
|
|
|
docker run --publish 8080:8080 dutchcoders/transfer.sh:latest --provider local --basedir /tmp/
|
2014-11-13 21:41:43 +01:00
|
|
|
```
|
2019-08-17 08:36:58 +02:00
|
|
|
Pass the params to the transfer.sh binary inside container by the *args*, not through docker environment vars.
|
|
|
|
|
|
|
|
```bash
|
|
|
|
docker run -p 8080:8080 dutchcoders/transfer.sh:latest --provider s3 --http-auth-user my-username --http-auth-pass somepassword --aws-access-key $AWS_ACCESS_KEY_ID --aws-secret-key $AWS_SECRET_ACCESS_KEY --bucket $AWS_TRANSFERSH_BUCKET --s3-region $AWS_TRANSFERSH_BUCKET_REGION
|
2019-08-17 15:43:38 +02:00
|
|
|
```
|
2019-08-17 10:48:22 +02:00
|
|
|
|
2019-08-18 20:35:11 +02:00
|
|
|
## HOW TO? Kubernetes helm chart
|
|
|
|
|
2019-08-17 15:43:38 +02:00
|
|
|
```sh
|
2019-08-17 10:48:22 +02:00
|
|
|
# Kubernetes examples:
|
|
|
|
# run locally
|
2019-08-17 15:43:38 +02:00
|
|
|
kubectl run transfersh --restart=Never --image=dutchcoders/transfer.sh:latest -- --http-auth-user my-username --http-auth-pass somepassword --provider local --basedir=/tmp
|
2019-08-17 10:48:22 +02:00
|
|
|
|
|
|
|
# run with s3
|
2019-08-17 15:43:38 +02:00
|
|
|
kubectl run transfersh --restart=Never --image=dutchcoders/transfer.sh:latest -- --http-auth-user my-username --http-auth-pass somepassword --provider s3 --aws-access-key $AWS_ACCESS_KEY_ID --aws-secret-key $AWS_SECRET_ACCESS_KEY --bucket $AWS_TRANSFERSH_BUCKET --s3-region $AWS_TRANSFERSH_BUCKET_REGION
|
|
|
|
|
2019-08-18 20:35:11 +02:00
|
|
|
# Manual process of Helm chart deployment
|
2019-08-17 15:43:38 +02:00
|
|
|
# if your service is going to run behind nginx or any other proxy then update, proxy-path variable too in deployment.yaml, by-default it is blank.
|
|
|
|
|
2019-08-18 20:35:11 +02:00
|
|
|
# manually create needed secrets for deployment params totally aligned with [Usage Params](https://github.com/dutchcoders/transfer.sh#usage-1)
|
|
|
|
kubectl create secret generic transfersh-secrets --from-literal=HTTP_AUTH_USER=$HTTP_AUTH_USER --from-literal=HTTP_AUTH_PASS=$HTTP_AUTH_PASS --from-literal=AWS_ACCESS_KEY=$AWS_ACCESS_KEY --from-literal=AWS_SECRET_KEY=$AWS_SECRET_KEY --from-literal=BUCKET=$BUCKET --from-literal=S3_REGION=$S3_REGION --from-literal=PROXY_PATH=$PROXY_PATH
|
2019-08-17 10:48:22 +02:00
|
|
|
|
2019-08-17 15:43:38 +02:00
|
|
|
cd charts/transfersh
|
|
|
|
helm install --debug --name=transfersh transfersh/
|
2019-08-17 10:48:22 +02:00
|
|
|
|
2019-08-17 08:36:58 +02:00
|
|
|
```
|
|
|
|
|
2014-11-13 21:41:43 +01:00
|
|
|
|
2019-06-23 20:48:52 +02:00
|
|
|
## S3 Usage
|
|
|
|
|
|
|
|
For the usage with a AWS S3 Bucket, you just need to specify the following options:
|
|
|
|
- provider
|
|
|
|
- aws-access-key
|
|
|
|
- aws-secret-key
|
|
|
|
- bucket
|
|
|
|
- s3-region
|
|
|
|
|
|
|
|
If you specify the s3-region, you don't need to set the endpoint URL since the correct endpoint will used automatically.
|
|
|
|
|
|
|
|
### Custom S3 providers
|
|
|
|
|
|
|
|
To use a custom non-AWS S3 provider, you need to specify the endpoint as definied from your cloud provider.
|
|
|
|
|
2014-10-16 20:08:40 +02:00
|
|
|
## Contributions
|
|
|
|
|
|
|
|
Contributions are welcome.
|
|
|
|
|
2018-08-13 08:56:08 +02:00
|
|
|
## Creators
|
2014-10-16 20:08:40 +02:00
|
|
|
|
|
|
|
**Remco Verhoef**
|
|
|
|
- <https://twitter.com/remco_verhoef>
|
|
|
|
- <https://twitter.com/dutchcoders>
|
|
|
|
|
|
|
|
**Uvis Grinfelds**
|
|
|
|
|
2018-10-27 00:15:55 +02:00
|
|
|
## Maintainer
|
|
|
|
|
|
|
|
**Andrea Spacca**
|
|
|
|
|
2014-10-16 20:08:40 +02:00
|
|
|
## Copyright and license
|
|
|
|
|
2018-08-13 22:14:54 +02:00
|
|
|
Code and documentation copyright 2011-2018 Remco Verhoef.
|
2018-08-13 08:56:08 +02:00
|
|
|
Code released under [the MIT license](LICENSE).
|