Commit Graph

480 Commits

Author SHA1 Message Date
Sheng Yang
b22fcdd6a7 Merge branch 'master' into v1.0.1
Fix merge conflict.

Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-07-20 20:27:25 -07:00
Sheng Yang
ab63788557 Longhorn v1.0.1 release
i## Highlights:
1. [Make Longhorn Helm Chart directly available through Helm repo](https://github.com/longhorn/longhorn/issues/1043). Now the users can use `helm repo add longhorn https://charts.longhorn.io` to find and install Longhorn easily through Helm command line.
1. [NFS on Longhorn for RWX Access Mode (experimental)](https://github.com/longhorn/longhorn/issues/1183). We've provided a way to add Longhorn backed NFS provisioner to the cluster, so now user can use `longhorn-nfs` StorageClass to provision RWX volumes. Note: currently NFS provisioner is not highly available. If the node NFS provisioner running is down, the workload using RWX volume might be interrupted for a couple of minutes before restoring the service. Check [here](https://staging.longhorn.io/docs/1.0.0/advanced-resources/rwx-workloads/) for details.
1. Improved Air Gap Environment Support. Check [here](https://staging.longhorn.io/docs/1.0.0/advanced-resources/deploy/airgap/) for updated document for air gap installation.
    1. [Remove the air gap image name length limitation](https://github.com/longhorn/longhorn/issues/1323).
    1. [Change the default image pull policy from `Always` to `IfNotPresent`](https://github.com/longhorn/longhorn/issues/1491)
    1. [Aggregate the necessary Docker images](https://github.com/longhorn/longhorn/issues/1419)
    1. [HTTP/HTTPS_PROXY support for S3 backupstore](https://github.com/longhorn/longhorn/issues/1540)
1. [Support PriorityClass for Longhorn deployment](https://github.com/longhorn/longhorn/issues/1487). Check [here](https://staging.longhorn.io/docs/1.0.0/advanced-resources/deploy/priority-class/) for details.

Live upgrade from v1.0.0 to v1.0.1 is supported.

Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-07-20 20:25:13 -07:00
Sheng Yang
01f6597992 Update tag to v1.0.1
Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-07-20 20:25:13 -07:00
Sheng Yang
8ad1f9f378 Sync with manager
commit f13b9a9f32b010420d9e66b15b7cae7ac4545b5c
Author: Sheng Yang <sheng.yang@rancher.com>
Date:   Mon Jul 20 18:08:13 2020 -0700

    Longhorn v1.0.1 release

    Signed-off-by: Sheng Yang <sheng.yang@rancher.com>

Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-07-20 20:25:13 -07:00
Michael William Le Nguyen
1eae8fc7e2 chart: remove rancher labs from chart description
Signed-off-by: Michael William Le Nguyen <michael@mail.ttp.codes>
2020-07-20 16:50:29 -07:00
Michael William Le Nguyen
505163c9dc chart: use icon instead of horizontal for logo
Signed-off-by: Michael William Le Nguyen <michael@mail.ttp.codes>
2020-07-20 16:50:29 -07:00
Sheng Yang
46f0270df9 Correct chart tags to v1.0.1-rc3
Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-07-18 13:09:34 -07:00
Sheng Yang
3a13b07630 Update version to v1.0.1-rc3
Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-07-18 13:02:55 -07:00
Sheng Yang
d1be6b428c Sync with manager
commit 5be96bd1ad71fecbf670cd21313e8d1858c7ddb8
Author: Sheng Yang <sheng.yang@rancher.com>
Date:   Sat Jul 18 12:17:44 2020 -0700

    Longhorn v1.0.1-rc3 release

    Signed-off-by: Sheng Yang <sheng.yang@rancher.com>

Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-07-18 13:02:55 -07:00
Sheng Yang
e2253bc882 Update version to v1.0.1-rc2
Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-07-15 22:58:04 -07:00
Sheng Yang
934baee6f6 Sync with manager:
commit 7a8bdeedfa7f046f4cd2ee1a8827a499dc9b5cd1
Author: Sheng Yang <sheng.yang@rancher.com>
Date:   Wed Jul 15 22:01:54 2020 -0700

    Longhorn v1.0.1-rc2 release

    Signed-off-by: Sheng Yang <sheng.yang@rancher.com>

Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-07-15 22:58:04 -07:00
Michael William Le Nguyen
4a24d6b0ee chart: update maintainers
Signed-off-by: Michael William Le Nguyen <michael@mail.ttp.codes>
2020-07-15 22:58:04 -07:00
Phan Le
395795353e chart: change the CSI Driver Registrar image variable in question.yaml to have the same name as in values.yaml
This makes sure that the Rancher chart correctly passes the
user-provided image registry value to values.yaml. So Longhorn
will pull the CSI Driver Registrar image from private registry
if the registry is provided.

Longhorn#1590

Signed-off-by: Phan Le <phan.le@rancher.com>
2020-07-15 22:00:36 -07:00
Phan Le
c90ad4cf2b scripts: fix the scripts load-images.sh and save-images.sh in the case user provides invalid flags
When user provides an invalid flag, print out error message and
help menu instead of looping forever

Longhorn #1419

Signed-off-by: Phan Le <phan.le@rancher.com>
2020-07-15 19:48:43 -07:00
Sheng Yang
312ea9d54d Update images.txt to v1.0.1-rc1
Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-07-15 18:13:28 -07:00
Sheng Yang
9464de28e0 deploy: Rename longhorn-images-release.txt to release-images.txt
Also remove test image in images.txt and release-images.txt.

The images related to integration test will be addressed separately later.

Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-07-15 18:13:28 -07:00
Phan Le
13b2d0c84e deploy, scripts: change the save-images.sh and load-images.sh so by default they don't create/load a tar file
This option will make it faster for user who don't need the exported tar file

Longhorn #1419

Signed-off-by: Phan Le <phan.le@rancher.com>
2020-07-15 17:38:02 -07:00
Michael William Le Nguyen
ba31edc6a2 chart: update maintainers
Signed-off-by: Michael William Le Nguyen <michael@mail.ttp.codes>
2020-07-15 13:00:05 -07:00
Phan Le
d2460a9819 deploy, scripts: provide list of images and script to pull and push all Longhorn component images to user provided registry
This help to remove the extra dependency on different container image
registry. Docker Hub now holds all Longhorn components' images.
Also, users can easily pull all the necessary images to their
air-gap environment

Longhorn #1419

Signed-off-by: Phan Le <phan.le@rancher.com>
2020-07-14 22:29:57 -07:00
Sheng Yang
c08d2a0295 Revert "deploy, scripts: provide list of images and script to pull and push all Longhorn component images to user provided registry"
This reverts commit f5379e2ec0.
2020-07-14 21:41:40 -07:00
Phan Le
f5379e2ec0 deploy, scripts: provide list of images and script to pull and push all Longhorn component images to user provided registry
This help to remove the extra dependency on different container image
registry. Docker Hub now holds all Longhorn components' images.
Also, users can easily pull all the necessary images to their
air-gap environment

Longhorn #1419

Signed-off-by: Phan Le <phan.le@rancher.com>
2020-07-14 21:39:57 -07:00
Michael William Le Nguyen
b76af125da chart: fix whitespace in questions.yml
Signed-off-by: Michael William Le Nguyen <michael@mail.ttp.codes>
2020-07-14 17:02:30 -07:00
Michael William Le Nguyen
1857eef869 chart: add priority class to questions.yml
Signed-off-by: Michael William Le Nguyen <michael@mail.ttp.codes>
2020-07-14 17:02:30 -07:00
Michael William Le Nguyen
7823f6485c Update deploy for v1.0.1-rc1
Signed-off-by: Michael William Le Nguyen <michael@mail.ttp.codes>
2020-07-14 16:18:34 -07:00
Sheng Yang
f67834598e Add back RWX examples
It should be added to longhorn/manager instead. Will be fixed by the
next RC.

Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-07-10 17:47:50 -07:00
Sheng Yang
1b20b1b0fe Update version to v1.0.1-rc1
Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-07-10 17:47:50 -07:00
Sheng Yang
7d19a0cbbb Sync with manager
commit 77b2d77251ebe280d4ffaade654c85c6bcba5bbc
Author: Sheng Yang <sheng.yang@rancher.com>
Date:   Fri Jul 10 16:17:29 2020 -0700

    Longhorn v1.0.1-rc1 release

    Signed-off-by: Sheng Yang <sheng.yang@rancher.com>

Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-07-10 17:47:50 -07:00
Michael William Le Nguyen
222759ee75 chart: update NOTES.txt
This provides a basic post-install message for the Longhorn chart.

Signed-off-by: Michael William Le Nguyen <michael@mail.ttp.codes>
2020-07-10 12:23:29 -07:00
Michael William Le Nguyen
5df10eccf1 chart: Fix newline for default-setting.yaml
Signed-off-by: Michael William Le Nguyen <michael@mail.ttp.codes>
2020-07-09 12:12:14 -07:00
Michael William Le Nguyen
ce6db0b2bc chart: Add Helm standard labels to templates
Signed-off-by: Michael William Le Nguyen <michael@mail.ttp.codes>
2020-07-09 12:12:14 -07:00
Shuo Wu
b478c3a1bf example: Fix example rwx
1. Use different names for the 2 roles
(and the related role bindings)
2. Make sure the role binding namespace is the same as the
namespace where nfs provisioner is deployed

Signed-off-by: Shuo Wu <shuo@rancher.com>
2020-07-07 13:09:18 -07:00
Joshua Moody
43318cd24f enhancements: Add LEP for backupstore file locks
The idea is to implement a locking mechanism that utilizes the backupstore,
to prevent the following dangerous cases of concurrent operations.
1. prevent backup deletion during backup restoration
2. prevent backup deletion while a backup is in progress
3. prevent backup creation during backup deletion
4. prevent backup restoration during backup deletion

The locking solution shouldn't unnecessary block operations, so the
following cases should be allowed.
1. allow backup creation during restoration
2. allow backup restoration during creation

The locking solution should have a maximum wait time for lock acquisition,
which will fail the backup operation so that the user does not have to wait
forever.

The locking solution should be self expiring, so that when a process dies
unexpectedly, future processes are able to acquire the lock.

The locking solution should guarantee that only a single type of lock is
active at a time.

The locking solution should allow a lock to be passed down into async
running go routines.

Longhorn #612

Signed-off-by: Joshua Moody <joshua.moody@rancher.com>
2020-07-07 10:09:24 -07:00
Phan Le
1a58855f0d dev/scripts, deploy, chart/templates: change imagePullPolicy to IfNotPresent for manager, ui, driver deployer. Also add a bash script to update the image pull policy to be Always
We changed the imagePullPolicy to IfNotPresent so that user can easily
install Longhorn in air-gap instalation.
Also add a bash script for the developer to quickly change all the
imagePullPolicies back to Always so that k8s always pull the
lastest images. This will be useful when dev use the tag such as master.

Longhorn #1491

Signed-off-by: Phan Le <phan.le@rancher.com>
2020-07-02 10:35:18 -07:00
Michael William Le Nguyen
063db2bc5d enhancements: Add LEP for Volume deletion logic
Signed-off-by: Michael William Le Nguyen <michael@mail.ttp.codes>
2020-07-01 12:20:02 -07:00
Joshua Moody
aec2021833 Add rwx-test deployment (append only log)
The test deployment creates 4 replicas that continously, write the
current date time once a second into the file `/mnt/nfs-test/test.log`

This is a good test for an rwx volume. Since it replicates an append
only log that is used by multiple pods.

Signed-off-by: Joshua Moody <joshua.moody@rancher.com>
2020-07-01 12:16:34 -07:00
Joshua Moody
23f9cc18b3 Hardcode nfs service cluster ip
So that on a delete & recreate of the service the previous pv's still
point to this nfs-provisioner. We cannot use the hostname since the actual
host doesn't know how to resolve service addresses inside of the cluster.

To support this would require the installation of kube-dns and
modification to the /etc/resolve.conf file on each host.

Signed-off-by: Joshua Moody <joshua.moody@rancher.com>
2020-07-01 12:16:34 -07:00
Joshua Moody
f70ee1063d Add noresvport to the nfs mount options
This makes the nfs client use a new src port for each tcp reconnect.
This way after a crash the faulty connection isn't kept alive in the
connection cache (nat). This should allow to resolve the cluster ip to
the new destination pod ip.

Signed-off-by: Joshua Moody <joshua.moody@rancher.com>
2020-07-01 12:16:34 -07:00
Joshua Moody
8969d829f2 Add quicker failover for nfs
Add tolerations so that nfs provisioner pod gets evicted from a failing
node after 60 second + 30 grace period (relevant for va recovery policy).
Add liveness + readyness probe, so that no traffic gets routed to a failed
nfs server. Disable device based fsids (major:minor) since our block device
mapping can change from node to node, which makes the id's unstable.

Signed-off-by: Joshua Moody <joshua.moody@rancher.com>
2020-07-01 12:16:34 -07:00
Joshua Moody
51d693b42d Add example deployment of nfs on top of a longhorn volume
This can be used to support RWX scenarios by exposing the longhorn volume via the nfs provisioner. The nfs-provisioner we use can be found at:
https://github.com/kubernetes-incubator/external-storage/tree/master/nfs

Signed-off-by: Joshua Moody <joshua.moody@rancher.com>
2020-07-01 12:16:34 -07:00
dmayle
5f775a7488 Update README.md to specify NFS version is v4
Attempting to use longhorn with NFSv3 for backuip causes errors related to rpc.statd, which is not managed by longhorn processes.  Longhorn works properly with NFSv4 servers only.

Signed-off-by: Douglas Mayle <dmayle@dmayle.com>
2020-06-25 17:09:11 -07:00
Bo Tao
809578d983 chart: Add downgrade warning and highlight namespace requirement
Longhorn #1454

Signed-off-by: Bo Tao <bo.tao@rancher.com>
2020-06-04 11:52:18 -07:00
Sheng Yang
2218629598 Update README.md
Remove mention of beta quality.

Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-06-02 06:29:27 -07:00
Sheng Yang
3b051eb0fd
Merge pull request #1438 from longhorn/v1.0.0
v1.0.0 to master
2020-05-30 10:20:55 -07:00
Sheng Yang
6d9f02a8c7 Longhorn v1.0.0 release
See https://github.com/longhorn/longhorn/releases/tag/v1.0.0 for the
release note.

Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-05-30 10:03:43 -07:00
Sheng Yang
af389e60a9 Update version to v1.0.0
Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-05-30 10:03:43 -07:00
Sheng Yang
92bbd62958 Sync with manager
commit 1c1bb3571c25378bc8e3680bed72ef3ce61c4360
Author: Sheng Yang <sheng.yang@rancher.com>
Date:   Sat May 30 08:55:06 2020 -0700

    Longhorn v1.0.0 release

    Signed-off-by: Sheng Yang <sheng.yang@rancher.com>

Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-05-30 10:03:43 -07:00
Sheng Yang
acb80c4660 Update version to v1.0.0-rc3
Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-05-28 15:20:01 -07:00
Sheng Yang
905c507717 Sync with Longhorn manager:
commit 50524bd046eae4e6702a153115fdf6f82aa0eb3a
Author: Sheng Yang <sheng.yang@rancher.com>
Date:   Thu May 28 14:38:29 2020 -0700

    Longhorn v1.0.0-rc3 release

    Signed-off-by: Sheng Yang <sheng.yang@rancher.com>

Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-05-28 15:20:01 -07:00
Sheng Yang
6bb4abd5f7 Update version to v1.0.0-rc2
Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-05-23 13:35:29 -07:00
Sheng Yang
385c7ea54d Sync with manager:
commit fdd34f4f1986da6db3bac1b53c385c23203b0775
Author: Sheng Yang <sheng.yang@rancher.com>
Date:   Sat May 23 13:00:11 2020 -0700

    Longhorn v1.0.0-rc2 release

    Signed-off-by: Sheng Yang <sheng.yang@rancher.com>

Signed-off-by: Sheng Yang <sheng.yang@rancher.com>
2020-05-23 13:35:29 -07:00