James Lu 7cc3351ff8 LEP for Azure Blob Storage Backup Store Support

Ref: 1309

Signed-off-by: James Lu <james.lu@suse.com>

2023-04-26 15:31:58 +08:00

1.8 KiB

Raw Permalink Blame History

Azure Blob Storage Backup Store Support

Summary

Longhorn supports Azure Blob Storage as a backup storage.

https://github.com/longhorn/longhorn/issues/1309

Motivation

Goals

Support Azure Blob Storage as a backup storage.

Proposal

Introduce Azure Blob Storage client for supporting Azure Blob Storage as a backup storage.

User Stories

Longhorn already supports NFSv4, CIFS and S3 servers as backup storage. However, certain users may still want to be able to utilize Azure blob storage to push/pull backups to/from.

User Experience In Details

Users can configure a Azure Blob Storage as a backup storage
- Set Backup Target. The path to a Azure Blob Storage is like
```
azblob://${container}@blob.core.windows.net/${path name}
```

Set Backup Target Credential Secret

Create a secret and deploy it

apiVersion: v1
kind: Secret
metadata:
name: azblob-secret
  namespace: longhorn-system
type: Opaque
data:
  AZBLOB_ACCOUNT_NAME: ${AZBLOB_ACCOUNT_NAME}
  AZBLOB_ACCOUNT_KEY: ${AZBLOB_ACCOUNT_KEY}

Set the setting Backup Target Credential Secret to azblob-secret

Design

Implementation Overview

longhorn-manager
- Introduce the fields AZBLOB_ACCOUNT_NAME and AZBLOB_ACCOUNT_KEY in credentials. The two fields are passed to engine and replica processes for volume backup and restore operations.
backupstore
- Implement Azure Blob Storage register/unregister and basic CRUD functions.

Test Plan

Integration Tests

Set a Azure Blob Storage as backup storage.
Create volumes and write some data.
Back up volumes to the backup storage and the operation should succeed.
Restore backups and operations should succeed.
All data is not corrupted.

1.8 KiB Raw Permalink Blame History