| Sergiusz Bazanski | de06180 | 2019-01-13 21:14:02 +0100 | [diff] [blame] | 1 | HSCloud Clusters |
| 2 | ================ |
| 3 | |
| 4 | Current cluster: `k0.hswaw.net` |
| 5 | |
| 6 | Accessing via kubectl |
| 7 | --------------------- |
| 8 | |
| Sergiusz Bazanski | b13b7ff | 2019-08-29 20:12:24 +0200 | [diff] [blame^] | 9 | prodaccess # get a short-lived certificate for your use via SSO |
| Sergiusz Bazanski | de06180 | 2019-01-13 21:14:02 +0100 | [diff] [blame] | 10 | kubectl get nodes |
| 11 | |
| Sergiusz Bazanski | b13b7ff | 2019-08-29 20:12:24 +0200 | [diff] [blame^] | 12 | Persistent Storage |
| Sergiusz Bazanski | de06180 | 2019-01-13 21:14:02 +0100 | [diff] [blame] | 13 | ------------------ |
| 14 | |
| Sergiusz Bazanski | 2fd5861 | 2019-04-02 14:45:17 +0200 | [diff] [blame] | 15 | HDDs on bc01n0{1-3}. 3TB total capacity. |
| 16 | |
| 17 | The following storage classes use this cluster: |
| 18 | |
| Sergiusz Bazanski | b13b7ff | 2019-08-29 20:12:24 +0200 | [diff] [blame^] | 19 | - `waw-hdd-paranoid-1` - 3 replicas |
| Sergiusz Bazanski | 2fd5861 | 2019-04-02 14:45:17 +0200 | [diff] [blame] | 20 | - `waw-hdd-redundant-1` - erasure coded 2.1 |
| Sergiusz Bazanski | 36cc4fb | 2019-05-17 18:08:48 +0200 | [diff] [blame] | 21 | - `waw-hdd-yolo-1` - unreplicated (you _will_ lose your data) |
| Piotr Dobrowolski | 5691823 | 2019-04-09 23:48:33 +0200 | [diff] [blame] | 22 | - `waw-hdd-redundant-1-object` - erasure coded 2.1 object store |
| Sergiusz Bazanski | 2fd5861 | 2019-04-02 14:45:17 +0200 | [diff] [blame] | 23 | |
| 24 | A dashboard is available at https://ceph-waw1.hswaw.net/, to get the admin password run: |
| 25 | |
| 26 | kubectl -n ceph-waw1 get secret rook-ceph-dashboard-password -o yaml | grep "password:" | awk '{print $2}' | base64 --decode ; echo |
| 27 | |
| Piotr Dobrowolski | 5691823 | 2019-04-09 23:48:33 +0200 | [diff] [blame] | 28 | Rados Gateway (S3) is available at https://object.ceph-waw1.hswaw.net/. To create |
| 29 | an object store user consult rook.io manual (https://rook.io/docs/rook/v0.9/ceph-object-store-user-crd.html) |
| 30 | User authentication secret is generated in ceph cluster namespace (`ceph-waw1`), |
| 31 | thus may need to be manually copied into application namespace. (see |
| 32 | `app/registry/prod.jsonnet` comment) |
| 33 | |
| 34 | `tools/rook-s3cmd-config` can be used to generate test configuration file for s3cmd. |
| 35 | Remember to append `:default-placement` to your region name (ie. `waw-hdd-redundant-1-object:default-placement`) |
| Sergiusz Bazanski | b13b7ff | 2019-08-29 20:12:24 +0200 | [diff] [blame^] | 36 | |
| 37 | Administration |
| 38 | ============== |
| 39 | |
| 40 | Provisioning nodes |
| 41 | ------------------ |
| 42 | |
| 43 | - bring up a new node with nixos, running the configuration.nix from bootstrap (to be documented) |
| 44 | - `bazel run //cluster/clustercfg:clustercfg nodestrap bc01nXX.hswaw.net` |
| 45 | |
| 46 | That's it! |
| 47 | |
| 48 | Ceph |
| 49 | ==== |
| 50 | |
| 51 | We run Ceph via Rook. The Rook operator is running in the `ceph-rook-system` namespace. To debug Ceph issues, start by looking at its logs. |
| 52 | |
| 53 | The following Ceph clusters are available: |
| 54 | |