Commit graph

6663 commits

Author SHA1 Message Date
Grant Limberg
c9c8e95d60 debug output of main script 2025-09-04 11:16:48 -07:00
Grant Limberg
d216a3739f run process in conda env directly from docker 2025-09-04 11:14:34 -07:00
Grant Limberg
092fc268d3 ok back to full path 2025-09-04 11:11:14 -07:00
Grant Limberg
1da9e24905 no absolute path for pg_isready 2025-09-04 11:03:30 -07:00
Grant Limberg
158d24545a also have to add postgres to the container for pg_isready 2025-09-04 10:30:08 -07:00
Grant Limberg
96aa893df4 stray backtick 2025-09-04 09:50:19 -07:00
Grant Limberg
4516e6a340 need a conda init here first apparently 2025-09-04 09:27:08 -07:00
Grant Limberg
2416c42df7 change tag to match existing 2025-09-04 08:48:54 -07:00
Grant Limberg
4f07599992 add jemalloc
Some checks are pending
/ build_macos (push) Waiting to run
/ build_windows (push) Waiting to run
/ Central Controller Build (push) Waiting to run
/ multi-arch-docker (push) Blocked by required conditions
/ build_ubuntu (push) Waiting to run
2025-09-03 15:04:51 -07:00
Grant Limberg
6ceb8eac97 text alignment 2025-09-03 13:56:32 -07:00
Grant Limberg
3ad352c08e no trailing comma on bigtable block 2025-09-03 13:56:04 -07:00
Grant Limberg
9d73c346b7 new modified startup script for central controller docker images with support for configuring bigtable, pubsub, redis 2025-09-03 13:48:38 -07:00
Grant Limberg
4abf90247d update ld.so.conf for paths to libraries 2025-09-03 13:22:21 -07:00
Grant Limberg
594d227f92 fix multi-arch manifest creation
Some checks are pending
/ build_macos (push) Waiting to run
/ build_windows (push) Waiting to run
/ Central Controller Build (push) Waiting to run
/ multi-arch-docker (push) Blocked by required conditions
/ build_ubuntu (push) Waiting to run
2025-09-03 12:18:21 -07:00
Grant Limberg
7fd112eb4f fix short hash 2025-09-03 11:50:09 -07:00
Grant Limberg
000f3d5a8c let's build a docker image 2025-09-03 11:37:26 -07:00
Grant Limberg
3f3e684811 only update conda env if cache was not hit 2025-09-03 10:42:22 -07:00
Grant Limberg
a841e96bd2 put git branch ref into cache key name 2025-09-03 10:40:31 -07:00
Grant Limberg
3ff4d67d21 bump 2025-09-03 10:29:53 -07:00
Grant Limberg
b09956ae59 fix run arg 2025-09-03 10:28:42 -07:00
Grant Limberg
4395574706 cache conda environment 2025-09-03 10:27:06 -07:00
Grant Limberg
1dae4c4c5f cache conda environment 2025-09-03 10:23:33 -07:00
Grant Limberg
d31b3a08db set ZT_AES_NEON for arm64 2025-09-03 10:08:16 -07:00
Grant Limberg
0f3a5148b1 fix deps for selftest 2025-09-03 09:29:33 -07:00
Grant Limberg
d3f1ec74ba fix arm64 build flag 2025-09-03 09:20:13 -07:00
Grant Limberg
3470ceb13d cmake --build args 2025-09-03 09:12:04 -07:00
Grant Limberg
648f0915e5 skip cmake action 2025-09-03 09:09:17 -07:00
Grant Limberg
21e20f2104 more conda 2025-09-03 09:04:40 -07:00
Grant Limberg
f43bc3d10c more conda 2025-09-03 09:00:36 -07:00
Grant Limberg
3ad36c773d fix cmake options 2025-09-03 08:55:29 -07:00
Grant Limberg
22484c708f dependency juggling 2025-09-03 08:51:21 -07:00
Grant Limberg
cab33dfc89 no linux/arm64 build available for google-cloud-cpp 2.39 :/. Downgrade to 2.38 2025-09-03 08:45:33 -07:00
Grant Limberg
e1db40d932 test 2025-09-03 08:39:02 -07:00
Grant Limberg
97681b589e trying to get this working 2025-09-03 08:37:30 -07:00
Grant Limberg
09f1ee77e1 skip caching until this all works 2025-09-03 08:26:08 -07:00
Grant Limberg
0f13363895 runs-on matrix 2025-09-03 08:22:47 -07:00
Grant Limberg
7c1bfc97c4 setup github action for building 2025-09-03 08:18:56 -07:00
Grant Limberg
2a647d497a remove otel warning
Some checks are pending
/ build_macos (push) Waiting to run
/ build_windows (push) Waiting to run
/ build_ubuntu (push) Waiting to run
2025-09-02 16:25:16 -07:00
Grant Limberg
70f9fe0412 update central controller readme with config block 2025-09-02 14:15:28 -07:00
Grant Limberg
0753556aa3 wire up configuration.
New config block in local.conf for controllers:

```
{
  "settings": {
    ...standard zt1 local.conf settings...
  },
  "controller": {
    "listenMode": (pgsql|redis|pubsub),
    "statusMode": (pgsql|redis|bigtable),
    "redis": {
      "hostname": ...,
      "port": 6379,
      "clusterMode": true
    },
    "pubsub": {
      "project_id": <gcp-project-id>
    },
    "bigtable": {
      "project_id": <gcp-project-id>,
      "instance_id": <bigtable-instance-id>,
      "table_id": <bigtable-table-id>
    }
  }
}
```
2025-09-02 14:06:24 -07:00
Grant Limberg
a5bd262b3a Wiring through initialization of the CentralDB version of the controller
Still need to do the actual configuration from local.conf
2025-09-02 13:30:08 -07:00
Grant Limberg
4ddb1fbe58 Create the pubsub topic if it doesn't exist
Some checks are pending
/ build_macos (push) Waiting to run
/ build_windows (push) Waiting to run
/ build_ubuntu (push) Waiting to run
2025-09-02 07:49:41 -07:00
Grant Limberg
195d5b47f0 Merge branch 'adam/1.16' into gl/ctl-pubsub
Some checks are pending
/ build_macos (push) Waiting to run
/ build_windows (push) Waiting to run
/ build_ubuntu (push) Waiting to run
2025-09-01 16:47:55 -07:00
Grant Limberg
496e69e666 add def for new style controllers 2025-09-01 15:29:27 -07:00
Grant Limberg
0f63783592 remove rust-based pubsub 2025-09-01 14:55:16 -07:00
Grant Limberg
db6e698245 rework the pubsub listener again so the subscription is set up on its own thread 2025-09-01 14:40:18 -07:00
Grant Limberg
b114896e7b PubSub to gcloud-cpp library for simplicity's sake 2025-09-01 14:25:15 -07:00
Grant Limberg
17b48d78cb Merge branch 'dev' into gl/ctl-pubsub
Some checks are pending
/ build_macos (push) Waiting to run
/ build_windows (push) Waiting to run
/ build_ubuntu (push) Waiting to run
2025-09-01 09:50:15 -07:00
Grant Limberg
e347f895b8 add sleep at end of online notificaiton loop 2025-09-01 09:44:39 -07:00
Grant Limberg
d119547a95 wire up status writers 2025-09-01 09:18:01 -07:00