Commit graph

6658 commits

Author SHA1 Message Date
Grant Limberg
96aa893df4 stray backtick 2025-09-04 09:50:19 -07:00
Grant Limberg
4516e6a340 need a conda init here first apparently 2025-09-04 09:27:08 -07:00
Grant Limberg
2416c42df7 change tag to match existing 2025-09-04 08:48:54 -07:00
Grant Limberg
4f07599992 add jemalloc
Some checks are pending
/ build_macos (push) Waiting to run
/ build_windows (push) Waiting to run
/ Central Controller Build (push) Waiting to run
/ multi-arch-docker (push) Blocked by required conditions
/ build_ubuntu (push) Waiting to run
2025-09-03 15:04:51 -07:00
Grant Limberg
6ceb8eac97 text alignment 2025-09-03 13:56:32 -07:00
Grant Limberg
3ad352c08e no trailing comma on bigtable block 2025-09-03 13:56:04 -07:00
Grant Limberg
9d73c346b7 new modified startup script for central controller docker images with support for configuring bigtable, pubsub, redis 2025-09-03 13:48:38 -07:00
Grant Limberg
4abf90247d update ld.so.conf for paths to libraries 2025-09-03 13:22:21 -07:00
Grant Limberg
594d227f92 fix multi-arch manifest creation
Some checks are pending
/ build_macos (push) Waiting to run
/ build_windows (push) Waiting to run
/ Central Controller Build (push) Waiting to run
/ multi-arch-docker (push) Blocked by required conditions
/ build_ubuntu (push) Waiting to run
2025-09-03 12:18:21 -07:00
Grant Limberg
7fd112eb4f fix short hash 2025-09-03 11:50:09 -07:00
Grant Limberg
000f3d5a8c let's build a docker image 2025-09-03 11:37:26 -07:00
Grant Limberg
3f3e684811 only update conda env if cache was not hit 2025-09-03 10:42:22 -07:00
Grant Limberg
a841e96bd2 put git branch ref into cache key name 2025-09-03 10:40:31 -07:00
Grant Limberg
3ff4d67d21 bump 2025-09-03 10:29:53 -07:00
Grant Limberg
b09956ae59 fix run arg 2025-09-03 10:28:42 -07:00
Grant Limberg
4395574706 cache conda environment 2025-09-03 10:27:06 -07:00
Grant Limberg
1dae4c4c5f cache conda environment 2025-09-03 10:23:33 -07:00
Grant Limberg
d31b3a08db set ZT_AES_NEON for arm64 2025-09-03 10:08:16 -07:00
Grant Limberg
0f3a5148b1 fix deps for selftest 2025-09-03 09:29:33 -07:00
Grant Limberg
d3f1ec74ba fix arm64 build flag 2025-09-03 09:20:13 -07:00
Grant Limberg
3470ceb13d cmake --build args 2025-09-03 09:12:04 -07:00
Grant Limberg
648f0915e5 skip cmake action 2025-09-03 09:09:17 -07:00
Grant Limberg
21e20f2104 more conda 2025-09-03 09:04:40 -07:00
Grant Limberg
f43bc3d10c more conda 2025-09-03 09:00:36 -07:00
Grant Limberg
3ad36c773d fix cmake options 2025-09-03 08:55:29 -07:00
Grant Limberg
22484c708f dependency juggling 2025-09-03 08:51:21 -07:00
Grant Limberg
cab33dfc89 no linux/arm64 build available for google-cloud-cpp 2.39 :/. Downgrade to 2.38 2025-09-03 08:45:33 -07:00
Grant Limberg
e1db40d932 test 2025-09-03 08:39:02 -07:00
Grant Limberg
97681b589e trying to get this working 2025-09-03 08:37:30 -07:00
Grant Limberg
09f1ee77e1 skip caching until this all works 2025-09-03 08:26:08 -07:00
Grant Limberg
0f13363895 runs-on matrix 2025-09-03 08:22:47 -07:00
Grant Limberg
7c1bfc97c4 setup github action for building 2025-09-03 08:18:56 -07:00
Grant Limberg
2a647d497a remove otel warning
Some checks are pending
/ build_macos (push) Waiting to run
/ build_windows (push) Waiting to run
/ build_ubuntu (push) Waiting to run
2025-09-02 16:25:16 -07:00
Grant Limberg
70f9fe0412 update central controller readme with config block 2025-09-02 14:15:28 -07:00
Grant Limberg
0753556aa3 wire up configuration.
New config block in local.conf for controllers:

```
{
  "settings": {
    ...standard zt1 local.conf settings...
  },
  "controller": {
    "listenMode": (pgsql|redis|pubsub),
    "statusMode": (pgsql|redis|bigtable),
    "redis": {
      "hostname": ...,
      "port": 6379,
      "clusterMode": true
    },
    "pubsub": {
      "project_id": <gcp-project-id>
    },
    "bigtable": {
      "project_id": <gcp-project-id>,
      "instance_id": <bigtable-instance-id>,
      "table_id": <bigtable-table-id>
    }
  }
}
```
2025-09-02 14:06:24 -07:00
Grant Limberg
a5bd262b3a Wiring through initialization of the CentralDB version of the controller
Still need to do the actual configuration from local.conf
2025-09-02 13:30:08 -07:00
Grant Limberg
4ddb1fbe58 Create the pubsub topic if it doesn't exist
Some checks are pending
/ build_macos (push) Waiting to run
/ build_windows (push) Waiting to run
/ build_ubuntu (push) Waiting to run
2025-09-02 07:49:41 -07:00
Grant Limberg
195d5b47f0 Merge branch 'adam/1.16' into gl/ctl-pubsub
Some checks are pending
/ build_macos (push) Waiting to run
/ build_windows (push) Waiting to run
/ build_ubuntu (push) Waiting to run
2025-09-01 16:47:55 -07:00
Grant Limberg
496e69e666 add def for new style controllers 2025-09-01 15:29:27 -07:00
Grant Limberg
0f63783592 remove rust-based pubsub 2025-09-01 14:55:16 -07:00
Grant Limberg
db6e698245 rework the pubsub listener again so the subscription is set up on its own thread 2025-09-01 14:40:18 -07:00
Grant Limberg
b114896e7b PubSub to gcloud-cpp library for simplicity's sake 2025-09-01 14:25:15 -07:00
Grant Limberg
17b48d78cb Merge branch 'dev' into gl/ctl-pubsub
Some checks are pending
/ build_macos (push) Waiting to run
/ build_windows (push) Waiting to run
/ build_ubuntu (push) Waiting to run
2025-09-01 09:50:15 -07:00
Grant Limberg
e347f895b8 add sleep at end of online notificaiton loop 2025-09-01 09:44:39 -07:00
Grant Limberg
d119547a95 wire up status writers 2025-09-01 09:18:01 -07:00
Grant Limberg
85f23356a3 add a StatusWriter class hierarchy for writing member status updates
Some checks failed
/ build_macos (push) Has been cancelled
/ build_windows (push) Has been cancelled
/ build_ubuntu (push) Has been cancelled
* Postgres Direct
* Redis
* BigTable
2025-08-28 17:03:59 -07:00
Grant Limberg
3187c2ffce clang format change (not applied project-wide yet) 2025-08-28 17:00:06 -07:00
Grant Limberg
9bdd564bdc spacing
Some checks are pending
/ build_macos (push) Waiting to run
/ build_windows (push) Waiting to run
/ build_ubuntu (push) Waiting to run
2025-08-27 16:23:55 -07:00
Grant Limberg
7f3b15011e Update central controller build to use CMake + conda
Muuuuch easier to use external dependencies now

Also tried out conan and vcpkg.   Ran into dependency issues when solving for packages to install with conan.

vcpkg is just obtuse as all hell to install and not easy to integrate
2025-08-27 16:23:02 -07:00
Adam Ierymenko
bbba390e97 Windows build and version bump.
Some checks failed
/ build_macos (push) Has been cancelled
/ build_windows (push) Has been cancelled
/ build_ubuntu (push) Has been cancelled
2025-08-26 09:33:54 -07:00