Skip to content

Releases: IBM/lunchpail

v0.27.0

25 Sep 21:35
Compare
Choose a tag to compare

What's Changed

  • fix:target=ibmcloud components workstealer and workdispatcher default sa not found by @aavarghese in #225
  • feat: port tests/bin/helpers.sh from kubectl logs to lunchpail logs by @starpit in #227
  • feat: runs command and update helpers.sh to use it by @starpit in #228
  • test: remove unused local queue= shell variable in tests/bin/helpers.sh by @starpit in #230
  • test: eliminate unused waitForStatus in helpers.sh by @starpit in #232
  • test: update the second run_name= in helpers.sh by @starpit in #233
  • test: eliminate watch from helpers.sh by @starpit in #234
  • test: eliminate unnecessary kubectl waits from helper.sh by @starpit in #235
  • feat: lunchpail run instances by @starpit in #236
  • test: update test7 validator to expect 6 output files by @starpit in #237
  • feat: qls and qcat in compiled mode by @starpit in #238
  • test: isolate securityContext tests into test7-security-context by @starpit in #239
  • feat: update qin to support running in compiled mode by @starpit in #240
  • fix: eliminate rclone CLI dependence from tests by @starpit in #241
  • feat: do away with hack/init by having be/kubernetes.Ok() prompt to create cluster by @starpit in #242
  • fix: update kubernetes ListRuns to look for pods not jobs by @starpit in #243
  • fix: remove leftover debug comments by @starpit in #244
  • fix: minio server command sleeps twice before exit by @starpit in #245
  • feat: lunchpail copyout by @starpit in #246
  • feat: move copyout impl from be/kubernetes into fe/transformer by @starpit in #247
  • fix: job parallelism for all VSIs together can be more than requested worker bug by @aavarghese in #248
  • fix: front-end has kubernetes-specific queue endpoint (service address) by @starpit in #251
  • fix: remove leftover debug output by @starpit in #250
  • fix: avoid kubernetes-isms in test rclone config by @starpit in #252
  • fix: ibmcloud be should delete cloud resources for multiple runs by @aavarghese in #253
  • fix: remove leftover debug output by @starpit in #255
  • fix: s3 DownloadFile should wait for bucket to exist by @starpit in #254
  • fix: avoid /workdir absolute path in qout call by @starpit in #256
  • refactor: pull out common parts of qstat streaming by @starpit in #257
  • feat: update qstat streamer to support line channels by @starpit in #258
  • feat: local backend by @starpit in #223
  • feat: --run option and run list --all option by @starpit in #259
  • fix: avoid using fixed in-pod (or process) port 9000 for minio by @starpit in #260
  • feat: allow --target to be provided at compile time by @starpit in #261
  • fix: pass through context to streamer APIs by @starpit in #262
  • fix: update backend.Up/Down to pass through context by @starpit in #263
  • fix: avoid context.TODO() in pkg/be/kubernetes by @starpit in #265
  • fix: ListRuns/Singleton/WaitForRun should require a context by @starpit in #266
  • fix: remove unintended context.Background remnant in be/kubernetes by @starpit in #267
  • fix: compiler.Compile should accept a context by @starpit in #268
  • fix: backend.Queue should accept a context by @starpit in #269
  • fix: pkg/runtime/queue funcs should accept a context by @starpit in #270
  • fix: backend.InstanceCount() should accept a context by @starpit in #271
  • fix: ChangeWorkers should accept a context by @starpit in #272
  • fix: backend.Ok() should accept a context by @starpit in #273
  • test: add test to validate that pkg/ is free of context.Background/TODO by @starpit in #274
  • fix: adding verbose + debug flags by @aavarghese in #276
  • fix: auto-disable watch mode if stdout is not a tty by @starpit in #275
  • fix: removing verbose as parameter and use compilationOptions by @aavarghese in #277
  • fix: unknown --verbose in lunchpail enqueue file by @aavarghese in #279
  • chore: bump charmbracelet (status ui) dependencies by @starpit in #280
  • Fix code scanning alert #2: Incorrect conversion between integer types by @starpit in #282
  • fix: down with kubernetes target does not clean up done runs by @starpit in #283
  • fix: removing verbose as parameter and use compilationOptions cont.. by @aavarghese in #278
  • fix: support minio component logs by @aavarghese in #285
  • fix: clean up minio server code by @starpit in #284
  • fix: implement RunComponentUpdates for local backend by @starpit in #286
  • fix: restore target/log options from compile time by @aavarghese in #287
  • fix: update streamer.RunComponentUpdates() to put caller in charge of channels and goroutines by @starpit in #288
  • fix: remove some remnants of namespace in pkg/observe by @starpit in #290
  • fix: workerpool InstanceName should include run name by @starpit in #289
  • fix: restore original pool name label by @starpit in #293
  • fix: Streamer.QueueStats() api should place caller in control of goroutines and channels by @starpit in #292
  • test: reduce verbosity of test output vs logs by @starpit in #291
  • fix: Streamer.Utilization() should place caller in charge of goroutines and channels by @starpit in #294
  • fix: kube utilization streamer may send on closed channel by @starpit in #295
  • fix: add another s3 retry for 'Server not initialized yet' by @starpit in #297
  • fix: local run list --all does not show all runs by @starpit in #298
  • feat: simplify up to stream logs only (for now) by @starpit in #296
  • feat: add component prefix to log line output by @starpit in #299
  • fix: parametersweep dispatcher has two printenvs by @starpit in #300
  • fix: clean up parametersweep output, e.g. echo -n shows -n by @starpit in #301
  • feat: add Utilization impl to local backend by @starpit in #302
  • test: add test-python by @starpit in #303
  • fix: boot/up without watch results in hanging channel send by @starpit in #304
  • fix: local run instances does not check if pids are still running by @starpit in #305
  • refactor: rename test-python to python-basic by @starpit in #307
  • test: update wait-to-die validators to pass current run name to instance count by @starpit in #306
  • refactor: eliminate linker.ConfigureOptions by @starpit in #308
  • refactor: eliminate fe.CompileOptions by @starpit in #309
  • refactor: clean up linker.Configure API to remove unneeded args and returns by @starpit in #310
  • refactor: no need to return compilation options from PrepareForRun by @starpit in #311
  • refactor: simply boot/up,down by avoiding needless reuse by @starpit in #312
  • fix: remove lingering UpOptions.UseThisRunName by @starpit in #313
  • chore: code cleanup and comments for prepare-run by @starpit in #315
  • refactor: rename hlir.AppModel -> hlir.HLIR by @starpit in #316
  • feat: update runtime/queue/CopyIn to accept an array of files/paths to copy in by @starpit in #317
  • feat: update runtime/queue.CopyIn to support copying ...
Read more

v0.26.0

05 Sep 15:16
Compare
Choose a tag to compare

What's Changed

  • feat: begin update llir to be kubernetes-agnostic by @starpit in #182
  • fix: up subcommand positional argument validation by @starpit in #185
  • feat: a bit more lunchpail.xxx namespacing of lunchpail-provided template values by @starpit in #186
  • refactor: shift helm values for shell component out of fe and into be/kubernetes by @starpit in #188
  • fix: metadata ns should not be specified in template, only during apply by @aavarghese in #189
  • fix: set ns in llir by @aavarghese in #190
  • fix: cloud-init cmd to include ns with apply by @aavarghese in #191
  • refactor: move kubernetes common chart into be/kubernetes by @starpit in #195
  • refactor: move kubernetes-specific functions into pkg/be/kubernetes out of pkg/fe/transformer by @starpit in #196
  • refactor: move pkg/fe/template to pkg/be/helm by @starpit in #197
  • fix: avoid creating multiple workstealers by @starpit in #198
  • refactor: eliminate use of namespace from transformer by @starpit in #199
  • refactor: split out be.New logic into separate file by @starpit in #200
  • refactor: move remnants of be/delegation into be.Backend interface by @starpit in #201
  • chore: reduce docker image size by @starpit in #202
  • fix: trim more from the image builds by @starpit in #203
  • feat: log qstat info to a file in the queue folder by @starpit in #109
  • refactor: move qstat and utilization streamer kubernetes logic into backend by @starpit in #204
  • fix: stabilize tests by @starpit in #206
  • refactor: move kubernetes logic from pkg/observe/logs into pkg/be by @starpit in #205
  • fix: more shrinking of binary by @starpit in #207
  • refactor: remove unused backend variable from pkg/fe by @starpit in #208
  • refactor: pkg/be/platform -> pkg/be/options by @starpit in #209
  • refactor: rename backend.DeleteNamespace() to backend.Purge() by @starpit in #210
  • feat: introduce backend.DryRun by @starpit in #211
  • fix: make namespace field private in kubernetes backend by @starpit in #212
  • fix: simplify the way we trim out the backend by @starpit in #213
  • fix: remove some lingering "appname" variables scattered throughout by @starpit in #214
  • fix: shift +/- does not change pool size by @starpit in #215
  • fix: remove superfluous Runname from Linked struct by @starpit in #216
  • fix: remove superfluous ir.Linked struct altogether by @starpit in #217
  • fix: simplify/consolidate opts in the backend by @starpit in #218
  • fix: -t/--target parameter has no effect by @starpit in #220
  • fix: further simplify options in backend by having llir.Options by @starpit in #219
  • fix: no minio component with external s3 by @aavarghese in #221
  • feat: port minio.sh to lunchpail minio server by @starpit in #224

Full Changelog: v0.25.0...v0.26.0

v0.25.0

20 Aug 18:36
Compare
Choose a tag to compare

What's Changed

  • fix: only create and use service account if needed by @starpit in #159
  • feat: update minio component to transpile to shell by @starpit in #162
  • refactor: update workstealer to transpile to shell (remove charts/workstealer) by @starpit in #163
  • fix: add sleep before exit in minio and terminationGracePeriodSeconds when running tests by @starpit in #164
  • feat: Port workerpool to transpile to shell by @starpit in #165
  • fix: remove unnecessary charts/values.yaml and charts/requirements.lock by @starpit in #166
  • refactor: move charts/shell into pkg/ by @starpit in #167
  • fix: add field comments to ApplicationInstanceSpec by @starpit in #168
  • refactor: more charts/ into pkg/fe/template/chart by @starpit in #169
  • refactor: move images/base-images into docs/base-images by @starpit in #170
  • chore: remove old commented code in workerpool/lower by @starpit in #171
  • fix: remove unnecessarily duplicated RemoveAll of transformer template by @starpit in #172
  • chore: remove unused template values in configure.go by @starpit in #173
  • fix: up --create-namespace regression by @starpit in #174
  • fix: regression base chart.tar.gz may not get updated by @starpit in #175
  • refactor: further simplify template values in configure.go by @starpit in #176
  • feat: pass through yaml values to transformer by @starpit in #177
  • feat: remove Values.enclosingRun by @starpit in #178
  • refactor: rename ApplicationInstanceSpec -> ShellSpec by @starpit in #180
  • chore: cleanup same tests, and spread to another layer by @aavarghese in #181
  • chore: bump to 0.25.0 by @starpit in #179

Full Changelog: v0.24.0...v0.25.0

v0.24.0

15 Aug 19:22
Compare
Choose a tag to compare

What's Changed

  • feat: internal s3 in a separate component by @aavarghese in #142
  • feat: lunchpail enqueue file --wait by @starpit in #143
  • fix: remove remnants of internal s3 from workstealer chart by @starpit in #144
  • feat: update minio chart to use minio image directly by @starpit in #147
  • fix: remove unused Secret from workerpool chart by @starpit in #150
  • feat: minio container self-destruct when run finishes by @starpit in #149
  • fix: restructure Dockerfile to avoid proliferation of 1.8Gi image build layers by @starpit in #152
  • fix: remove unused queue-related volume/volumeMounts from workerpool chart by @starpit in #151
  • fix: remove more remnants of old workdir logic from charts by @starpit in #153
  • fix: skip empty env with lowering to llir by @starpit in #154
  • fix: simplify charts/shell env by removing configmap by @starpit in #155
  • fix: simplify charts/workerpool env by removing configmap by @starpit in #156
  • fix: remove old 'run as root' bits from charts by @starpit in #158
  • fix: more work on optimizing proliferation of docker layers by @starpit in #157
  • feat: enqueue --wait returns task exit code by @aavarghese in #148
  • chore: bump to 0.24.0 by @aavarghese in #161

Full Changelog: v0.23.0...v0.24.0

v0.23.0

13 Aug 21:51
Compare
Choose a tag to compare

What's Changed

  • fix: clean up handling of queue paths by @starpit in #101
  • chore: bump workstealer/worker-watcher golang 1.22.1 -> 1.22.6 by @starpit in #102
  • chore: bump golang 1.22.1 -> 1.22.6 by @starpit in #103
  • chore: update issue templates by @aavarghese in #105
  • chore: refactor assemble terminology to compile by @aavarghese in #108
  • feat: remove support for Application repo field and PlatformRepoSecret by @starpit in #111
  • chore: remove lunchpail-workdir image by @starpit in #112
  • chore: remove untested lunchpail-tasksimulator-parquet image by @starpit in #113
  • chore: remove unused python-alpine component image by @aavarghese in #114
  • feat: use alpine:3 as the default Application image by @starpit in #115
  • feat: update workstealer image to use alpine rather than debian slim by @starpit in #117
  • feat: pull worker-watcher into main lunchpail binary by @starpit in #116
  • feat: port workstealer.sh to go by @starpit in #118
  • refactor: move workstealer out of its own image into pkg/runtime/workstealer by @starpit in #119
  • doc: remove reference to old 'images/components' by @starpit in #120
  • refactor: rename copyin.go -> qin.go by @starpit in #121
  • feat: lunchpail enqueue commands by @starpit in #122
  • chore: purge remnants of bash-based workerpool watcher by @starpit in #123
  • chore: clean out prestop shell script in charts/shell by @starpit in #124
  • chore: remove unused tests/base-images by @starpit in #125
  • chore: remove unused ibmcloud create_vm by @starpit in #126
  • chore: remove unused tests/bin/mc.sh by @starpit in #127
  • chore: remove unused tests/bin/s3-copyin by @starpit in #128
  • chore: remove now-unused lunchpail-rclone base image by @starpit in #129
  • refactor: introduce hlir.NewApplication()` by @starpit in #130
  • refactor: move runtime queue logic into pkg/runtime/queue by @starpit in #131
  • fix: retry s3 on i/o timeout by @starpit in #132
  • chore: remove vestiges of AppWrapper from workstealer chart by @starpit in #133
  • chore: remove vestiges of AppWrapper from shell chart by @starpit in #134
  • chore: remove vestiges of AppWrapper from workerpool chart by @starpit in #135
  • fix: remove last use of LUNCHPAIL_RUN_NAME env var from workers by @starpit in #136
  • fix: remove a few env vars by @starpit in #137
  • fix: remove a few more env vars by @starpit in #140
  • chore: bump to 0.23.0 by @starpit in #141

Full Changelog: v0.22.0...v0.23.0

v0.22.0

07 Aug 00:25
Compare
Choose a tag to compare

What's Changed

  • doc: update README badge link to reflect actions.yml -> tests.yml workflow change by @starpit in #51
  • doc: update demo docs to reflect --create-namespace changes by @starpit in #52
  • doc: add gif to readme by @starpit in #53
  • doc: add descriptions for images/gifs by @starpit in #54
  • doc: leverage github's support for Notes rendering by @starpit in #55
  • doc: tweak readme image sizes by @starpit in #56
  • doc: split out user roles from main readme by @starpit in #57
  • doc: add usage and example to build readme by @starpit in #58
  • docs: restructure into docs/architecture by @starpit in #59
  • feat: allow backend to provide values to linker.Configure, and do so to infer ClusterIsOpenShift by @starpit in #60
  • chore: bump IBM/go-sdk-core v4 -> v5 by @starpit in #61
  • feat: up --target-platform/-p -> --target/-t by @starpit in #62
  • feat: down --target-platform/-p -> --target/-t by @starpit in #64
  • fix: casing for target deployment types by @aavarghese in #66
  • feat: support bearer token auth for ibmcloud target by @starpit in #67
  • feat: looping for cluster ready check by @aavarghese in #70
  • fix: overriding global type for openshift clusters by @aavarghese in #71
  • feat: log creation times for ibmcloud backend by @starpit in #73
  • feat: parallelize ibmcloud VSI creation calls by @starpit in #75
  • feat: using randomized zone from region discovery by @aavarghese in #74
  • feat: add username to runname by @aavarghese in #76
  • feat: allow for re-assembly i.e. assemble against an assembled binary by @starpit in #78
  • refactor: introduce interface-based Backend by @starpit in #79
  • fix: clean up default-queue secret by @starpit in #80
  • fix: clean up workstealer queue variables by @starpit in #81
  • fix: begin consolidation of queue prefix path logic by @starpit in #82
  • fix: continue consolidate of queue variables by @starpit in #83
  • fix: disallow kubernetes api access from our pods by @starpit in #85
  • fix: clean up workerpool and shell queue variables by @starpit in #84
  • doc: flesh out docs/contribute/README.md by @starpit in #87
  • fix: ipv6 address should not fail security group creation by @aavarghese in #88
  • doc: clarify up versus down in demo docs by @starpit in #90
  • doc: place conventional commits in TIP block by @starpit in #91
  • doc: make top-level README consistent with doc/demos in naming of binaries by @starpit in #92
  • fix: be interface missing assemble option for apikey, random zone only if config resouregroup exists by @aavarghese in #93
  • feat: remove unnecessary api: field of Application by @starpit in #95
  • doc: fix typo in docs/contribute by @starpit in #96
  • feat: discover existing sshkey from userdir for ibmcloud be, reuse existing sshkey resource if exists by @aavarghese in #89
  • feat: add support for --set-file by @starpit in #97
  • fix: set apikey for cloud authenticator with down cmd by @aavarghese in #98
  • fix: status UI fails to show task cells for workers by @starpit in #99
  • chore: bump to 0.22.0 by @starpit in #100

Full Changelog: v0.21.2...v0.22.0

0.21.2

26 Jul 15:34
Compare
Choose a tag to compare

What's Changed

  • doc: improve demo download wording and links a bit by @starpit in #34
  • chore: add LICENSE file by @starpit in #33
  • doc: tweak and tighten intro by @starpit in #35
  • chore: remove outdated architecture image by @starpit in #36
  • doc: add screenshots to readme by @starpit in #37
  • doc: split up README into docs/demos docs/build docs/contribute by @starpit in #38
  • doc: add OpenROAD demo to demos README by @starpit in #39
  • test: tests should run up --no-watch by @starpit in #42
  • feat: be.Ok() API and update up() to use it as a prereq by @starpit in #41
  • fix: update internal minio service name to include 'lunchpail' by @starpit in #43
  • fix: fully-qualify alpine:3 -> docker.io/alpine:3 by @starpit in #44
  • test: remove outdated test6b by @starpit in #45
  • test: split out test7* into two workflows for github actions by @starpit in #46
  • fix: disable internal s3 for remote cos by @aavarghese in #40
  • fix: wait before kubectl apply, platform type, vsi(s) per component, etc by @aavarghese in #7
  • feat: allow --create-namespace to be specified at assembly time by @starpit in #47
  • chore: bump go module versions by @starpit in #48
  • chore: rename github action test workflow actions.yml -> tests.yml by @starpit in #50
  • chore: bump to 0.21.2 by @starpit in #49

New Contributors

Full Changelog: v0.21.1...v0.21.2

0.21.1

23 Jul 23:02
Compare
Choose a tag to compare

What's Changed

  • fix: update two go.mod to point to new repo by @starpit in #11
  • test: remove archived tests by @starpit in #12
  • fix: update comment to use public github by @starpit in #13
  • feat: add --all-platforms/-A option to assemble by @starpit in #14
  • feat: allow app to pass through app version by @starpit in #15
  • doc: add release badge to readme by @starpit in #16
  • doc: update readme to remove outdated info by @starpit in #17
  • doc: update readme to point to latest lunchpail-demo release by @starpit in #18
  • feat: version command should show both app version and lunchpail version by @starpit in #29
  • feat: improve local UX with up --create-cluster and --watch by default by @starpit in #20
  • fix: status UI hangs with a blank screen; shows no pool updates by @starpit in #31
  • chore: bump to 0.21.1 by @starpit in #32

Full Changelog: v0.21.0...v0.21.1

0.21.0

22 Jul 14:22
Compare
Choose a tag to compare

First public release