[terraform] Add blob cleanup cron task
ClosedPublic
Actions

Authored by bartek on Oct 9 2023, 5:42 AM.

Details

Reviewers

Commits

rCOMM053da35e00ba: [terraform] Add blob cleanup cron task

Summary

Created an ECS task definition for cleanup job and used AWS EventBridge Scheduler to run it every 24 hours.

Depends on D9414

Test Plan

Tested on staging during the weekend. The cleanup job is being run periodically and succeeds.

Repository

rCOMM Comm

Lint

No Lint Coverage

Unit

No Test Coverage

bartek held this revision as a draft.

bartek published this revision for review.Oct 9 2023, 6:04 AM

bartek added inline comments.

services/terraform/remote/service_blob.tf
2	This is only to reflect current terraform state on staging. I'll revert this in favor of D9416
services/terraform/remote/task_blob_cleanup.tf
18	This can be reverted to just `"info"` although I consider it helpful when testing on staging

michal added inline comments.

services/terraform/remote/task_blob_cleanup.tf
18	What does the `info` in `info,blob=trace` mean?

This revision is now accepted and ready to land.Oct 10 2023, 6:41 AM

services/terraform/remote/task_blob_cleanup.tf
18	Set global log level to info, but for `blob` crate only override level to `trace`. And for `comm_services_lib` namespace logs set the level to `debug`. This lets us see only blob service debug logs, without spam from aws-sdk-*, hyper and all these libs.