Page MenuHomePhabricator

[terraform] Add blob cleanup cron task
ClosedPublic

Authored by bartek on Oct 9 2023, 5:42 AM.
Tags
None
Referenced Files
F3385531: D9415.diff
Fri, Nov 29, 12:54 AM
Unknown Object (File)
Mon, Nov 25, 2:00 PM
Unknown Object (File)
Mon, Nov 11, 6:44 AM
Unknown Object (File)
Oct 30 2024, 12:59 AM
Unknown Object (File)
Oct 27 2024, 4:25 PM
Unknown Object (File)
Sep 28 2024, 2:20 PM
Unknown Object (File)
Sep 28 2024, 12:55 AM
Unknown Object (File)
Sep 28 2024, 12:55 AM
Subscribers

Details

Summary

Created an ECS task definition for cleanup job and used AWS EventBridge Scheduler to run it every 24 hours.

Depends on D9414

Test Plan

Tested on staging during the weekend. The cleanup job is being run periodically and succeeds.

Diff Detail

Repository
rCOMM Comm
Lint
No Lint Coverage
Unit
No Test Coverage

Event Timeline

bartek held this revision as a draft.
bartek published this revision for review.Oct 9 2023, 6:04 AM
bartek added inline comments.
services/terraform/remote/service_blob.tf
2

This is only to reflect current terraform state on staging. I'll revert this in favor of D9416

services/terraform/remote/task_blob_cleanup.tf
18

This can be reverted to just "info" although I consider it helpful when testing on staging

michal added inline comments.
services/terraform/remote/task_blob_cleanup.tf
18

What does the info in info,blob=trace mean?

This revision is now accepted and ready to land.Oct 10 2023, 6:41 AM
services/terraform/remote/task_blob_cleanup.tf
18

Set global log level to info, but for blob crate only override level to trace. And for comm_services_lib namespace logs set the level to debug.

This lets us see only blob service debug logs, without spam from aws-sdk-*, hyper and all these libs.

services/terraform/remote/task_blob_cleanup.tf
18

Ohh it's not one info,blob=trace expression but separate info and blob=trace expressions, got it 🤦

This revision was automatically updated to reflect the committed changes.