Page MenuHomePhabricator

[terraform] Add blob cleanup cron task
ClosedPublic

Authored by bartek on Oct 9 2023, 5:42 AM.
Tags
None
Referenced Files
Unknown Object (File)
Fri, Jun 7, 5:18 AM
Unknown Object (File)
Thu, Jun 6, 11:07 PM
Unknown Object (File)
Sat, May 25, 7:20 PM
Unknown Object (File)
May 4 2024, 6:25 PM
Unknown Object (File)
May 4 2024, 6:25 PM
Unknown Object (File)
May 4 2024, 6:22 PM
Unknown Object (File)
May 4 2024, 5:58 PM
Unknown Object (File)
May 2 2024, 1:38 AM
Subscribers

Details

Summary

Created an ECS task definition for cleanup job and used AWS EventBridge Scheduler to run it every 24 hours.

Depends on D9414

Test Plan

Tested on staging during the weekend. The cleanup job is being run periodically and succeeds.

Diff Detail

Repository
rCOMM Comm
Lint
Lint Not Applicable
Unit
Tests Not Applicable

Event Timeline

bartek held this revision as a draft.
bartek published this revision for review.Oct 9 2023, 6:04 AM
bartek added inline comments.
services/terraform/remote/service_blob.tf
2 ↗(On Diff #31792)

This is only to reflect current terraform state on staging. I'll revert this in favor of D9416

services/terraform/remote/task_blob_cleanup.tf
18 ↗(On Diff #31792)

This can be reverted to just "info" although I consider it helpful when testing on staging

michal added inline comments.
services/terraform/remote/task_blob_cleanup.tf
18 ↗(On Diff #31792)

What does the info in info,blob=trace mean?

This revision is now accepted and ready to land.Oct 10 2023, 6:41 AM
services/terraform/remote/task_blob_cleanup.tf
18 ↗(On Diff #31792)

Set global log level to info, but for blob crate only override level to trace. And for comm_services_lib namespace logs set the level to debug.

This lets us see only blob service debug logs, without spam from aws-sdk-*, hyper and all these libs.

services/terraform/remote/task_blob_cleanup.tf
18 ↗(On Diff #31792)

Ohh it's not one info,blob=trace expression but separate info and blob=trace expressions, got it 🤦

This revision was automatically updated to reflect the committed changes.