Page MenuHomePhabricator
Feed All Stories

Jul 17 2024

will committed rCOMMf4eee22671f3: [terraform] initial Redis terraform config (authored by will).
[terraform] initial Redis terraform config
Jul 17 2024, 3:29 PM
will committed rCOMM7c8726a6d4fe: [terraform] Upgrade AWS Terraform provider to 5.32.0 (authored by will).
[terraform] Upgrade AWS Terraform provider to 5.32.0
Jul 17 2024, 3:29 PM
will closed D12339: [terraform] Use default vpc, subnets, and internet gateway for self-host.
Jul 17 2024, 3:29 PM
will committed rCOMM5391d6ca6ca6: [terraform] Use default vpc, subnets, and internet gateway for self-host (authored by will).
[terraform] Use default vpc, subnets, and internet gateway for self-host
Jul 17 2024, 3:29 PM
will updated the summary of D12558: [keyserver] add health check route to keyserver for use by load balancer.
Jul 17 2024, 3:23 PM
will updated the summary of D12558: [keyserver] add health check route to keyserver for use by load balancer.
Jul 17 2024, 3:19 PM
will updated the diff for D12711: [terraform] Introduce secondary keyserver service.

rebase

Jul 17 2024, 3:08 PM
will updated the diff for D12710: [terraform] add authoritative keyserver id as a user-specified variable.

make authoritative id variable a config json object

Jul 17 2024, 3:04 PM
atul added a comment to D12779: [keyserver] Strip `member.permissions` for `FUTURE_CODE_VERSION` clients.

Updated test plan after some more testing.

Jul 17 2024, 3:02 PM
atul updated the test plan for D12779: [keyserver] Strip `member.permissions` for `FUTURE_CODE_VERSION` clients.
Jul 17 2024, 3:02 PM
atul updated the diff for D12779: [keyserver] Strip `member.permissions` for `FUTURE_CODE_VERSION` clients.

fix logic, still need to do more testing

Jul 17 2024, 2:49 PM
will updated the diff for D12711: [terraform] Introduce secondary keyserver service.

rebase

Jul 17 2024, 2:42 PM
will updated the diff for D12531: [terraform] initial ecs setup for keyserver primary.

configure user credentials as json object variable instead of individual string variables

Jul 17 2024, 2:35 PM
Harbormaster failed remote builds in B30436: Diff 42412 for D12733: [lib] Deprecate `minimallyEncodeRawThreadInfo`!
Jul 17 2024, 2:30 PM
Harbormaster failed remote builds in B30435: Diff 42411 for D12722: [lib] Add `invariant` to suppress `flow` issue in `getPushUserInfo`!
Jul 17 2024, 2:29 PM
atul added inline comments to D12779: [keyserver] Strip `member.permissions` for `FUTURE_CODE_VERSION` clients.
Jul 17 2024, 2:29 PM
atul planned changes to D12779: [keyserver] Strip `member.permissions` for `FUTURE_CODE_VERSION` clients.

Lot of things that need to be fixed up here.

Jul 17 2024, 2:25 PM
atul updated the diff for D12779: [keyserver] Strip `member.permissions` for `FUTURE_CODE_VERSION` clients.

rebase after addressing feedback in previous diffs in stack, still need to fix this diff up

Jul 17 2024, 2:25 PM
Harbormaster failed remote builds in B30434: Diff 42410 for D12597: [lib] Fix construction of `ThinRawThreadInfo` in `createPendingThread`!
Jul 17 2024, 2:24 PM
atul updated the diff for D12763: [lib] Introduce `stripMemberPermissionsFromRawThreadInfo`.

move changes to stripMemberPermissionsFromRawThreadInfo into this diff

Jul 17 2024, 2:24 PM
Harbormaster failed remote builds in B30433: Diff 42409 for D12597: [lib] Fix construction of `ThinRawThreadInfo` in `createPendingThread`!
Jul 17 2024, 2:22 PM
Harbormaster failed remote builds in B30432: Diff 42408 for D12594: [lib] Change type of `ThinRawThreadInfo.members` from `MemberInfoWithPermissions` to `MemberInfoSansPermissions`!
Jul 17 2024, 2:21 PM
atul updated the diff for D12755: [lib] Add `flow` suppression to `deprecatedMinimallyEncodeRawThreadInfo`.

update diff with ESLint and validator unit test resolved.

Jul 17 2024, 2:19 PM
atul updated the diff for D12733: [lib] Deprecate `minimallyEncodeRawThreadInfo`.

update to address ESLint and failing validator test. flow issue(s) still expected.

Jul 17 2024, 2:18 PM
varun accepted D12725: [terraform] add Tunnelbroker configuration variable to self-host.
Jul 17 2024, 2:17 PM
atul updated the diff for D12722: [lib] Add `invariant` to suppress `flow` issue in `getPushUserInfo`.

rebase

Jul 17 2024, 2:17 PM
atul requested review of D12722: [lib] Add `invariant` to suppress `flow` issue in `getPushUserInfo`.

still would like to see the ESLint fix moved to the diff where the issue is introduced.

Jul 17 2024, 2:14 PM
atul updated the diff for D12597: [lib] Fix construction of `ThinRawThreadInfo` in `createPendingThread`.

fix ESLint issue

Jul 17 2024, 2:12 PM
atul updated the diff for D12597: [lib] Fix construction of `ThinRawThreadInfo` in `createPendingThread`.

rebase after landing validator fix

Jul 17 2024, 2:09 PM
atul updated the diff for D12594: [lib] Change type of `ThinRawThreadInfo.members` from `MemberInfoWithPermissions` to `MemberInfoSansPermissions`.

rebase after landing validator fix.

Jul 17 2024, 2:08 PM
atul closed D12756: [lib] Move `stripPermissionsFromMemberInfo` out of `...-types.js` file.
Jul 17 2024, 2:05 PM
atul committed rCOMMdc0975f965cb: [lib] Move `stripPermissionsFromMemberInfo` out of `...-types.js` file (authored by atul).
[lib] Move `stripPermissionsFromMemberInfo` out of `...-types.js` file
Jul 17 2024, 2:05 PM
atul added a comment to D12756: [lib] Move `stripPermissionsFromMemberInfo` out of `...-types.js` file.

Ran yarn eslint:all, yarn flow:all, and yarn jest:all locally and confirmed that they all passed without issue. Will wait for ESLint & Flow & Jest workflow to pass before landing.

Jul 17 2024, 1:56 PM
atul updated the diff for D12756: [lib] Move `stripPermissionsFromMemberInfo` out of `...-types.js` file.

cherry-pick and land, validator test should pass now

Jul 17 2024, 1:53 PM
atul closed D12787: [lib] Add `memberInfoSansPermissionsValidator` to `convertClientDBThreadInfoToRawThreadInfo`.
Jul 17 2024, 1:52 PM
atul committed rCOMM1a4d31715739: [lib] Add `memberInfoSansPermissionsValidator` to… (authored by atul).
[lib] Add `memberInfoSansPermissionsValidator` to…
Jul 17 2024, 1:52 PM
atul updated the diff for D12787: [lib] Add `memberInfoSansPermissionsValidator` to `convertClientDBThreadInfoToRawThreadInfo`.

cherry-pick and land

Jul 17 2024, 1:48 PM
atul added a comment to D12787: [lib] Add `memberInfoSansPermissionsValidator` to `convertClientDBThreadInfoToRawThreadInfo`.

Can also cherry-pick and land this to simplify stack before rebasing and addressing all feedback.

Jul 17 2024, 1:47 PM
atul closed D12758: [lib] Introduce `memberInfoSansPermissionsValidator` and consume in `rawThreadInfoValidator`.
Jul 17 2024, 1:37 PM
atul committed rCOMM5029a29dfb30: [lib] Introduce `memberInfoSansPermissionsValidator` and consume in… (authored by atul).
[lib] Introduce `memberInfoSansPermissionsValidator` and consume in…
Jul 17 2024, 1:37 PM
ashoat accepted D12594: [lib] Change type of `ThinRawThreadInfo.members` from `MemberInfoWithPermissions` to `MemberInfoSansPermissions`.

Ah okay, sorry I missed that

Jul 17 2024, 1:13 PM
atul requested review of D12594: [lib] Change type of `ThinRawThreadInfo.members` from `MemberInfoWithPermissions` to `MemberInfoSansPermissions`.

Hmm looks like a bunch of Flow errors

Jul 17 2024, 1:03 PM
ashoat requested changes to D12594: [lib] Change type of `ThinRawThreadInfo.members` from `MemberInfoWithPermissions` to `MemberInfoSansPermissions`.

Hmm looks like a bunch of Flow errors

Jul 17 2024, 1:02 PM
ashoat accepted D12787: [lib] Add `memberInfoSansPermissionsValidator` to `convertClientDBThreadInfoToRawThreadInfo`.
Jul 17 2024, 1:01 PM
ashoat added a comment to D12786: [lib] Track progress of message processing.

I wonder what the difference is between our terms "P2P messages" and "DM"s

Jul 17 2024, 12:57 PM
ashoat added a comment to D12776: [lib] Generate P2P messages based on actions.

Would probably be a good idea to discuss this in my detail in our 1:1 tomorrow. One tradeoff neither of us has mentioned so far about using a single action for all business logic that generates DMOperations is that it might be debugging a little bit more painful.

Jul 17 2024, 12:54 PM
Harbormaster failed remote builds in B30428: Diff 42401 for D12594: [lib] Change type of `ThinRawThreadInfo.members` from `MemberInfoWithPermissions` to `MemberInfoSansPermissions`!
Jul 17 2024, 12:53 PM
atul requested review of D12787: [lib] Add `memberInfoSansPermissionsValidator` to `convertClientDBThreadInfoToRawThreadInfo`.
Jul 17 2024, 12:53 PM
atul updated the diff for D12758: [lib] Introduce `memberInfoSansPermissionsValidator` and consume in `rawThreadInfoValidator`.

cherry-pick off master

Jul 17 2024, 12:50 PM
will added a comment to D12730: [terraform] Ensure that the primary service is running before deploying secondary service.

Looks like @will figured out a solution within the bash script in D12731

I think this can be solved with some smart load balancer & network configuration (IIRC there is a way to prioritize health checks traffic in AWS), but I need to research on what's the best way of doing that. I think we can figure it out later.

This sounds like potentially a better solution, but the current solution in D12731 works for now – agree we can address it later. @will maybe you can create a follow-up task before landing to investigate @bartek's proposal here?

Jul 17 2024, 12:49 PM
atul added a comment to D12758: [lib] Introduce `memberInfoSansPermissionsValidator` and consume in `rawThreadInfoValidator`.

Going to go ahead and try cherry-picking this onto master to fix the failing validator unit test and get rest of stack "more green."

Jul 17 2024, 12:43 PM
ashoat added a comment to D12730: [terraform] Ensure that the primary service is running before deploying secondary service.

Looks like @will figured out a solution within the bash script in D12731

Jul 17 2024, 12:41 PM
atul updated the diff for D12594: [lib] Change type of `ThinRawThreadInfo.members` from `MemberInfoWithPermissions` to `MemberInfoSansPermissions`.

rebase, look like there are no ESLint issues. There's failing validator that gets fixed in later diff... though maybe it makes sense to cherry-pick D12758 and land it to resolve failing validator test for rest of stack.

Jul 17 2024, 12:41 PM
ashoat added inline comments to D12703: Transfer CSAT to IndexedDB from service worker and implement call to identity to query for inbound keys.
Jul 17 2024, 12:39 PM
will added inline comments to D12725: [terraform] add Tunnelbroker configuration variable to self-host.
Jul 17 2024, 12:38 PM
atul added inline comments to D12763: [lib] Introduce `stripMemberPermissionsFromRawThreadInfo`.
Jul 17 2024, 12:33 PM
will added inline comments to D12731: [terraform] Migration script for for self-hosted keyserver.
Jul 17 2024, 12:31 PM
ashoat added a comment to D12722: [lib] Add `invariant` to suppress `flow` issue in `getPushUserInfo`.

Looks like the Flow issue is resolved in D12755, but still would like to see the ESLint fix moved to the diff where the issue is introduced. Let me know if I'm off-base or missing something

Jul 17 2024, 12:31 PM
atul added a comment to D12758: [lib] Introduce `memberInfoSansPermissionsValidator` and consume in `rawThreadInfoValidator`.

But it's inappropriate for use on the client, where we don't expect the keyserver to ever respond with the legacy format.

Jul 17 2024, 12:30 PM
ashoat requested changes to D12779: [keyserver] Strip `member.permissions` for `FUTURE_CODE_VERSION` clients.
Jul 17 2024, 12:29 PM
ashoat requested changes to D12763: [lib] Introduce `stripMemberPermissionsFromRawThreadInfo`.

Love that you included tests! A bit confused about the invariant not matching the types – a couple questions inline

Jul 17 2024, 12:20 PM
ashoat accepted D12758: [lib] Introduce `memberInfoSansPermissionsValidator` and consume in `rawThreadInfoValidator`.

It looks like these validators are used on both the keyserver and the client. It's appropriate for use on the keyserver, which needs to continue supporting older clients.

Jul 17 2024, 12:17 PM
ashoat accepted D12756: [lib] Move `stripPermissionsFromMemberInfo` out of `...-types.js` file.

Actually it seems to be explained in the Test Plan:

Jul 17 2024, 12:10 PM
ashoat requested changes to D12756: [lib] Move `stripPermissionsFromMemberInfo` out of `...-types.js` file.

CI issues – can you please resolve before asking for review again?

Jul 17 2024, 12:08 PM
ashoat requested changes to D12722: [lib] Add `invariant` to suppress `flow` issue in `getPushUserInfo`.

There is a Flow issue. Can you please either pass this diff back to me when it's fully green, or else explain why there need to be CI issues?

Jul 17 2024, 12:07 PM
ashoat requested changes to D12755: [lib] Add `flow` suppression to `deprecatedMinimallyEncodeRawThreadInfo`.

Can you fix the CI issues please? The practice of immediately publishing your diff before waiting for CI should only be used for urgent diffs, and if you submit a diff for review with CI issues you should explain / justify why

Jul 17 2024, 12:05 PM
will added inline comments to D12731: [terraform] Migration script for for self-hosted keyserver.
Jul 17 2024, 12:04 PM
ashoat requested changes to D12733: [lib] Deprecate `minimallyEncodeRawThreadInfo`.

Actually I must've gotten confused about the CI. I'm actually not seeing any Flow issues, but there do appear to be ESLint issues.

Jul 17 2024, 12:03 PM
ashoat requested changes to D12731: [terraform] Migration script for for self-hosted keyserver.

(Passing back to @will)

Jul 17 2024, 12:01 PM
tomek requested review of D12786: [lib] Track progress of message processing.
Jul 17 2024, 11:11 AM
varun added inline comments to D12734: [lib] add device type to qr code URL.
Jul 17 2024, 11:09 AM
Harbormaster failed remote builds in B30426: Diff 42399 for D12784: Make client notif generation code operate on thick threads only!
Jul 17 2024, 11:01 AM
marcin updated the diff for D12784: Make client notif generation code operate on thick threads only.

Rebase before landing

Jul 17 2024, 10:57 AM
marcin closed D12785: Add keyserverID to unencrypted notification and display to staff info about notification failure.
Jul 17 2024, 10:56 AM
marcin committed rCOMM46beed0710f4: Add keyserverID to unencrypted notification and display to staff info about… (authored by marcin).
Add keyserverID to unencrypted notification and display to staff info about…
Jul 17 2024, 10:56 AM
marcin updated the diff for D12784: Make client notif generation code operate on thick threads only.

Rebase before landing

Jul 17 2024, 10:33 AM
marcin updated the diff for D12785: Add keyserverID to unencrypted notification and display to staff info about notification failure.

Log information about notification encryption failure regardless of user staff member status.

Jul 17 2024, 10:30 AM
ashoat added a comment to D12731: [terraform] Migration script for for self-hosted keyserver.

Can you address the CI issues?

Jul 17 2024, 10:28 AM
will updated the diff for D12731: [terraform] Migration script for for self-hosted keyserver.

review feedback, additional checks and comments

Jul 17 2024, 10:05 AM
tomek updated the diff for D12776: [lib] Generate P2P messages based on actions.

Don't create messages from actions

Jul 17 2024, 9:44 AM
tomek planned changes to D12776: [lib] Generate P2P messages based on actions.
Jul 17 2024, 9:26 AM
tomek updated the diff for D12776: [lib] Generate P2P messages based on actions.

Rebase

Jul 17 2024, 9:26 AM
tomek updated the test plan for D12749: [lib] Stop requiring sequential messages.
Jul 17 2024, 9:25 AM
tomek updated the test plan for D12747: [lib] Enable automatic retries for some messages.
Jul 17 2024, 9:24 AM
tomek updated the test plan for D12746: [lib] Disable automatic retries of all messages and enable manual retries.
Jul 17 2024, 9:23 AM
tomek updated the test plan for D12745: [native][web] Introduce a method fetching messages by ID to SQLiteAPI.
Jul 17 2024, 9:21 AM
tomek updated the test plan for D12744: [native][web] Add a method fetching messages by ID.
Jul 17 2024, 9:21 AM
bartek accepted D12769: [Tunnelbroker] implement sending FCM message.

Proposed an optional alternative to error handling

Jul 17 2024, 9:18 AM
bartek accepted D12768: [Tunnelbroker] implement errors from FCM service.
Jul 17 2024, 9:05 AM
bartek accepted D12767: [Tunnelbroker] implement messages types to FCM service.
Jul 17 2024, 9:04 AM
will added inline comments to D12689: [terraform] create comm database on aws rds startup.
Jul 17 2024, 9:02 AM
will updated the diff for D12689: [terraform] create comm database on aws rds startup.

remove timestamp trigger, running only on first rds creation

Jul 17 2024, 9:00 AM
ashoat accepted D12785: Add keyserverID to unencrypted notification and display to staff info about notification failure.
Jul 17 2024, 8:59 AM
ashoat published D12785: Add keyserverID to unencrypted notification and display to staff info about notification failure for review.

Can we continue printing the log when this happens, even for non-staff builds?

Jul 17 2024, 8:59 AM
bartek accepted D12753: [Tunnelbroker] implement creating FCM client.
Jul 17 2024, 8:54 AM
bartek accepted D12752: [Tunnelbroker] implement FCM config.
Jul 17 2024, 8:53 AM
bartek accepted D12751: [terraform] add FCM secrets config.
Jul 17 2024, 8:51 AM
bartek accepted D12711: [terraform] Introduce secondary keyserver service.
Jul 17 2024, 8:48 AM
bartek accepted D12728: Implement Android HTTP call to identity to get notifs inbound keys.
Jul 17 2024, 8:47 AM
will updated the test plan for D12475: [keyserver] upgrade redis to version 7 on docker based keyserver.
Jul 17 2024, 8:46 AM