Page MenuHomePhabricator
Feed All Stories

Jul 17 2024

will updated the test plan for D12475: [keyserver] upgrade redis to version 7 on docker based keyserver.
Jul 17 2024, 8:46 AM
tomek updated the diff for D12745: [native][web] Introduce a method fetching messages by ID to SQLiteAPI.

Rebase

Jul 17 2024, 8:29 AM
tomek updated the diff for D12744: [native][web] Add a method fetching messages by ID.

Rebase

Jul 17 2024, 8:22 AM
tomek updated the diff for D12743: Add a new field to OutboundP2PMessage.

Rebase

Jul 17 2024, 8:18 AM
tomek updated the diff for D12742: [SQLite] Add a new column to outbound_p2p_messages table.

Rebase

Jul 17 2024, 8:14 AM
tomek added a comment to D12776: [lib] Generate P2P messages based on actions.

Hmm... to me, I think it would be much more simple to have the components generate a DMOp, and then to have a utility function that calls processDMOperation on it, and put the result in a Redux action. That way, we avoid having to support multiple different kinds of actions. What do you think?

Yeah, agree, it's simpler. It's similar to an updated solution I was thinking about. But there are some things we have to figure out:

  1. As of D12780 processDMOperation returns rawMessageInfos and updateInfos. But we also need to generate OutboundP2PMessages (generateMessagesToPeers function from this diff) - we probably should do that as a part of processDMOperation.
  2. We need to know the sending status of messages that aren't automatically retriable. We can have a function that takes OutboundP2PMessages and returns a promise that can be passed to dispatchActionPromise.
  3. Manual retries need IDs of failed messages - that is something relevant only for local messages. But we will need to modify them in a way that allows storing the IDs.

Figured sharing these makes us sure we're on the same page.

Jul 17 2024, 7:41 AM
tomek accepted D12783: [web] Add bindings for inserting into the search table.
Jul 17 2024, 7:03 AM
will added inline comments to D12731: [terraform] Migration script for for self-hosted keyserver.
Jul 17 2024, 6:33 AM
will added inline comments to D12731: [terraform] Migration script for for self-hosted keyserver.
Jul 17 2024, 6:28 AM
ashoat accepted D12784: Make client notif generation code operate on thick threads only.
Jul 17 2024, 6:22 AM
marcin requested review of D12784: Make client notif generation code operate on thick threads only.
Jul 17 2024, 6:21 AM
will added a comment to D12711: [terraform] Introduce secondary keyserver service.

@bartek thanks for catching that

Jul 17 2024, 6:19 AM
will updated the diff for D12711: [terraform] Introduce secondary keyserver service.

remove copy of keyserver_secondary.tf from root

Jul 17 2024, 6:18 AM
will closed D12777: [nix] Replaces brew install of watchman with nix.
Jul 17 2024, 6:13 AM
will committed rCOMM30b605adaa15: [nix] Replaces brew install of watchman with nix (authored by will).
[nix] Replaces brew install of watchman with nix
Jul 17 2024, 6:13 AM
tomek updated the diff for D12747: [lib] Enable automatic retries for some messages.

Use boolean value

Jul 17 2024, 5:34 AM
tomek updated the diff for D12744: [native][web] Add a method fetching messages by ID.

Rebase

Jul 17 2024, 5:31 AM
tomek updated the diff for D12743: Add a new field to OutboundP2PMessage.

Return boolean value

Jul 17 2024, 5:27 AM
tomek added inline comments to D12747: [lib] Enable automatic retries for some messages.
Jul 17 2024, 5:23 AM
inka requested review of D12783: [web] Add bindings for inserting into the search table.
Jul 17 2024, 5:07 AM
tomek added a comment to D12778: [native] Add SQLiteQueryExecutor code for inserting into the search table.

It might be a good idea to test both insert and update.

Jul 17 2024, 4:49 AM
tomek accepted D12778: [native] Add SQLiteQueryExecutor code for inserting into the search table.
Jul 17 2024, 4:48 AM
tomek accepted D12673: Utilities to idempotently create content and notif sessions.

This diff looks confusing to me. We're introducing a new context PeerOlmSessionCreatorContext but it doesn't look like we're using it.

Jul 17 2024, 4:37 AM
inka requested review of D12778: [native] Add SQLiteQueryExecutor code for inserting into the search table.
Jul 17 2024, 3:43 AM
bartek added inline comments to D12731: [terraform] Migration script for for self-hosted keyserver.
Jul 17 2024, 1:14 AM
bartek accepted D12730: [terraform] Ensure that the primary service is running before deploying secondary service.

@will mentioned a concern I had raised in a 1:1 here. Not sure if we want to address that here, but broadly I'm worried that the health check might not work if we're doing it after bringing the load balancer publicly online with only a single node (the primary) accessible

Jul 17 2024, 1:04 AM
bartek accepted D12729: [terraform] Make number of secondary nodes configured by the user.
Jul 17 2024, 12:52 AM
bartek accepted D12725: [terraform] add Tunnelbroker configuration variable to self-host.

Adding @varun as blocking to answer the inline comment

Jul 17 2024, 12:50 AM
bartek requested changes to D12711: [terraform] Introduce secondary keyserver service.
Jul 17 2024, 12:49 AM
bartek accepted D12710: [terraform] add authoritative keyserver id as a user-specified variable.
Jul 17 2024, 12:45 AM

Jul 16 2024

bartek added inline comments to D12703: Transfer CSAT to IndexedDB from service worker and implement call to identity to query for inbound keys.
Jul 16 2024, 11:59 PM
ashoat requested review of D12781: [lib] Reduce new PROCESS_DM_OPS action.
Jul 16 2024, 8:34 PM
ashoat added a comment to D12694: [native](web) Add message_search fts5 table.

Heads-up that I landed a different migration 48 in D12759, so you'll have to rebase this one. Sorry about that!

Jul 16 2024, 8:30 PM
ashoat added a comment to D12742: [SQLite] Add a new column to outbound_p2p_messages table.

Heads-up that I landed a different migration 48 in D12759, so you'll have to rebase this one. Sorry about that!

Jul 16 2024, 8:30 PM
ashoat requested review of D12780: [lib] Introduce new PROCESS_DM_OPS action and dispatch from useProcessDMOperation.
Jul 16 2024, 8:28 PM
will updated the diff for D12777: [nix] Replaces brew install of watchman with nix.

feedback. remove unnecessary homebrew install deps script

Jul 16 2024, 8:01 PM
will updated the diff for D12710: [terraform] add authoritative keyserver id as a user-specified variable.

review feedback

Jul 16 2024, 7:54 PM
ashoat closed D12740: [lib] Introduce getRelatedMessages to SQLiteAPI.
Jul 16 2024, 6:46 PM
ashoat committed rCOMM308cf3b2c316: [lib] Introduce getRelatedMessages to SQLiteAPI (authored by ashoat).
[lib] Introduce getRelatedMessages to SQLiteAPI
Jul 16 2024, 6:46 PM
ashoat closed D12739: [native] Introduce getRelatedMessages to CommCoreModule.
Jul 16 2024, 6:46 PM
ashoat closed D12738: [web] Introduce getRelatedMessages to shared worker.
Jul 16 2024, 6:46 PM
ashoat committed rCOMMa272644bd405: [native] Introduce getRelatedMessages to CommCoreModule (authored by ashoat).
[native] Introduce getRelatedMessages to CommCoreModule
Jul 16 2024, 6:46 PM
ashoat closed D12737: [SQLite] Introduce getRelatedMessages.
Jul 16 2024, 6:46 PM
ashoat closed D12760: [SQLite] Factor out SQLiteQueryExecutor::processMessagesResults.
Jul 16 2024, 6:46 PM
ashoat committed rCOMMba1a449ef488: [web] Introduce getRelatedMessages to shared worker (authored by ashoat).
[web] Introduce getRelatedMessages to shared worker
Jul 16 2024, 6:46 PM
ashoat committed rCOMMae2fd4b4f144: [SQLite] Introduce getRelatedMessages (authored by ashoat).
[SQLite] Introduce getRelatedMessages
Jul 16 2024, 6:46 PM
ashoat committed rCOMMdd228baabee8: [SQLite] Factor out SQLiteQueryExecutor::processMessagesResults (authored by ashoat).
[SQLite] Factor out SQLiteQueryExecutor::processMessagesResults
Jul 16 2024, 6:46 PM
ashoat closed D12759: [SQLite] Add target_message generated column and index.
Jul 16 2024, 6:46 PM
ashoat closed D12736: [web] add std::optional (C++) <-> undefined (JS) marshalling.
Jul 16 2024, 6:46 PM
ashoat committed rCOMM2ea66c63800b: [SQLite] Add target_message generated column and index (authored by ashoat).
[SQLite] Add target_message generated column and index
Jul 16 2024, 6:46 PM
ashoat committed rCOMMd1c2b00e9d7c: [web] add std::optional (C++) <-> undefined (JS) marshalling (authored by ashoat).
[web] add std::optional (C++) <-> undefined (JS) marshalling
Jul 16 2024, 6:46 PM
ashoat closed D12735: [native] Introduce MessageEntity type alias in more places.
Jul 16 2024, 6:46 PM
ashoat committed rCOMM1457551a5a0f: [native] Introduce MessageEntity type alias in more places (authored by ashoat).
[native] Introduce MessageEntity type alias in more places
Jul 16 2024, 6:46 PM
will updated the diff for D12711: [terraform] Introduce secondary keyserver service.

rebase

Jul 16 2024, 3:01 PM
will updated the diff for D12339: [terraform] Use default vpc, subnets, and internet gateway for self-host.

only create vpc, subnets, and internet gateway if user created option is true

Jul 16 2024, 3:00 PM
atul published D12779: [keyserver] Strip `member.permissions` for `FUTURE_CODE_VERSION` clients for review.
Jul 16 2024, 2:49 PM
will updated the diff for D12708: [keyserver] configure separation of primary secondary logic.

feedback

Jul 16 2024, 2:19 PM
Harbormaster failed remote builds in B30395: Diff 42358 for D12731: [terraform] Migration script for for self-hosted keyserver!
Jul 16 2024, 2:14 PM
will updated the diff for D12708: [keyserver] configure separation of primary secondary logic.

reduce line count

Jul 16 2024, 2:03 PM
will updated the summary of D12731: [terraform] Migration script for for self-hosted keyserver.
Jul 16 2024, 2:00 PM
will updated the diff for D12731: [terraform] Migration script for for self-hosted keyserver.

include logic to disable traffic until all nodes available

Jul 16 2024, 2:00 PM
will added inline comments to D12777: [nix] Replaces brew install of watchman with nix.
Jul 16 2024, 12:12 PM
ashoat accepted D12777: [nix] Replaces brew install of watchman with nix.
Jul 16 2024, 11:59 AM
Harbormaster failed remote builds in B30394: Diff 42357 for D12711: [terraform] Introduce secondary keyserver service!
Jul 16 2024, 11:53 AM
will updated the diff for D12711: [terraform] Introduce secondary keyserver service.

create secondary resources after primary

Jul 16 2024, 11:39 AM
will updated the diff for D12339: [terraform] Use default vpc, subnets, and internet gateway for self-host.

typo

Jul 16 2024, 11:35 AM
will updated the diff for D12560: [terraform] set up keyserver load balancer.

include security group

Jul 16 2024, 11:33 AM
ashoat added a comment to D12776: [lib] Generate P2P messages based on actions.

What do you mean by business logic? Is it the logic that lives in components, or in reducers, or maybe somewhere else?

Jul 16 2024, 10:25 AM
tomek planned changes to D12776: [lib] Generate P2P messages based on actions.
Jul 16 2024, 9:47 AM
tomek added a comment to D12776: [lib] Generate P2P messages based on actions.

Can you provide some more context about this? I don't quite understand why it makes sense to start from an action... my initial thinking was that business logic would construct a DMOperation directly, rather than constructing an action that gets converted into a DMOperation

Jul 16 2024, 8:31 AM
will updated the test plan for D12777: [nix] Replaces brew install of watchman with nix.
Jul 16 2024, 7:54 AM
ashoat added a comment to D12776: [lib] Generate P2P messages based on actions.

Can you provide some more context about this? I don't quite understand why it makes sense to start from an action... my initial thinking was that business logic would construct a DMOperation directly, rather than constructing an action that gets converted into a DMOperation

Jul 16 2024, 7:49 AM
will requested review of D12777: [nix] Replaces brew install of watchman with nix.
Jul 16 2024, 7:48 AM
tomek requested review of D12776: [lib] Generate P2P messages based on actions.
Jul 16 2024, 7:42 AM
kamil added a comment to D12692: Migrate notification account to IndexedDB on web.

Right now two JS threads (shared worker and service worker) can concurrently modify the same key in IndexedDB. I think to make it safe we should use transactions to make sure this is safe.

Jul 16 2024, 7:27 AM
ashoat added inline comments to D12747: [lib] Enable automatic retries for some messages.
Jul 16 2024, 7:26 AM
marcin updated the diff for D12673: Utilities to idempotently create content and notif sessions.

Remove TODO

Jul 16 2024, 7:19 AM
kamil added inline comments to D12676: Migrate notifications crypto account to MMKV on native.
Jul 16 2024, 7:12 AM
marcin updated the diff for D12673: Utilities to idempotently create content and notif sessions.

Fix race condition by exposing olm session creation via context

Jul 16 2024, 7:10 AM
ashoat added inline comments to D12745: [native][web] Introduce a method fetching messages by ID to SQLiteAPI.
Jul 16 2024, 6:50 AM
ashoat added a comment to D12668: Implement peer notifications session creation as outbound on native.

I really don't like the idea (looking at this diff and the entire stack) of passing isKeyserverSession - notification crypto module should treat all devices the same regardless of whether this is a keyserver or client device, and we should only have senderID, because the current design makes it confusing. But given this is implemented and tested I believe we can proceed, you could create a follow-up task to improve it in future but for now LGTM.

Jul 16 2024, 6:46 AM
ashoat added a comment to D12736: [web] add std::optional (C++) <-> undefined (JS) marshalling.

Ah okay, no need to create a new follow-up task then – thanks for linking!

Jul 16 2024, 6:43 AM
ashoat added inline comments to D12770: [Tunnelbroker][lib] add FCM notif message type.
Jul 16 2024, 6:43 AM
tomek requested review of D12775: [lib] Fix an invalid condition.
Jul 16 2024, 6:31 AM
tomek requested review of D12749: [lib] Stop requiring sequential messages.
Jul 16 2024, 5:30 AM
tomek requested review of D12747: [lib] Enable automatic retries for some messages.
Jul 16 2024, 5:25 AM
tomek requested review of D12746: [lib] Disable automatic retries of all messages and enable manual retries.
Jul 16 2024, 5:19 AM
tomek requested review of D12745: [native][web] Introduce a method fetching messages by ID to SQLiteAPI.
Jul 16 2024, 5:14 AM
tomek requested review of D12744: [native][web] Add a method fetching messages by ID.
Jul 16 2024, 5:06 AM
kamil accepted D12672: Implement utility functions to check if we have content or notif session with device.
Jul 16 2024, 4:53 AM
kamil accepted D12671: Implement notification encryption on web.
Jul 16 2024, 4:48 AM
kamil accepted D12670: Implement notification encryption on native.
Jul 16 2024, 4:43 AM
bartek accepted D12677: Implement method to query identity service from the NSE.

The HTTP request-response logic looks good; it's analogous to the existing Blob GET request logic.

Jul 16 2024, 4:41 AM
ashoat requested review of D12764: [lib] Introduce useGetLatestMessageEdit.
Jul 16 2024, 4:35 AM
tomek updated the diff for D12743: Add a new field to OutboundP2PMessage.

Rename

Jul 16 2024, 4:35 AM
kamil accepted D12669: Implement peer notifications session creation as outbound on web and add notifs outbound session creator to OlmAPI.
Jul 16 2024, 4:32 AM
tomek updated the diff for D12742: [SQLite] Add a new column to outbound_p2p_messages table.

Fix indentation

Jul 16 2024, 4:25 AM
tomek added inline comments to D12742: [SQLite] Add a new column to outbound_p2p_messages table.
Jul 16 2024, 4:23 AM
tomek updated the diff for D12742: [SQLite] Add a new column to outbound_p2p_messages table.

Rename column

Jul 16 2024, 4:23 AM
kamil accepted D12668: Implement peer notifications session creation as outbound on native.

I really don't like the idea (looking at this diff and the entire stack) of passing isKeyserverSession - notification crypto module should treat all devices the same regardless of whether this is a keyserver or client device, and we should only have senderID, because the current design makes it confusing. But given this is implemented and tested I believe we can proceed, you could create a follow-up task to improve it in future but for now LGTM.

Jul 16 2024, 4:12 AM