Page MenuHomePhabricator
Differential D5006

[services] Backup - Blob Put Client - Add helper functions
ClosedPublic
Actions

Authored by • karol on Sep 1 2022, 4:06 AM.
Tags
None
Referenced Files
Unknown Object (File)
Tue, Apr 8, 11:19 PM
Unknown Object (File)
Wed, Apr 2, 11:00 AM
Unknown Object (File)
Wed, Apr 2, 11:00 AM
Unknown Object (File)
Wed, Apr 2, 6:17 AM
Unknown Object (File)
Wed, Apr 2, 4:21 AM
Unknown Object (File)
Sun, Mar 30, 7:32 AM
Unknown Object (File)
Sun, Mar 30, 7:31 AM
Unknown Object (File)
Wed, Mar 19, 1:59 PM
View All Files
Subscribers
• abosh
ashoat
atul
tomek

Details

Reviewers
• jon
tomek
varun
• max
Commits
rCOMMa20c5f282130: [services] Backup - Blob Put Client - Add helper functions
Summary

Depends on D5005

Adding some helper function that will be used by the put client

Test Plan

backup builds

Diff Detail

Repository
rCOMM Comm
Lint
Lint Not Applicable
Unit
Tests Not Applicable

Event Timeline

• karol created this revision.Sep 1 2022, 4:06 AM
Herald added a reviewer: • jon. · View Herald TranscriptSep 1 2022, 4:06 AM
Herald added subscribers: • abosh, atul, tomek, ashoat. · View Herald Transcript
Harbormaster completed remote builds in B11763: Diff 16166.Sep 1 2022, 4:17 AM
• karol requested review of this revision.Sep 1 2022, 4:17 AM
• karol edited the summary of this revision. (Show Details)Sep 1 2022, 4:19 AM
• karol edited the test plan for this revision. (Show Details)
• karol added reviewers: tomek, varun, • max.
• karol added a parent revision: D5005: [services] Backup - Blob Put Client - Add essential objects.
• karol added a child revision: D5007: [services] Backup - Blob Put Client - Install async stream.
• jon requested changes to this revision.Sep 1 2022, 8:51 AM
• jon added inline comments.
services/backup/blob_client/src/put_client.rs
46–63 ↗(On Diff #16166)

I'm confused as to why we need to collect then later read error messages.

We should probably just emit them as they occur, and not deal with this state management.

What's the benefit of having to separately manage error messages?

This revision now requires changes to proceed.Sep 1 2022, 8:51 AM
• karol requested review of this revision.Sep 2 2022, 7:05 AM
• karol added inline comments.
services/backup/blob_client/src/put_client.rs
46–63 ↗(On Diff #16166)

https://phab.comm.dev/D5005#146417

tomek accepted this revision.Sep 5 2022, 2:35 AM
tomek added inline comments.
services/backup/blob_client/src/put_client.rs
35–44 ↗(On Diff #16166)

We can simplify this

• karol added inline comments.Sep 5 2022, 6:53 AM
services/backup/blob_client/src/put_client.rs
35–44 ↗(On Diff #16166)

ok

• karol updated this revision to Diff 16315.Sep 5 2022, 6:53 AM

address comment

Harbormaster completed remote builds in B11883: Diff 16315.Sep 5 2022, 7:03 AM
tomek mentioned this in D5013: [services] Backup - Blob Get Client - Add base structure.Sep 7 2022, 5:06 AM
• jon accepted this revision.Sep 7 2022, 10:38 AM

https://linear.app/comm/issue/ENG-1734/improve-error-handling-system-in-the-blob-client

This revision is now accepted and ready to land.Sep 7 2022, 10:38 AM
• karol updated this revision to Diff 16438.Sep 8 2022, 3:57 AM

rebase

Harbormaster completed remote builds in B11983: Diff 16438.Sep 8 2022, 4:07 AM
Closed by commit rCOMMa20c5f282130: [services] Backup - Blob Put Client - Add helper functions (authored by • karol). · Explain WhySep 8 2022, 4:10 AM
This revision was automatically updated to reflect the committed changes.
• karol added a commit: rCOMMa20c5f282130: [services] Backup - Blob Put Client - Add helper functions.

Revision Contents
Changeset List

PathSize
services/
backup/
blob_client/
src/
29 lines

Diff 16465

View Options

services/backup/blob_client/src/put_client.rs

// @flow // @flow
import type { ResponseFailure } from '@parse/node-apn'; import type { ResponseFailure } from '@parse/node-apn';
import type { FirebaseApp, FirebaseError } from 'firebase-admin'; import type { FirebaseApp, FirebaseError } from 'firebase-admin';
import invariant from 'invariant'; import invariant from 'invariant';
import nodeFetch from 'node-fetch'; import nodeFetch from 'node-fetch';
import type { Response } from 'node-fetch'; import type { Response } from 'node-fetch';
import uuid from 'uuid';
import webpush from 'web-push'; import webpush from 'web-push';
import type { PlatformDetails } from 'lib/types/device-types.js'; import type { PlatformDetails } from 'lib/types/device-types.js';
import { threadSubscriptions } from 'lib/types/subscription-types.js'; import { threadSubscriptions } from 'lib/types/subscription-types.js';
import { threadPermissions } from 'lib/types/thread-permission-types.js'; import { threadPermissions } from 'lib/types/thread-permission-types.js';
import { encryptBlobPayload } from './crypto.js';
import { import {
getAPNPushProfileForCodeVersion, getAPNPushProfileForCodeVersion,
getFCMPushProfileForCodeVersion, getFCMPushProfileForCodeVersion,
getAPNProvider, getAPNProvider,
getFCMProvider, getFCMProvider,
ensureWebPushInitialized, ensureWebPushInitialized,
getWNSToken, getWNSToken,
} from './providers.js'; } from './providers.js';
▲ Show 20 Lines • Show All 362 Lines • ▼ Show 20 Lines
async function blobServiceUpload(payload: string): Promise< async function blobServiceUpload(payload: string): Promise<
| { | {
+blobHash: string, +blobHash: string,
+encryptionKey: string, +encryptionKey: string,
} }
| { +blobUploadError: string }, | { +blobUploadError: string },
> { > {
return upload(payload); const blobHolder = uuid.v4();
try {
const { encryptionKey, encryptedPayload, encryptedPayloadHash } =
await encryptBlobPayload(payload);
await upload(encryptedPayload, encryptedPayloadHash, blobHolder);
return {
blobHash: encryptedPayloadHash,
encryptionKey,
};
} catch (e) {
return {
blobUploadError: e.message,
};
}
} }
export { export {
apnPush, apnPush,
blobServiceUpload, blobServiceUpload,
fcmPush, fcmPush,
webPush, webPush,
wnsPush, wnsPush,
getUnreadCounts, getUnreadCounts,
apnMaxNotificationPayloadByteSize, apnMaxNotificationPayloadByteSize,
fcmMaxNotificationPayloadByteSize, fcmMaxNotificationPayloadByteSize,
wnsMaxNotificationPayloadByteSize, wnsMaxNotificationPayloadByteSize,
}; };