mirror of
https://github.com/simplex-chat/simplex-chat.git
synced 2026-11-04 21:37:45 +00:00
spaced4ndyandspacedandy-agents-simplex
9696a71b91
* core, badge-service: name Apple claims by reference
Rename appleTransactionId to appleTransactionRef, matching googlePurchaseRef
and StoreTransactionRef. No behaviour change: the next change makes it
return a subscription's original transaction id, which the old name would
misstate.
Run: 001-badge-subscriptions, slice 1
* core, badge-service: store subscription charges and carry the subscription state
Add the service migration 20261012_badge_subscriptions: the subscription
charges table, the ledger's charge_id, and the payment's subscription state,
check time and Play token, replacing three subscription columns nothing
wrote. The ledger now stores and reads back charge credits, and the badge
credential response gains an optional subscription state that older clients
ignore and that reads an unknown state without failing. Nothing writes a
charge or a state yet, so no behaviour changes.
Run: 001-badge-subscriptions, slice 2
* core, badge-service: plan subscription charges and claim Apple subscriptions by original id
Add chargeEntries, the one planner for a store charge's ledger rows: a
lapse to the billing period start, the grant dated to that start, and a
lapse to now, so coverage follows the store's periods and every row
verifies by re-running it at its createdAt. A test runs its rows through
the client's own balanceChecked for first charges, monthly and annual
renewals, billing-retry recovery and grace.
An Apple auto-renewable transaction is now claimed by its original
transaction id, which every renewal keeps, so renewals resolve to one
purchase. One function names the ref for both the claim and the real
verifier, so they cannot disagree.
Run: 001-badge-subscriptions, slice 3a
* badge-service: credit a store subscription purchase
The catalog now tells subscription products from one-time ones and maps a
store plan to its tier and months. A subscription receipt is checked with
the store once: with a grantable charge, the service plans the charge's
rows from the store's period start, signs the first month, and writes the
payment, purchase, charge, ledger rows, issuance, state and Play token in
one transaction, answering with the subscription state. Without one, it
answers payment_pending (300 s while the period has not started or the
store is pending, a day otherwise), receipt_invalid for an ended Play
subscription, or test_purchase, and writes nothing. Replays carry the
state. The store verifier interface gains the subscription check, which no
real store implements yet; the fake store does.
Run: 001-badge-subscriptions, slice 3b
* badge-service: renew a subscription once its paid coverage ends
While a subscription purchase's coverage runs, issueBadge is unchanged
and makes no store call. Once it has ended, the service asks the store at
most once an hour per subscription, stamping every attempt, and answers
from the stored state in between; a failed check is retried after the
whole interval. A grantable charge is planned from the tip at the store's
period start, signed, and written with its issuance and state in one
transaction that re-reads the tip, answering internal if it moved. Any
other charge and the state are recorded without a ledger row. Every answer
for a subscription purchase carries its state.
Run: 001-badge-subscriptions, slice 4
* core: keep a subscription badge until the service says it ended
A purchase is a subscription exactly when its ledger replica holds a
charge credit, so the kind is derived with no column or migration. A
subscription is still asked about at zero months, at the shared weekly
moment, and keeps its badge past paidThrough until an answer says the
subscription ended, so a renewed month is presented at the old
credential's expiry with no gap, and a charge the store recovers later
still re-activates it. While it waits, the client records no failure and
raises no support-ended alert; "issued no credential" now fires only while
the ledger still owes a month. Prepaid purchases are unchanged.
Run: 001-badge-subscriptions, slice 5
* badge-service: check Apple subscriptions with the App Store Server API
With an in-app purchase key configured in [apple], the service reads a
subscription's status by its original transaction id from Get All
Subscription Statuses, authenticated by an ES256 token reused until near
expiry. Each signed transaction and renewal info is verified against the
pinned Apple root through the same chain check as one-time purchases, now a
separate function, and a body that fails it is a verifier failure, never a
refusal. Statuses map to renewing, cancelled, billing retry and ended;
family-shared transactions are refused; 401 and 403 are this service's
failure, other errors and timeouts unreachable. A verifier failure thrown
by a store check is answered internal, and a test subscription is refused
in one place for first purchases and renewals. Without the key, Apple
one-time purchases verify as before and subscriptions are not configured.
Run: 001-badge-subscriptions, slice 6
* badge-service: check and acknowledge Google Play subscriptions
The Play subscription check reads purchases.subscriptionsv2 by token
through the existing service-account client, with the same HTTP classes as
product reads, and maps Play's state, base plan, period, order id and
offer phase; the period start is its end minus the plan's length, and a
pending subscription stays pending. A subscription is acknowledged with
purchases.subscriptions.acknowledge before it is credited, skipped when
Play reports it acknowledged, so it never reaches the one-time endpoint.
Each store's subscriptions answer provider_not_configured when that store
is not configured. A charge on a plan the catalog does not sell is pending
rather than a malformed period.
Run: 001-badge-subscriptions, slice 7
* review: round 1 fixes
R1-1: test an App Store subscription renewal through issueBadge, including
a charge recorded before its period starts and granted later under the
same charge id.
R1-2: make the ledger's charge_id index unique, so the schema itself grants
each store charge at most once.
R1-3: pin that a charge on a plan the catalog does not sell, with an empty
period, is pending at purchase and recorded at renewal, never internal.
Run: 001-badge-subscriptions, review round 1
* core: update query plans
getBadgePurchase derives the purchase kind from the ledger replica, and a
subscription test makes a held store receipt due.
Run: 001-badge-subscriptions, final verification
* fixes
* core: move SubscriptionState to Badges.Types (structural)
BadgeState, which lives in Badges.Types, is about to carry a subscription's
state, and Badges.Service imports Badges.Types. Service re-exports it, as it
does BadgeServiceErrorCode. No behaviour change.
Run: 003-badge-subscriptions-ui, slice 1
* core: keep a store subscription's state on the client
The screens and alerts need to know whether a subscription renews, was
cancelled, waits for a charge, or ended, and the client dropped every state
the service sent but ended. It is now stored on the purchase: from the
answer to the first credit, and from a renewal answer only when the
asserted tip's coverage had ended, since while coverage runs the service
repeats what it read at the last renewal (a year old for an annual plan).
BadgeState gains `subscription` (the plan's months, from the latest charge
credit, and the state), and fills renewsAt/willRenew from it. A changed
state is announced with CEvtBadgeChanged. The column goes into the
unreleased M20260925 migration.
Run: 003-badge-subscriptions-ui, slice 2
* core: record the device store's view of a subscription
The service reads the store only once a subscription's paid coverage has
ended, so it never sees a cancellation while the period runs. The apps read
the device's store (StoreKit's renewal state, Play's isAutoRenewing) and
report it with /_badge subscription <state> <payment>, which records it on
the credited subscription purchase the payment resolves to and announces the
change to its owner.
A renewing report does not replace billingRetry or ended: Play lists a
subscription in its grace period with auto-renew on, and the service's next
answer clears billing retry once the charge lands.
Run: 003-badge-subscriptions-ui, slice 3
* core: claim a store-listed transaction only on the device that bought it
A store account's purchases are listed on every device signed into it:
Play's purchase query lists active subscriptions for their whole life, and
Apple's Transaction.updates delivers auto-renewables made on other devices.
A hand-over with no record and an unknown echoed invoice made a new record
under the presenting profile, so another device could claim a buyer's
subscription for its own active profile, or repeat a refused request every
30 days after cleanup.
/_badge purchase now takes a `listed` mark, which the apps' sweeps and
purchase listeners send: it joins only a record this core already has for
the transaction or its echoed invoice, and otherwise records and sends
nothing (CRStoreReceiptNotRecorded). The purchase call and Restore hand over
unmarked, as before.
Run: 003-badge-subscriptions-ui, slice 4
* core: let a held App Store subscription adopt its later transactions
A held Apple subscription record is keyed by its original transaction id,
so every renewal resolves to it. It kept the payment's back-off when a new
transaction arrived, and adopted any payment handed over, including a
revoked renewal, which the service refuses as receipt_invalid and so would
refuse the whole subscription.
A held Apple record now adopts a JWS only for another transaction with a
later purchaseDate and no revocationDate, read from the unverified payload,
and is then due at once with its retry delay and credit error cleared. A
re-delivered or re-signed copy changes nothing. A failed attempt writes its
back-off only if the record still holds the payment it sent.
Run: 003-badge-subscriptions-ui, slice 5
* core: refuse a badge code or invoice while a store receipt is pending
A code redeemed while a store receipt is held put the code's badge on the
profile, and the held receipt then waited behind it; for a subscription the
store kept charging every period meanwhile. Code redemption and invoice
creation now answer "store purchase open" while the profile holds an App
Store subscription receipt, or another receipt whose last failure can clear
on its own. A receipt that failed for good does not block, except an Apple
subscription, which Apple keeps charging; an uncredited Play subscription is
refunded by Play.
Run: 003-badge-subscriptions-ui, slice 6
* core: alert a subscriber that a payment failed, a renewal nears, or it was cancelled or ended
A subscription's alerts were the prepaid ones: a retired subscription said
"support ended", and nothing told the user a payment failed, an annual
renewal was near, or a cancelled subscription still runs. The derived alert
for a subscription is now, in order: subscription_ended once retired,
payment_issue while the store retries, issue_failed as before,
subscription_cancelled before paidThrough, and renewal_approaching from
three days before an annual plan renews, with a wake at that moment. Monthly
plans get no reminder, as there is no opt-out yet.
The unreleased migration's down step clears an acked subscription_cancelled,
which an older core cannot read.
Run: 003-badge-subscriptions-ui, slice 7
* badge-service: let the dev mock vouch for store subscriptions
With [dev] accept_unverified_store_receipts on, every subscription was
answered provider_not_configured, so the apps' subscription screens could
not be tried against a dev service. The mock now credits an App Store
subscription for the plan its product names, and a Play subscription for
the base plan a test token test.<basePlanId>.<uuid> names, or else its
product's monthly plan, from a minute ago; it remembers the plan in memory
and grants each renewal a new charge, answering a subscription it does not
know (after a restart) as ended.
The subscription check is given the product the presented receipt names,
which only the mock reads; it reads the service's badge clock at check time.
Run: 003-badge-subscriptions-ui, slice 8
* ios: hand App Store subscriptions to the core and report their renewal state
A subscription transaction was finished uncredited, so a buyer would pay and
get nothing. Every badge product now goes through a core invoice and is
handed over, and finished only once the core answers it credited or refused.
Transactions the store lists (the launch sweep, Transaction.updates) are
handed over as listed, so another device's purchase is not claimed here;
Restore purchases syncs with the App Store and claims them for this profile.
A revoked renewal is finished without hand-over, as the service would refuse
it and so the whole subscription.
The app reports StoreKit's renewal state to the core at each sweep, after the
manage-subscriptions sheet and after a restore. Monthly and annual are offered
only to an Apple ID with no earlier subscription in the group, which Apple
would fold a new one into.
Run: 003-badge-subscriptions-ui, slice 9
* ios: sell badge subscriptions and show their state on Your badge
Monthly and annual subscriptions are offered on How long and Check your
order, with the App Store's subscription disclosure, Terms of use and
Privacy policy links, and Restore purchases. Your badge shows a
subscription's state - Renews {date} · {price}, Ends {date}, Payment
problem, Renewing or Ended - with why another badge cannot be bought or
redeemed while it waits for its charge, Manage subscription and Restore
purchases. The chat list shows one banner for the current badge alert of
any kind: renewal soon, payment problem, cancelled, ended, as well as the
expired and renewal-failed ones it had.
Run: 003-badge-subscriptions-ui, slice 10
* android: hand Play subscriptions to the core and report their renewal state
The Kotlin port of the iOS store change. A Play subscription was
acknowledged uncredited; every badge product now goes through a core
invoice and is handed over. The sweep queries subscriptions as well as
one-time products, and the sweep and purchases listener hand over as listed,
so another device on the Google account does not claim them; Restore claims
them for this profile. A subscription is bought on its base plan's own
offer, and the app never acknowledges one itself: the service does when it
credits it, so Play still refunds one the service never credits.
The app reports Play's isAutoRenewing to the core as renewing or cancelled.
Run: 003-badge-subscriptions-ui, slice 11
* android, desktop: sell badge subscriptions and show their state on Your badge
The Kotlin port of the iOS screens. How long and Check your order offer
monthly and annual with Google Play's subscription disclosure, the privacy
policy link and Restore purchases. Your badge shows the subscription's state
with the same texts as iOS, the store named Google Play with a store lane and
"the store" without one, and Manage subscription and Restore purchases only
with a store lane on the local host. The chat list shows one banner for the
current badge alert of any kind. Desktop shows the state, footers and banners
without store rows or a price.
Run: 003-badge-subscriptions-ui, slice 12
* docs: describe the one badge alert banner in the apps' chat-list specs
Both chat-list specs described two hand-written badge banners (expired,
renewal failed); the chat list now has one banner for the current badge
alert of any kind. Also moves the line links this run shifted.
Run: 003-badge-subscriptions-ui, slice 13
* review: round 1 fixes
ios: stop selling a subscription once this device has seen one, so a
second profile is not charged for a subscription Apple folds into the
first (R1-12). Continue pins the chosen period on both apps (R1-13).
Only a device with a subscription asks its store for products and status
when reporting, and the purchases are marked checked before the report
(R1-14, R1-5: Kotlin now loads the products, so the price shows after a
restart). Restore says "Nothing to restore" after a cancelled purchase
(R1-7). Android keeps sweeping one-time purchases when the subscriptions
query fails (R1-6). The freshness comment in requestBadgeIssue states the
service's one-hour repeat of its last check (R1-1).
Run: 003-badge-subscriptions-ui, review round 1
* badge-service: answer a long-expired Play subscription as ended, and hash Play order ids
Play answers HTTP 410 for a subscription that expired too long ago to be
queried; it was read as unreachable, so the service never answered ended,
the badge was never retired and the profile stayed blocked from buying or
redeeming (R1-2). Play order ids appear on the buyer's receipt email, so
charges now store a hash of the order id, as purchase tokens already are
(R1-10).
Run: 004-badge-subscriptions-review, review round 1
* review: run 003 round 2 and run 004 round 1 app fixes
ios: buy a subscription only while it is still for sale, after re-reading
the Apple ID's transactions, and disable Pay once it is not, so a Check
your order screen opened before another profile or device subscribed
cannot buy one Apple folds into the earlier subscription (run 003 R2-1,
run 004 R1-4). android: skip the subscriptions query only on a device
whose Play does not support subscriptions, so Restore no longer says
"Nothing to restore" when the query failed (run 003 R2-2).
Run: 003-badge-subscriptions-ui round 2; 004-badge-subscriptions-review round 1
* review: round 3 fixes
ios: a subscription refused because this Apple ID subscribed before has
its own error, and Check your order says why Pay is disabled (R3-2).
android: skip the subscriptions query only when Play does not support
subscriptions, so a disconnected client fails the sweep or Restore
rather than reading as no subscriptions (R3-1).
Run: 003-badge-subscriptions-ui, review round 3
* core: update query plans
Regenerated by the full suite for the purchase, subscription status and adoption queries. Run: 003-badge-subscriptions-ui, final step
* badge-service: say what hashing the Play order id protects
The hash is unkeyed, so a holder of the buyer's receipt can still find the row (R2-1). Run: 004-badge-subscriptions-review, review round 2
* badge-service: name the rule for when a subscription is due a store check
The issue path's purchase read becomes getIssuePurchase and its "ask the
store now" test becomes subscriptionCheckDue, so the request router can
read the same rows by the same rule. No behaviour change.
Run: 005-subscriptions-load-timing, slice 1
* badge-service: answer every request that may ask a store on the store lane
App Store subscription purchases and subscription renewal checks called
their store from the main lane, so one slow or repeated store call held up
code redemptions and every other renewal. The router now reads the
purchase the way the issue path does and sends to the store lane every
request that may ask a store: Play purchases, App Store auto-renewable
purchases, and issue requests for a subscription due its store check,
judged a minute ahead so the handler never finds one due on the main lane.
Run: 005-subscriptions-load-timing, slice 2
* core: send no badge request before the wake a request that issued nothing set
While a subscription waited for its store charge, or a prepaid renewal
kept failing, every launch, foreground, profile switch and badge-state
read sent the issue request again, so the badge service saw the user's
app-open times for weeks. A due request now waits for the wake the last
pass stored, as long as that wake is no more than a stall interval away,
so it is asked again a day later as the renewal design says.
Run: 005-subscriptions-load-timing, slice 3
* fixup! core: send no badge request before the wake a request that issued nothing set
* fixup! badge-service: answer every request that may ask a store on the store lane
* badge-service: ask the App Store about a subscription purchase at most once an hour per claim
Anyone holding a real but uncreditable App Store subscription JWS, such as
their own lapsed subscription, could present it again and again, each time
spending an App Store Server API call from the quota every subscriber's
renewal check needs. The purchase path now remembers, in memory, which
subscription claims it asked about within the hour and answers a repeat
payment_pending with the time left. Keys are original transaction ids from
JWS that verified offline, entries expire after the hour, and a full table
asks rather than refuses, so memory stays bounded and no buyer waits on
another's claim.
Run: 005-subscriptions-load-timing, slice 4
* fixup! badge-service: ask the App Store about a subscription purchase at most once an hour per claim
* review: round 1 fixes
badge-service: a Play charge whose clipped period start leaves its month
already spent is answered as period over, not internal (R1-A1).
docs: the per-store answer classes list Play's 410 and the App Store
subscription check (R1-A2).
tests: a held receipt with no attempt yet blocks an invoice (R1-B2); a
renewing report keeps an ended status (R1-B3); a test comment names
[google] (run 005 C2-R2-1).
ios: a subscription refused because this Apple ID subscribed before
shows its sentence, not the error's name (R1-C2); ios, android, desktop:
the Check your order footnotes share one helper (R1-C3).
Run: 006-subscriptions-branch-review, review round 1
* fixup! review: round 1 fixes
* core: wait a day after a badge request that issued nothing, whatever the service or a snooze says
The hold on the stored wake let two moments the client does not schedule end it early. A renewal whose store check failed was answered with an hour's retryAfter, so the next activation after each hour sent it again, sampling when the app is opened. A snooze set before a request ended its wait at the snooze's end, timing the next request by the user's tap. Now a request that issued nothing waits the stall or a ledger moment: retryAfter only marks the failure transient, and a snooze is not a wake while a request waits; the request's own wake raises the alert again.
Run: 005-subscriptions-load-timing, slice 5
* fixup! review: round 1 fixes
* fixup! core: wait a day after a badge request that issued nothing, whatever the service or a snooze says
* badge-service: ask Play about a subscription purchase at most once an hour per token
The purchase path's hourly bound covered only App Store claims, so a re-presented Play subscription token, uncredited or credited to another key, spent a subscriptionsv2.get call each time, from the quota bucket Play renewal checks use. The bound now lives in purchaseSubscription, which both stores' purchase paths call, with one map per store: Play's keyed by the token's hash, so made-up Play tokens cannot fill the App Store's. Distinct made-up tokens are still one call each.
Run: 005-subscriptions-load-timing, slice 6
* badge-service: read Play's paused subscription as waiting to renew
An unmapped SUBSCRIPTION_STATE_PAUSED was answered internal, so a paused subscriber's renewal failed for the whole pause. Play reports a pause with auto-renewal on and charges again when it ends, so it now maps as an active subscription does: renewing, or cancelled with auto-renewal off. Pause is being turned off on the base plan; this is defence in depth. A pause grants nothing: Play names no new order, and the last one is already granted.
Run: 005-subscriptions-load-timing, slice 9
* core: retire a subscription badge once no store could still charge it, whatever the service answers
A subscription badge retired only on an ended answer, so a service that never sent one (a final error such as unknown_purchase_key, a rollback, a service that never answers) left the badge shown, one request a day forever, and the profile unable to redeem, buy or have a held receipt credited. Now it also retires once paidThrough is older than the longest store recovery window: Apple retries a failed renewal for up to 60 days, the longest with Play's pause off, plus a week. paidThrough counts every month the ledger holds, so banked months are never retired by it.
Run: 005-subscriptions-load-timing, slice 8
* ios, android: no Restore purchases on Your badge, where a restored purchase could not be credited
Your badge shows only while a badge is shown, so a purchase Restore found there with no record on this device was held under a profile whose held receipts are not processed while it shows a badge: not credited, nothing said, and on Android acknowledged, ending Play's three-day refund. Restore stays on Check your order, the one screen where a restored purchase can be processed.
Run: 005-subscriptions-load-timing, slice 7
* review: round 4 fixes
R4-1: a subscription badge is asked about first and retired only after the service answers, judged on the ledger after that answer. Retiring before asking used the client's paidThrough, which moves only when the client asks, so a subscriber who had not opened the app for longer than the recovery window while the store kept charging lost the badge at the next launch and was never asked again. A request that is not answered retires nothing. Tests: testSubscriptionRetiredAfterRecoveryWindow changed, testIdleSubscriptionKeptPastWindow and testSubscriptionNotRetiredWithoutAnswer added.
R4-2: one snooze comment where two contradicted each other.
R4-3: the recovery window's comment names Play's clipped period start.
R4-4: the retirement tests use subscriptionRecoveryWindow.
* badge-service: name the lane each request waits on
The router answered "may this request ask a store" as a Bool; renewal checks are to get a lane of their own, which a Bool cannot say. requestLane now names the lane: main, purchase or renewal. Both store lanes still share one queue, so no request changes lane.
Run: 007-subscriptions-retirement-lane, slice 1
* badge-service: check renewals on a lane no purchase waits on
Renewal checks shared the store lane with every purchase, so made-up Play tokens, which anyone can send, and the weekly burst of genuine purchases delayed them. Renewal checks now wait on a lane of their own, which only a request signed by the purchase key it names, and due its hourly store check, can reach.
Run: 007-subscriptions-retirement-lane, slice 2
* badge-service: name the web limiter's fixed-window step
takeToken counted a request against a minute's limit inline. The step becomes takeFrom, a pure function, so the purchase path's Play read allowance can use the same rule. No behaviour change.
Run: 007-subscriptions-retirement-lane, slice 3a
* badge-service: read Play's subscriptions at most 300 times a minute for purchases
A Play subscription purchase is asked about without any offline check, so any token in the accepted grammar spends a read from the Subscriptions quota renewal checks share. The purchase path now takes one of a minute's 300 reads for each Play subscription it asks about, a tenth of Play's default quota; with none left, the claim is answered rate_limited with the seconds left in the minute and is not held, as Play was not asked. A claim already held takes no read, and App Store claims, verified offline first, take none.
Run: 007-subscriptions-retirement-lane, slice 3
* core: count the subscription retirement window from the first answer that renewed nothing
The window was counted from the client's paidThrough, which moves only when the client asks, so after months away the first answer that granted nothing for any reason, a transient error, Play's clipped last days or a billing retry, retired a subscriber whose store may still have been charging. The purchase now stores its unrenewed run: the first answered request after which the ledger covered nothing, and the latest one. The badge retires once the window has passed since the run started, still only after an answer; a renewal ends the run, and an answer that comes a window or more after the latest one starts a new run, since an absence or an outage that long may hide a renewal. The window stays 67 days, written as Apple's 60-day billing retry plus the week contacts give an expired credential.
Run: 007-subscriptions-retirement-lane, slice 4
* review: round 1 fixes
R1-A1: the docs and the PlayReads comment said the purchase path reads Play's subscriptions at most 300 times a minute; it asks about at most 300 subscriptions, and a credited one is read once more to acknowledge it, so made-up tokens can spend at most a tenth of the quota renewal checks share.
R1-A2: a comment on RequestLane repeated the one above the queues.
R1-B1: a test that a held pass, which sends no request, leaves the unrenewed run unchanged.
R1-B2: the outage test's last wait for the run is 30 s instead of 5 s.
Run: 007-subscriptions-retirement-lane, review round 1
* core: add the badge subscription columns in their own migration
M20261016_badge_store_receipts shipped to master in #7587, so it must
stay as released. Restore it in both dialects and move the
subscription_status, unrenewed_since and last_unrenewed_at columns,
with the down step that clears subscription_cancelled acknowledgements
master cannot read, into M20261016_badge_subscriptions.
Run: 008-subs-migration-split, slice 1
* tests: drop the FilePath import a merge duplicated
The branch and master each added import System.FilePath ((</>)) to
Direct.hs on 2026-10-14 at different positions, and an earlier merge
kept both, so GHC warned that one was redundant. Keep master's.
Run: 008-subs-migration-split, slice 2
* fixup! core: add the badge subscription columns in their own migration
* ios, android, desktop: choose a badge in the app
* ios, android, desktop: use the dev badge page for testing (don't merge)
* update postgres schema
* update ios lib
* ios, android: hide Restore purchases on the order screen
* docs: summarize the badge subscriptions PR for reviewers, with diagrams
A summary of PR #7716 as built: buying, renewing and retiring on each
store, the retirement window, lanes and store limits, RPC, API and
database changes, alerts, tests, open items, and a review map. Seven
SVG diagrams, an HTML page with them inline, and a link from the plan.
* ios, android, desktop: restore purchases on the Support SimpleX screen
* ios, android, desktop: show the badge privacy policy in the app
* docs: keep only the badge subscription diagrams, with a README
The reviewer summary leaves the repo; the folder keeps the seven
diagrams with a README that captions each, and the plan links the
README.
* ios, android, desktop: smaller Restore purchases label
* ios: no alert when a badge purchase is cancelled
* docs: replace the badge subscriptions diagrams README with a short summary
A plain-English summary for anyone on the team, with the seven
diagrams and a self-contained HTML page; the plan links it again.
Diagrams follow the branch: Restore purchases is on Support SimpleX,
"Renewing" shows past paidThrough, and only a present retryAfter is
raised to an hour.
* ui
* ui wip
* core: retire a subscription badge as soon as its store says it ended
A subscription badge retired only on an ended answer to a request that was due, and only once the ledger's paidThrough had passed, so an ended answer while the ledger still covered, or the iOS app's report of StoreKit's expired or revoked state, left the badge shown, Support SimpleX unreachable and every purchase refused until a later request. Now an answered ended state is stored even while coverage runs (the service writes it only from a store check, after which it grants nothing), and every pass retires a subscription whose state, from this pass's answer or else as stored, is ended, whatever the ledger covers. The paidThrough guard stays at the prepaid call site, its only remaining user.
Run: 010-subscription-lifecycle, slice S1
* docs: record that a badge subscription cannot be restored or bought again
Restoring a subscription on a new device or under another profile fails for two independent reasons, the client's restore reading only unfinished transactions on iOS and the service answering any key but the one it credited receipt_used, and a lapsed iOS subscriber cannot subscribe again on the same install either. Both gaps files record it in their own format, and both restorePurchases() say why reading the store's entitlements alone would not help.
Run: 010-subscription-lifecycle, slice S2c
* fixup! core: retire a subscription badge as soon as its store says it ended
* transfer plan
* shorter plan
* update plan
* badge-service: let a dev deployment ask its mock store while coverage runs
[dev] check_store_during_coverage = on makes every issueBadge for a
subscription ask the dev mock, during paid coverage too, and bank the
month of a charge it can grant, issued once coverage reaches it. So a
renewal can be watched by hand without waiting a month, and a mock that
forgot the plan after a restart answers ended at once.
Off by default, and refused unless accept_unverified_store_receipts is
on, which is itself refused beside a real store: a real store has not
started its next charge while coverage runs, and asking spends the
quota every subscriber shares.
Run: 011-subscription-tools, slice S3a
* core: send a badge request at once from a build for the dev badge service
/_badge request <userId> sends the profile's badge request now, while
its badge is shown, and runs the badge pass on the answer, so a renewal
or an ended subscription can be watched by hand against the dev
service.
It is allowed only when ChatConfig's badgeDevRequests is set, which no
shipped build does and nothing sets at runtime: the dev-service branch
sets it beside its own badge service overrides. A request off the shared
expiry would tell requests apart, so every other build refuses it, and
it is refused from a paired remote controller.
Run: 011-subscription-tools, slice S3b
* fixup! badge-service: let a dev deployment ask its mock store while coverage runs
* fixup! badge-service: let a dev deployment ask its mock store while coverage runs
* fixup! core: send a badge request at once from a build for the dev badge service
* core: split the badge request's lock from its body
The receipt worker's attempt already holds the owner's badge lock, which is not reentrant, so it cannot call requestBadgeIssue. The body becomes sendBadgeIssue, and both answer a service error as Left (code, retryAfter) instead of Nothing, so that caller can classify it as it does today. No behaviour change.
Run: 011-subscription-resume, slice S2-0
* core: retire on a device's ended report only once the paid period is over
StoreKit can report a subscription expired during Apple's billing retry, and Apple may then recover the charge, so retiring at once on that report left a paying user without the badge. The service's answered ended still retires at once, also while the ledger covers. A stored ended, which is how the device's report arrives, retires once paidThrough has passed.
Run: 011-subscription-resume, slice S1c
* core: resume a retired Apple subscription when its store charges it again
A same-install resubscription keeps Apple's original transaction id, so its hand-over found the old credited record and was answered from it with the old credential: the subscriber paid and got nothing. A credited record is now held again when a later charge of its subscription is handed over, the charge is not revoked, its paid period runs and it is dated less than a day ahead of this device's clock, and the record's purchase is its owner's newest, a subscription and not shown, with no other receipt held. The receipt worker then sends the purchase's issueBadge, and the service grants the charge as a renewal. A covered answer shows the purchase again with the newest credential and clears an ended state. A charge the service answers without crediting is deferred an hour and refused a day after its purchase date, so it holds the profile for about a day. A refused resume is remembered on the record (every credit, re-hold and resume clears credit_error), so the app's sweep does not hold the same charge again after its day.
Run: 011-subscription-resume, slice S2a
* fixup! core: resume a retired Apple subscription when its store charges it again
Review round 1 fixes:
- R1-1: a resumable charge waiting behind another held receipt of the owner is answered held and left unfinished, rather than answered from the record and finished uncredited.
- R1-3: a resume shows the purchase again only with a credential that has not expired.
- R1-2, R1-8: tests of the resumable-charge rule and the hold's edge, of a held charge whose paid period ends before it is sent, and that a resumed profile shows the newest credential. The resume test is split in two, one environment each.
- R2-V1: a test comment that the reordered steps made false.
Run: 011-subscription-resume, review rounds 1 and 2
* core, ios, android, desktop: let a lapsed iOS subscriber subscribe again to the badge the profile retired
The iOS app refused any subscription to an Apple ID that ever subscribed, so a lapsed subscriber could never subscribe again in the app. Core now tells the apps each subscription's store reference (BadgeSubscription.transactionRef, optional in JSON), and the iOS gate opens a subscription card only when every earlier subscription of the Apple ID is the active profile's newest purchase, retired, of the card's badge: the one charge core resumes. Kotlin gets the model field only, as Play gives a resubscription a new token and needs no gate.
Run: 011-subscription-resume, slice S2b
* docs: bound a badge move by the previous credential's expiry
* badge-service: credit test purchases and check the store during coverage in a dev deployment
* core: let a dev build ask the badge service on an interval
* badge-service: log each request's command and each store check's outcome
* fix compilation
* badge-service: name the purchase each request came from in the log
* badge-service: name the purchase each request came from in the log
* core, ios, android: explain a failed badge renewal and stop retrying a subscription the store forgot; tests (#7788)
* core, badge-service, ios, android: change badge tier in the store, and restore a subscription on another device (#7795)
* core: tell the apps when a badge request banks a month without issuing it
A pass announced the badge state only when the balance start moved, so a charge granted onto running coverage, or a debit the service wrote, changed months left and paid-through without an event, and the apps kept showing the old renewal date until the screen was reopened. The pass now announces whenever the ledger's last entry is not the one it started from, which a moved balance start implies.
Run: 015-badge-fixes, slice 1
* core: test that every Play charge of a month-end subscription funds its month
Play reports only a period's end, and the service dates the charge a plan length before it, so month-end clipping could leave a charge funding less than its month. Walk a monthly and an annual Play plan anchored on 31 January through their renewals at the device's request moments, through the deployed Play verifier: each charge funds exactly its months, paid-through stays at most the grace behind Play's period end (three days at most in this walk), and no charge is left without a grant.
Run: 015-badge-fixes, slice 2
* core: test that the newest issued badge credential is taken by its ledger row
After a tier change the newer issuance can end before the older one, so ordering issuances by period end would answer the superseded credential to the worker and to the resume and tier-change paths. Pin the row order: the test fails if the query goes back to period_end order.
Run: 015-badge-fixes, slice 3
* review: round 1 fixes
The App Store tier-change hold, reviewed for the first time:
- R1-B2: a tier change's credit now shows its purchase again (shown_badge_id) in the same transaction, as a resume's does, so a retire that ran while the change was with the service cannot leave a paid purchase unshown and never renewed.
- R1-B5: a tier change of a shown purchase is held whatever other receipt is held, as the worker serves it while the badge is shown; only a resume waits for other held receipts.
- R1-B3: test a tier change the store does not vouch for: refused in silence, the badge kept, and answered from the record after.
- R1-B8: the changeTier comment names when the record settles.
Run: 015-badge-fixes, review round 1
* review: round 2 fixes
- R2-1: a granted tier change clears an ended state the device reported before it. A renewing report never replaces ended, and a charge of the new tier granted proves the subscription has not ended, so without this the worker retired the new tier's badge at its paid-through while the subscription renewed.
- R1-B3: test a tier change whose credential does not verify: the failure stays on the receipt record, not the purchase, and Supporter stays shown.
- R2-3: the refused tier change's test buys Supporter through an invoice, so it shows the refusal announces nothing.
- R2-2: the changeTier comment says what follows each way the record settles.
Run: 015-badge-fixes, review round 2
* review: round 3 fixes
- R3-1: a tier change whose answer says the subscription ended is not credited, as a resume is not, so the credit's clearing of a stored ended never drops the one this answer carries.
- R3-2: the changeTier comment in two lines.
Run: 015-badge-fixes, review round 3
* core: apply an App Store tier change at once only when it raises the tier
Apple keeps charging the old plan to the end of the period, so applying a downgrade at once took away a badge the subscriber had already paid for. A charge of another tier is now held and sent at once only from supporter to legend; a lower tier, or one that is not ranked (investor, unknown), is answered from the record and the renewal check grants it, as badges-rpc.md says. A record already held for such a change settles silently.
Run: 016-tier-change-direction
* core: test that an App Store change to a lower tier waits for the renewal
A Supporter charge handed over while Legend is shown is answered from the record and sends nothing, and the renewal check grants Supporter, shown once the Legend credential expires; a record an older build held for a lower tier settles with no request. Both fail if every change of tier is sent at once again.
Run: 016-tier-change-direction
* badge-service: let a restore ask the store without waiting for the purchase's own check
* docs: describe badge tier changes and restore as the service handles them
The RPC document splits a store tier change by store and direction: the
app never starts one, an App Store raise seen within a day of its charge
is sent as upgradeBadgeSubscription, every other change waits for the
renewal check, and a Play plan change is a new token, a new purchase.
transferBadge and its limits are checked against the handlers, and the
upgrades that are not built are marked so.
The overview admits what Restore discloses: the service links the two
purchase keys, a store receipt moves its subscription to whoever presents
it within the move limit, and a new badge or tier is shown as soon as it
is issued. The Android gap names what remains of Restore.
* docs: tell the badge subscriptions story with tier changes and restore
The summary now covers the whole lifecycle: buying, renewing, changing
tier, moving to another device or profile, and ending. The badge retires
as soon as the store says the subscription ended, a lapsed iOS subscriber
can resume the retired badge, an App Store raise is granted at once and
a lower tier at the renewal, and a Play plan change is a new purchase.
The known limits and the before-sale list follow the code.
The seven diagrams are updated, with stale file and line references
dropped, and two are added: a tier change and a restore. The page now
points at the diagram files instead of carrying copies of them.
* fixup! docs: describe badge tier changes and restore as the service handles them
* fixup! docs: tell the badge subscriptions story with tier changes and restore
* fixup! docs: describe badge tier changes and restore as the service handles them
* fixup! docs: tell the badge subscriptions story with tier changes and restore
* core: make the badge subscription tests fail on the defects they name (#7798)
* fix compilation
* fix api
* ios, android, desktop: open the badge page on the site again
* ios: choose a badge on the site, not in the app
* tests: hold the move with no charge to grant, not with the purchase's store check
* unfocus test
* update postgres schema
* badge-service: break a tie between issuances by their period, so both databases agree
* badge subscription review fixes (#7799)
* update badge subscriptions docs (#7802)
* core: show a changed badge tier to contacts as soon as it is granted
* update plans
* core: show a raised badge tier to contacts at once, hold back a lower one
* update sqlite schema
* badge subscriptions review fixes (#7903)
* update ios lib
* update query plans
* ios: one property wrapper on the chat view's chat (#7910)
* android: a shorter note under Restore purchases
* Revert "ios: one property wrapper on the chat view's chat (#7910)"
This reverts commit d5a24bb342.
* ci: larger RAM disk so tests do not run out of space
* update sqlite schema
* ios: preview references for the badge screens
---------
Co-authored-by: spacedandy-agents-simplex <342056592+spacedandy-agents-simplex@users.noreply.github.com>
1867 lines
79 KiB
YAML
1867 lines
79 KiB
YAML
name: build
|
|
|
|
on:
|
|
push:
|
|
branches:
|
|
- master
|
|
- stable
|
|
tags:
|
|
- "v*"
|
|
- "!*-fdroid"
|
|
- "!*-armv7a"
|
|
pull_request:
|
|
paths:
|
|
- "src/**"
|
|
- "apps/simplex-chat/**"
|
|
- "apps/simplex-bot/**"
|
|
- "apps/simplex-bot-advanced/**"
|
|
- "apps/simplex-badge-service/**"
|
|
- "apps/simplex-broadcast-bot/**"
|
|
- "apps/simplex-directory-service/**"
|
|
- "apps/multiplatform/**"
|
|
- "apps/ios/**"
|
|
- "tests/**"
|
|
- "bots/src/**"
|
|
- "simplex-chat.cabal"
|
|
- "cabal.project"
|
|
- "Dockerfile*"
|
|
- "scripts/ci/*.sh"
|
|
- "scripts/ci/ios-stub-libs.sh"
|
|
- "scripts/desktop/**"
|
|
- ".github/workflows/build.yml"
|
|
- ".github/actions/**"
|
|
- ".github/changelog_conf.json"
|
|
- "packages/simplex-chat-nodejs/**"
|
|
- "packages/simplex-chat-client/types/typescript/**"
|
|
- "packages/simplex-chat-python/**"
|
|
- "scripts/ci/package-tests.sh"
|
|
- "apps/simplex-badge-service/web/**"
|
|
- "scripts/ci/packages_release.py"
|
|
- "scripts/ci/test_packages_release.py"
|
|
types: [opened, synchronize, reopened, ready_for_review]
|
|
workflow_dispatch:
|
|
inputs:
|
|
tests:
|
|
description: "hspec match patterns, one per line; / runs all tests, empty runs none"
|
|
type: string
|
|
default: ""
|
|
base:
|
|
description: the branch that the changes are compared with
|
|
type: string
|
|
default: master
|
|
|
|
env:
|
|
opt: ${{ github.event_name == 'push' && 'O2' || 'O0' }}
|
|
ghc_options: ${{ github.event_name != 'push' && '--ghc-options=-O0' || '' }}
|
|
release: ${{ startsWith(github.ref, 'refs/tags/v') }}
|
|
branch: ${{ github.base_ref || github.ref_name }}
|
|
cache_o0: ${{ github.event_name == 'push' && (github.ref == 'refs/heads/master' || github.ref == 'refs/heads/stable') }}
|
|
release_branch: ${{ github.event_name == 'push' && (github.ref == 'refs/heads/master' || github.ref == 'refs/heads/stable') && github.repository == 'simplex-chat/simplex-chat' && github.ref_name || '' }}
|
|
ZSTD_CLEVEL: 9
|
|
|
|
# This workflow uses custom actions (prepare-build and prepare-release) defined in:
|
|
#
|
|
# .github/actions/
|
|
# ├── prepare-build
|
|
# │ └── action.yml
|
|
# └── prepare-release
|
|
# └── action.yml
|
|
|
|
# Important!
|
|
# Do not use always(), it makes build unskippable.
|
|
# See: https://github.com/actions/runner/issues/1846#issuecomment-1246102753
|
|
|
|
jobs:
|
|
|
|
# =============================
|
|
# Global variables
|
|
# =============================
|
|
|
|
# That is the only and less hacky way to setup global variables
|
|
# to use in strategy matrix (env:/YAML anchors doesn't work).
|
|
# See: https://github.com/orgs/community/discussions/56787#discussioncomment-6041789
|
|
# https://github.com/actions/runner/issues/1182
|
|
# https://stackoverflow.com/a/77549656
|
|
|
|
variables:
|
|
runs-on: ubuntu-latest
|
|
outputs:
|
|
GHC_VER: 9.6.3
|
|
JAVA_VER: 17
|
|
steps:
|
|
- name: Dummy job when we have just simple variables
|
|
if: false
|
|
run: echo
|
|
|
|
# =============================
|
|
# Create release
|
|
# =============================
|
|
|
|
# Create release, but only if it's triggered by tag push.
|
|
# On pushes to master or stable: claim the simplex-chat-libs release core-<version of simplex-chat.cabal> for the branch
|
|
# and create its draft, create the draft of a missing add-on release, and find the package versions to publish.
|
|
# On pull requests and other pushes, this job will always complete.
|
|
|
|
# Secrets:
|
|
# -------
|
|
# NODEJS_REPO_TOKEN
|
|
# Only select repositories: simplex-chat-libs
|
|
# Permissions:
|
|
# * Contents (Read and Write)
|
|
|
|
maybe-release:
|
|
runs-on: ubuntu-latest
|
|
outputs:
|
|
libs_tag: ${{ steps.libs.outputs.tag }}
|
|
core_changed: ${{ steps.changes.outputs.core }}
|
|
haskell: ${{ steps.changes.outputs.haskell }}
|
|
kotlin: ${{ steps.changes.outputs.kotlin }}
|
|
ios: ${{ steps.changes.outputs.ios }}
|
|
addon_tag: ${{ steps.addon.outputs.tag }}
|
|
addon_draft: ${{ steps.addon.outputs.draft }}
|
|
libs_latest: ${{ steps.latest_libs.outputs.tag }}
|
|
publish_types: ${{ steps.libs.outputs.tag && steps.publish.outputs.types_version || '' }}
|
|
publish_nodejs: ${{ steps.publish.outputs.nodejs_version }}
|
|
publish_python: ${{ steps.publish.outputs.python_version }}
|
|
publish: ${{ steps.publish.outputs.nodejs_version || steps.publish.outputs.python_version }}
|
|
packages: ${{ steps.changes.outputs.packages }}
|
|
scopes: ${{ steps.changes.outputs.scopes }}
|
|
reduced: ${{ github.event_name == 'workflow_dispatch' || github.event.pull_request.draft == true || (github.event_name == 'push' && github.ref_type == 'branch' && github.repository != 'simplex-chat/simplex-chat') }}
|
|
steps:
|
|
- name: Reject a manual run on a tag
|
|
if: github.event_name == 'workflow_dispatch' && github.ref_type == 'tag'
|
|
run: |
|
|
echo "::error::A manual run starts on a branch; to retry a release, re-run the jobs of its tag push."
|
|
exit 1
|
|
|
|
- name: Clone project
|
|
uses: actions/checkout@v3
|
|
with:
|
|
fetch-depth: 2
|
|
|
|
- name: Check changes
|
|
id: changes
|
|
shell: bash
|
|
env:
|
|
BASE_BRANCH: ${{ inputs.base }}
|
|
GH_TOKEN: ${{ github.token }}
|
|
run: |
|
|
case "$GITHUB_EVENT_NAME" in
|
|
pull_request)
|
|
python3 scripts/ci/packages_release.py changes HEAD^1
|
|
;;
|
|
workflow_dispatch)
|
|
base=$(gh api "repos/$GITHUB_REPOSITORY/compare/$BASE_BRANCH...$GITHUB_REF_NAME" --jq .merge_base_commit.sha)
|
|
git fetch -q --depth=1 origin "$base"
|
|
python3 scripts/ci/packages_release.py changes "$base"
|
|
;;
|
|
*)
|
|
echo "haskell=true"
|
|
if [ -n "$release_branch" ]; then
|
|
echo "kotlin=true"
|
|
echo "ios=true"
|
|
python3 scripts/ci/packages_release.py scopes
|
|
fi
|
|
;;
|
|
esac >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Build changelog
|
|
id: build_changelog
|
|
if: startsWith(github.ref, 'refs/tags/v')
|
|
uses: simplex-chat/release-changelog-builder-action@v5
|
|
with:
|
|
configuration: .github/changelog_conf.json
|
|
failOnError: true
|
|
ignorePreReleases: true
|
|
commitMode: true
|
|
env:
|
|
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
|
|
|
|
- name: Create release
|
|
if: startsWith(github.ref, 'refs/tags/v')
|
|
uses: simplex-chat/action-gh-release@v2
|
|
with:
|
|
body: ${{ steps.build_changelog.outputs.changelog }}
|
|
prerelease: true
|
|
files: |
|
|
LICENSE
|
|
fail_on_unmatched_files: true
|
|
env:
|
|
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
|
|
|
|
- name: Library release
|
|
id: libs
|
|
if: env.release_branch
|
|
shell: bash
|
|
env:
|
|
GH_TOKEN: ${{ secrets.NODEJS_REPO_TOKEN }}
|
|
LIBS_REPOSITORY: ${{ github.repository }}-libs
|
|
run: |
|
|
version=$(sed -n 's/^version: *//p' simplex-chat.cabal)
|
|
tag=core-$version
|
|
claim_output=$(python3 scripts/ci/packages_release.py claim-core "$version" "$GITHUB_SHA" "$release_branch")
|
|
eval "$claim_output"
|
|
if [ "$claim" = skip ]; then
|
|
echo "::notice title=Library release::core $version is recorded for another commit"
|
|
exit 0
|
|
fi
|
|
status_output=$(python3 scripts/ci/packages_release.py release-status "$tag")
|
|
eval "$status_output"
|
|
if [ "$status" = absent ]; then
|
|
gh release create "$tag" --repo "$LIBS_REPOSITORY" --draft --title "$tag" --notes "" ${commit:+--target "$commit"}
|
|
fi
|
|
if [ "$status" != published ]; then
|
|
echo "tag=$tag" >> "$GITHUB_OUTPUT"
|
|
fi
|
|
|
|
- name: Add-on release
|
|
id: addon
|
|
if: env.release_branch
|
|
shell: bash
|
|
env:
|
|
GH_TOKEN: ${{ secrets.NODEJS_REPO_TOKEN }}
|
|
LIBS_REPOSITORY: ${{ github.repository }}-libs
|
|
run: |
|
|
addon_output=$(python3 scripts/ci/packages_release.py addon-release)
|
|
eval "$addon_output"
|
|
if [ "$status" = absent ]; then
|
|
tag=nodejs-addon-${GITHUB_SHA::7}
|
|
gh release create "$tag" --repo "$LIBS_REPOSITORY" --draft --title "$tag" --notes "$notes"
|
|
fi
|
|
if [ "$status" != published ]; then
|
|
echo "tag=$tag" >> "$GITHUB_OUTPUT"
|
|
echo "draft=true" >> "$GITHUB_OUTPUT"
|
|
fi
|
|
|
|
- name: Latest library
|
|
id: latest_libs
|
|
if: steps.addon.outputs.draft
|
|
env:
|
|
GH_TOKEN: ${{ secrets.NODEJS_REPO_TOKEN }}
|
|
LIBS_REPOSITORY: ${{ github.repository }}-libs
|
|
run: python3 scripts/ci/packages_release.py latest-libs --branch "$release_branch" >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Versions to publish
|
|
id: publish
|
|
if: env.release_branch
|
|
env:
|
|
GH_TOKEN: ${{ github.token }}
|
|
LIBS_REPOSITORY: ${{ github.repository }}-libs
|
|
NPM_SCOPE: ${{ vars.NPM_SCOPE }}
|
|
PYPI_PROJECT: ${{ vars.PYPI_PROJECT }}
|
|
PYPI_URL: ${{ vars.PYPI_URL }}
|
|
run: python3 scripts/ci/packages_release.py publish-plan >> "$GITHUB_OUTPUT"
|
|
|
|
# =========================
|
|
# Linux Build
|
|
# =========================
|
|
|
|
build-linux:
|
|
name: "ubuntu-${{ matrix.os }}-${{ matrix.arch }} (CLI,Desktop), GHC: ${{ matrix.ghc }}"
|
|
needs: [maybe-release, variables]
|
|
if: needs.maybe-release.outputs.haskell == 'true' || needs.maybe-release.outputs.scopes != '' || (needs.maybe-release.outputs.reduced == 'true' && (needs.maybe-release.outputs.kotlin == 'true' || needs.maybe-release.outputs.packages == 'true'))
|
|
runs-on: ${{ matrix.runner }}
|
|
permissions:
|
|
contents: write
|
|
packages: write
|
|
env:
|
|
image_cache: ghcr.io/${{ github.repository_owner }}/simplex-chat-build-cache:${{ matrix.os }}-${{ matrix.arch }}-ghc${{ matrix.ghc }}
|
|
source_hashes: dist-newstyle/sources.sha256
|
|
concurrency: &linux-concurrency
|
|
group: ${{ github.workflow }}-${{ github.ref }}-linux-${{ matrix.os }}-${{ matrix.arch }}-${{ matrix.ghc }}-${{ needs.maybe-release.outputs.libs_tag }}
|
|
cancel-in-progress: ${{ github.event_name != 'push' }}
|
|
strategy:
|
|
fail-fast: false
|
|
matrix:
|
|
include:
|
|
- os: 22.04
|
|
os_underscore: 22_04
|
|
arch: x86_64
|
|
runner: "ubuntu-22.04"
|
|
should_run: ${{ needs.maybe-release.outputs.haskell == 'true' }}
|
|
ghc: ${{ needs.variables.outputs.GHC_VER }}
|
|
hash: 'sha256:5c8b2c0a6c745bc177669abfaa716b4bc57d58e2ea3882fb5da67f4d59e3dda5'
|
|
libs: true
|
|
kotlin: ${{ needs.maybe-release.outputs.reduced == 'true' && needs.maybe-release.outputs.kotlin == 'true' }}
|
|
packages: ${{ needs.maybe-release.outputs.reduced == 'true' && needs.maybe-release.outputs.packages == 'true' }}
|
|
scope_tests: ${{ needs.maybe-release.outputs.scopes != '' }}
|
|
steps: &linux-steps
|
|
- name: Checkout Code
|
|
if: matrix.should_run == true || matrix.kotlin == true || matrix.packages == true || matrix.scope_tests == true
|
|
uses: actions/checkout@v3
|
|
with:
|
|
submodules: recursive
|
|
|
|
- name: Setup swap
|
|
if: matrix.ghc == '8.10.7' && matrix.should_run == true
|
|
uses: ./.github/actions/swap
|
|
with:
|
|
swap-size-gb: 30
|
|
|
|
- name: Get UID and GID
|
|
id: ids
|
|
run: |
|
|
echo "uid=$(id -u)" >> $GITHUB_OUTPUT
|
|
echo "gid=$(id -g)" >> $GITHUB_OUTPUT
|
|
|
|
# Otherwise we run out of disk space with Docker build
|
|
- name: Free disk space
|
|
if: (matrix.should_run == true || matrix.kotlin == true) && needs.maybe-release.outputs.reduced != 'true'
|
|
shell: bash
|
|
run: ./scripts/ci/linux_util_free_space.sh
|
|
|
|
- name: Set up Docker Buildx
|
|
if: matrix.should_run == true || matrix.kotlin == true
|
|
uses: simplex-chat/docker-setup-buildx-action@v3
|
|
|
|
- name: Log in to GitHub Container Registry
|
|
if: (matrix.should_run == true || matrix.kotlin == true) && env.release != 'true'
|
|
shell: bash
|
|
env:
|
|
GHCR_TOKEN: ${{ secrets.GITHUB_TOKEN }}
|
|
run: echo "$GHCR_TOKEN" | docker login ghcr.io -u "${{ github.actor }}" --password-stdin
|
|
|
|
- name: Compute image cache week
|
|
id: week
|
|
if: (matrix.should_run == true || matrix.kotlin == true) && env.release != 'true'
|
|
run: echo "week=$(date -u +%G-W%V)" >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Build and cache Docker image
|
|
if: matrix.should_run == true || matrix.kotlin == true
|
|
uses: simplex-chat/docker-build-push-action@v6
|
|
with:
|
|
context: .
|
|
load: true
|
|
file: Dockerfile.build
|
|
tags: build/${{ matrix.os }}:latest
|
|
build-args: |
|
|
TAG=${{ matrix.os }}
|
|
HASH=${{ matrix.hash }}
|
|
GHC=${{ matrix.ghc }}
|
|
USER_UID=${{ steps.ids.outputs.uid }}
|
|
USER_GID=${{ steps.ids.outputs.gid }}
|
|
cache-from: ${{ env.release != 'true' && format('type=registry,ref={0}-{1}', env.image_cache, steps.week.outputs.week) || '' }}
|
|
cache-to: ${{ github.event_name == 'push' && github.ref == 'refs/heads/master' && format('type=registry,ref={0}-{1},mode=max,ignore-error=true', env.image_cache, steps.week.outputs.week) || '' }}
|
|
|
|
# Docker needs these flags for AppImage build:
|
|
# --device /dev/fuse
|
|
# --cap-add SYS_ADMIN
|
|
# --security-opt apparmor:unconfined
|
|
- name: Start container
|
|
if: matrix.should_run == true || matrix.kotlin == true
|
|
shell: bash
|
|
run: |
|
|
mkdir -p ~/.cabal
|
|
docker run -t -d \
|
|
--device /dev/fuse \
|
|
--cap-add SYS_ADMIN \
|
|
--security-opt apparmor:unconfined \
|
|
--name builder \
|
|
-e CABAL_DIR=/home/builder/.cabal \
|
|
-v ~/.cabal:/home/builder/.cabal \
|
|
-v /home/runner/work/_temp:/home/runner/work/_temp \
|
|
-v ${{ github.workspace }}:/project \
|
|
build/${{ matrix.os }}:latest
|
|
|
|
- name: Compute cache key prefixes
|
|
id: keys
|
|
if: matrix.should_run == true && env.release != 'true'
|
|
run: |
|
|
toolchain=$(docker exec builder dpkg-query -W -f '${db:Status-Status} ${binary:Package} ${Version}\n' 'binutils*' 'cpp*' 'gcc*' '*-dev' | grep '^installed ' | sha256sum | cut -c1-16)
|
|
target=ubuntu-${{ matrix.os }}-${{ matrix.arch }}-ghc${{ matrix.ghc }}-$toolchain
|
|
echo "deps=deps-$target" >> "$GITHUB_OUTPUT"
|
|
echo "dist=dist-$target" >> "$GITHUB_OUTPUT"
|
|
echo "dist_lib=dist-lib-$target" >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Restore dependencies from cache
|
|
id: restore-deps
|
|
if: matrix.should_run == true && env.release != 'true'
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: ~/.cabal/store
|
|
key: ${{ steps.keys.outputs.deps }}-${{ env.branch }}-${{ github.sha }}
|
|
restore-keys: |
|
|
${{ steps.keys.outputs.deps }}-${{ env.branch }}-
|
|
${{ steps.keys.outputs.deps }}-
|
|
|
|
- name: Warn if dependencies not in cache
|
|
if: matrix.should_run == true && env.release != 'true' && steps.restore-deps.outputs.cache-matched-key == ''
|
|
run: echo "::warning title=Cache miss::${{ steps.keys.outputs.deps }}-${{ env.branch }}"
|
|
|
|
- name: Restore source repositories from cache
|
|
id: restore-src
|
|
if: matrix.should_run == true && env.release != 'true'
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: dist-newstyle/src
|
|
key: src-${{ runner.os }}-${{ hashFiles('cabal.project') }}
|
|
restore-keys: src-${{ runner.os }}-
|
|
|
|
- name: Warn if source repositories not in cache
|
|
if: matrix.should_run == true && env.release != 'true' && steps.restore-src.outputs.cache-matched-key == ''
|
|
run: echo "::warning title=Cache miss::src-${{ runner.os }}"
|
|
|
|
- name: Restore build directory from cache
|
|
id: restore-build
|
|
if: matrix.should_run == true && env.release != 'true'
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: |
|
|
dist-newstyle/*
|
|
!dist-newstyle/src
|
|
key: ${{ steps.keys.outputs.dist }}-${{ env.opt }}-${{ env.branch }}-${{ github.sha }}
|
|
restore-keys: |
|
|
${{ steps.keys.outputs.dist }}-${{ env.opt }}-${{ env.branch }}-
|
|
${{ steps.keys.outputs.dist }}-${{ env.opt }}-
|
|
|
|
- name: Warn if build directory not in cache
|
|
if: matrix.should_run == true && env.release != 'true' && steps.restore-build.outputs.cache-matched-key == ''
|
|
run: echo "::warning title=Cache miss::${{ steps.keys.outputs.dist }}-${{ env.opt }}-${{ env.branch }}"
|
|
|
|
- name: Restore library build directory from cache
|
|
id: restore-build-lib
|
|
if: env.release != 'true' && matrix.libs && needs.maybe-release.outputs.core_changed && matrix.arch == 'x86_64' && (needs.maybe-release.outputs.reduced != 'true' || matrix.packages == true)
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: |
|
|
dist-lib/*
|
|
!dist-lib/src
|
|
key: ${{ steps.keys.outputs.dist_lib }}-${{ env.branch }}-${{ github.sha }}
|
|
restore-keys: |
|
|
${{ steps.keys.outputs.dist_lib }}-${{ env.branch }}-
|
|
${{ steps.keys.outputs.dist_lib }}-
|
|
|
|
- name: Warn if library build directory not in cache
|
|
if: steps.restore-build-lib.outcome == 'success' && steps.restore-build-lib.outputs.cache-matched-key == ''
|
|
run: echo "::warning title=Cache miss::${{ steps.keys.outputs.dist_lib }}-${{ env.branch }}"
|
|
|
|
- name: Set old timestamps on unchanged sources (GHC 8.10.7)
|
|
if: matrix.ghc == '8.10.7' && steps.restore-build.outputs.cache-matched-key != '' && hashFiles(env.source_hashes) != ''
|
|
run: scripts/ci/source-timestamps.sh restore ${{ env.source_hashes }}
|
|
|
|
- name: Prepare cabal.project.local
|
|
if: matrix.should_run == true
|
|
shell: bash
|
|
run: |
|
|
echo "ignore-project: False" >> cabal.project.local
|
|
echo "package direct-sqlcipher" >> cabal.project.local
|
|
echo " flags: +openssl" >> cabal.project.local
|
|
|
|
- name: Build CLI
|
|
id: build-cli
|
|
if: matrix.should_run == true
|
|
shell: docker exec -t builder sh -eu {0}
|
|
run: |
|
|
scripts/ci/prune-old-builds.sh dist-newstyle
|
|
cabal update
|
|
cabal build -j --enable-tests ${{ env.ghc_options }}
|
|
mkdir -p /out
|
|
for i in simplex-chat simplex-chat-test; do
|
|
bin=$(find /project/dist-newstyle -name "$i" -type f -executable)
|
|
chmod +x "$bin"
|
|
cp "$bin" /out/
|
|
done
|
|
strip /out/simplex-chat
|
|
|
|
# Also for pull requests that change the chat core, for the package tests.
|
|
- name: Build library
|
|
id: build-lib
|
|
if: matrix.libs && (needs.maybe-release.outputs.libs_tag || (needs.maybe-release.outputs.core_changed && matrix.arch == 'x86_64' && (needs.maybe-release.outputs.reduced != 'true' || matrix.packages == true)))
|
|
shell: docker exec -t builder sh -eu {0}
|
|
run: |
|
|
scripts/ci/prune-old-builds.sh dist-lib
|
|
mkdir -p dist-lib
|
|
rm -rf dist-lib/src
|
|
ln -s ../dist-newstyle/src dist-lib/src
|
|
DIST_DIR=dist-lib SKIP_VLC=1 scripts/desktop/build-lib-linux.sh
|
|
name=simplex-chat-libs-linux-${{ matrix.arch }}
|
|
mkdir -p release-libs/$name/libs
|
|
find apps/multiplatform/common/src/commonMain/cpp/desktop/libs/linux-${{ matrix.arch }} -maxdepth 1 -type f -exec cp {} release-libs/$name/libs/ \;
|
|
(cd release-libs/$name && zip -r ../$name.zip libs)
|
|
|
|
- name: Record source hashes (GHC 8.10.7)
|
|
if: matrix.should_run == true && matrix.ghc == '8.10.7'
|
|
shell: docker exec -t builder sh -eu {0}
|
|
run: scripts/ci/source-timestamps.sh record ${{ env.source_hashes }}
|
|
|
|
- name: Compute dependency cache key
|
|
id: hash-deps
|
|
if: matrix.should_run == true && env.release != 'true'
|
|
shell: bash
|
|
run: echo "hash=$(ls ~/.cabal/store/ghc-*/ | sha256sum | cut -c1-16)" >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Save dependencies to cache
|
|
if: matrix.should_run == true && env.release != 'true' && steps.restore-deps.outputs.cache-matched-key != format('{0}-{1}-{2}', steps.keys.outputs.deps, env.branch, steps.hash-deps.outputs.hash)
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: ~/.cabal/store
|
|
key: ${{ steps.keys.outputs.deps }}-${{ env.branch }}-${{ steps.hash-deps.outputs.hash }}
|
|
|
|
- name: Save source repositories to cache
|
|
if: matrix.should_run == true && env.release != 'true' && matrix.libs && matrix.arch == 'x86_64' && steps.restore-src.outputs.cache-hit != 'true'
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: dist-newstyle/src
|
|
key: src-${{ runner.os }}-${{ hashFiles('cabal.project') }}
|
|
|
|
- name: Save build directory to cache
|
|
if: matrix.should_run == true && env.release != 'true' && steps.restore-build.outputs.cache-hit != 'true'
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: |
|
|
dist-newstyle/*
|
|
!dist-newstyle/src
|
|
key: ${{ steps.keys.outputs.dist }}-${{ env.opt }}-${{ env.branch }}-${{ github.sha }}
|
|
|
|
- name: Save library build directory to cache
|
|
if: steps.build-lib.outcome == 'success' && env.release != 'true' && steps.restore-build-lib.outputs.cache-hit != 'true'
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: |
|
|
dist-lib/*
|
|
!dist-lib/src
|
|
key: ${{ steps.keys.outputs.dist_lib }}-${{ env.branch }}-${{ github.sha }}
|
|
|
|
- name: Upload library
|
|
if: needs.maybe-release.outputs.libs_tag && matrix.libs
|
|
shell: bash
|
|
env:
|
|
GH_TOKEN: ${{ secrets.NODEJS_REPO_TOKEN }}
|
|
TAG: ${{ needs.maybe-release.outputs.libs_tag }}
|
|
run: gh release upload "$TAG" release-libs/*.zip --clobber --repo "${{ github.repository }}-libs"
|
|
|
|
- name: Build CLI deb
|
|
if: startsWith(github.ref, 'refs/tags/v') && matrix.should_run == true
|
|
shell: docker exec -t builder sh -eu {0}
|
|
run: |
|
|
version=${{ github.ref }}
|
|
version=${version#refs/tags/v}
|
|
version=${version%-*}
|
|
|
|
./scripts/desktop/build-cli-deb.sh "$version"
|
|
|
|
- name: Copy tests from container
|
|
if: matrix.should_run == true
|
|
shell: bash
|
|
run: |
|
|
docker cp builder:/out/simplex-chat-test .
|
|
|
|
- name: Copy CLI from container and prepare it
|
|
id: linux_cli_prepare
|
|
if: startsWith(github.ref, 'refs/tags/v') && matrix.should_run == true
|
|
shell: bash
|
|
run: |
|
|
cli_name="simplex-chat-ubuntu-${{ matrix.os_underscore }}-${{ matrix.arch }}"
|
|
cli_deb_name="${cli_name}.deb"
|
|
cli_path="${{ github.workspace }}"
|
|
|
|
docker cp builder:/out/simplex-chat "./${cli_name}"
|
|
docker cp builder:/out/deb-build/simplex-chat.deb "./${cli_deb_name}"
|
|
|
|
echo "bin_name=${cli_name}" >> $GITHUB_OUTPUT
|
|
echo "bin_path=${cli_path}/${cli_name}" >> $GITHUB_OUTPUT
|
|
echo "bin_hash=$(echo SHA2-256\(${cli_name}\)= $(openssl sha256 "${cli_path}/${cli_name}" | cut -d' ' -f 2))" >> $GITHUB_OUTPUT
|
|
|
|
echo "deb_name=${cli_deb_name}" >> $GITHUB_OUTPUT
|
|
echo "deb_path=${cli_path}/${cli_deb_name}" >> $GITHUB_OUTPUT
|
|
echo "deb_hash=$(echo SHA2-256\(${cli_deb_name}\)= $(openssl sha256 "${cli_path}/${cli_deb_name}" | cut -d' ' -f 2))" >> $GITHUB_OUTPUT
|
|
|
|
- name: Upload CLI
|
|
if: startsWith(github.ref, 'refs/tags/v') && matrix.should_run == true
|
|
uses: ./.github/actions/prepare-release
|
|
with:
|
|
bin_name: ${{ steps.linux_cli_prepare.outputs.bin_name }}
|
|
bin_path: ${{ steps.linux_cli_prepare.outputs.bin_path }}
|
|
bin_hash: ${{ steps.linux_cli_prepare.outputs.bin_hash }}
|
|
github_ref: ${{ github.ref }}
|
|
github_token: ${{ secrets.GITHUB_TOKEN }}
|
|
|
|
- name: Upload CLI deb
|
|
if: startsWith(github.ref, 'refs/tags/v') && matrix.should_run == true
|
|
uses: ./.github/actions/prepare-release
|
|
with:
|
|
bin_name: ${{ steps.linux_cli_prepare.outputs.deb_name }}
|
|
bin_path: ${{ steps.linux_cli_prepare.outputs.deb_path }}
|
|
bin_hash: ${{ steps.linux_cli_prepare.outputs.deb_hash }}
|
|
github_ref: ${{ github.ref }}
|
|
github_token: ${{ secrets.GITHUB_TOKEN }}
|
|
|
|
- name: Build Desktop
|
|
if: startsWith(github.ref, 'refs/tags/v') && matrix.should_run == true
|
|
shell: docker exec -t builder sh -eu {0}
|
|
run: |
|
|
export ASSETS_DIR='../../assets'
|
|
scripts/desktop/make-deb-linux.sh
|
|
|
|
- name: Prepare Desktop
|
|
id: linux_desktop_build
|
|
if: startsWith(github.ref, 'refs/tags/v') && matrix.should_run == true
|
|
shell: bash
|
|
run: |
|
|
path=$(echo ${{ github.workspace }}/apps/multiplatform/release/main/deb/simplex_${{ matrix.arch }}.deb )
|
|
echo "package_path=$path" >> $GITHUB_OUTPUT
|
|
echo "package_hash=$(echo SHA2-256\(simplex-desktop-ubuntu-${{ matrix.os_underscore }}-${{ matrix.arch }}.deb\)= $(openssl sha256 $path | cut -d' ' -f 2))" >> $GITHUB_OUTPUT
|
|
|
|
- name: Upload Desktop
|
|
uses: ./.github/actions/prepare-release
|
|
if: startsWith(github.ref, 'refs/tags/v') && matrix.should_run == true
|
|
with:
|
|
bin_path: ${{ steps.linux_desktop_build.outputs.package_path }}
|
|
bin_name: simplex-desktop-ubuntu-${{ matrix.os_underscore }}-${{ matrix.arch }}.deb
|
|
bin_hash: ${{ steps.linux_desktop_build.outputs.package_hash }}
|
|
github_ref: ${{ github.ref }}
|
|
github_token: ${{ secrets.GITHUB_TOKEN }}
|
|
|
|
- name: Build AppImage
|
|
if: startsWith(github.ref, 'refs/tags/v') && matrix.os == '22.04' && matrix.should_run == true
|
|
shell: docker exec -t builder sh -eu {0}
|
|
run: |
|
|
export ASSETS_DIR='../../assets'
|
|
scripts/desktop/make-appimage-linux.sh
|
|
|
|
- name: Prepare AppImage
|
|
id: linux_appimage_build
|
|
if: startsWith(github.ref, 'refs/tags/v') && matrix.os == '22.04' && matrix.should_run == true
|
|
shell: bash
|
|
run: |
|
|
path=$(echo ${{ github.workspace }}/apps/multiplatform/release/main/*imple*.AppImage)
|
|
echo "appimage_path=$path" >> $GITHUB_OUTPUT
|
|
echo "appimage_hash=$(echo SHA2-256\(simplex-desktop-${{ matrix.arch }}.AppImage\)= $(openssl sha256 $path | cut -d' ' -f 2))" >> $GITHUB_OUTPUT
|
|
|
|
- name: Upload AppImage
|
|
if: startsWith(github.ref, 'refs/tags/v') && matrix.os == '22.04' && matrix.should_run == true
|
|
uses: ./.github/actions/prepare-release
|
|
with:
|
|
bin_path: ${{ steps.linux_appimage_build.outputs.appimage_path }}
|
|
bin_name: "simplex-desktop-${{ matrix.arch }}.AppImage"
|
|
bin_hash: ${{ steps.linux_appimage_build.outputs.appimage_hash }}
|
|
github_ref: ${{ github.ref }}
|
|
github_token: ${{ secrets.GITHUB_TOKEN }}
|
|
|
|
- name: Mount RAM disk for tests
|
|
if: matrix.should_run == true && matrix.arch == 'x86_64'
|
|
shell: bash
|
|
run: |
|
|
mkdir -p tests/tmp
|
|
sudo mount -t tmpfs -o size=2G tmpfs tests/tmp
|
|
sudo chown $(id -u):$(id -g) tests/tmp
|
|
|
|
- name: Run tests
|
|
if: matrix.should_run == true && matrix.arch == 'x86_64'
|
|
timeout-minutes: 120
|
|
shell: bash
|
|
env:
|
|
REDUCED: ${{ needs.maybe-release.outputs.reduced }}
|
|
TESTS: ${{ github.event_name == 'workflow_dispatch' && inputs.tests || '' }}
|
|
PR_BODY: ${{ github.event.pull_request.draft == true && github.event.pull_request.body || '' }}
|
|
ATTEMPTS: ${{ (github.ref == 'refs/heads/stable' || startsWith(github.ref, 'refs/tags/v')) && 3 || 1 }}
|
|
run: scripts/ci/run-tests.sh ./simplex-chat-test
|
|
|
|
# Compiling the desktop and Android targets of :common in parallel exceeds the 2 GB Kotlin daemon heap.
|
|
# cmakeBuildAndCopy links the JNI library against libsimplex, which this job does not build.
|
|
- name: Build and test Kotlin apps
|
|
if: ${{ !cancelled() && matrix.kotlin == true }}
|
|
timeout-minutes: 90
|
|
shell: docker exec -t builder sh -eu {0}
|
|
run: |
|
|
cd apps/multiplatform
|
|
./gradlew --no-daemon --max-workers=1 \
|
|
:common:desktopTest \
|
|
:desktop:compileKotlinJvm -x :desktop:cmakeBuildAndCopy \
|
|
:android:compileGoogleDebugKotlin \
|
|
:android:testFossDebugUnitTest
|
|
|
|
- name: Setup Node.js
|
|
id: setup-node
|
|
if: ${{ !cancelled() && (matrix.packages == true || matrix.scope_tests == true || (matrix.should_run == true && matrix.libs && ((github.event_name == 'pull_request' && needs.maybe-release.outputs.reduced != 'true') || needs.maybe-release.outputs.addon_draft || needs.maybe-release.outputs.publish))) }}
|
|
uses: actions/setup-node@v7
|
|
with:
|
|
node-version: 22
|
|
|
|
- name: Setup Python
|
|
id: setup-python
|
|
if: ${{ !cancelled() && steps.setup-node.outcome == 'success' }}
|
|
uses: actions/setup-python@v7
|
|
with:
|
|
python-version: "3.12"
|
|
|
|
- name: Package tests (pull request)
|
|
if: ${{ !cancelled() && steps.setup-python.outcome == 'success' && github.event_name != 'push' && steps.build-lib.outcome != 'failure' && ((needs.maybe-release.outputs.reduced != 'true' && matrix.should_run == true) || matrix.packages == true) }}
|
|
timeout-minutes: 30
|
|
shell: bash
|
|
env:
|
|
SIMPLEX_LIBS_DIR: ${{ steps.build-lib.outcome == 'success' && format('{0}/release-libs/simplex-chat-libs-linux-{1}/libs', github.workspace, matrix.arch) || '' }}
|
|
run: |
|
|
scripts/ci/package-tests.sh build linux-${{ matrix.arch }}
|
|
scripts/ci/package-tests.sh test
|
|
|
|
- name: Add-on
|
|
if: ${{ !cancelled() && steps.setup-python.outcome == 'success' && needs.maybe-release.outputs.addon_draft }}
|
|
timeout-minutes: 30
|
|
shell: bash
|
|
env:
|
|
LIBS_RELEASE: ${{ needs.maybe-release.outputs.libs_latest }}
|
|
ADDON_TAG: ${{ needs.maybe-release.outputs.addon_tag }}
|
|
LIBS_REPOSITORY: ${{ github.repository }}-libs
|
|
GH_TOKEN: ${{ secrets.NODEJS_REPO_TOKEN }}
|
|
run: scripts/ci/package-tests.sh addon linux-${{ matrix.arch }}
|
|
|
|
- name: Package tests
|
|
id: package-tests
|
|
if: ${{ !cancelled() && steps.setup-python.outcome == 'success' && needs.maybe-release.outputs.publish }}
|
|
timeout-minutes: 30
|
|
shell: bash
|
|
run: |
|
|
scripts/ci/package-tests.sh publish linux-${{ matrix.arch }} ${{ needs.maybe-release.outputs.publish_nodejs && 'nodejs' || '' }} ${{ needs.maybe-release.outputs.publish_python && 'python' || '' }}
|
|
echo "linux-${{ matrix.arch }}" > "$RUNNER_TEMP/package-tests"
|
|
|
|
- name: Package tests result
|
|
if: ${{ !cancelled() && steps.package-tests.outcome == 'success' }}
|
|
uses: actions/upload-artifact@v7
|
|
with:
|
|
name: package-tests-linux-${{ matrix.arch }}
|
|
path: ${{ runner.temp }}/package-tests
|
|
|
|
- name: Test changed scopes
|
|
if: ${{ !cancelled() && matrix.scope_tests == true && steps.setup-python.outcome == 'success' }}
|
|
timeout-minutes: 30
|
|
shell: bash
|
|
env:
|
|
SCOPES: ${{ needs.maybe-release.outputs.scopes }}
|
|
run: |
|
|
for scope in $SCOPES; do
|
|
scripts/ci/scope-tests.sh "$scope"
|
|
done
|
|
|
|
- name: Remove -O2 build directory
|
|
id: remove-o2
|
|
if: env.cache_o0 == 'true' && !cancelled() && steps.build-cli.outcome == 'success'
|
|
shell: docker exec -t builder sh -eu {0}
|
|
run: find dist-newstyle -mindepth 1 -maxdepth 1 ! -name src -exec rm -rf {} +
|
|
|
|
- name: Restore -O0 build directory from cache
|
|
id: restore-build-o0
|
|
if: ${{ !cancelled() && steps.remove-o2.outcome == 'success' }}
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: |
|
|
dist-newstyle/*
|
|
!dist-newstyle/src
|
|
key: ${{ steps.keys.outputs.dist }}-O0-${{ env.branch }}-${{ github.sha }}
|
|
restore-keys: |
|
|
${{ steps.keys.outputs.dist }}-O0-${{ env.branch }}-
|
|
${{ steps.keys.outputs.dist }}-O0-
|
|
|
|
- name: Set old timestamps on unchanged sources for -O0 build (GHC 8.10.7)
|
|
if: ${{ !cancelled() && matrix.ghc == '8.10.7' && steps.restore-build-o0.outputs.cache-matched-key != '' && hashFiles(env.source_hashes) != '' }}
|
|
run: scripts/ci/source-timestamps.sh restore ${{ env.source_hashes }}
|
|
|
|
- name: Build at -O0 for pull request caches
|
|
id: build-o0
|
|
if: ${{ !cancelled() && steps.remove-o2.outcome == 'success' }}
|
|
shell: docker exec -t builder sh -eu {0}
|
|
run: |
|
|
scripts/ci/prune-old-builds.sh dist-newstyle
|
|
cabal build -j --enable-tests --ghc-options=-O0
|
|
|
|
- name: Record source hashes for -O0 build (GHC 8.10.7)
|
|
if: ${{ !cancelled() && matrix.ghc == '8.10.7' && steps.build-o0.outcome == 'success' }}
|
|
shell: docker exec -t builder sh -eu {0}
|
|
run: scripts/ci/source-timestamps.sh record ${{ env.source_hashes }}
|
|
|
|
- name: Save -O0 build directory to cache
|
|
if: ${{ !cancelled() && steps.build-o0.outcome == 'success' && steps.restore-build-o0.outputs.cache-hit != 'true' }}
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: |
|
|
dist-newstyle/*
|
|
!dist-newstyle/src
|
|
key: ${{ steps.keys.outputs.dist }}-O0-${{ env.branch }}-${{ github.sha }}
|
|
|
|
build-linux-full:
|
|
name: "ubuntu-${{ matrix.os }}-${{ matrix.arch }} (CLI,Desktop), GHC: ${{ matrix.ghc }}"
|
|
needs: [maybe-release, variables]
|
|
if: needs.maybe-release.outputs.reduced != 'true' && (needs.maybe-release.outputs.haskell == 'true' || needs.maybe-release.outputs.kotlin == 'true')
|
|
runs-on: ${{ matrix.runner }}
|
|
permissions:
|
|
contents: write
|
|
packages: write
|
|
env:
|
|
image_cache: ghcr.io/${{ github.repository_owner }}/simplex-chat-build-cache:${{ matrix.os }}-${{ matrix.arch }}-ghc${{ matrix.ghc }}
|
|
source_hashes: dist-newstyle/sources.sha256
|
|
concurrency: *linux-concurrency
|
|
strategy:
|
|
fail-fast: false
|
|
matrix:
|
|
include:
|
|
- os: 24.04
|
|
os_underscore: 24_04
|
|
arch: x86_64
|
|
runner: "ubuntu-24.04"
|
|
should_run: ${{ needs.maybe-release.outputs.haskell == 'true' }}
|
|
ghc: ${{ needs.variables.outputs.GHC_VER }}
|
|
hash: 'sha256:98ff7968124952e719a8a69bb3cccdd217f5fe758108ac4f21ad22e1df44d237'
|
|
kotlin: ${{ needs.maybe-release.outputs.kotlin == 'true' }}
|
|
steps: *linux-steps
|
|
|
|
build-linux-push:
|
|
name: "ubuntu-${{ matrix.os }}-${{ matrix.arch }} (CLI,Desktop), GHC: ${{ matrix.ghc }}"
|
|
needs: [maybe-release, variables]
|
|
if: needs.maybe-release.outputs.reduced != 'true' && github.event_name == 'push'
|
|
runs-on: ${{ matrix.runner }}
|
|
permissions:
|
|
contents: write
|
|
packages: write
|
|
env:
|
|
image_cache: ghcr.io/${{ github.repository_owner }}/simplex-chat-build-cache:${{ matrix.os }}-${{ matrix.arch }}-ghc${{ matrix.ghc }}
|
|
source_hashes: dist-newstyle/sources.sha256
|
|
cache_o0: false
|
|
concurrency: *linux-concurrency
|
|
strategy:
|
|
fail-fast: false
|
|
matrix:
|
|
include:
|
|
- os: 22.04
|
|
os_underscore: 22_04
|
|
arch: aarch64
|
|
runner: "ubuntu-22.04-arm"
|
|
should_run: true
|
|
ghc: ${{ needs.variables.outputs.GHC_VER }}
|
|
hash: 'sha256:6a62a4157b8775eaf4959cb629e757d32d39d1f4c8ac1b0ddc2510b555cf72f3'
|
|
libs: true
|
|
kotlin: false
|
|
- os: 24.04
|
|
os_underscore: 24_04
|
|
arch: aarch64
|
|
runner: "ubuntu-24.04-arm"
|
|
should_run: true
|
|
ghc: ${{ needs.variables.outputs.GHC_VER }}
|
|
hash: 'sha256:68434214381cb38287104e629fe8ee720167dd98cbb36ab1cbbab342515fa6ab'
|
|
kotlin: false
|
|
steps: *linux-steps
|
|
|
|
build-linux-ghc8:
|
|
name: "ubuntu-${{ matrix.os }}-${{ matrix.arch }} (CLI,Desktop), GHC: ${{ matrix.ghc }}"
|
|
needs: [maybe-release, variables]
|
|
if: ${{ needs.maybe-release.outputs.reduced != 'true' && needs.maybe-release.outputs.haskell == 'true' && !(github.ref == 'refs/heads/stable' || startsWith(github.ref, 'refs/tags/v')) }}
|
|
runs-on: ${{ matrix.runner }}
|
|
permissions:
|
|
contents: write
|
|
packages: write
|
|
env:
|
|
image_cache: ghcr.io/${{ github.repository_owner }}/simplex-chat-build-cache:${{ matrix.os }}-${{ matrix.arch }}-ghc${{ matrix.ghc }}
|
|
source_hashes: dist-newstyle/sources.sha256
|
|
opt: O0
|
|
ghc_options: --ghc-options=-O0
|
|
cache_o0: false
|
|
concurrency: *linux-concurrency
|
|
strategy:
|
|
fail-fast: false
|
|
matrix:
|
|
include:
|
|
- os: 22.04
|
|
os_underscore: 22_04
|
|
arch: x86_64
|
|
runner: "ubuntu-22.04"
|
|
ghc: "8.10.7"
|
|
hash: 'sha256:5c8b2c0a6c745bc177669abfaa716b4bc57d58e2ea3882fb5da67f4d59e3dda5'
|
|
should_run: true
|
|
kotlin: false
|
|
steps: *linux-steps
|
|
|
|
# =================================
|
|
# Linux PostgreSQL Library Build
|
|
# =================================
|
|
|
|
build-linux-postgres:
|
|
name: "ubuntu-22.04-x86_64 (Postgres lib), GHC: ${{ needs.variables.outputs.GHC_VER }}"
|
|
needs: [maybe-release, variables]
|
|
runs-on: ubuntu-22.04
|
|
if: needs.maybe-release.outputs.libs_tag
|
|
steps:
|
|
- name: Checkout Code
|
|
uses: actions/checkout@v3
|
|
|
|
- name: Get UID and GID
|
|
id: ids
|
|
run: |
|
|
echo "uid=$(id -u)" >> $GITHUB_OUTPUT
|
|
echo "gid=$(id -g)" >> $GITHUB_OUTPUT
|
|
|
|
- name: Free disk space
|
|
shell: bash
|
|
run: ./scripts/ci/linux_util_free_space.sh
|
|
|
|
- name: Set up Docker Buildx
|
|
uses: simplex-chat/docker-setup-buildx-action@v3
|
|
|
|
- name: Build and cache Docker image
|
|
uses: simplex-chat/docker-build-push-action@v6
|
|
with:
|
|
context: .
|
|
load: true
|
|
file: Dockerfile.build
|
|
tags: build/22.04:latest
|
|
build-args: |
|
|
TAG=22.04
|
|
HASH=sha256:5c8b2c0a6c745bc177669abfaa716b4bc57d58e2ea3882fb5da67f4d59e3dda5
|
|
GHC=${{ needs.variables.outputs.GHC_VER }}
|
|
USER_UID=${{ steps.ids.outputs.uid }}
|
|
USER_GID=${{ steps.ids.outputs.gid }}
|
|
|
|
- name: Start container
|
|
shell: bash
|
|
run: |
|
|
mkdir -p ~/.cabal
|
|
docker run -t -d \
|
|
--name builder \
|
|
-e CABAL_DIR=/home/builder/.cabal \
|
|
-v ~/.cabal:/home/builder/.cabal \
|
|
-v /home/runner/work/_temp:/home/runner/work/_temp \
|
|
-v ${{ github.workspace }}:/project \
|
|
build/22.04:latest
|
|
|
|
- name: Compute cache key prefix
|
|
id: keys
|
|
run: |
|
|
toolchain=$(docker exec builder dpkg-query -W -f '${db:Status-Status} ${binary:Package} ${Version}\n' 'binutils*' 'cpp*' 'gcc*' '*-dev' | grep '^installed ' | sha256sum | cut -c1-16)
|
|
echo "deps=deps-ubuntu-22.04-x86_64-postgres-ghc${{ needs.variables.outputs.GHC_VER }}-$toolchain" >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Restore dependencies from cache
|
|
id: restore-deps
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: ~/.cabal/store
|
|
key: ${{ steps.keys.outputs.deps }}-${{ env.branch }}-${{ github.sha }}
|
|
restore-keys: |
|
|
${{ steps.keys.outputs.deps }}-${{ env.branch }}-
|
|
${{ steps.keys.outputs.deps }}-
|
|
|
|
- name: Warn if dependencies not in cache
|
|
if: steps.restore-deps.outputs.cache-matched-key == ''
|
|
run: echo "::warning title=Cache miss::${{ steps.keys.outputs.deps }}-${{ env.branch }}"
|
|
|
|
- name: Prepare cabal.project.local
|
|
shell: bash
|
|
run: |
|
|
echo "ignore-project: False" >> cabal.project.local
|
|
echo "package direct-sqlcipher" >> cabal.project.local
|
|
echo " flags: +openssl" >> cabal.project.local
|
|
|
|
- name: Build postgres library
|
|
shell: docker exec -t builder sh -eu {0}
|
|
run: |
|
|
cabal update
|
|
scripts/desktop/build-lib-linux.sh postgres
|
|
|
|
- name: Compute dependency cache key
|
|
id: hash-deps
|
|
shell: bash
|
|
run: echo "hash=$(ls ~/.cabal/store/ghc-*/ | sha256sum | cut -c1-16)" >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Save dependencies to cache
|
|
if: steps.restore-deps.outputs.cache-matched-key != format('{0}-{1}-{2}', steps.keys.outputs.deps, env.branch, steps.hash-deps.outputs.hash)
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: ~/.cabal/store
|
|
key: ${{ steps.keys.outputs.deps }}-${{ env.branch }}-${{ steps.hash-deps.outputs.hash }}
|
|
|
|
- name: Copy libs from container
|
|
shell: bash
|
|
run: |
|
|
ARCH=x86_64
|
|
GHC_VER=${{ needs.variables.outputs.GHC_VER }}
|
|
BUILD_DIR=$(echo dist-newstyle/build/${ARCH}-linux/ghc-${GHC_VER}/simplex-chat-*)
|
|
mkdir -p postgres-libs/libs
|
|
cp ${BUILD_DIR}/build/libsimplex.so postgres-libs/libs/
|
|
cp ${BUILD_DIR}/build/deps/* postgres-libs/libs/
|
|
(cd postgres-libs && zip -r simplex-chat-libs-linux-x86_64-postgres.zip libs)
|
|
|
|
- name: Upload postgres library
|
|
shell: bash
|
|
env:
|
|
GH_TOKEN: ${{ secrets.NODEJS_REPO_TOKEN }}
|
|
TAG: ${{ needs.maybe-release.outputs.libs_tag }}
|
|
run: gh release upload "$TAG" postgres-libs/*.zip --clobber --repo "${{ github.repository }}-libs"
|
|
|
|
# =========================
|
|
# MacOS Build
|
|
# =========================
|
|
|
|
build-macos:
|
|
name: "${{ matrix.os }} (CLI,Desktop), GHC: ${{ matrix.ghc }}"
|
|
needs: [maybe-release, variables]
|
|
if: needs.maybe-release.outputs.reduced != 'true' && needs.maybe-release.outputs.haskell == 'true'
|
|
runs-on: ${{ matrix.os }}
|
|
concurrency:
|
|
group: ${{ github.workflow }}-${{ github.ref }}-macos-${{ matrix.os }}-${{ needs.maybe-release.outputs.libs_tag }}
|
|
cancel-in-progress: ${{ github.event_name == 'pull_request' }}
|
|
strategy:
|
|
fail-fast: false
|
|
matrix:
|
|
include:
|
|
- os: macos-latest
|
|
arch: aarch64
|
|
ghc: ${{ needs.variables.outputs.GHC_VER }}
|
|
cli_asset_name: simplex-chat-macos-aarch64
|
|
desktop_asset_name: simplex-desktop-macos-aarch64.dmg
|
|
openssl_dir: "/opt/homebrew/opt"
|
|
should_run: ${{ needs.maybe-release.outputs.haskell == 'true' }}
|
|
- os: macos-15-intel
|
|
arch: x86_64
|
|
ghc: ${{ needs.variables.outputs.GHC_VER }}
|
|
cli_asset_name: simplex-chat-macos-x86-64
|
|
desktop_asset_name: simplex-desktop-macos-x86_64.dmg
|
|
openssl_dir: "/usr/local/opt"
|
|
should_run: ${{ needs.maybe-release.outputs.haskell == 'true' }}
|
|
steps:
|
|
- name: Checkout Code
|
|
if: matrix.should_run == true
|
|
uses: actions/checkout@v3
|
|
with:
|
|
submodules: recursive
|
|
|
|
- name: Point Command Line Tools SDK to Xcode SDK
|
|
if: matrix.should_run == true
|
|
shell: bash
|
|
run: sudo ln -sfn "$(xcrun --sdk macosx --show-sdk-path)" /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk
|
|
|
|
- name: Compute toolchain cache key
|
|
id: toolchain-key
|
|
if: matrix.should_run == true && env.release != 'true'
|
|
shell: bash
|
|
run: echo "key=ghcup-${{ matrix.os }}-${{ matrix.arch }}-ghc${{ matrix.ghc }}-cabal3.10.2.0-$({ sw_vers -productVersion; clang --version; } | shasum -a 256 | cut -c1-16)" >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Restore toolchain from cache
|
|
id: restore-toolchain
|
|
if: matrix.should_run == true && env.release != 'true'
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: |
|
|
~/.ghcup/ghc/${{ matrix.ghc }}
|
|
~/.ghcup/bin/*-${{ matrix.ghc }}
|
|
~/.ghcup/bin/cabal-3.10.2.0
|
|
key: ${{ steps.toolchain-key.outputs.key }}
|
|
|
|
- name: Warn if toolchain not in cache
|
|
if: matrix.should_run == true && env.release != 'true' && steps.restore-toolchain.outputs.cache-hit != 'true'
|
|
run: echo "::warning title=Cache miss::${{ steps.toolchain-key.outputs.key }}"
|
|
|
|
- name: Prepare build
|
|
id: prepare
|
|
if: matrix.should_run == true
|
|
uses: ./.github/actions/prepare-build
|
|
with:
|
|
java_ver: ${{ needs.variables.outputs.JAVA_VER }}
|
|
ghc_ver: ${{ matrix.ghc }}
|
|
github_ref: ${{ github.ref }}
|
|
|
|
- name: Save toolchain to cache
|
|
if: matrix.should_run == true && env.release != 'true' && steps.restore-toolchain.outputs.cache-hit != 'true'
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: |
|
|
~/.ghcup/ghc/${{ matrix.ghc }}
|
|
~/.ghcup/bin/*-${{ matrix.ghc }}
|
|
~/.ghcup/bin/cabal-3.10.2.0
|
|
key: ${{ steps.toolchain-key.outputs.key }}
|
|
|
|
- name: Install OpenSSL
|
|
if: matrix.should_run == true
|
|
run: brew install openssl@3.0
|
|
|
|
- name: Prepare cabal.project.local
|
|
if: matrix.should_run == true
|
|
shell: bash
|
|
run: |
|
|
echo "ignore-project: False" >> cabal.project.local
|
|
echo "package simplexmq" >> cabal.project.local
|
|
echo " extra-include-dirs: ${{ matrix.openssl_dir }}/openssl@3.0/include" >> cabal.project.local
|
|
echo " extra-lib-dirs: ${{ matrix.openssl_dir}}/openssl@3.0/lib" >> cabal.project.local
|
|
echo "" >> cabal.project.local
|
|
echo "package direct-sqlcipher" >> cabal.project.local
|
|
echo " extra-include-dirs: ${{ matrix.openssl_dir }}/openssl@3.0/include" >> cabal.project.local
|
|
echo " extra-lib-dirs: ${{ matrix.openssl_dir }}/openssl@3.0/lib" >> cabal.project.local
|
|
echo " flags: +openssl" >> cabal.project.local
|
|
|
|
- name: Compute cache key prefixes
|
|
id: keys
|
|
if: matrix.should_run == true && env.release != 'true'
|
|
shell: bash
|
|
run: |
|
|
toolchain=$({ sw_vers -productVersion; clang --version; } | shasum -a 256 | cut -c1-16)
|
|
target=${{ matrix.os }}-${{ matrix.arch }}-ghc${{ matrix.ghc }}-$toolchain
|
|
echo "deps=deps-$target" >> "$GITHUB_OUTPUT"
|
|
echo "dist=dist-$target" >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Restore dependencies from cache
|
|
id: restore-deps
|
|
if: matrix.should_run == true && env.release != 'true'
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: ${{ steps.prepare.outputs.cabal-store }}
|
|
key: ${{ steps.keys.outputs.deps }}-${{ env.branch }}-${{ github.sha }}
|
|
restore-keys: |
|
|
${{ steps.keys.outputs.deps }}-${{ env.branch }}-
|
|
${{ steps.keys.outputs.deps }}-
|
|
|
|
- name: Warn if dependencies not in cache
|
|
if: matrix.should_run == true && env.release != 'true' && steps.restore-deps.outputs.cache-matched-key == ''
|
|
run: echo "::warning title=Cache miss::${{ steps.keys.outputs.deps }}-${{ env.branch }}"
|
|
|
|
- name: Restore source repositories from cache
|
|
id: restore-src
|
|
if: matrix.should_run == true && env.release != 'true'
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: dist-newstyle/src
|
|
key: src-${{ runner.os }}-${{ hashFiles('cabal.project') }}
|
|
restore-keys: src-${{ runner.os }}-
|
|
|
|
- name: Warn if source repositories not in cache
|
|
if: matrix.should_run == true && env.release != 'true' && steps.restore-src.outputs.cache-matched-key == ''
|
|
run: echo "::warning title=Cache miss::src-${{ runner.os }}"
|
|
|
|
- name: Restore build directory from cache
|
|
id: restore-build
|
|
if: matrix.should_run == true && env.release != 'true' && !needs.maybe-release.outputs.libs_tag
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: |
|
|
dist-newstyle/*
|
|
!dist-newstyle/src
|
|
key: ${{ steps.keys.outputs.dist }}-${{ env.opt }}-${{ env.branch }}-${{ github.sha }}
|
|
restore-keys: |
|
|
${{ steps.keys.outputs.dist }}-${{ env.opt }}-${{ env.branch }}-
|
|
${{ steps.keys.outputs.dist }}-${{ env.opt }}-
|
|
|
|
- name: Warn if build directory not in cache
|
|
if: matrix.should_run == true && steps.restore-build.outcome == 'success' && steps.restore-build.outputs.cache-matched-key == ''
|
|
run: echo "::warning title=Cache miss::${{ steps.keys.outputs.dist }}-${{ env.opt }}-${{ env.branch }}"
|
|
|
|
- name: Build CLI
|
|
id: mac_cli_build
|
|
if: matrix.should_run == true
|
|
shell: bash
|
|
run: |
|
|
scripts/ci/prune-old-builds.sh dist-newstyle
|
|
cabal build -j --enable-tests ${{ env.ghc_options }}
|
|
path=$(cabal list-bin simplex-chat | tail -n 1)
|
|
echo "bin_path=$path" >> $GITHUB_OUTPUT
|
|
echo "bin_hash=$(echo SHA2-256\(${{ matrix.cli_asset_name }}\)= $(openssl sha256 $path | cut -d' ' -f 2))" >> $GITHUB_OUTPUT
|
|
|
|
- name: Compute dependency cache key
|
|
id: hash-deps
|
|
if: matrix.should_run == true && env.release != 'true'
|
|
shell: bash
|
|
run: echo "hash=$(ls '${{ steps.prepare.outputs.cabal-store }}'/ghc-*/ | shasum -a 256 | cut -c1-16)" >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Save dependencies to cache
|
|
if: matrix.should_run == true && env.release != 'true' && steps.restore-deps.outputs.cache-matched-key != format('{0}-{1}-{2}', steps.keys.outputs.deps, env.branch, steps.hash-deps.outputs.hash)
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: ${{ steps.prepare.outputs.cabal-store }}
|
|
key: ${{ steps.keys.outputs.deps }}-${{ env.branch }}-${{ steps.hash-deps.outputs.hash }}
|
|
|
|
- name: Save source repositories to cache
|
|
if: matrix.should_run == true && env.release != 'true' && matrix.arch == 'x86_64' && steps.restore-src.outputs.cache-hit != 'true'
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: dist-newstyle/src
|
|
key: src-${{ runner.os }}-${{ hashFiles('cabal.project') }}
|
|
|
|
- name: Save build directory to cache
|
|
if: matrix.should_run == true && env.release != 'true' && steps.restore-build.outputs.cache-hit != 'true'
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: |
|
|
dist-newstyle/*
|
|
!dist-newstyle/src
|
|
key: ${{ steps.keys.outputs.dist }}-${{ env.opt }}-${{ env.branch }}-${{ github.sha }}
|
|
|
|
- name: Upload CLI
|
|
if: matrix.should_run == true && startsWith(github.ref, 'refs/tags/v')
|
|
uses: ./.github/actions/prepare-release
|
|
with:
|
|
bin_path: ${{ steps.mac_cli_build.outputs.bin_path }}
|
|
bin_name: ${{ matrix.cli_asset_name }}
|
|
bin_hash: ${{ steps.mac_cli_build.outputs.bin_hash }}
|
|
github_ref: ${{ github.ref }}
|
|
github_token: ${{ secrets.GITHUB_TOKEN }}
|
|
|
|
- name: Build Desktop
|
|
id: mac_desktop_build
|
|
if: matrix.should_run == true && startsWith(github.ref, 'refs/tags/v')
|
|
shell: bash
|
|
env:
|
|
APPLE_SIMPLEX_SIGNING_KEYCHAIN: ${{ secrets.APPLE_SIMPLEX_SIGNING_KEYCHAIN }}
|
|
APPLE_SIMPLEX_NOTARIZATION_APPLE_ID: ${{ secrets.APPLE_SIMPLEX_NOTARIZATION_APPLE_ID }}
|
|
APPLE_SIMPLEX_NOTARIZATION_PASSWORD: ${{ secrets.APPLE_SIMPLEX_NOTARIZATION_PASSWORD }}
|
|
run: |
|
|
export ASSETS_DIR='../../assets'
|
|
scripts/ci/build-desktop-mac.sh
|
|
path=$(echo $PWD/apps/multiplatform/release/main/dmg/SimpleX-*.dmg)
|
|
echo "package_path=$path" >> $GITHUB_OUTPUT
|
|
echo "package_hash=$(echo SHA2-256\(${{ matrix.desktop_asset_name }}\)= $(openssl sha256 $path | cut -d' ' -f 2))" >> $GITHUB_OUTPUT
|
|
|
|
- name: Upload Desktop
|
|
if: matrix.should_run == true && startsWith(github.ref, 'refs/tags/v')
|
|
uses: ./.github/actions/prepare-release
|
|
with:
|
|
bin_path: ${{ steps.mac_desktop_build.outputs.package_path }}
|
|
bin_name: ${{ matrix.desktop_asset_name }}
|
|
bin_hash: ${{ steps.mac_desktop_build.outputs.package_hash }}
|
|
github_ref: ${{ github.ref }}
|
|
github_token: ${{ secrets.GITHUB_TOKEN }}
|
|
|
|
- name: Mount RAM disk for tests
|
|
if: matrix.should_run == true && matrix.arch == 'aarch64'
|
|
shell: bash
|
|
run: |
|
|
disk=$(hdiutil attach -nomount ram://4194304 | tr -d '[:space:]')
|
|
diskutil erasevolume HFS+ tests "$disk"
|
|
ln -s /Volumes/tests tests/tmp
|
|
|
|
- name: Run tests
|
|
if: matrix.should_run == true && matrix.arch == 'aarch64'
|
|
timeout-minutes: 120
|
|
shell: bash
|
|
run: |
|
|
i=1
|
|
attempts=1
|
|
${{ (github.ref == 'refs/heads/stable' || startsWith(github.ref, 'refs/tags/v')) }} && attempts=3
|
|
while [ "$i" -le "$attempts" ]; do
|
|
if cabal test --test-show-details=direct ${{ env.ghc_options }}; then
|
|
break
|
|
else
|
|
echo "Attempt $i failed, retrying..."
|
|
i=$((i + 1))
|
|
sleep 1
|
|
fi
|
|
done
|
|
if [ "$i" -gt "$attempts" ]; then
|
|
echo "All "$attempts" attempts failed."
|
|
exit 1
|
|
fi
|
|
|
|
- name: Build library
|
|
id: mac_lib_build
|
|
if: ${{ !cancelled() && matrix.should_run == true && needs.maybe-release.outputs.libs_tag && steps.mac_cli_build.outcome == 'success' }}
|
|
shell: bash
|
|
env:
|
|
APPLE_SIMPLEX_SIGNING_KEYCHAIN: ${{ secrets.APPLE_SIMPLEX_SIGNING_KEYCHAIN }}
|
|
APPLE_SIMPLEX_NOTARIZATION_APPLE_ID: ${{ secrets.APPLE_SIMPLEX_NOTARIZATION_APPLE_ID }}
|
|
APPLE_SIMPLEX_NOTARIZATION_PASSWORD: ${{ secrets.APPLE_SIMPLEX_NOTARIZATION_PASSWORD }}
|
|
run: |
|
|
SKIP_VLC=1 scripts/desktop/build-lib-mac.sh
|
|
name=simplex-chat-libs-macos-${{ matrix.arch }}
|
|
mkdir -p release-libs/$name/libs
|
|
find apps/multiplatform/common/src/commonMain/cpp/desktop/libs/mac-${{ matrix.arch }} -maxdepth 1 -type f -exec cp {} release-libs/$name/libs/ \;
|
|
scripts/ci/sign-libs-mac.sh release-libs/$name/libs
|
|
(cd release-libs/$name && zip -r ../$name.zip libs)
|
|
|
|
- name: Upload library
|
|
if: ${{ !cancelled() && matrix.should_run == true && steps.mac_lib_build.outcome == 'success' }}
|
|
shell: bash
|
|
env:
|
|
GH_TOKEN: ${{ secrets.NODEJS_REPO_TOKEN }}
|
|
TAG: ${{ needs.maybe-release.outputs.libs_tag }}
|
|
run: gh release upload "$TAG" release-libs/*.zip --clobber --repo "${{ github.repository }}-libs"
|
|
|
|
- name: Setup Node.js
|
|
id: setup-node
|
|
if: ${{ !cancelled() && matrix.should_run == true && (github.event_name == 'pull_request' || needs.maybe-release.outputs.addon_draft || needs.maybe-release.outputs.publish) }}
|
|
uses: actions/setup-node@v7
|
|
with:
|
|
node-version: 22
|
|
|
|
- name: Setup Python
|
|
id: setup-python
|
|
if: ${{ !cancelled() && matrix.should_run == true && steps.setup-node.outcome == 'success' }}
|
|
uses: actions/setup-python@v7
|
|
with:
|
|
python-version: "3.12"
|
|
|
|
- name: Package tests (pull request)
|
|
if: ${{ !cancelled() && matrix.should_run == true && steps.setup-python.outcome == 'success' && github.event_name == 'pull_request' }}
|
|
timeout-minutes: 30
|
|
shell: bash
|
|
run: |
|
|
scripts/ci/package-tests.sh build macos-${{ matrix.arch }}
|
|
scripts/ci/package-tests.sh test
|
|
|
|
- name: Add-on
|
|
if: ${{ !cancelled() && matrix.should_run == true && steps.setup-python.outcome == 'success' && needs.maybe-release.outputs.addon_draft }}
|
|
timeout-minutes: 30
|
|
shell: bash
|
|
env:
|
|
LIBS_RELEASE: ${{ needs.maybe-release.outputs.libs_latest }}
|
|
ADDON_TAG: ${{ needs.maybe-release.outputs.addon_tag }}
|
|
LIBS_REPOSITORY: ${{ github.repository }}-libs
|
|
GH_TOKEN: ${{ secrets.NODEJS_REPO_TOKEN }}
|
|
run: scripts/ci/package-tests.sh addon macos-${{ matrix.arch }}
|
|
|
|
- name: Package tests
|
|
id: package-tests
|
|
if: ${{ !cancelled() && matrix.should_run == true && steps.setup-python.outcome == 'success' && needs.maybe-release.outputs.publish }}
|
|
timeout-minutes: 30
|
|
shell: bash
|
|
run: |
|
|
scripts/ci/package-tests.sh publish macos-${{ matrix.arch }} ${{ needs.maybe-release.outputs.publish_nodejs && 'nodejs' || '' }} ${{ needs.maybe-release.outputs.publish_python && 'python' || '' }}
|
|
echo "macos-${{ matrix.arch }}" > "$RUNNER_TEMP/package-tests"
|
|
|
|
- name: Package tests result
|
|
if: ${{ !cancelled() && matrix.should_run == true && steps.package-tests.outcome == 'success' }}
|
|
uses: actions/upload-artifact@v7
|
|
with:
|
|
name: package-tests-macos-${{ matrix.arch }}
|
|
path: ${{ runner.temp }}/package-tests
|
|
|
|
- name: Remove -O2 build directory
|
|
id: remove-o2
|
|
if: matrix.should_run == true && env.cache_o0 == 'true' && !cancelled() && steps.mac_cli_build.outcome == 'success'
|
|
shell: bash
|
|
run: find dist-newstyle -mindepth 1 -maxdepth 1 ! -name src -exec rm -rf {} +
|
|
|
|
- name: Restore -O0 build directory from cache
|
|
id: restore-build-o0
|
|
if: ${{ !cancelled() && matrix.should_run == true && steps.remove-o2.outcome == 'success' }}
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: |
|
|
dist-newstyle/*
|
|
!dist-newstyle/src
|
|
key: ${{ steps.keys.outputs.dist }}-O0-${{ env.branch }}-${{ github.sha }}
|
|
restore-keys: |
|
|
${{ steps.keys.outputs.dist }}-O0-${{ env.branch }}-
|
|
${{ steps.keys.outputs.dist }}-O0-
|
|
|
|
- name: Build at -O0 for pull request caches
|
|
id: build-o0
|
|
if: ${{ !cancelled() && matrix.should_run == true && steps.remove-o2.outcome == 'success' }}
|
|
shell: bash
|
|
run: |
|
|
scripts/ci/prune-old-builds.sh dist-newstyle
|
|
cabal build -j --enable-tests --ghc-options=-O0
|
|
|
|
- name: Save -O0 build directory to cache
|
|
if: ${{ !cancelled() && matrix.should_run == true && steps.build-o0.outcome == 'success' && steps.restore-build-o0.outputs.cache-hit != 'true' }}
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: |
|
|
dist-newstyle/*
|
|
!dist-newstyle/src
|
|
key: ${{ steps.keys.outputs.dist }}-O0-${{ env.branch }}-${{ github.sha }}
|
|
|
|
build-ios:
|
|
name: "macos-latest (iOS)"
|
|
needs: maybe-release
|
|
if: needs.maybe-release.outputs.ios == 'true'
|
|
runs-on: macos-latest
|
|
concurrency:
|
|
group: ${{ github.workflow }}-${{ github.ref }}-ios
|
|
cancel-in-progress: ${{ github.event_name != 'push' }}
|
|
steps:
|
|
- name: Checkout Code
|
|
uses: actions/checkout@v3
|
|
|
|
- name: Point Command Line Tools SDK to Xcode SDK
|
|
shell: bash
|
|
run: sudo ln -sfn "$(xcrun --sdk macosx --show-sdk-path)" /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk
|
|
|
|
- name: Check the previews listed in the snapshot tests
|
|
shell: bash
|
|
run: python3 "apps/ios/SimpleX Snapshots/check-previews.py"
|
|
|
|
- name: Build iOS app
|
|
timeout-minutes: 60
|
|
shell: bash
|
|
run: |
|
|
scripts/ci/ios-stub-libs.sh
|
|
xcodebuild build -quiet \
|
|
-project apps/ios/SimpleX.xcodeproj \
|
|
-scheme "SimpleX (iOS)" \
|
|
-configuration Debug \
|
|
-destination "generic/platform=iOS Simulator" \
|
|
-onlyUsePackageVersionsFromResolvedFile \
|
|
-skipPackagePluginValidation \
|
|
-skipMacroValidation \
|
|
ARCHS=arm64 \
|
|
CODE_SIGNING_ALLOWED=NO
|
|
|
|
# =========================
|
|
# Windows Build
|
|
# =========================
|
|
|
|
build-windows:
|
|
name: "${{ matrix.os }} (CLI,Desktop), GHC: ${{ matrix.ghc }}"
|
|
needs: [maybe-release, variables]
|
|
if: needs.maybe-release.outputs.reduced != 'true' && needs.maybe-release.outputs.haskell == 'true'
|
|
runs-on: ${{ matrix.os }}
|
|
concurrency:
|
|
group: ${{ github.workflow }}-${{ github.ref }}-windows-${{ matrix.os }}-${{ needs.maybe-release.outputs.libs_tag }}
|
|
cancel-in-progress: ${{ github.event_name == 'pull_request' }}
|
|
strategy:
|
|
fail-fast: false
|
|
matrix:
|
|
include:
|
|
- os: windows-latest
|
|
ghc: ${{ needs.variables.outputs.GHC_VER }}
|
|
cli_asset_name: simplex-chat-windows-x86-64
|
|
desktop_asset_name: simplex-desktop-windows-x86_64.msi
|
|
steps:
|
|
- name: Checkout Code
|
|
uses: actions/checkout@v3
|
|
with:
|
|
submodules: recursive
|
|
|
|
- name: Prepare build
|
|
id: prepare
|
|
uses: ./.github/actions/prepare-build
|
|
with:
|
|
java_ver: ${{ needs.variables.outputs.JAVA_VER }}
|
|
ghc_ver: ${{ matrix.ghc }}
|
|
github_ref: ${{ github.ref }}
|
|
|
|
- name: Configure pagefile (Windows)
|
|
uses: simplex-chat/configure-pagefile-action@v1.4
|
|
with:
|
|
minimum-size: 16GB
|
|
maximum-size: 16GB
|
|
disk-root: "C:"
|
|
|
|
- name: 'Setup MSYS2'
|
|
uses: simplex-chat/setup-msys2@v2
|
|
with:
|
|
msystem: ucrt64
|
|
update: true
|
|
install: >-
|
|
git
|
|
perl
|
|
make
|
|
zip
|
|
pacboy: >-
|
|
toolchain:p
|
|
cmake:p
|
|
|
|
- name: Compute cache key prefixes
|
|
id: keys
|
|
if: env.release != 'true'
|
|
shell: msys2 {0}
|
|
run: |
|
|
toolchain=$(gcc --version | sha256sum | cut -c1-16)
|
|
target=windows-x86_64-ghc${{ matrix.ghc }}-$toolchain
|
|
echo "deps=deps-$target" >> "$GITHUB_OUTPUT"
|
|
echo "dist=dist-$target" >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Restore dependencies from cache
|
|
id: restore-deps
|
|
if: env.release != 'true'
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: ${{ steps.prepare.outputs.cabal-store }}
|
|
key: ${{ steps.keys.outputs.deps }}-${{ env.branch }}-${{ github.sha }}
|
|
restore-keys: |
|
|
${{ steps.keys.outputs.deps }}-${{ env.branch }}-
|
|
${{ steps.keys.outputs.deps }}-
|
|
|
|
- name: Warn if dependencies not in cache
|
|
if: env.release != 'true' && steps.restore-deps.outputs.cache-matched-key == ''
|
|
run: echo "::warning title=Cache miss::${{ steps.keys.outputs.deps }}-${{ env.branch }}"
|
|
|
|
- name: Restore source repositories from cache
|
|
id: restore-src
|
|
if: env.release != 'true'
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: dist-newstyle/src
|
|
key: src-${{ runner.os }}-${{ hashFiles('cabal.project') }}
|
|
restore-keys: src-${{ runner.os }}-
|
|
|
|
- name: Warn if source repositories not in cache
|
|
if: env.release != 'true' && steps.restore-src.outputs.cache-matched-key == ''
|
|
run: echo "::warning title=Cache miss::src-${{ runner.os }}"
|
|
|
|
- name: Restore build directory from cache
|
|
id: restore-build
|
|
if: env.release != 'true' && !needs.maybe-release.outputs.libs_tag
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: |
|
|
dist-newstyle/*
|
|
!dist-newstyle/src
|
|
key: ${{ steps.keys.outputs.dist }}-${{ env.opt }}-${{ env.branch }}-${{ github.sha }}
|
|
restore-keys: |
|
|
${{ steps.keys.outputs.dist }}-${{ env.opt }}-${{ env.branch }}-
|
|
${{ steps.keys.outputs.dist }}-${{ env.opt }}-
|
|
|
|
- name: Warn if build directory not in cache
|
|
if: steps.restore-build.outcome == 'success' && steps.restore-build.outputs.cache-matched-key == ''
|
|
run: echo "::warning title=Cache miss::${{ steps.keys.outputs.dist }}-${{ env.opt }}-${{ env.branch }}"
|
|
|
|
# rm -rf dist-newstyle/src/{direct-sq,simplexmq}* is here because of the bug in cabal's dependency which prevents second build from finishing
|
|
# (simplexmq is removed because cabal cannot delete its read-only git submodule pack files - blst, libbbs - on Windows)
|
|
- name: Build CLI
|
|
id: windows_cli_build
|
|
shell: msys2 {0}
|
|
run: |
|
|
export PATH=$PATH:/c/ghcup/bin:$(echo /c/tools/ghc-*/bin || echo)
|
|
scripts/desktop/prepare-openssl-windows.sh
|
|
openssl_windows_style_path=$(echo `pwd`/dist-newstyle/openssl-3.0.15 | sed 's#/\([a-zA-Z]\)#\1:#' | sed 's#/#\\#g')
|
|
rm cabal.project.local 2>/dev/null || true
|
|
echo "ignore-project: False" >> cabal.project.local
|
|
echo "package direct-sqlcipher" >> cabal.project.local
|
|
echo " flags: +openssl" >> cabal.project.local
|
|
echo " extra-include-dirs: $openssl_windows_style_path\include" >> cabal.project.local
|
|
echo " extra-lib-dirs: $openssl_windows_style_path" >> cabal.project.local
|
|
|
|
scripts/ci/prune-old-builds.sh dist-newstyle
|
|
rm -rf dist-newstyle/src/direct-sq* dist-newstyle/src/simplexmq*
|
|
sed -i "s/, unix /--, unix /" simplex-chat.cabal
|
|
cabal build -j --enable-tests ${{ env.ghc_options }}
|
|
rm -rf dist-newstyle/src/direct-sq* dist-newstyle/src/simplexmq*
|
|
path=$(cabal list-bin simplex-chat | tail -n 1)
|
|
echo "bin_path=$path" >> $GITHUB_OUTPUT
|
|
echo "bin_hash=$(echo SHA2-256\(${{ matrix.cli_asset_name }}\)= $(openssl sha256 $path | cut -d' ' -f 2))" >> $GITHUB_OUTPUT
|
|
|
|
- name: Compute dependency cache key
|
|
id: hash-deps
|
|
if: env.release != 'true'
|
|
shell: msys2 {0}
|
|
run: echo "hash=$(ls "$(cygpath -u '${{ steps.prepare.outputs.cabal-store }}')"/ghc-*/ | sha256sum | cut -c1-16)" >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Save dependencies to cache
|
|
if: env.release != 'true' && steps.restore-deps.outputs.cache-matched-key != format('{0}-{1}-{2}', steps.keys.outputs.deps, env.branch, steps.hash-deps.outputs.hash)
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: ${{ steps.prepare.outputs.cabal-store }}
|
|
key: ${{ steps.keys.outputs.deps }}-${{ env.branch }}-${{ steps.hash-deps.outputs.hash }}
|
|
|
|
- name: Save source repositories to cache
|
|
if: env.release != 'true' && steps.restore-src.outputs.cache-hit != 'true'
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: dist-newstyle/src
|
|
key: src-${{ runner.os }}-${{ hashFiles('cabal.project') }}
|
|
|
|
- name: Save build directory to cache
|
|
if: env.release != 'true' && steps.restore-build.outputs.cache-hit != 'true'
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: |
|
|
dist-newstyle/*
|
|
!dist-newstyle/src
|
|
key: ${{ steps.keys.outputs.dist }}-${{ env.opt }}-${{ env.branch }}-${{ github.sha }}
|
|
|
|
- name: Build library
|
|
if: needs.maybe-release.outputs.libs_tag
|
|
shell: msys2 {0}
|
|
run: |
|
|
export PATH=$PATH:/c/ghcup/bin:$(echo /c/tools/ghc-*/bin || echo)
|
|
SKIP_VLC=1 scripts/desktop/build-lib-windows.sh
|
|
dlltool -d libsimplex.dll.def -l libsimplex.lib -D libsimplex.dll
|
|
name=simplex-chat-libs-windows-x86_64
|
|
mkdir -p release-libs/$name/libs
|
|
find apps/multiplatform/common/src/commonMain/cpp/desktop/libs/windows-x86_64 -maxdepth 1 -type f -exec cp {} release-libs/$name/libs/ \;
|
|
cp libsimplex.lib release-libs/$name/libs/
|
|
(cd release-libs/$name && zip -r ../$name.zip libs)
|
|
|
|
- name: Upload library
|
|
if: needs.maybe-release.outputs.libs_tag
|
|
shell: bash
|
|
env:
|
|
GH_TOKEN: ${{ secrets.NODEJS_REPO_TOKEN }}
|
|
TAG: ${{ needs.maybe-release.outputs.libs_tag }}
|
|
run: gh release upload "$TAG" release-libs/*.zip --clobber --repo "${{ github.repository }}-libs"
|
|
|
|
- name: Setup Node.js
|
|
id: setup-node
|
|
if: ${{ !cancelled() && (github.event_name == 'pull_request' || needs.maybe-release.outputs.addon_draft || needs.maybe-release.outputs.publish) }}
|
|
uses: actions/setup-node@v7
|
|
with:
|
|
node-version: 22
|
|
|
|
- name: Setup Python
|
|
id: setup-python
|
|
if: ${{ !cancelled() && steps.setup-node.outcome == 'success' }}
|
|
uses: actions/setup-python@v7
|
|
with:
|
|
python-version: "3.12"
|
|
|
|
- name: Package tests (pull request)
|
|
if: ${{ !cancelled() && steps.setup-python.outcome == 'success' && github.event_name == 'pull_request' }}
|
|
timeout-minutes: 30
|
|
shell: bash
|
|
run: |
|
|
scripts/ci/package-tests.sh build windows-x86_64
|
|
scripts/ci/package-tests.sh test
|
|
|
|
- name: Add-on
|
|
if: ${{ !cancelled() && steps.setup-python.outcome == 'success' && needs.maybe-release.outputs.addon_draft }}
|
|
timeout-minutes: 30
|
|
shell: bash
|
|
env:
|
|
LIBS_RELEASE: ${{ needs.maybe-release.outputs.libs_latest }}
|
|
ADDON_TAG: ${{ needs.maybe-release.outputs.addon_tag }}
|
|
LIBS_REPOSITORY: ${{ github.repository }}-libs
|
|
GH_TOKEN: ${{ secrets.NODEJS_REPO_TOKEN }}
|
|
run: scripts/ci/package-tests.sh addon windows-x86_64
|
|
|
|
- name: Package tests
|
|
id: package-tests
|
|
if: ${{ !cancelled() && steps.setup-python.outcome == 'success' && needs.maybe-release.outputs.publish }}
|
|
timeout-minutes: 30
|
|
shell: bash
|
|
run: |
|
|
scripts/ci/package-tests.sh publish windows-x86_64 ${{ needs.maybe-release.outputs.publish_nodejs && 'nodejs' || '' }} ${{ needs.maybe-release.outputs.publish_python && 'python' || '' }}
|
|
echo "windows-x86_64" > "$RUNNER_TEMP/package-tests"
|
|
|
|
- name: Package tests result
|
|
if: ${{ !cancelled() && steps.package-tests.outcome == 'success' }}
|
|
uses: actions/upload-artifact@v7
|
|
with:
|
|
name: package-tests-windows-x86_64
|
|
path: ${{ runner.temp }}/package-tests
|
|
|
|
- name: Upload CLI
|
|
if: startsWith(github.ref, 'refs/tags/v')
|
|
uses: ./.github/actions/prepare-release
|
|
with:
|
|
bin_path: ${{ steps.windows_cli_build.outputs.bin_path }}
|
|
bin_name: ${{ matrix.cli_asset_name }}
|
|
bin_hash: ${{ steps.windows_cli_build.outputs.bin_hash }}
|
|
github_ref: ${{ github.ref }}
|
|
github_token: ${{ secrets.GITHUB_TOKEN }}
|
|
|
|
- name: Build Desktop
|
|
id: windows_desktop_build
|
|
if: startsWith(github.ref, 'refs/tags/v')
|
|
shell: msys2 {0}
|
|
run: |
|
|
export PATH=$PATH:/c/ghcup/bin:$(echo /c/tools/ghc-*/bin || echo)
|
|
scripts/desktop/build-lib-windows.sh
|
|
cd apps/multiplatform
|
|
./gradlew -Psimplex.assets.dir=../../assets packageMsi
|
|
rm -rf dist-newstyle/src/direct-sq* dist-newstyle/src/simplexmq*
|
|
path=$(echo $PWD/release/main/msi/*imple*.msi | sed 's#/\([a-z]\)#\1:#' | sed 's#/#\\#g')
|
|
echo "package_path=$path" >> $GITHUB_OUTPUT
|
|
echo "package_hash=$(echo SHA2-256\(${{ matrix.desktop_asset_name }}\)= $(openssl sha256 $path | cut -d' ' -f 2))" >> $GITHUB_OUTPUT
|
|
|
|
- name: Upload Desktop
|
|
if: startsWith(github.ref, 'refs/tags/v')
|
|
uses: ./.github/actions/prepare-release
|
|
with:
|
|
bin_path: ${{ steps.windows_desktop_build.outputs.package_path }}
|
|
bin_name: ${{ matrix.desktop_asset_name }}
|
|
bin_hash: ${{ steps.windows_desktop_build.outputs.package_hash }}
|
|
github_ref: ${{ github.ref }}
|
|
github_token: ${{ secrets.GITHUB_TOKEN }}
|
|
|
|
- name: Remove -O2 build directory
|
|
id: remove-o2
|
|
if: env.cache_o0 == 'true' && !needs.maybe-release.outputs.libs_tag && !cancelled() && steps.windows_cli_build.outcome == 'success'
|
|
shell: msys2 {0}
|
|
run: find dist-newstyle -mindepth 1 -maxdepth 1 ! -name src -exec rm -rf {} +
|
|
|
|
- name: Restore -O0 build directory from cache
|
|
id: restore-build-o0
|
|
if: ${{ !cancelled() && steps.remove-o2.outcome == 'success' }}
|
|
uses: actions/cache/restore@v4
|
|
with:
|
|
path: |
|
|
dist-newstyle/*
|
|
!dist-newstyle/src
|
|
key: ${{ steps.keys.outputs.dist }}-O0-${{ env.branch }}-${{ github.sha }}
|
|
restore-keys: |
|
|
${{ steps.keys.outputs.dist }}-O0-${{ env.branch }}-
|
|
${{ steps.keys.outputs.dist }}-O0-
|
|
|
|
- name: Build at -O0 for pull request caches
|
|
id: build-o0
|
|
if: ${{ !cancelled() && steps.remove-o2.outcome == 'success' }}
|
|
shell: msys2 {0}
|
|
run: |
|
|
export PATH=$PATH:/c/ghcup/bin:$(echo /c/tools/ghc-*/bin || echo)
|
|
scripts/desktop/prepare-openssl-windows.sh
|
|
scripts/ci/prune-old-builds.sh dist-newstyle
|
|
rm -rf dist-newstyle/src/direct-sq* dist-newstyle/src/simplexmq*
|
|
cabal build -j --enable-tests --ghc-options=-O0
|
|
rm -rf dist-newstyle/src/direct-sq* dist-newstyle/src/simplexmq*
|
|
|
|
- name: Save -O0 build directory to cache
|
|
if: ${{ !cancelled() && steps.build-o0.outcome == 'success' && steps.restore-build-o0.outputs.cache-hit != 'true' }}
|
|
uses: actions/cache/save@v4
|
|
with:
|
|
path: |
|
|
dist-newstyle/*
|
|
!dist-newstyle/src
|
|
key: ${{ steps.keys.outputs.dist }}-O0-${{ env.branch }}-${{ github.sha }}
|
|
|
|
# =========================
|
|
# Releases and packages
|
|
# =========================
|
|
|
|
releases:
|
|
needs: [maybe-release, build-linux, build-linux-full, build-linux-push, build-linux-postgres, build-macos, build-ios, build-windows]
|
|
if: ${{ !cancelled() && (needs.maybe-release.outputs.libs_tag || needs.maybe-release.outputs.addon_draft) }}
|
|
runs-on: ubuntu-latest
|
|
env:
|
|
GH_TOKEN: ${{ secrets.NODEJS_REPO_TOKEN }}
|
|
LIBS_REPOSITORY: ${{ github.repository }}-libs
|
|
steps:
|
|
- name: Checkout Code
|
|
uses: actions/checkout@v6
|
|
|
|
- name: Publish library release
|
|
if: needs.maybe-release.outputs.libs_tag
|
|
run: python3 scripts/ci/packages_release.py publish-release "${{ needs.maybe-release.outputs.libs_tag }}"
|
|
|
|
- name: Publish add-on release
|
|
if: ${{ !cancelled() && needs.maybe-release.outputs.addon_draft }}
|
|
run: python3 scripts/ci/packages_release.py publish-release "${{ needs.maybe-release.outputs.addon_tag }}"
|
|
|
|
# Publishing uses trusted publishing (OIDC) for this workflow on npm and PyPI,
|
|
# or the NPM_TOKEN and PYPI_API_TOKEN secrets when they are set.
|
|
# Test repositories: variables NPM_SCOPE, PYPI_PROJECT and PYPI_URL / PYPI_UPLOAD_URL (TestPyPI)
|
|
# publish under other names.
|
|
|
|
publish:
|
|
needs: [maybe-release, build-linux, build-linux-full, build-linux-push, build-macos, build-ios, build-windows, releases]
|
|
if: ${{ !cancelled() && (needs.maybe-release.outputs.publish || needs.maybe-release.outputs.publish_types) }}
|
|
runs-on: ubuntu-latest
|
|
permissions:
|
|
contents: read
|
|
id-token: write
|
|
# set by a publish step after it succeeds, so a failed publish still reports the earlier ones
|
|
outputs:
|
|
types: ${{ steps.types.outputs.version }}
|
|
nodejs: ${{ steps.nodejs.outputs.version }}
|
|
python: ${{ steps.python.outputs.version }}
|
|
env:
|
|
NODE_AUTH_TOKEN: ${{ secrets.NPM_TOKEN }}
|
|
NPM_SCOPE: ${{ vars.NPM_SCOPE }}
|
|
PYPI_PROJECT: ${{ vars.PYPI_PROJECT }}
|
|
PYPI_URL: ${{ vars.PYPI_URL }}
|
|
steps:
|
|
- name: Checkout Code
|
|
uses: actions/checkout@v6
|
|
|
|
- name: Download package tests results
|
|
if: needs.maybe-release.outputs.publish
|
|
uses: actions/download-artifact@v8
|
|
with:
|
|
pattern: package-tests-*
|
|
path: ${{ runner.temp }}/package-tests
|
|
|
|
- name: Check package tests and pins
|
|
if: needs.maybe-release.outputs.publish
|
|
env:
|
|
GH_TOKEN: ${{ github.token }}
|
|
LIBS_REPOSITORY: ${{ github.repository }}-libs
|
|
run: |
|
|
passed=$(find "$RUNNER_TEMP/package-tests" -mindepth 1 -maxdepth 1 -type d -name 'package-tests-*' | wc -l)
|
|
if [ "$passed" -ne 5 ]; then
|
|
echo "::error::package tests passed on $passed of 5 platforms"
|
|
exit 1
|
|
fi
|
|
python3 scripts/ci/packages_release.py check-pins
|
|
|
|
- name: Versions to publish
|
|
id: plan
|
|
env:
|
|
GH_TOKEN: ${{ github.token }}
|
|
LIBS_REPOSITORY: ${{ github.repository }}-libs
|
|
run: python3 scripts/ci/packages_release.py publish-plan >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Setup Node.js
|
|
if: steps.plan.outputs.types_version || steps.plan.outputs.nodejs_version
|
|
uses: actions/setup-node@v7
|
|
with:
|
|
node-version: 24
|
|
registry-url: https://registry.npmjs.org
|
|
|
|
- name: Setup Python
|
|
if: steps.plan.outputs.python_version
|
|
uses: actions/setup-python@v7
|
|
with:
|
|
python-version: "3.12"
|
|
|
|
# Before the test names: the build installs @simplex-chat/types from this repository.
|
|
- name: Build and test simplex-chat (npm)
|
|
if: steps.plan.outputs.nodejs_version
|
|
working-directory: packages/simplex-chat-nodejs
|
|
run: |
|
|
(cd ../simplex-chat-client/types/typescript && npm install --no-audit --no-fund && npx tsc)
|
|
npm install --ignore-scripts --no-save --no-audit --no-fund ../simplex-chat-client/types/typescript
|
|
npx tsc && cp src/simplex.* dist
|
|
npx jest tests/libs.test.ts tests/api.unit.test.ts
|
|
|
|
- name: Use test package names
|
|
if: vars.NPM_SCOPE || vars.PYPI_PROJECT
|
|
run: python3 scripts/ci/packages_release.py test-names
|
|
|
|
- name: Publish @simplex-chat/types
|
|
id: types
|
|
if: steps.plan.outputs.types_version && needs.maybe-release.outputs.publish_types && needs.releases.result == 'success'
|
|
working-directory: packages/simplex-chat-client/types/typescript
|
|
env:
|
|
VERSION: ${{ steps.plan.outputs.types_version }}
|
|
DIST_TAG: ${{ steps.plan.outputs.types_dist_tag }}
|
|
run: |
|
|
npm install --no-audit --no-fund
|
|
npm publish --provenance --access public --tag "$DIST_TAG"
|
|
echo "version=$VERSION" >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Publish simplex-chat (npm)
|
|
id: nodejs
|
|
if: steps.plan.outputs.nodejs_version
|
|
working-directory: packages/simplex-chat-nodejs
|
|
env:
|
|
VERSION: ${{ steps.plan.outputs.nodejs_version }}
|
|
DIST_TAG: ${{ steps.plan.outputs.nodejs_dist_tag }}
|
|
run: |
|
|
npm publish --provenance --access public --tag "$DIST_TAG"
|
|
echo "version=$VERSION" >> "$GITHUB_OUTPUT"
|
|
|
|
- name: Build and test simplex-chat (PyPI)
|
|
if: steps.plan.outputs.python_version
|
|
working-directory: packages/simplex-chat-python
|
|
run: |
|
|
python -m pip install build -e ".[test]"
|
|
python -m pytest -q
|
|
python -m build
|
|
|
|
- name: Publish simplex-chat (PyPI)
|
|
if: steps.plan.outputs.python_version
|
|
uses: pypa/gh-action-pypi-publish@release/v1
|
|
with:
|
|
packages-dir: packages/simplex-chat-python/dist
|
|
repository-url: ${{ vars.PYPI_UPLOAD_URL || 'https://upload.pypi.org/legacy/' }}
|
|
password: ${{ secrets.PYPI_API_TOKEN }}
|
|
|
|
- name: Report the published PyPI version
|
|
id: python
|
|
if: steps.plan.outputs.python_version
|
|
env:
|
|
VERSION: ${{ steps.plan.outputs.python_version }}
|
|
run: echo "version=$VERSION" >> "$GITHUB_OUTPUT"
|
|
|
|
record:
|
|
needs: publish
|
|
if: ${{ !cancelled() && (needs.publish.outputs.types || needs.publish.outputs.nodejs || needs.publish.outputs.python) }}
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
- name: Checkout Code
|
|
uses: actions/checkout@v6
|
|
|
|
- name: Record published versions
|
|
env:
|
|
GH_TOKEN: ${{ secrets.NODEJS_REPO_TOKEN }}
|
|
LIBS_REPOSITORY: ${{ github.repository }}-libs
|
|
TYPES: ${{ needs.publish.outputs.types }}
|
|
NODEJS: ${{ needs.publish.outputs.nodejs }}
|
|
PYTHON: ${{ needs.publish.outputs.python }}
|
|
run: |
|
|
python3 scripts/ci/packages_release.py record --commit "$GITHUB_SHA" \
|
|
--types "$TYPES" --nodejs "$NODEJS" --python "$PYTHON"
|