Commit graph

709 commits

Author SHA1 Message Date
Timo Kösters
c2c6a8673e
improvement: use u64s in auth chain cache 2021-08-12 17:56:14 +02:00
Timo Kösters
096e0971f1
improvement: smaller cache, better prev event fetching 2021-08-12 17:56:13 +02:00
Jonas Zohren
4cf3c432af Try to set canonical room alias on room creation.
The spec does not require servers to apply a room canonical alias event upon room creation (yet).
Still, synapse does that, since users can set their desired alias in Elements room creation dialog.
With this commit, conduit also sets that alias if it is a valid one.

This closes https://gitlab.com/famedly/conduit/-/issues/123
2021-08-12 14:02:46 +02:00
Timo Kösters
e83c226b1b Merge branch 'zap-displayname' into 'master'
Set nicer displayname

See merge request famedly/conduit!149
2021-08-10 05:43:44 +00:00
Jonathan de Jong
8335f44bfe Set nicer displayname 2021-08-10 05:43:44 +00:00
Timo Kösters
3745a7cbe6 Merge branch '3pid' into 'master'
Add support for a minimal `r0/account/3pid`.

See merge request famedly/conduit!151
2021-08-10 05:42:50 +00:00
Timo Kösters
610b4f9ad1 Merge branch 'fetchprev' into 'master'
improvement: try to load missing prev events

See merge request famedly/conduit!152
2021-08-10 05:30:12 +00:00
Ahmed Charles
879aeafa9e Add support for a minimal r0/account/3pid. 2021-08-09 12:34:25 -07:00
Timo Kösters
260db9fcc7
improvement: try to load missing prev events 2021-08-09 21:05:41 +02:00
Timo Kösters
1cbc61c558 Merge branch 'badeventfix' into 'master'
fix: handle bad events in db better

See merge request famedly/conduit!148
2021-08-08 19:48:08 +00:00
Timo Kösters
d2f406e0e8
fix: handle bad events in db better 2021-08-08 21:33:28 +02:00
Kurt Roeckx
989a20e99c Support creating rooms with a version 2021-08-07 16:25:21 +02:00
Timo Kösters
55a2ff025f
improvement: longer timeout, more descriptive errors 2021-08-04 22:55:03 +02:00
Timo Kösters
df727688ef
remove rocksdb 2021-08-04 21:17:40 +02:00
Timo Kösters
902404d48d
improvement: save member count + sled fixes 2021-08-04 21:15:01 +02:00
Timo Kösters
b813c34642
improvement: more auth chain caching 2021-08-04 18:30:56 +02:00
Timo Kösters
ab7835dedb
fix: early return from state res 2021-08-04 15:19:50 +02:00
Timo Kösters
9bb4c3cd01
improvement: batched inserts for tokenids 2021-08-04 12:54:26 +02:00
Timo Kösters
fce22362d4
improvement: better auth chain calculation 2021-08-03 19:18:41 +02:00
Timo Kösters
41ec7cf5d0
improvement: batch inserts for stateids 2021-08-03 16:14:07 +02:00
Timo Kösters
49ade0cfbd
improvement: allow batch inserts 2021-08-03 11:24:21 +02:00
Timo Kösters
0eeba86b32
fix: improve locks 2021-08-03 11:17:39 +02:00
Timo Kösters
6b06fc9707
fix: don't run push rules for users that don't exist 2021-08-03 10:24:20 +02:00
Timo Kösters
bd63797213
improvement: make better use of sqlite connections 2021-08-03 10:24:14 +02:00
Timo Kösters
2c4f966d60
improvement: use sqlite properly 2021-08-01 16:59:52 +02:00
Timo Kösters
dc85a8fafd
fix: migration and push edu bugs 2021-07-30 18:05:26 +02:00
Timo Kösters
5df6b8cd5f
improvement: better account data implementation 2021-07-30 16:08:24 +02:00
Timo Kösters
5c776e9ba7
feat: heed db backend (LMDB) 2021-07-29 23:11:53 +02:00
Timo Kösters
c209775abd
fix: pdu without state bug 2021-07-29 12:33:44 +02:00
Timo Kösters
5e924227b6
feat: add threadpool for iterator threads, bug fixes, tracing_flame support 2021-07-29 08:49:28 +02:00
Timo Kösters
e0072eff63 Merge branch 'v5' into 'master'
feat: support room version 5

See merge request famedly/conduit!138
2021-07-21 11:05:59 +00:00
Timo Kösters
cae2b200cc Merge branch 'initial_state_keys' into 'master'
Implement From<AnyInitialStateEvent> on PduBuilder

Closes #116

See merge request famedly/conduit!136
2021-07-21 10:03:08 +00:00
Timo Kösters
918df9ca6d
feat: support room version 5 2021-07-21 11:59:56 +02:00
Kurt Roeckx
0d33cc4acd Implement getting room aliases
Signed-off-by: Kurt Roeckx <kurt@roeckx.be>
2021-07-21 10:56:22 +02:00
phesch
666e1d30a3 Implement From<AnyInitialStateEvent> on PduBuilder
The conversion between the two is now direct and thus shouldn't lose the state_keys.
2021-07-21 10:55:23 +02:00
Timo Kösters
1587f2cd52
fix: check events in timeline (not only state) for member changes 2021-07-21 09:39:54 +02:00
Timo Kösters
f121978897
fix: state bug 2021-07-20 23:36:03 +02:00
Timo Kösters
80533bfab2
fix: improve code when skipping /state_ids 2021-07-20 22:06:42 +02:00
Timo Kösters
08a3326431
docs: Initial end-to-end encryption over federation support 2021-07-20 21:37:08 +02:00
Timo Kösters
fe3b5d32a7
feat: send to-device events over federation 2021-07-20 21:17:15 +02:00
Timo Kösters
e20f55970e
feat: call /query/profile over federation when local user asks 2021-07-20 19:49:47 +02:00
Timo Kösters
728e176a06
feat: /keys/query and /keys/claim over federation 2021-07-20 19:40:25 +02:00
Timo Kösters
68cc743f2a
fix: use get_auth_chain method more often 2021-07-20 18:45:21 +02:00
Timo Kösters
56e5d5e3d2
fix: add warning for strange bug 2021-07-20 18:38:17 +02:00
Timo Kösters
f0ac7ed933
chore: update ruma again 2021-07-20 15:25:17 +02:00
Timo Kösters
0f8ecdc625
fix: state res fixes 2021-07-20 15:25:17 +02:00
Timo Kösters
cfaa900e83
improvement: auth chain cache 2021-07-20 15:25:16 +02:00
Timo Kösters
f5273f7eb1
improvement: upgrade ruma and implement blurhashes 2021-07-20 15:25:16 +02:00
Timo Kösters
0fcefa4125
fix: ruma 2021-07-20 15:25:16 +02:00
Timo Kösters
d07762f596 Merge branch 'connection-cushion' into 'master'
Spillover connection cushion

See merge request famedly/conduit!133
2021-07-20 10:39:04 +00:00
Jonathan de Jong
d253f9236a change fraction type 2021-07-20 11:01:35 +02:00
Jonathan de Jong
ec44f3d568 change to f64 2021-07-20 10:47:36 +02:00
Jonathan de Jong
e7a51c07d0 log change feedback 2021-07-19 17:17:10 +02:00
Jonathan de Jong
79bf7fc597 some logging shuffling 2021-07-19 16:46:59 +02:00
Jonathan de Jong
7e579f8d34 change to fraction-based approach 2021-07-19 16:25:41 +02:00
Jonathan de Jong
0f2dc9a239 add stuff and bits 2021-07-19 15:56:20 +02:00
Jonathan de Jong
faa283d35b review feedback 2021-07-19 13:44:53 +02:00
Jonathan de Jong
3ce75d1f02 apply fix 2021-07-19 11:55:39 +02:00
Timo Kösters
f924ebf8a6 Merge branch 'fix-windows-signal' into 'master'
fix signal compiling on windows

See merge request famedly/conduit!126
2021-07-15 16:29:47 +00:00
Jonathan de Jong
b1993421c2 fix signal compiling on windows 2021-07-15 18:09:10 +02:00
Jonathan de Jong
d76e95e8fc use existing db cache size 2021-07-15 13:47:21 +02:00
Jonathan de Jong
661101c9ae add sled cache_capacity back 2021-07-15 13:29:08 +02:00
Timo Kösters
f7ecf83ac3 Merge branch 'stuff' into 'master'
fix: stuck/duplicate messages, e2ee and sync timeouts

See merge request famedly/conduit!123
2021-07-15 08:18:56 +00:00
Jonathan de Jong
952fb75795 add shutdown handler to kick sync 2021-07-14 14:50:07 +02:00
Timo Kösters
e12b1ff863
improvement: locks 2021-07-14 13:21:25 +02:00
Timo Kösters
e15e6d4405
improvement: efficient /sync, mutex for federation transactions 2021-07-14 13:20:39 +02:00
Timo Kösters
1c25492a7e
fix: stuck messages
Conduit did not send the event in /sync because of a race condition.
There is a brief moment in time where Conduit accepted the event, but
did not store it yet. So when the client /syncs it updates the since
token without sending the event. I hope I fixed it by significantly
shortening the race-condition period.
2021-07-14 13:19:24 +02:00
Timo Kösters
8c44312485
fix: e2ee verification 2021-07-14 13:10:56 +02:00
Timo Kösters
ac0027756e
improvement: more efficient state res 2021-07-14 13:10:49 +02:00
Jonathan de Jong
e1b89c1248 apply lint suggestions and version bump 2021-07-14 12:31:38 +02:00
Jonathan de Jong
15471d9ac4 update rocket and lock 2021-07-14 11:28:24 +02:00
Jonathan de Jong
9d4fa9a220 Sqlite 2021-07-14 07:07:08 +00:00
Kurt Roeckx
dcb5e5900f Getting capabilities requires authentication 2021-07-11 22:07:10 +02:00
Timo Kösters
4732aa6782 Merge branch 'invalid_utf8' into 'master'
Return proper error in case of invalid UTF-8

See merge request famedly/conduit!110
2021-07-11 13:44:27 +00:00
Kurt Roeckx
699f77671f Return proper error in case of invalid UTF-8 in json_body
json_body is used in places that need authentication. In
case an unknown field is set, Ruma doesn't parse the field
and so doesn't give an error on invalid UTF-8. But Conduit
has parsed and on error makes json_body None. Return an
error to the client instead of generating an internal error.
2021-07-11 14:47:13 +02:00
Timo Kösters
13c0beafa6 Merge branch 'lib-fix' into 'master'
Export conduits Config struct and fix clippy warnings

See merge request famedly/conduit!99
2021-07-11 11:42:07 +00:00
Timo Kösters
5711467ad9 Merge branch 'state-res-closure' into 'master'
Remove auth_cache using a closure to fetch events in state-res

See merge request famedly/conduit!108
2021-07-02 10:56:21 +00:00
Aiden McClelland
c53cc03ff8
address pr comments 2021-07-01 13:38:25 -06:00
Aiden McClelland
f25f61d4a9
fix errors introduced by rebase 2021-07-01 12:48:12 -06:00
Aiden McClelland
b2d5516058 add support for arbitrary proxies 2021-07-01 12:41:12 -06:00
Devin Ragotzy
1bb84a8e2d Fix docs for fetch_and_handle_events 2021-06-30 07:48:16 -04:00
Devin Ragotzy
98f1480e2b
Remove auth_cache using a closure to fetch events in state-res 2021-06-30 12:54:19 +02:00
Timo Kösters
05821d6fd5
improvement: pdu cache, /sync cache 2021-06-30 10:31:34 +02:00
Devin Ragotzy
09a8737f24 Export conduits Config struct and fix clipp warningsy 2021-06-29 16:02:12 -04:00
Timo Kösters
dcac1361ec
improvement: /search works for multiple rooms 2021-06-21 15:21:00 +02:00
Timo Kösters
fee7d3d2e3 Merge branch 'allow_appservice_registration' into 'master'
Always allow appservices to register new users

See merge request famedly/conduit!105
2021-06-21 10:15:48 +00:00
phesch
637d9d3b6f Always allow appservices to register new users 2021-06-19 16:12:05 +02:00
Jonas Platte
808741bcb6
Remove unnecessary Option-wrapping and successive unwrapping 2021-06-17 20:44:29 +02:00
Jonas Platte
b291e76572
Use try operator for Option more 2021-06-17 20:37:07 +02:00
Jonas Platte
f3e630c064
Fix lots of clippy lints 2021-06-17 20:34:14 +02:00
Jonas Platte
af2ce5803e
Remove pointless double deserialization 2021-06-17 20:29:02 +02:00
Jonas Platte
7fa54e4411
Use Ruma-provided default power levels for shorter code 2021-06-17 20:14:37 +02:00
Jonas Platte
f6046871f4
Upgrade Ruma 2021-06-17 20:12:36 +02:00
Timo Kösters
67f9592b17
feat: /event_auth 2021-06-14 11:36:40 +02:00
Timo Kösters
77a23f8969
improvement: filter our room directory
Fixes #35
2021-06-14 11:26:41 +02:00
Timo Kösters
3c9ea55938
feat: /state 2021-06-14 11:01:12 +02:00
Timo Kösters
e8f6708927
improvement: show more users in our user directory 2021-06-12 18:40:33 +02:00
Timo Kösters
cd4bc520d8
improvement: feature flags for sled, rocksdb 2021-06-12 15:13:04 +02:00
hamidreza kalbasi
2078af59d8
fix fmt problems 2021-06-09 22:22:05 +02:00
hamidreza kalbasi
2385bd1cfd
add migrations 2021-06-09 22:22:05 +02:00
hamidreza kalbasi
affa124864
create media folder in init 2021-06-09 22:22:05 +02:00
hamidreza kalbasi
ff841b73c5
use .keys() and remove unneccery .to_vec() 2021-06-09 22:22:04 +02:00
hamidreza kalbasi
804105479c
fix fmt and clippy warnings 2021-06-09 22:22:04 +02:00
hamidreza kalbasi
972caacdc2
put media in filesystem 2021-06-09 22:22:04 +02:00
Timo Kösters
d0ee823254
feat: swappable database backend 2021-06-09 22:21:52 +02:00
Timo Kösters
e1e529d818
fix: don't apply push rules for users of other homeservers 2021-05-30 22:01:12 +02:00
Timo Kösters
88cf043f94
fix: deactivate accounts that should be deactivated 2021-05-30 21:56:36 +02:00
Timo Kösters
59dd3676d5
fix: putting global account data works now 2021-05-29 10:53:03 +02:00
Timo Kösters
deacdf6f58
fix: is_direct for locally invited users 2021-05-28 22:53:00 +02:00
Timo Kösters
5b5cc0574e
feat: implement /claim, handle to-device events 2021-05-28 13:46:15 +02:00
Gabriel Souza Franco
7db59c550f fix: also return successful PDUs in /send/:txnId 2021-05-27 18:10:48 -03:00
Timo Kösters
daa1fc90a7
fix: state resolution bugs 2021-05-27 10:48:17 +02:00
phesch
ddcf1a715b Fix redacted_because field being sent as a string 2021-05-26 17:38:30 +02:00
Timo Kösters
aacf6289db
improvement: increase default max concurrent requests 2021-05-24 18:00:39 +02:00
Timo Kösters
57ecd81534
fix: logs for ruma crate 2021-05-24 13:22:30 +02:00
Timo Kösters
e5c7119516
feat: forward federation errors to the client 2021-05-23 16:46:46 +02:00
Timo Kösters
1939e62814
fmt 2021-05-23 11:11:20 +02:00
Timo Kösters
c1b2b468b8
fix: bad except in ruma wrapper 2021-05-22 21:33:31 +02:00
Timo Kösters
90cd11d850
fix: Forbidden instead of InvalidParam when joining 2021-05-22 18:50:40 +02:00
Timo Kösters
9b77eb7bb7
fix: too many syncs 2021-05-22 11:31:15 +02:00
Timo Kösters
1b42770ab5
improvement: warning for small max_request_size values 2021-05-22 10:34:19 +02:00
Timo Kösters
3e2f742f30
fix: room version warnings and other bugs when joining rooms 2021-05-21 22:22:05 +02:00
Timo Kösters
989d843c40
fix: unauthorized pdus will be responded to with FORBIDDEN 2021-05-21 18:12:02 +02:00
Timo Kösters
09157b2096
improvement: federation get_keys and optimize signingkey storage
- get encryption keys over federation
- optimize signing key storage
- rate limit parsing of bad events
- rate limit signature fetching
- dependency bumps
2021-05-21 13:25:24 +02:00
Timo Kösters
ae41bc5067
fix: run state res with old current state again
I'm a bit torn on the "auth check based on the current state of the
room". It can mean multiple things:

1. The state of the room before the homeserver looked at the event at
all. But that means if a message event from a user arrives, but we
didn't see their join event before, we soft fail the message (even
though we would find the join event when going through the auth events
of the event and doing state res)

2. The state of the room after doing state-res with the event and our
previous room state. We need to do this state resolution to find the new
room state anyway, so we could just use the new room state for the auth
check. The problem is that if the incoming event is a membership leave
event, the new room state does not allow another leave event. This is
obviously the wrong option.

3. The state of the room after doing state-res with the state **before**
the event and our previous room state. This will mean a lot more
calculations because we have to run state-res again

We used 2. before and now use 1. again
2021-05-17 10:58:44 +02:00
Timo Kösters
8f27e6123b
feat: send read receipts over federation
currently they will only be sent if a PDU has to be sent as well
2021-05-17 10:25:27 +02:00
Timo Kösters
24793891e0
feat: implement GET /presence 2021-05-14 11:05:41 +02:00
Timo Kösters
37b4a1cd0d Merge branch 'dbg_clippy' into 'master'
Add dbg_macro check

See merge request famedly/conduit!75
2021-05-12 18:44:01 +00:00
Timo Kösters
f62258ba35
improvement: bug fixes and refactors
- power level content override adds to the default event instead of
replacing it
- sending code refactored to make edus possible
- remove presence events when restarting conduit
- remove room_id field from read receipts over /sync
- handle incoming read receipts
- fix array bounds bug in server_server.rs
2021-05-12 20:15:24 +02:00
Jonas Platte
af6fea3d4e
Refactor some canonical JSON code 2021-05-08 02:13:01 +02:00
Jonas Platte
a0457000ff
Upgrade Ruma 2021-05-08 01:54:28 +02:00
Jonathan de Jong
268ad3441c add dbg_macro check 2021-05-05 16:14:49 +00:00
Timo Kösters
cf94b8e712
improvement: uiaa works like in synapse 2021-05-04 19:05:30 +02:00
Jonas Platte
e1c4e5c73e
Return only event content in account_data endpoints, not the entire event 2021-04-29 21:28:01 +02:00
Jonas Platte
8bfaf09f37
Clean up reqwest::Response to http::Response conversion 2021-04-29 21:28:00 +02:00
Jonas Platte
c28eba1e5b
Bump ruma 2021-04-29 21:05:29 +02:00
Jonas Platte
08ca573df0
Remove explicit setting of content-type header
`try_into_http_request` takes care of this already.
2021-04-29 20:50:59 +02:00
Jonas Platte
61c522dcc0
Fix formatting 2021-04-29 20:50:59 +02:00
Jonas Platte
b76af682a6
Fix clippy warnings 2021-04-29 20:50:59 +02:00
Timo Kösters
3c3062a316
improvement: optimize room directory 2021-04-28 17:56:15 +02:00
Jonas Platte
2e1d7d12ca
Refactor usage of CanonicalJsonValue 2021-04-26 19:03:51 +02:00
Jonas Platte
c2b72773d5
Fix clippy warning 2021-04-26 19:02:32 +02:00
Timo Kösters
58463bba93
feat: send invites over federation 2021-04-25 14:10:21 +02:00
Timo Kösters
3dfc245633
fix: send transaction retry code 2021-04-24 18:26:41 +02:00
Timo Kösters
2fc1ec2ad5
fix: logging 2021-04-24 13:34:35 +02:00
Timo Kösters
226045ea4b
improvement: warning on misconfigured reverse proxy 2021-04-24 12:29:02 +02:00
Jonas Platte
026af6b1a6
Improve formatting of ruma_wrapper.rs 2021-04-24 12:22:42 +02:00
Jonas Platte
d8b484beed
Upgrade ruma 2021-04-24 12:22:36 +02:00
Jonas Platte
e72fd44bb5
Refactor send_request for appservices 2021-04-24 12:18:21 +02:00
Jonas Platte
7067d7acae
Refactor Responder implementation for RumaResponse 2021-04-24 12:18:21 +02:00