mirror of
https://mau.dev/maunium/synapse.git
synced 2024-08-26 12:16:12 +00:00
![Eric Eastwood](/assets/img/avatar_default.png)
* Make historical messages available to federated servers Part of MSC2716: https://github.com/matrix-org/matrix-doc/pull/2716 Follow-up to https://github.com/matrix-org/synapse/pull/9247 * Debug message not available on federation * Add base starting insertion point when no chunk ID is provided * Fix messages from multiple senders in historical chunk Follow-up to https://github.com/matrix-org/synapse/pull/9247 Part of MSC2716: https://github.com/matrix-org/matrix-doc/pull/2716 --- Previously, Synapse would throw a 403, `Cannot force another user to join.`, because we were trying to use `?user_id` from a single virtual user which did not match with messages from other users in the chunk. * Remove debug lines * Messing with selecting insertion event extremeties * Move db schema change to new version * Add more better comments * Make a fake requester with just what we need See https://github.com/matrix-org/synapse/pull/10276#discussion_r660999080 * Store insertion events in table * Make base insertion event float off on its own See https://github.com/matrix-org/synapse/pull/10250#issuecomment-875711889 Conflicts: synapse/rest/client/v1/room.py * Validate that the app service can actually control the given user See https://github.com/matrix-org/synapse/pull/10276#issuecomment-876316455 Conflicts: synapse/rest/client/v1/room.py * Add some better comments on what we're trying to check for * Continue debugging * Share validation logic * Add inserted historical messages to /backfill response * Remove debug sql queries * Some marker event implemntation trials * Clean up PR * Rename insertion_event_id to just event_id * Add some better sql comments * More accurate description * Add changelog * Make it clear what MSC the change is part of * Add more detail on which insertion event came through * Address review and improve sql queries * Only use event_id as unique constraint * Fix test case where insertion event is already in the normal DAG * Remove debug changes * Switch to chunk events so we can auth via power_levels Previously, we were using `content.chunk_id` to connect one chunk to another. But these events can be from any `sender` and we can't tell who should be able to send historical events. We know we only want the application service to do it but these events have the sender of a real historical message, not the application service user ID as the sender. Other federated homeservers also have no indicator which senders are an application service on the originating homeserver. So we want to auth all of the MSC2716 events via power_levels and have them be sent by the application service with proper PL levels in the room. * Switch to chunk events for federation * Add unstable room version to support new historical PL * Fix federated events being rejected for no state_groups Add fix from https://github.com/matrix-org/synapse/pull/10439 until it merges. * Only connect base insertion event to prev_event_ids Per discussion with @erikjohnston, https://matrix.to/#/!UytJQHLQYfvYWsGrGY:jki.re/$12bTUiObDFdHLAYtT7E-BvYRp3k_xv8w0dUQHibasJk?via=jki.re&via=matrix.org * Make it possible to get the room_version with txn * Allow but ignore historical events in unsupported room version See https://github.com/matrix-org/synapse/pull/10245#discussion_r675592489 We can't reject historical events on unsupported room versions because homeservers without knowledge of MSC2716 or the new room version don't reject historical events either. Since we can't rely on the auth check here to stop historical events on unsupported room versions, I've added some additional checks in the processing/persisting code (`synapse/storage/databases/main/events.py` -> `_handle_insertion_event` and `_handle_chunk_event`). I've had to do some refactoring so there is method to fetch the room version by `txn`. * Move to unique index syntax See https://github.com/matrix-org/synapse/pull/10245#discussion_r675638509 * High-level document how the insertion->chunk lookup works * Remove create_event fallback for room_versions See https://github.com/matrix-org/synapse/pull/10245/files#r677641879 * Use updated method name
236 lines
6.1 KiB
Python
236 lines
6.1 KiB
Python
# Copyright 2014-2016 OpenMarket Ltd
|
|
# Copyright 2017 Vector Creations Ltd
|
|
# Copyright 2018-2019 New Vector Ltd
|
|
# Copyright 2019 The Matrix.org Foundation C.I.C.
|
|
#
|
|
# Licensed under the Apache License, Version 2.0 (the "License");
|
|
# you may not use this file except in compliance with the License.
|
|
# You may obtain a copy of the License at
|
|
#
|
|
# http://www.apache.org/licenses/LICENSE-2.0
|
|
#
|
|
# Unless required by applicable law or agreed to in writing, software
|
|
# distributed under the License is distributed on an "AS IS" BASIS,
|
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
# See the License for the specific language governing permissions and
|
|
# limitations under the License.
|
|
|
|
"""Contains constants from the specification."""
|
|
|
|
# the max size of a (canonical-json-encoded) event
|
|
MAX_PDU_SIZE = 65536
|
|
|
|
# the "depth" field on events is limited to 2**63 - 1
|
|
MAX_DEPTH = 2 ** 63 - 1
|
|
|
|
# the maximum length for a room alias is 255 characters
|
|
MAX_ALIAS_LENGTH = 255
|
|
|
|
# the maximum length for a user id is 255 characters
|
|
MAX_USERID_LENGTH = 255
|
|
|
|
# The maximum length for a group id is 255 characters
|
|
MAX_GROUPID_LENGTH = 255
|
|
MAX_GROUP_CATEGORYID_LENGTH = 255
|
|
MAX_GROUP_ROLEID_LENGTH = 255
|
|
|
|
|
|
class Membership:
|
|
|
|
"""Represents the membership states of a user in a room."""
|
|
|
|
INVITE = "invite"
|
|
JOIN = "join"
|
|
KNOCK = "knock"
|
|
LEAVE = "leave"
|
|
BAN = "ban"
|
|
LIST = (INVITE, JOIN, KNOCK, LEAVE, BAN)
|
|
|
|
|
|
class PresenceState:
|
|
"""Represents the presence state of a user."""
|
|
|
|
OFFLINE = "offline"
|
|
UNAVAILABLE = "unavailable"
|
|
ONLINE = "online"
|
|
BUSY = "org.matrix.msc3026.busy"
|
|
|
|
|
|
class JoinRules:
|
|
PUBLIC = "public"
|
|
KNOCK = "knock"
|
|
INVITE = "invite"
|
|
PRIVATE = "private"
|
|
# As defined for MSC3083.
|
|
MSC3083_RESTRICTED = "restricted"
|
|
|
|
|
|
class RestrictedJoinRuleTypes:
|
|
"""Understood types for the allow rules in restricted join rules."""
|
|
|
|
ROOM_MEMBERSHIP = "m.room_membership"
|
|
|
|
|
|
class LoginType:
|
|
PASSWORD = "m.login.password"
|
|
EMAIL_IDENTITY = "m.login.email.identity"
|
|
MSISDN = "m.login.msisdn"
|
|
RECAPTCHA = "m.login.recaptcha"
|
|
TERMS = "m.login.terms"
|
|
SSO = "m.login.sso"
|
|
DUMMY = "m.login.dummy"
|
|
|
|
|
|
# This is used in the `type` parameter for /register when called by
|
|
# an appservice to register a new user.
|
|
APP_SERVICE_REGISTRATION_TYPE = "m.login.application_service"
|
|
|
|
|
|
class EventTypes:
|
|
Member = "m.room.member"
|
|
Create = "m.room.create"
|
|
Tombstone = "m.room.tombstone"
|
|
JoinRules = "m.room.join_rules"
|
|
PowerLevels = "m.room.power_levels"
|
|
Aliases = "m.room.aliases"
|
|
Redaction = "m.room.redaction"
|
|
ThirdPartyInvite = "m.room.third_party_invite"
|
|
RelatedGroups = "m.room.related_groups"
|
|
|
|
RoomHistoryVisibility = "m.room.history_visibility"
|
|
CanonicalAlias = "m.room.canonical_alias"
|
|
Encrypted = "m.room.encrypted"
|
|
RoomAvatar = "m.room.avatar"
|
|
RoomEncryption = "m.room.encryption"
|
|
GuestAccess = "m.room.guest_access"
|
|
|
|
# These are used for validation
|
|
Message = "m.room.message"
|
|
Topic = "m.room.topic"
|
|
Name = "m.room.name"
|
|
|
|
ServerACL = "m.room.server_acl"
|
|
Pinned = "m.room.pinned_events"
|
|
|
|
Retention = "m.room.retention"
|
|
|
|
Dummy = "org.matrix.dummy_event"
|
|
|
|
SpaceChild = "m.space.child"
|
|
SpaceParent = "m.space.parent"
|
|
|
|
MSC2716_INSERTION = "org.matrix.msc2716.insertion"
|
|
MSC2716_CHUNK = "org.matrix.msc2716.chunk"
|
|
MSC2716_MARKER = "org.matrix.msc2716.marker"
|
|
|
|
|
|
class ToDeviceEventTypes:
|
|
RoomKeyRequest = "m.room_key_request"
|
|
|
|
|
|
class DeviceKeyAlgorithms:
|
|
"""Spec'd algorithms for the generation of per-device keys"""
|
|
|
|
ED25519 = "ed25519"
|
|
CURVE25519 = "curve25519"
|
|
SIGNED_CURVE25519 = "signed_curve25519"
|
|
|
|
|
|
class EduTypes:
|
|
Presence = "m.presence"
|
|
|
|
|
|
class RejectedReason:
|
|
AUTH_ERROR = "auth_error"
|
|
|
|
|
|
class RoomCreationPreset:
|
|
PRIVATE_CHAT = "private_chat"
|
|
PUBLIC_CHAT = "public_chat"
|
|
TRUSTED_PRIVATE_CHAT = "trusted_private_chat"
|
|
|
|
|
|
class ThirdPartyEntityKind:
|
|
USER = "user"
|
|
LOCATION = "location"
|
|
|
|
|
|
ServerNoticeMsgType = "m.server_notice"
|
|
ServerNoticeLimitReached = "m.server_notice.usage_limit_reached"
|
|
|
|
|
|
class UserTypes:
|
|
"""Allows for user type specific behaviour. With the benefit of hindsight
|
|
'admin' and 'guest' users should also be UserTypes. Normal users are type None
|
|
"""
|
|
|
|
SUPPORT = "support"
|
|
BOT = "bot"
|
|
ALL_USER_TYPES = (SUPPORT, BOT)
|
|
|
|
|
|
class RelationTypes:
|
|
"""The types of relations known to this server."""
|
|
|
|
ANNOTATION = "m.annotation"
|
|
REPLACE = "m.replace"
|
|
REFERENCE = "m.reference"
|
|
|
|
|
|
class LimitBlockingTypes:
|
|
"""Reasons that a server may be blocked"""
|
|
|
|
MONTHLY_ACTIVE_USER = "monthly_active_user"
|
|
HS_DISABLED = "hs_disabled"
|
|
|
|
|
|
class EventContentFields:
|
|
"""Fields found in events' content, regardless of type."""
|
|
|
|
# Labels for the event, cf https://github.com/matrix-org/matrix-doc/pull/2326
|
|
LABELS = "org.matrix.labels"
|
|
|
|
# Timestamp to delete the event after
|
|
# cf https://github.com/matrix-org/matrix-doc/pull/2228
|
|
SELF_DESTRUCT_AFTER = "org.matrix.self_destruct_after"
|
|
|
|
# cf https://github.com/matrix-org/matrix-doc/pull/1772
|
|
ROOM_TYPE = "type"
|
|
|
|
# Used on normal messages to indicate they were historically imported after the fact
|
|
MSC2716_HISTORICAL = "org.matrix.msc2716.historical"
|
|
# For "insertion" events to indicate what the next chunk ID should be in
|
|
# order to connect to it
|
|
MSC2716_NEXT_CHUNK_ID = "org.matrix.msc2716.next_chunk_id"
|
|
# Used on "chunk" events to indicate which insertion event it connects to
|
|
MSC2716_CHUNK_ID = "org.matrix.msc2716.chunk_id"
|
|
# For "marker" events
|
|
MSC2716_MARKER_INSERTION = "org.matrix.msc2716.marker.insertion"
|
|
|
|
|
|
class RoomTypes:
|
|
"""Understood values of the room_type field of m.room.create events."""
|
|
|
|
SPACE = "m.space"
|
|
|
|
|
|
class RoomEncryptionAlgorithms:
|
|
MEGOLM_V1_AES_SHA2 = "m.megolm.v1.aes-sha2"
|
|
DEFAULT = MEGOLM_V1_AES_SHA2
|
|
|
|
|
|
class AccountDataTypes:
|
|
DIRECT = "m.direct"
|
|
IGNORED_USER_LIST = "m.ignored_user_list"
|
|
|
|
|
|
class HistoryVisibility:
|
|
INVITED = "invited"
|
|
JOINED = "joined"
|
|
SHARED = "shared"
|
|
WORLD_READABLE = "world_readable"
|
|
|
|
|
|
class ReadReceiptEventFields:
|
|
MSC2285_HIDDEN = "org.matrix.msc2285.hidden"
|