Brendan Abolivier
2891693da6
Add new boolean column to synapse_port_db
2019-10-24 12:38:48 +01:00
Brendan Abolivier
b2510dce85
Fix import paths in synapse_port_db
2019-10-23 15:54:17 +01:00
Brendan Abolivier
c97ed64db3
Make synapse_port_db correctly create indexes ( #6102 )
...
Make `synapse_port_db` correctly create indexes in the PostgreSQL database, by having it run the background updates on the database before migrating the data.
To ensure we're migrating the right data, also block the port if the SQLite3 database still has pending or ongoing background updates.
Fixes #4877
2019-10-23 15:31:59 +01:00
Bart Noordervliet
dc4bec885d
Add missing BOOLEAN_COLUMNs to synapse_port_db ( #6216 )
...
Small fix to synapse_port_db to be able to convert from database schema v56.
2019-10-18 11:13:59 +02:00
Brendan Abolivier
83827c4922
Add account_validity's email_sent column to the list of boolean columns in synapse_port_db
...
Fixes #5306
2019-06-03 17:06:47 +01:00
Neil Johnson
2d951686a7
drop tables listed in #1830 ( #4992 )
...
Tables dropped:
* application_services,
* application_services_regex,
* transaction_id_to_pdu,
* stats_reporting
* current_state_resets
* event_content_hashes
* event_destinations
* event_edge_hashes
* event_signatures
* feedback
* room_hosts
* state_forward_extremities
2019-04-08 15:37:26 +01:00
Anders
2a59e8e429
Fix issue #4596
...
Make synapse_port_db --curses work with Python 3.
Signed-off-by: Anders Jensen-Waud <anders@jensenwaud.com>
2019-04-03 21:59:48 +00:00
Eric
8184ae8a09
Consider e2e_room_keys.is_verified column as boolean
...
This column was considered as an int, crashing the whole
migration process
Signed-off-by: Eric <eric@pedr0.net>
2019-02-20 23:18:00 +01:00
Richard van der Hoff
ef771cc4c2
Fix a number of flake8 errors
...
Broadly three things here:
* disable W504 which seems a bit whacko
* remove a bunch of `as e` expressions from exception handlers that don't use
them
* use `r""` for strings which include backslashes
Also, we don't use pep8 any more, so we can get rid of the duplicate config
there.
2018-10-24 10:39:03 +01:00
Amber Brown
e1728dfcbe
Make scripts/ and scripts-dev/ pass pyflakes (and the rest of the codebase on py3) ( #4068 )
2018-10-20 11:16:55 +11:00
Adrian Tschira
e54c202b81
Replace some type checks with six type checks
...
Signed-off-by: Adrian Tschira <nota@notafile.com>
2018-04-07 01:02:32 +02:00
Richard van der Hoff
6a9777ba02
Port script: Set up state_group_id_seq
...
Fixes https://github.com/matrix-org/synapse/issues/3050 .
2018-04-06 15:33:30 +01:00
Richard van der Hoff
01579384cc
Port script: clean up a bit
...
Improve logging and comments. Group all the stuff to do with inspecting tables
together rather than creating the port tables in the middle.
2018-04-06 15:33:30 +01:00
Richard van der Hoff
e01ba5bda3
Port script: avoid nasty errors when setting up
...
We really shouldn't spit out "Failed to create port table", it looks scary.
2018-04-06 15:33:30 +01:00
Erik Johnston
9ecf621404
Less s's
2017-11-14 15:55:15 +00:00
Erik Johnston
22db751d1e
Add new boolean columns to port script
2017-11-14 15:48:50 +00:00
David Baker
9d419f48e6
Make the port script drop NUL values in all tables
...
Postgres doesn't support NULs in strings so it makes the script
throw an exception and stop if any values contain \0. Drop them
with appropriate warning.
2017-10-31 16:58:49 +00:00
Luke Barnard
e86cefcb6f
Add groups table to BOOLEAN_COLUMNS in synapse_port_db
2017-10-26 17:24:54 +01:00
Erik Johnston
37d766aedd
Fix port script
...
We changed _simple_update_one_txn to use _simple_update_txn but didn't
yank it out in the port script.
Fixes #2565
2017-10-26 10:01:03 +01:00
Richard van der Hoff
7fc1aad195
Drop search values with nul characters
...
https://github.com/matrix-org/synapse/issues/2187 contains a report of a port
failing due to nul characters somewhere in the search table. Let's try dropping
the offending rows.
2017-10-02 00:53:32 +01:00
Erik Johnston
60a9a49f83
Extend comment
2017-07-20 16:16:29 +01:00
Erik Johnston
d7d24750be
Fix port script for user directory tables
2017-07-20 10:47:01 +01:00
Matthew
3fafb7b189
add missing boolean to synapse_port_db
2017-06-16 20:51:19 +01:00
Matthew
776a070421
fix synapse_port script
2017-06-16 20:24:14 +01:00
John Kristensen
be44558886
Don't assume postgres tables are in the public schema during db port
...
When fetching the list of tables from the postgres database during the
db port, it is assumed that the tables are in the public schema. This is
not always the case, so lets just rely on postgres to determine the
default schema to use.
2017-03-17 10:53:32 +11:00
Kevin Liu
70a00eacf9
Fix typo
...
This is what I get for not proofreading
2017-02-11 20:49:31 -05:00
Kevin Liu
a02d609b1f
Fix synapse_port_db failure ( fixes #1902 )
...
See https://matrix.to/#/!cURbafjkfsMDVwdRDQ:matrix.org/$148686272020hCgRD:potatofrom.space
Signed-off-by: Kevin Liu <kevin@potatofrom.space>
2017-02-11 20:44:16 -05:00
Erik Johnston
adae348fdf
Update port script with recently added tables
...
This also fixes a bug where the port script would explode when it
encountered the newly added boolean column
`public_room_list_stream.visibility`
2016-09-27 11:19:48 +01:00
Erik Johnston
7c7786d4e1
Allow upgrading from old port_from_sqlite3 format
2016-08-04 11:38:08 +01:00
Erik Johnston
b0a14bf53e
Handle the fact that some tables have negative rowid rows
2016-08-04 11:28:02 +01:00
Erik Johnston
4063fe0283
Update port script
2016-04-22 10:35:53 +01:00
Erik Johnston
8aab9d87fa
Don't require config to create database
2016-04-06 14:15:45 +01:00
Daniel Wagner-Hall
763360594d
Mark AS users with their AS's ID
2016-02-11 17:26:42 +00:00
Matthew Hodgson
6c28ac260c
copyrights
2016-01-07 04:26:29 +00:00
Erik Johnston
b361440738
Spelling
2015-11-19 09:11:42 +00:00
Erik Johnston
162e2c1ce5
Fix database port script to work with new event_search table
2015-11-18 15:54:50 +00:00
Mark Haines
7d55314277
Remove unused _execute_and_decode from scripts/synapse_port_db
2015-09-23 10:42:02 +01:00
Mark Haines
73e4ad4b8b
Merge branch 'master' into develop
...
Conflicts:
setup.py
2015-09-07 15:06:46 +01:00
Matthew Hodgson
bdf2e5865a
update logger to match new ambiguous script name...
2015-09-03 09:51:42 +03:00
Erik Johnston
a9ad647fb2
Make port script handle empty sent_transactions table
2015-09-02 11:11:11 +01:00
Erik Johnston
c961cd7736
Clean up scripts/
2015-08-27 13:03:17 +01:00