25ae0bf3ab
Set a chunk ID for all forward extremities
2018-05-25 11:42:35 +01:00
f9f6a6e0c1
Support pagination for tokens without chunk part
2018-05-25 10:56:42 +01:00
70639b07ec
Fix purge history
2018-05-25 10:56:42 +01:00
516207a966
Fix non integer limit
2018-05-25 10:56:42 +01:00
1fc988b43c
Fix clamp leave and disable backfill
2018-05-25 10:55:10 +01:00
f24c3bf0be
Implement pagination using chunks
2018-05-25 10:55:10 +01:00
b0beffa99e
Use calculated topological ordering when persisting events
2018-05-25 10:55:10 +01:00
b65cc7defa
Add chunk ID to pagination token
2018-05-25 10:55:10 +01:00
13dbcafb9b
Compute new chunks for new events
...
We also calculate a consistent topological ordering within a chunk, but
it isn't used yet.
2018-05-25 10:54:23 +01:00
bcc9e7f777
Merge branch 'develop' of github.com:matrix-org/synapse into erikj/room_chunks
2018-05-25 10:53:43 +01:00
cc1349c06a
Merge pull request #3279 from NotAFile/py3-more-iteritems
...
more six iteritems
2018-05-24 14:23:13 -05:00
17a70cf6e9
Misc. py3 fixes
...
Signed-off-by: Adrian Tschira <nota@notafile.com>
2018-05-24 20:20:33 +02:00
6c16a4ec1b
more iteritems
2018-05-24 20:19:06 +02:00
7ea07c7305
Merge pull request #3278 from NotAFile/py3-storage-base
...
Py3 storage/_base.py
2018-05-24 13:08:09 -05:00
1f69693347
Merge pull request #3244 from NotAFile/py3-six-4
...
replace some iteritems with six
2018-05-24 13:04:07 -05:00
36501068d8
Merge pull request #3247 from NotAFile/py3-misc
...
Misc Python3 fixes
2018-05-24 12:58:37 -05:00
095292304f
Py3 storage/_base.py
...
Signed-off-by: Adrian Tschira <nota@notafile.com>
2018-05-24 18:24:12 +02:00
6e11803ed3
Merge branch 'develop' of github.com:matrix-org/synapse into erikj/room_chunks
2018-05-23 10:54:14 +01:00
a17e901f4d
Remove unused string formatting param
2018-05-22 18:24:32 +01:00
5494c1d71e
Don't support limitless pagination
...
The pagination storage function supported not specifiying a limit on the
number of events returned. This was triggered when using the search or
context API with a limit of zero, which the storage function took to
mean not being limited.
2018-05-22 18:15:21 +01:00
9ea219c514
Send users a server notice about consent
...
When a user first syncs, we will send them a server notice asking them to
consent to the privacy policy if they have not already done so.
2018-05-22 11:54:51 +01:00
933bf2dd35
replace some iteritems with six
...
Signed-off-by: Adrian Tschira <nota@notafile.com>
2018-05-19 17:59:26 +02:00
dcc235b47d
use stand-in value if maxint is not available
...
Signed-off-by: Adrian Tschira <nota@notafile.com>
2018-05-19 17:35:44 +02:00
644aac5f73
Tighter filtering for user_daily_visits
2018-05-18 17:10:35 +01:00
ef466b3a13
fix psql compatability bug
2018-05-18 15:51:21 +01:00
b725e128f8
Comments
2018-05-18 13:43:01 +01:00
ed3125b0a1
Merge pull request #3235 from matrix-org/rav/fix_receipts_deferred
...
Fix error in handling receipts
2018-05-18 11:23:11 +01:00
fa30ac38cc
Merge pull request #3221 from matrix-org/erikj/purge_token
...
Make purge_history operate on tokens
2018-05-18 10:35:23 +01:00
8b1c856d81
Fix error in handling receipts
...
Fixes an error which has been happening ever since #2158 (v0.21.0-rc1):
> TypeError: argument of type 'ObservableDeferred' is not iterable
fixes #3234
2018-05-18 09:15:35 +01:00
0504d809fd
More comments
2018-05-17 17:08:36 +01:00
12fd6d7688
Document case of unconnected chunks
2018-05-17 16:07:20 +01:00
a638649254
Make insert_* functions internal and reorder funcs
...
This makes it clearer what the public interface is vs what subclasses
need to implement.
2018-05-17 15:10:23 +01:00
d4e4a7344f
Increase range of rebalance interval
...
This both simplifies the code, and ensures that the target node is
roughly in the center of the range rather than at an end.
2018-05-17 15:09:31 +01:00
c771c124d5
Improve documentation and comments
2018-05-17 15:09:10 +01:00
3b505a80dc
Merge branch 'develop' of github.com:matrix-org/synapse into erikj/chunk_base
2018-05-17 14:00:41 +01:00
943f1029d6
Begin adding implementing room chunks
...
This commit adds the necessary tables and columns, as well as an
implementation of an online topological sorting algorithm to maintain an
absolute ordering of the room chunks.
2018-05-17 12:05:22 +01:00
f7906203f6
Merge pull request #3212 from matrix-org/erikj/epa_stream
...
Use stream rather depth ordering for push actions
2018-05-17 12:01:21 +01:00
680530cc7f
Clarify comment
2018-05-16 11:47:29 +01:00
43e6e82c4d
Comments
2018-05-16 11:13:31 +01:00
dc8930ea9e
Merge pull request #3163 from matrix-org/cohort_analytics
...
user visit data
2018-05-16 10:09:24 +00:00
c945af8799
Move and rename variable
2018-05-16 10:52:06 +01:00
be11a02c4f
remove empty line
2018-05-16 10:45:40 +01:00
31c2502ca8
style and further contraining query
2018-05-16 09:46:43 +01:00
8030a825c8
Merge pull request #3213 from matrix-org/rav/consent_handler
...
ConsentResource to gather policy consent from users
2018-05-16 07:19:18 +01:00
05ac15ae82
Limit query load of generate_user_daily_visits
...
The aim is to keep track of when it was last called and only query from that point in time
2018-05-15 17:01:33 +01:00
5f27ed75ad
Make purge_history operate on tokens
...
As we're soon going to change how topological_ordering works
2018-05-15 16:23:50 +01:00
37dbee6490
Use events_to_purge table rather than token
2018-05-15 16:23:47 +01:00
47815edcfa
ConsentResource to gather policy consent from users
...
Hopefully there are enough comments and docs in this that it makes sense on its
own.
2018-05-15 15:11:59 +01:00
f077e97914
instead of inserting user daily visit data at the end of the day, instead insert incrementally through the day
2018-05-14 13:50:58 +01:00
8cbbfd16fb
Merge pull request #3201 from matrix-org/dbkr/leave_rooms_on_deactivate
...
Part user from rooms on account deactivate
2018-05-14 11:31:48 +01:00
Erik Johnston