100 lines
4.3 KiB
Markdown
100 lines
4.3 KiB
Markdown
# Matrix Public Archive
|
|
|
|
<a href="https://matrix.to/#/#matrix-public-archive:matrix.org"><img src="https://img.shields.io/matrix/matrix-public-archive:matrix.org.svg?label=%23matrix-public-archive%3Amatrix.org&logo=matrix&server_fqdn=matrix.org" alt="Join the community and get support at #matrix-public-archive:matrix.org" /></a>
|
|
|
|
In the vein of [feature parity with
|
|
Gitter](https://github.com/vector-im/roadmap/issues/26), the goal is to make a
|
|
public archive site for `world_readable` Matrix rooms like Gitter's archives
|
|
which search engines can index and keep all of the content accessible/available.
|
|
There is already https://view.matrix.org/
|
|
(https://github.com/matrix-org/matrix-static) but there is some desire to make
|
|
something with more Element-feeling polish and loading faster (avoid the slow
|
|
502's errors that are frequent on `view.matrix.org`).
|
|
|
|
|
|
|
|
## Demo videos
|
|
|
|
- [ Aug 2022](https://www.youtube.com/watch?v=6KHQSeJTXm0&t=583s) ([blog post](https://matrix.org/blog/2022/08/05/this-week-in-matrix-2022-08-05#matrix-public-archive-website)): A quick intro of what the project looks like, the goals, what it accomplishes, and how it's a new portal into the Matrix ecosystem.
|
|
- [ Oct 2022](https://www.youtube.com/watch?v=UT6KSEqDUf8&t=548s): Showing off the room directory landing page used to browse everything available in the archive.
|
|
|
|
## Technical overview
|
|
|
|
We server-side render (SSR) the [Hydrogen](https://github.com/vector-im/hydrogen-web)
|
|
Matrix client on a Node.js server (since both use JavaScript) and serve pages on the fly
|
|
(with some Cloudflare caching on top) when someone requests
|
|
`/archives/r/matrixhq:matrix.org/${year}/${month}/${day}`. To fetch the events for a
|
|
given day/time, we use [MSC3030](https://github.com/matrix-org/matrix-doc/pull/3030)'s
|
|
`/timestamp_to_event` endpoint to jump to a given day in the timeline and fetch the
|
|
messages from a Matrix homeserver.
|
|
|
|
Re-using Hydrogen gets us pretty and native(to Element) looking styles and keeps
|
|
the maintenance burden of supporting more event types in Hydrogen.
|
|
|
|
## Setup
|
|
|
|
### Prerequisites
|
|
|
|
- Node.js v16
|
|
- We only need v16 because it includes
|
|
[`require('crypto').webcrypto.subtle`](https://nodejs.org/docs/latest-v16.x/api/webcrypto.html#cryptosubtle)
|
|
for [Matrix encryption (olm) which can't be disabled in
|
|
Hydrogen](https://github.com/vector-im/hydrogen-web/issues/579) yet.
|
|
- A Matrix homeserver that supports [MSC3030's](https://github.com/matrix-org/matrix-spec-proposals/pull/3030) `/timestamp_to_event` endpoint
|
|
- Synapse 1.73.0+
|
|
|
|
### Get the app running
|
|
|
|
```sh
|
|
$ npm install
|
|
|
|
# Edit `config/config.user-overrides.json` so that `matrixServerUrl` points to
|
|
# your homeserver and has `matrixAccessToken` defined
|
|
$ cp config/config.default.json config/config.user-overrides.json
|
|
|
|
$ npm run start
|
|
# To enable tracing, add the `--tracing` flag
|
|
$ npm run start -- --tracing
|
|
```
|
|
|
|
## Development
|
|
|
|
```sh
|
|
# Clone and install the `matrix-public-archive` project
|
|
$ git clone git@github.com:matrix-org/matrix-public-archive.git
|
|
$ cd matrix-public-archive
|
|
$ npm install
|
|
|
|
# Edit `config/config.user-overrides.json` so that `matrixServerUrl` points to
|
|
# your homeserver and has `matrixAccessToken` defined
|
|
$ cp config/config.default.json config/config.user-overrides.json
|
|
|
|
# This will watch for changes, rebuild bundles and restart the server
|
|
$ npm run start-dev
|
|
# To enable tracing, add the `--tracing` flag
|
|
$ npm run start-dev -- --tracing
|
|
```
|
|
|
|
If you want to make changes to the underlying Hydrogen SDK as well, you can locally link
|
|
it into this project with the following instructions:
|
|
|
|
```
|
|
# We need to use a draft branch of Hydrogen to get the custom changes needed for
|
|
# `matrix-public-archive` to run. Hopefully soon, we can get all of the custom
|
|
# changes mainlined so this isn't necessary.
|
|
$ git clone git@github.com:vector-im/hydrogen-web.git
|
|
$ cd hydrogen-web
|
|
$ git checkout madlittlemods/matrix-public-archive-scratch-changes
|
|
$ yarn install
|
|
$ yarn build:sdk
|
|
$ cd target/ && npm link && cd ..
|
|
$ cd ..
|
|
|
|
$ cd matrix-public-archive
|
|
$ npm link hydrogen-view-sdk
|
|
```
|
|
|
|
### Running tests
|
|
|
|
See the [testing readme](./test/README.md).
|