diff --git a/changelog.d/12370.bugfix b/changelog.d/12370.bugfix
deleted file mode 100644
index 97dca9782..000000000
--- a/changelog.d/12370.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix `/messages` returning backfilled and [MSC2716](https://github.com/matrix-org/synapse/pull/12319) historic messages our of order.
diff --git a/changelog.d/12370.feature b/changelog.d/12370.feature
new file mode 100644
index 000000000..2c695ddaa
--- /dev/null
+++ b/changelog.d/12370.feature
@@ -0,0 +1 @@
+Update `/messages` to use historic pagination tokens if no `from` query parameter is given.