This is easier than I thought, the way I implemented it before was bad.
We can just support server-side search to start.
Please note that blocking a user has other effects, such as: