Investigate query performance

[ElliottKasoar]

While most functionality seems to work reasonably well on a small scale, more consideration needs to be put into storing/querying large amounts of data, including:

• OpenSearch stability e.g. the containing crashing
  • In some cases, this may be an issue with database setup, rather than abcd interface
• Poor performance when returning many results
• Query/push timeouts (in some cases, such as large scale deletion, the instruction may complete despite throwing an exception)

Discussions have also included the use of caching, which can be controlled to some extent, but is also largely handled behind the scenes, as well as pagination, lazy loading etc, although in some cases that caused issues such as generating summary histograms, all the data may be required in memory simultaneously, so there may be no clear resolution.