Skip to content

GH-5653 experimenting with query optimisation for union and optional implementated based on paper#5654

Draft
hmottestad wants to merge 41 commits intodevelopfrom
GH-5653-query-optimisation-for-union-and-optional-implementated-based-on-paper
Draft

GH-5653 experimenting with query optimisation for union and optional implementated based on paper#5654
hmottestad wants to merge 41 commits intodevelopfrom
GH-5653-query-optimisation-for-union-and-optional-implementated-based-on-paper

Conversation

@hmottestad
Copy link
Copy Markdown
Contributor

@hmottestad hmottestad commented Dec 27, 2025

GitHub issue resolved: #5653

Briefly describe the changes proposed in this PR:


PR Author Checklist (see the contributor guidelines for more details):

  • my pull request is self-contained
  • I've added tests for the changes I made
  • I've applied code formatting (you can use mvn process-resources to format from the command line)
  • I've squashed my commits where necessary
  • every commit message starts with the issue number (GH-xxxx) followed by a meaningful description of the change

@hmottestad hmottestad changed the base branch from main to develop December 27, 2025 05:30
Squashed commits:
[fda9de2] wip
[bb1798e] wip
[5316527] wip
[05483e0] wip
[bfe4194] wip
[543ebb8] wip
[a94797a] wip
[0e84556] wip
[82dc4fb] wip
[b40e73f] wip
[1dc8888] wip
[a675c99] wip
[c3613cd] wip
[442321b] initial implementation

# Conflicts:
#	scripts/checkCopyrightPresent.sh
@hmottestad
Copy link
Copy Markdown
Contributor Author

hmottestad commented Dec 27, 2025

Memory Store - Develop branch

Benchmark                              (themeName)  (z_queryIndex)  Mode  Cnt      Score   Error  Units
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               0  avgt    2     18.789          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               1  avgt    2     49.384          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               2  avgt    2     17.610          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               3  avgt    2     34.161          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               4  avgt    2     28.687          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               5  avgt    2     21.749          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               6  avgt    2     17.832          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               7  avgt    2     14.336          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               8  avgt    2     16.547          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               9  avgt    2     91.028          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              10  avgt    2     42.433          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               0  avgt    2      0.038          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               1  avgt    2      1.763          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               2  avgt    2      0.032          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               3  avgt    2      0.043          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               4  avgt    2      0.045          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               5  avgt    2    581.857          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               6  avgt    2      0.044          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               7  avgt    2      1.970          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               8  avgt    2    141.365          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               9  avgt    2      1.542          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              10  avgt    2      0.814          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               0  avgt    2    193.058          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               1  avgt    2    104.471          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               2  avgt    2      8.506          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               3  avgt    2     22.175          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               4  avgt    2     47.161          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               5  avgt    2      4.412          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               6  avgt    2   6929.486          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               7  avgt    2  36361.394          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               8  avgt    2     10.816          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               9  avgt    2     20.461          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              10  avgt    2    305.934          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               0  avgt    2     72.144          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               1  avgt    2     89.763          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               2  avgt    2      0.192          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               3  avgt    2     80.268          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               4  avgt    2     43.227          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               5  avgt    2      0.289          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               6  avgt    2    118.175          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               7  avgt    2      1.064          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               8  avgt    2      0.450          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               9  avgt    2      0.595          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              10  avgt    2      0.412          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               0  avgt    2    171.027          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               1  avgt    2    564.537          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               2  avgt    2    172.856          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               3  avgt    2     78.093          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               4  avgt    2    119.280          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               5  avgt    2     69.526          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               6  avgt    2    768.697          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               7  avgt    2     70.042          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               8  avgt    2    262.440          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               9  avgt    2    791.116          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              10  avgt    2  25053.220          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               0  avgt    2     11.476          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               1  avgt    2     17.137          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               2  avgt    2      1.426          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               3  avgt    2     52.291          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               4  avgt    2     49.630          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               5  avgt    2      8.510          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               6  avgt    2     22.082          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               7  avgt    2     19.505          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               8  avgt    2     27.818          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               9  avgt    2     93.419          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              10  avgt    2    116.668          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               0  avgt    2     11.028          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               1  avgt    2      8.384          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               2  avgt    2      0.735          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               3  avgt    2    123.936          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               4  avgt    2      0.662          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               5  avgt    2      1.743          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               6  avgt    2     21.841          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               7  avgt    2     29.197          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               8  avgt    2      1.562          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               9  avgt    2      1.310          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              10  avgt    2     89.010          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               0  avgt    2      0.083          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               1  avgt    2      0.357          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               2  avgt    2   1932.758          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               3  avgt    2      1.897          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               4  avgt    2      6.934          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               5  avgt    2      0.099          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               6  avgt    2      0.835          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               7  avgt    2      3.216          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               8  avgt    2      9.673          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               9  avgt    2      3.360          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              10  avgt    2   2339.505          ms/op

Memory Store - Current branch


Benchmark                              (themeName)  (z_queryIndex)  Mode  Cnt      Score   Error  Units
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               0  avgt    2     17.452          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               1  avgt    2     48.030          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               2  avgt    2     17.355          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               3  avgt    2     39.901          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               4  avgt    2     28.998          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               5  avgt    2     22.168          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               6  avgt    2     20.803          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               7  avgt    2     15.255          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               8  avgt    2     16.859          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               9  avgt    2     91.984          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              10  avgt    2     43.981          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               0  avgt    2      0.043          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               1  avgt    2      1.697          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               2  avgt    2      0.043          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               3  avgt    2      0.047          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               4  avgt    2      0.050          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               5  avgt    2    571.806          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               6  avgt    2      0.048          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               7  avgt    2      2.366          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               8  avgt    2    183.422          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               9  avgt    2      1.580          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              10  avgt    2      0.983          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               0  avgt    2    200.458          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               1  avgt    2    104.187          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               2  avgt    2      9.008          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               3  avgt    2     23.261          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               4  avgt    2     47.922          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               5  avgt    2      4.765          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               6  avgt    2   6891.078          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               7  avgt    2  35617.396          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               8  avgt    2     11.208          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               9  avgt    2     22.003          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              10  avgt    2    294.693          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               0  avgt    2     64.468          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               1  avgt    2     83.157          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               2  avgt    2      0.156          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               3  avgt    2     71.842          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               4  avgt    2     37.925          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               5  avgt    2      0.344          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               6  avgt    2    105.361          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               7  avgt    2      1.018          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               8  avgt    2      0.461          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               9  avgt    2      0.460          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              10  avgt    2      0.409          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               0  avgt    2    155.939          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               1  avgt    2    509.309          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               2  avgt    2    146.737          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               3  avgt    2     71.438          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               4  avgt    2     79.823          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               5  avgt    2     57.716          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               6  avgt    2    704.153          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               7  avgt    2     62.092          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               8  avgt    2    223.961          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               9  avgt    2    709.950          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              10  avgt    2  23963.384          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               0  avgt    2     11.886          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               1  avgt    2     17.021          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               2  avgt    2      1.660          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               3  avgt    2     52.369          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               4  avgt    2     52.384          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               5  avgt    2      8.568          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               6  avgt    2     28.831          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               7  avgt    2     20.365          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               8  avgt    2     26.252          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               9  avgt    2    101.914          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              10  avgt    2    126.661          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               0  avgt    2     12.395          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               1  avgt    2      8.919          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               2  avgt    2      0.778          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               3  avgt    2    130.259          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               4  avgt    2      0.747          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               5  avgt    2      2.751          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               6  avgt    2     22.784          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               7  avgt    2     32.773          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               8  avgt    2      1.692          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               9  avgt    2      1.807          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              10  avgt    2    118.601          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               0  avgt    2      0.096          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               1  avgt    2      0.379          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               2  avgt    2   1875.122          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               3  avgt    2      1.884          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               4  avgt    2      7.414          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               5  avgt    2      0.106          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               6  avgt    2      0.844          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               7  avgt    2      3.257          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               8  avgt    2      9.766          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               9  avgt    2      3.254          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              10  avgt    2   2258.259          ms/op

@hmottestad hmottestad force-pushed the GH-5653-query-optimisation-for-union-and-optional-implementated-based-on-paper branch from 57b79d7 to a4d815a Compare December 27, 2025 18:30
@hmottestad
Copy link
Copy Markdown
Contributor Author

hmottestad commented Dec 27, 2025

LMDB Store - develop branch

Benchmark                              (themeName)  (z_queryIndex)  Mode  Cnt       Score   Error  Units
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               0  avgt    2      51.256          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               1  avgt    2     186.645          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               2  avgt    2      50.005          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               3  avgt    2      98.563          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               4  avgt    2     121.535          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               5  avgt    2      64.928          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               6  avgt    2      61.191          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               7  avgt    2      51.656          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               8  avgt    2      58.814          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               9  avgt    2     272.421          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              10  avgt    2  293429.747          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               0  avgt    2       0.061          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               1  avgt    2       6.016          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               2  avgt    2       0.076          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               3  avgt    2       0.069          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               4  avgt    2       0.087          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               5  avgt    2     861.699          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               6  avgt    2       0.088          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               7  avgt    2       5.986          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               8  avgt    2     737.210          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               9  avgt    2       5.751          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              10  avgt    2       2.608          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               0  avgt    2     665.671          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               1  avgt    2     254.135          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               2  avgt    2      36.678          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               3  avgt    2      42.249          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               4  avgt    2     120.662          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               5  avgt    2       9.535          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               6  avgt    2   23784.702          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               7  avgt    2   91930.684          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               8  avgt    2      74.209          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               9  avgt    2     151.046          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              10  avgt    2     183.888          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               0  avgt    2     233.185          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               1  avgt    2     303.684          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               2  avgt    2       1.289          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               3  avgt    2     150.705          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               4  avgt    2      60.455          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               5  avgt    2       2.357          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               6  avgt    2     248.904          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               7  avgt    2       4.436          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               8  avgt    2       2.528          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               9  avgt    2       3.786          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              10  avgt    2       1.922          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               0  avgt    2     323.203          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               1  avgt    2    1165.947          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               2  avgt    2     548.036          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               3  avgt    2      99.026          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               4  avgt    2     248.351          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               5  avgt    2     109.557          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               6  avgt    2    1463.763          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               7  avgt    2     152.188          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               8  avgt    2    1170.030          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               9  avgt    2    1481.964          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              10  avgt    2  126334.595          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               0  avgt    2      37.937          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               1  avgt    2      86.435          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               2  avgt    2       8.738          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               3  avgt    2     162.916          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               4  avgt    2     138.137          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               5  avgt    2      26.519          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               6  avgt    2      97.552          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               7  avgt    2      51.524          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               8  avgt    2     269.601          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               9  avgt    2     262.040          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              10  avgt    2     226.000          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               0  avgt    2      42.103          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               1  avgt    2      87.022          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               2  avgt    2       4.939          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               3  avgt    2     328.922          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               4  avgt    2       4.621          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               5  avgt    2      11.560          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               6  avgt    2      95.600          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               7  avgt    2      19.453          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               8  avgt    2      13.925          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               9  avgt    2       5.615          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              10  avgt    2     524.353          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               0  avgt    2       0.303          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               1  avgt    2       1.736          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               2  avgt    2      39.557          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               3  avgt    2      14.988          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               4  avgt    2      31.892          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               5  avgt    2       0.408          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               6  avgt    2       5.374          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               7  avgt    2      22.562          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               8  avgt    2      32.379          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               9  avgt    2      18.538          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              10  avgt    2   13561.666          ms/op

LMDB - current branch


Benchmark                              (themeName)  (z_queryIndex)  Mode  Cnt       Score   Error  Units
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               0  avgt    2      55.319          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               1  avgt    2     241.472          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               2  avgt    2      53.437          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               3  avgt    2      94.536          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               4  avgt    2     126.095          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               5  avgt    2      70.282          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               6  avgt    2      64.382          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               7  avgt    2      56.569          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               8  avgt    2      59.684          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               9  avgt    2     272.028          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              10  avgt    2  263079.586          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               0  avgt    2       0.115          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               1  avgt    2       0.263          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               2  avgt    2       0.129          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               3  avgt    2       0.098          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               4  avgt    2       0.137          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               5  avgt    2     924.485          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               6  avgt    2       0.129          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               7  avgt    2       0.125          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               8  avgt    2     798.428          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               9  avgt    2       0.171          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              10  avgt    2       1.777          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               0  avgt    2     706.336          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               1  avgt    2     277.950          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               2  avgt    2      42.081          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               3  avgt    2      47.185          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               4  avgt    2     128.997          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               5  avgt    2      10.916          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               6  avgt    2   23443.893          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               7  avgt    2   83192.334          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               8  avgt    2      74.443          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               9  avgt    2     146.260          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              10  avgt    2     216.790          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               0  avgt    2     238.600          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               1  avgt    2     292.031          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               2  avgt    2       1.325          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               3  avgt    2     140.774          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               4  avgt    2      61.466          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               5  avgt    2       2.278          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               6  avgt    2     249.282          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               7  avgt    2       4.524          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               8  avgt    2       2.503          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               9  avgt    2       3.927          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              10  avgt    2       1.977          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               0  avgt    2     425.582          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               1  avgt    2    1260.407          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               2  avgt    2     536.718          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               3  avgt    2     135.355          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               4  avgt    2     250.304          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               5  avgt    2     141.570          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               6  avgt    2    1634.243          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               7  avgt    2     153.107          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               8  avgt    2    1146.167          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               9  avgt    2    1623.045          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              10  avgt    2  122659.946          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               0  avgt    2      39.724          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               1  avgt    2      84.462          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               2  avgt    2       9.168          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               3  avgt    2     156.922          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               4  avgt    2     138.273          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               5  avgt    2      25.737          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               6  avgt    2      83.502          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               7  avgt    2      50.785          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               8  avgt    2     279.293          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               9  avgt    2     266.764          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              10  avgt    2     218.442          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               0  avgt    2      43.745          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               1  avgt    2      88.631          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               2  avgt    2       4.272          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               3  avgt    2     378.649          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               4  avgt    2       4.354          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               5  avgt    2      10.898          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               6  avgt    2      89.819          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               7  avgt    2      28.290          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               8  avgt    2      14.767          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               9  avgt    2       5.369          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              10  avgt    2     552.016          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               0  avgt    2       0.279          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               1  avgt    2       1.767          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               2  avgt    2      40.619          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               3  avgt    2      13.974          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               4  avgt    2      32.478          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               5  avgt    2       0.207          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               6  avgt    2       5.206          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               7  avgt    2      21.731          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               9  avgt    2      16.832          ms/op

@hmottestad
Copy link
Copy Markdown
Contributor Author

hmottestad commented Dec 27, 2025

There are some improvements for LMDB at least.

Screenshot 2025-12-27 at 21 42 32

Some things are slower, but I wonder if they would even out more if the benchmark got to run for longer.

Screenshot 2025-12-27 at 21 43 53

@hmottestad hmottestad changed the title GH-5653 query optimisation for union and optional implementated based on paper GH-5653 experimenting with query optimisation for union and optional implementated based on paper Dec 27, 2025
@kenwenzel
Copy link
Copy Markdown
Member

Some queries with LmdbStore are much slower than with MemoryStore. Could this be due to wrong cardinality estimation?

@hmottestad
Copy link
Copy Markdown
Contributor Author

hmottestad commented Dec 28, 2025

MemoryStore updated results


Benchmark                              (themeName)  (useSparqlUo)  (z_queryIndex)  Mode  Cnt      Score   Error  Units
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS           true               0  avgt    2     38.117          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS           true               1  avgt    2    116.033          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS           true               2  avgt    2     20.599          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS           true               3  avgt    2     85.449          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS           true               4  avgt    2     63.075          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS           true               5  avgt    2     30.350          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS           true               6  avgt    2     28.703          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS           true               7  avgt    2     17.964          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS           true               8  avgt    2     31.166          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS           true               9  avgt    2    177.966          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS           true              10  avgt    2     84.648          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS          false               0  avgt    2     35.674          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS          false               1  avgt    2    100.922          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS          false               2  avgt    2     18.981          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS          false               3  avgt    2     77.920          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS          false               4  avgt    2     60.195          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS          false               5  avgt    2     28.456          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS          false               6  avgt    2     28.445          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS          false               7  avgt    2     18.776          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS          false               8  avgt    2     31.074          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS          false               9  avgt    2    178.949          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS          false              10  avgt    2     82.946          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA           true               0  avgt    2      0.051          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA           true               1  avgt    2      1.722          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA           true               2  avgt    2      0.062          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA           true               3  avgt    2      0.052          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA           true               4  avgt    2      0.069          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA           true               5  avgt    2    294.132          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA           true               6  avgt    2      0.079          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA           true               7  avgt    2      1.674          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA           true               8  avgt    2    286.572          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA           true               9  avgt    2      2.587          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA           true              10  avgt    2      1.490          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA          false               0  avgt    2      0.041          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA          false               1  avgt    2      1.611          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA          false               2  avgt    2      0.046          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA          false               3  avgt    2      0.050          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA          false               4  avgt    2      0.054          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA          false               5  avgt    2    594.123          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA          false               6  avgt    2      0.064          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA          false               7  avgt    2      2.027          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA          false               8  avgt    2    281.310          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA          false               9  avgt    2      2.334          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA          false              10  avgt    2      1.478          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY           true               0  avgt    2    410.835          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY           true               1  avgt    2    196.483          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY           true               2  avgt    2     10.801          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY           true               3  avgt    2     30.426          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY           true               4  avgt    2     49.230          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY           true               5  avgt    2      5.471          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY           true               6  avgt    2   1606.447          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY           true               7  avgt    2    588.189          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY           true               8  avgt    2     36.902          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY           true               9  avgt    2    125.716          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY           true              10  avgt    2     17.830          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY          false               0  avgt    2    419.210          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY          false               1  avgt    2    195.625          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY          false               2  avgt    2     10.820          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY          false               3  avgt    2     30.341          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY          false               4  avgt    2     49.205          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY          false               5  avgt    2      5.387          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY          false               6  avgt    2   1593.133          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY          false               7  avgt    2    602.474          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY          false               8  avgt    2     37.877          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY          false               9  avgt    2    114.416          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY          false              10  avgt    2     20.556          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING           true               0  avgt    2    151.397          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING           true               1  avgt    2    159.029          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING           true               2  avgt    2      0.334          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING           true               3  avgt    2     71.369          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING           true               4  avgt    2     43.323          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING           true               5  avgt    2      0.418          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING           true               6  avgt    2    180.130          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING           true               7  avgt    2      1.639          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING           true               8  avgt    2      0.795          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING           true               9  avgt    2      0.672          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING           true              10  avgt    2      0.530          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING          false               0  avgt    2    149.783          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING          false               1  avgt    2    157.860          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING          false               2  avgt    2      0.324          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING          false               3  avgt    2     71.953          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING          false               4  avgt    2     43.863          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING          false               5  avgt    2      0.419          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING          false               6  avgt    2    178.994          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING          false               7  avgt    2      1.623          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING          false               8  avgt    2      1.076          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING          false               9  avgt    2      0.687          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING          false              10  avgt    2      0.528          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED           true               0  avgt    2    266.230          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED           true               1  avgt    2    813.469          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED           true               2  avgt    2    331.145          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED           true               3  avgt    2    130.159          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED           true               4  avgt    2    112.794          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED           true               5  avgt    2     75.154          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED           true               6  avgt    2    808.049          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED           true               7  avgt    2     72.022          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED           true               8  avgt    2    474.973          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED           true               9  avgt    2    879.760          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED           true              10  avgt    2  19956.785          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED          false               0  avgt    2    259.383          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED          false               1  avgt    2    797.563          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED          false               2  avgt    2    325.368          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED          false               3  avgt    2    126.425          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED          false               4  avgt    2    111.318          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED          false               5  avgt    2     75.327          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED          false               6  avgt    2    780.778          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED          false               7  avgt    2     73.955          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED          false               8  avgt    2    436.746          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED          false               9  avgt    2    900.123          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED          false              10  avgt    2  19905.662          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN           true               0  avgt    2     22.262          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN           true               1  avgt    2     43.537          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN           true               2  avgt    2      1.611          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN           true               3  avgt    2     91.165          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN           true               4  avgt    2     45.034          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN           true               5  avgt    2      9.606          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN           true               6  avgt    2     43.229          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN           true               7  avgt    2     19.490          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN           true               8  avgt    2     98.852          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN           true               9  avgt    2    160.296          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN           true              10  avgt    2    206.421          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN          false               0  avgt    2     21.763          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN          false               1  avgt    2     44.457          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN          false               2  avgt    2      1.638          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN          false               3  avgt    2     92.924          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN          false               4  avgt    2     44.822          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN          false               5  avgt    2      9.730          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN          false               6  avgt    2     39.210          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN          false               7  avgt    2     22.340          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN          false               8  avgt    2     97.539          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN          false               9  avgt    2    155.499          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN          false              10  avgt    2    205.388          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID           true               0  avgt    2     22.978          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID           true               1  avgt    2     26.682          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID           true               2  avgt    2      0.796          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID           true               3  avgt    2    193.124          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID           true               4  avgt    2      0.707          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID           true               5  avgt    2      2.846          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID           true               6  avgt    2     49.324          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID           true               7  avgt    2     29.279          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID           true               8  avgt    2      5.004          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID           true               9  avgt    2      1.325          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID           true              10  avgt    2    217.908          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID          false               0  avgt    2     22.611          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID          false               1  avgt    2     26.094          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID          false               2  avgt    2      0.741          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID          false               3  avgt    2    193.159          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID          false               4  avgt    2      0.598          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID          false               5  avgt    2      2.352          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID          false               6  avgt    2     48.995          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID          false               7  avgt    2     28.897          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID          false               8  avgt    2      5.084          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID          false               9  avgt    2      1.324          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID          false              10  avgt    2    269.579          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA           true               0  avgt    2      0.176          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA           true               1  avgt    2      0.893          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA           true               2  avgt    2   3776.284          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA           true               3  avgt    2      4.644          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA           true               4  avgt    2     15.772          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA           true               5  avgt    2      0.208          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA           true               6  avgt    2      1.414          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA           true               7  avgt    2      7.937          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA           true               8  avgt    2     15.976          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA           true               9  avgt    2      6.072          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA           true              10  avgt    2   6645.790          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA          false               0  avgt    2      0.156          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA          false               1  avgt    2      0.786          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA          false               2  avgt    2   3773.933          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA          false               3  avgt    2      4.766          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA          false               4  avgt    2     15.547          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA          false               5  avgt    2      0.191          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA          false               6  avgt    2      1.272          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA          false               7  avgt    2      7.839          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA          false               8  avgt    2     15.813          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA          false               9  avgt    2      6.084          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA          false              10  avgt    2   6876.238          ms/op

@hmottestad
Copy link
Copy Markdown
Contributor Author

Some queries with LmdbStore are much slower than with MemoryStore. Could this be due to wrong cardinality estimation?

@kenwenzel that would be my guess, I'm curious to see if these queries will be faster with the new sketch based cardinality estimation.

I got ChatGPT to make a lot of data generators and queries for us to use for better benchmarking.

@hmottestad
Copy link
Copy Markdown
Contributor Author

Memory Store

Benchmark                              (themeName)  (x_queryIndex)  (z_useSparqlUo)  Mode  Cnt      Score   Error  Units
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               0             true  avgt          28.042          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               0            false  avgt          29.005          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               1             true  avgt          79.762          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               1            false  avgt         101.688          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               2             true  avgt          22.194          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               2            false  avgt          18.440          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               3             true  avgt          62.892          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               3            false  avgt          60.155          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               4             true  avgt          48.356          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               4            false  avgt          47.236          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               5             true  avgt          26.247          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               5            false  avgt          29.588          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               6             true  avgt          32.291          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               6            false  avgt          33.197          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               7             true  avgt          15.269          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               7            false  avgt          16.056          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               8             true  avgt          30.911          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               8            false  avgt          22.069          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               9             true  avgt         131.892          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               9            false  avgt         162.482          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              10             true  avgt          59.889          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              10            false  avgt          59.188          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               0             true  avgt           0.055          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               0            false  avgt           0.045          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               1             true  avgt           2.292          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               1            false  avgt           2.240          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               2             true  avgt           0.075          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               2            false  avgt           0.047          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               3             true  avgt           0.059          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               3            false  avgt           0.075          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               4             true  avgt           0.067          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               4            false  avgt           0.050          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               5             true  avgt         341.454          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               5            false  avgt         607.087          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               6             true  avgt           0.100          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               6            false  avgt           0.066          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               7             true  avgt           2.670          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               7            false  avgt           2.554          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               8             true  avgt         299.721          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               8            false  avgt         304.275          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               9             true  avgt           2.053          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               9            false  avgt           2.439          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              10             true  avgt           1.358          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              10            false  avgt           1.183          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               0             true  avgt         362.905          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               0            false  avgt         355.553          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               1             true  avgt         170.654          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               1            false  avgt         165.392          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               2             true  avgt          13.380          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               2            false  avgt          12.366          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               3             true  avgt          34.788          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               3            false  avgt          35.429          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               4             true  avgt          55.946          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               4            false  avgt          58.950          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               5             true  avgt           5.004          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               5            false  avgt           5.583          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               6             true  avgt        1401.088          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               6            false  avgt        1403.762          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               7             true  avgt         686.508          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               7            false  avgt         549.148          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               8             true  avgt          40.660          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               8            false  avgt          38.349          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               9             true  avgt          91.825          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               9            false  avgt          90.140          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              10             true  avgt          22.961          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              10            false  avgt          20.067          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               0             true  avgt         116.135          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               0            false  avgt         123.869          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               1             true  avgt         148.151          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               1            false  avgt         146.785          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               2             true  avgt           0.279          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               2            false  avgt           0.281          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               3             true  avgt          79.176          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               3            false  avgt          71.396          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               4             true  avgt          49.511          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               4            false  avgt          45.591          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               5             true  avgt           0.573          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               5            false  avgt           0.517          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               6             true  avgt         185.726          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               6            false  avgt         186.571          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               7             true  avgt           1.898          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               7            false  avgt           1.749          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               8             true  avgt           0.964          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               8            false  avgt           0.952          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               9             true  avgt           0.875          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               9            false  avgt           0.700          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              10             true  avgt           0.578          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              10            false  avgt           0.456          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               0             true  avgt         217.019          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               0            false  avgt         256.029          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               1             true  avgt         690.056          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               1            false  avgt         721.022          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               2             true  avgt         281.195          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               2            false  avgt         313.986          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               3             true  avgt          88.136          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               3            false  avgt          90.592          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               4             true  avgt          80.576          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               4            false  avgt         100.750          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               5             true  avgt          59.096          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               5            false  avgt          58.255          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               6             true  avgt         814.536          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               6            false  avgt         813.441          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               7             true  avgt          74.039          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               7            false  avgt          67.820          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               8             true  avgt         429.865          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               8            false  avgt         457.379          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               9             true  avgt         929.709          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               9            false  avgt         963.728          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              10             true  avgt       22690.445          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              10            false  avgt       22663.214          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               0             true  avgt          16.631          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               0            false  avgt          19.142          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               1             true  avgt          35.700          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               1            false  avgt          46.931          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               2             true  avgt           2.749          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               2            false  avgt           2.349          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               3             true  avgt          73.034          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               3            false  avgt          80.204          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               4             true  avgt          46.445          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               4            false  avgt          43.935          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               5             true  avgt           8.778          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               5            false  avgt          10.439          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               6             true  avgt          55.518          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               6            false  avgt          53.970          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               7             true  avgt          29.299          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               7            false  avgt          22.992          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               8             true  avgt          71.310          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               8            false  avgt          91.591          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               9             true  avgt         167.891          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               9            false  avgt         116.063          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              10             true  avgt         154.862          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              10            false  avgt         180.916          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               0             true  avgt          25.095          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               0            false  avgt          29.076          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               1             true  avgt          38.937          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               1            false  avgt          22.918          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               2             true  avgt           1.008          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               2            false  avgt           1.484          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               3             true  avgt         152.881          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               3            false  avgt         151.340          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               4             true  avgt           0.718          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               4            false  avgt           0.911          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               5             true  avgt           2.809          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               5            false  avgt           3.220          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               6             true  avgt          36.534          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               6            false  avgt          38.173          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               7             true  avgt          34.449          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               7            false  avgt          36.929          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               8             true  avgt           5.612          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               8            false  avgt           5.725          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               9             true  avgt           1.699          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               9            false  avgt           2.237          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              10             true  avgt         206.792          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              10            false  avgt         207.080          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               0             true  avgt           0.174          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               0            false  avgt           0.205          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               1             true  avgt           0.810          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               1            false  avgt           0.808          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               2             true  avgt        3562.712          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               2            false  avgt        3652.936          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               3             true  avgt           4.210          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               3            false  avgt           3.458          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               4             true  avgt          15.544          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               4            false  avgt          11.447          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               5             true  avgt           0.174          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               5            false  avgt           0.156          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               6             true  avgt           1.869          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               6            false  avgt           1.486          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               7             true  avgt           7.206          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               7            false  avgt           8.506          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               8             true  avgt          15.287          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               8            false  avgt          13.948          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               9             true  avgt           8.229          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               9            false  avgt           6.848          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              10             true  avgt        6829.711          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              10            false  avgt        7166.524          ms/op

@hmottestad
Copy link
Copy Markdown
Contributor Author

hmottestad commented Dec 29, 2025

Added more queries and optimisations. Here are the numbers for the Memory Store.

Benchmark                              (themeName)  (x_queryIndex)  (z_useSparqlUo)  Mode  Cnt      Score       Error  Units
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              11             true  avgt    3     50.258 ±    50.494  ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              11            false  avgt    3    158.340 ±   100.275  ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              12             true  avgt    3     51.237 ±    38.390  ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              12            false  avgt    3     60.565 ±    21.390  ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              13             true  avgt    3   7345.557 ±  1806.997  ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              13            false  avgt    3     98.622 ±   262.446  ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              11             true  avgt    3   1296.003 ±  1654.176  ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              11            false  avgt    3  21598.858 ±  7937.695  ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              12             true  avgt    3    360.873 ±    42.618  ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              12            false  avgt    3     55.257 ±   173.646  ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              13             true  avgt    3    768.265 ±   112.603  ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              13            false  avgt    3    908.328 ±  1010.528  ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              11             true  avgt    3    474.342 ±   760.945  ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              11            false  avgt    3    832.587 ±  1103.311  ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              12             true  avgt    3     84.562 ±   171.688  ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              12            false  avgt    3   1703.845 ±   819.627  ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              13             true  avgt    3     14.228 ±    28.982  ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              13            false  avgt    3     20.876 ±    44.990  ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              11             true  avgt    3      1.656 ±     2.619  ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              11            false  avgt    3      3.948 ±     3.197  ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              12             true  avgt    3    310.134 ±    95.872  ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              12            false  avgt    3    399.032 ±   803.468  ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              13             true  avgt    3     26.506 ±    76.289  ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              13            false  avgt    3     70.034 ±   219.019  ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              11             true  avgt    3    131.302 ±   203.463  ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              11            false  avgt    3    223.780 ±   457.193  ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              12             true  avgt    3    139.206 ±   143.498  ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              12            false  avgt    3    169.669 ±   187.395  ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              13             true  avgt    3   8037.102 ±  4162.307  ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              13            false  avgt    3  37869.716 ± 31644.336  ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              11             true  avgt    3     43.553 ±    59.978  ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              11            false  avgt    3     46.053 ±    40.048  ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              12             true  avgt    3    138.509 ±   284.481  ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              12            false  avgt    3    162.116 ±   240.185  ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              13             true  avgt    3     43.901 ±   134.451  ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              13            false  avgt    3     51.117 ±   119.258  ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              11             true  avgt    3     78.750 ±   113.650  ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              11            false  avgt    3    179.567 ±   225.076  ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              12             true  avgt    3     48.428 ±    36.123  ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              12            false  avgt    3     48.722 ±    22.724  ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              13             true  avgt    3    232.445 ±   334.297  ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              13            false  avgt    3    207.810 ±   332.732  ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              11             true  avgt    3     19.754 ±    14.615  ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              11            false  avgt    3     82.874 ±   107.536  ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              12             true  avgt    3      2.470 ±     0.295  ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              12            false  avgt    3      2.435 ±     1.167  ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              13             true  avgt    3      0.437 ±     0.988  ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              13            false  avgt    3      0.360 ±     1.014  ms/op

Another update


Benchmark                              (themeName)  (x_queryIndex)  (z_useSparqlUo)  Mode  Cnt      Score       Error  Units
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              11             true  avgt    3     40.996 ±     5.350  ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              11            false  avgt    3    154.965 ±   137.100  ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              12             true  avgt    3     45.717 ±     7.656  ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              12            false  avgt    3     52.580 ±    16.970  ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              13             true  avgt    3     30.638 ±     7.864  ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              13            false  avgt    3     84.768 ±    25.827  ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              11             true  avgt    3   3054.087 ±  1032.012  ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              11            false  avgt    3  21467.529 ±  2403.965  ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              12             true  avgt    3     90.471 ±    22.364  ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              12            false  avgt    3     41.806 ±    28.762  ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              13             true  avgt    3    691.446 ±   551.214  ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              13            false  avgt    3    852.865 ±   986.159  ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              11             true  avgt    3      0.115 ±     0.021  ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              11            false  avgt    3    887.764 ±  1783.116  ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              12             true  avgt    3     39.107 ±     7.168  ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              12            false  avgt    3   1492.078 ±   258.537  ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              13             true  avgt    3     10.573 ±     3.369  ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              13            false  avgt    3     15.126 ±     7.696  ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              11             true  avgt    3      0.604 ±     0.242  ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              11            false  avgt    3      3.988 ±     2.766  ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              12             true  avgt    3    304.884 ±    57.117  ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              12            false  avgt    3    341.800 ±    73.873  ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              13             true  avgt    3     21.195 ±     0.685  ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              13            false  avgt    3     57.841 ±     1.810  ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              11             true  avgt    3    132.225 ±   225.468  ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              11            false  avgt    3    196.525 ±    64.545  ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              12            false  avgt    3    167.499 ±    94.831  ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              13             true  avgt    3   7580.825 ±   452.968  ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              13            false  avgt    3  36240.909 ± 12336.164  ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              11             true  avgt    3     29.260 ±    40.279  ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              11            false  avgt    3     36.044 ±     9.086  ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              12             true  avgt    3    117.874 ±     2.831  ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              12            false  avgt    3    142.922 ±    22.540  ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              13             true  avgt    3     33.203 ±    25.080  ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              13            false  avgt    3     42.671 ±    11.912  ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              11             true  avgt    3     72.474 ±     2.198  ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              11            false  avgt    3    168.246 ±    58.608  ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              12             true  avgt    3     43.582 ±    17.399  ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              12            false  avgt    3     44.476 ±     9.822  ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              13             true  avgt    3    214.534 ±    52.925  ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              13            false  avgt    3    194.199 ±    19.255  ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              11             true  avgt    3     13.463 ±     3.718  ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              11            false  avgt    3     84.256 ±    14.863  ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              13             true  avgt    3      0.334 ±     0.024  ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              13            false  avgt    3      0.299 ±     0.107  ms/op

@hmottestad
Copy link
Copy Markdown
Contributor Author

Latest for the MemoryStore


Benchmark                              (themeName)  (x_queryIndex)  (z_useSparqlUo)  Mode  Cnt        Score   Error  Units
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               0             true  avgt            22.452          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               0            false  avgt            22.804          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               1             true  avgt            65.304          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               1            false  avgt            65.105          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               2             true  avgt            16.191          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               2            false  avgt            15.903          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               3             true  avgt            45.946          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               3            false  avgt            49.703          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               4             true  avgt            45.691          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               4            false  avgt            35.944          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               5             true  avgt            35.552          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               5            false  avgt            22.488          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               6             true  avgt            16.708          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               6            false  avgt            19.961          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               7             true  avgt            16.435          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               7            false  avgt            13.208          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               8             true  avgt         23546.528          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               8            false  avgt            21.446          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               9             true  avgt           106.583          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               9            false  avgt           107.186          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              10             true  avgt            40.571          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              10            false  avgt            52.174          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              11             true  avgt            26.821          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              11            false  avgt           133.267          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              12             true  avgt            38.660          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              12            false  avgt            40.775          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              13             true  avgt            25.386          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              13            false  avgt            60.284          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               0             true  avgt             0.051          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               0            false  avgt             0.039          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               1             true  avgt             3.952          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               1            false  avgt             1.832          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               2             true  avgt             0.053          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               2            false  avgt             0.038          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               3             true  avgt             0.067          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               3            false  avgt             0.042          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               4             true  avgt             0.073          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               4            false  avgt             0.044          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               5             true  avgt             1.329          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               5            false  avgt           542.813          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               6             true  avgt             0.069          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               6            false  avgt             0.051          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               7             true  avgt             1.407          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               7            false  avgt             1.731          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               8             true  avgt             1.109          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               8            false  avgt           260.775          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               9             true  avgt            10.332          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               9            false  avgt             1.854          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              10             true  avgt             1.707          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              10            false  avgt             1.060          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              11             true  avgt         17640.558          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              11            false  avgt         17727.430          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              12             true  avgt            35.305          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              12            false  avgt            42.616          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              13             true  avgt           642.575          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              13            false  avgt           857.603          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               0             true  avgt           320.165          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               0            false  avgt           304.509          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               1             true  avgt           143.697          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               1            false  avgt           142.948          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               2             true  avgt             8.847          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               2            false  avgt             8.559          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               3             true  avgt            24.332          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               3            false  avgt            26.685          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               4             true  avgt            98.816          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               4            false  avgt            51.711          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               5             true  avgt             5.105          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               5            false  avgt             4.692          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               6             true  avgt         18229.681          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               6            false  avgt         14690.000          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               7             true  avgt       1747972.941          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               7            false  avgt         53239.731          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               8             true  avgt             7.058          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               8            false  avgt            26.764          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               9             true  avgt            66.685          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               9            false  avgt            64.765          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              10             true  avgt           182.115          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              10            false  avgt           368.387          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              11             true  avgt             0.127          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              11            false  avgt           627.260          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              12             true  avgt            55.279          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              12            false  avgt          1252.378          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              13             true  avgt             9.883          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              13            false  avgt            11.819          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               0             true  avgt            93.399          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               0            false  avgt            96.902          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               1             true  avgt           117.434          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               1            false  avgt           120.368          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               2             true  avgt             0.209          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               2            false  avgt             0.200          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               3             true  avgt            38.898          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               3            false  avgt            65.252          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               4             true  avgt            60.167          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               4            false  avgt            40.918          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               5             true  avgt             0.333          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               5            false  avgt             0.307          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               6             true  avgt           135.865          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               6            false  avgt           141.484          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               7             true  avgt             0.787          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               7            false  avgt             1.008          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               8             true  avgt             0.650          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               8            false  avgt             0.622          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               9             true  avgt             0.631          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               9            false  avgt             0.591          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              10             true  avgt            26.474          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              10            false  avgt             0.338          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              11             true  avgt             1.355          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              11            false  avgt             3.517          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              12             true  avgt           229.369          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              12            false  avgt           273.905          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              13             true  avgt            20.924          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              13            false  avgt            56.281          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               0             true  avgt           188.558          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               0            false  avgt           195.808          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               1             true  avgt           715.610          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               1            false  avgt           753.536          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               2             true  avgt           227.427          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               2            false  avgt           223.696          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               3             true  avgt            72.579          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               3            false  avgt            84.650          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               4             true  avgt           109.461          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               4            false  avgt           111.188          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               5             true  avgt            59.189          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               5            false  avgt            58.413          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               6             true  avgt           510.156          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               6            false  avgt           859.354          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               7             true  avgt            79.356          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               7            false  avgt            57.309          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               8             true  avgt          1538.189          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               8            false  avgt           351.009          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               9             true  avgt           566.922          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               9            false  avgt           852.360          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              10             true  avgt         22902.157          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              10            false  avgt         22302.817          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              11             true  avgt           104.980          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              11            false  avgt           172.150          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              12             true  avgt           122.957          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              12            false  avgt           160.603          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              13             true  avgt          7120.200          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              13            false  avgt         34076.979          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               0             true  avgt            13.663          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               0            false  avgt            14.536          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               1             true  avgt            24.925          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               1            false  avgt            25.626          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               2             true  avgt             1.228          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               2            false  avgt             1.239          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               3             true  avgt            61.842          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               3            false  avgt            57.239          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               4             true  avgt            42.422          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               4            false  avgt            43.956          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               5             true  avgt             9.535          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               5            false  avgt             7.559          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               6             true  avgt            57.055          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               6            false  avgt            35.770          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               7             true  avgt            28.714          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               7            false  avgt            20.964          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               8             true  avgt            30.008          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               8            false  avgt            61.241          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               9             true  avgt        891273.515          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               9            false  avgt           113.453          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              10             true  avgt           108.078          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              10            false  avgt           129.732          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              11             true  avgt            31.434          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              11            false  avgt            28.704          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              12             true  avgt            95.121          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              12            false  avgt           107.912          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              13             true  avgt            27.557          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              13            false  avgt            34.434          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               0             true  avgt            17.198          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               0            false  avgt            15.743          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               1             true  avgt            16.528          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               1            false  avgt            15.806          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               2             true  avgt             0.598          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               2            false  avgt             0.530          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               3             true  avgt            97.751          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               3            false  avgt           132.681          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               4             true  avgt          8699.902          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               4            false  avgt             0.494          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               5             true  avgt             2.957          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               5            false  avgt             2.326          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               6             true  avgt            29.677          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               6            false  avgt            34.335          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               7             true  avgt         12524.537          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               7            false  avgt            29.066          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               8             true  avgt         54055.200          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               8            false  avgt             3.407          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               9             true  avgt             1.411          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               9            false  avgt             1.335          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              10             true  avgt            18.039          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              10            false  avgt           161.350          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              11             true  avgt            68.121          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              11            false  avgt           132.149          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              12             true  avgt            39.646          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              12            false  avgt            40.674          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              13             true  avgt           144.275          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              13            false  avgt           147.621          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               0             true  avgt             0.137          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               0            false  avgt             0.115          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               1             true  avgt             0.579          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               1            false  avgt             0.541          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               2             true  avgt           357.825          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               2            false  avgt          3685.709          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               3             true  avgt          3522.718          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               3            false  avgt             2.864          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               4             true  avgt            12.711          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               4            false  avgt             9.459          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               5             true  avgt             0.159          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               5            false  avgt             0.130          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               6             true  avgt           530.070          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               6            false  avgt             1.072          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               7             true  avgt             8.840          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               7            false  avgt             5.006          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               8             true  avgt            12.910          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               8            false  avgt             9.465          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               9             true  avgt             5.725          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               9            false  avgt             5.630          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              10            false  avgt          7553.770          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              11             true  avgt            18.799          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              11            false  avgt            59.018          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              12             true  avgt           318.722          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              12            false  avgt             2.398          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              13             true  avgt             0.243          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              13            false  avgt             0.258          ms/op

Quite a few regressions now, but all tests are passing at least.

@hmottestad
Copy link
Copy Markdown
Contributor Author

And another update for the memory store


Benchmark                              (themeName)  (x_queryIndex)  (z_useSparqlUo)  Mode  Cnt      Score   Error  Units
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               0             true  avgt          22.687          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               0            false  avgt          23.772          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               1             true  avgt          69.313          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               1            false  avgt          70.981          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               2             true  avgt          15.408          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               2            false  avgt          15.488          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               3             true  avgt          44.577          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               3            false  avgt          50.329          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               4             true  avgt          49.476          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               4            false  avgt          38.291          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               5             true  avgt          35.427          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               5            false  avgt          23.508          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               6             true  avgt          19.048          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               6            false  avgt          20.690          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               7             true  avgt          15.609          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               7            false  avgt          13.546          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               8             true  avgt          36.380          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               8            false  avgt          21.780          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               9             true  avgt         106.586          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               9            false  avgt         108.372          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              10             true  avgt          32.304          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              10            false  avgt          51.920          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              11             true  avgt          61.316          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              11            false  avgt         134.774          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              12             true  avgt          28.637          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              12            false  avgt          37.387          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              13             true  avgt          40.003          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              13            false  avgt          63.629          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               0             true  avgt           0.059          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               0            false  avgt           0.037          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               1             true  avgt           3.891          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               1            false  avgt           1.882          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               2             true  avgt           0.059          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               2            false  avgt           0.037          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               3             true  avgt           0.060          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               3            false  avgt           0.042          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               4             true  avgt           0.076          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               4            false  avgt           0.045          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               5             true  avgt         308.667          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               5            false  avgt         532.830          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               6             true  avgt           0.081          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               6            false  avgt           0.051          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               7             true  avgt           1.755          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               7            false  avgt           1.903          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               8             true  avgt         254.425          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               8            false  avgt         246.188          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               9             true  avgt           3.533          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               9            false  avgt           1.855          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              10             true  avgt           1.850          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              10            false  avgt           1.062          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              11             true  avgt       17902.467          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              11            false  avgt       17870.045          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              12             true  avgt          41.161          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              12            false  avgt          40.527          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              13             true  avgt         285.575          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              13            false  avgt         916.550          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               0             true  avgt         311.163          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               0            false  avgt         306.241          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               1             true  avgt         157.363          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               1            false  avgt         155.333          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               2             true  avgt          10.410          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               2            false  avgt           9.149          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               3             true  avgt          25.816          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               3            false  avgt          29.113          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               4             true  avgt         109.538          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               4            false  avgt          52.092          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               5             true  avgt           5.157          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               5            false  avgt           4.823          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               6             true  avgt       13312.910          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               6            false  avgt       15298.095          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               7             true  avgt       52965.042          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               7            false  avgt       26466.441          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               8             true  avgt          24.816          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               8            false  avgt          25.798          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               9             true  avgt          67.560          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               9            false  avgt          66.571          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              10             true  avgt         352.750          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              10            false  avgt         359.025          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              11             true  avgt         391.294          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              11            false  avgt         634.153          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              12             true  avgt         700.557          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              12            false  avgt        1279.864          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              13             true  avgt          12.275          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              13            false  avgt          11.326          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               0             true  avgt          96.095          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               0            false  avgt          95.043          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               1             true  avgt         136.684          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               1            false  avgt         135.832          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               2             true  avgt           0.216          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               2            false  avgt           0.201          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               3             true  avgt          37.720          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               3            false  avgt          70.375          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               4             true  avgt          68.873          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               4            false  avgt          46.764          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               5             true  avgt           0.328          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               5            false  avgt           0.305          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               6             true  avgt         158.937          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               6            false  avgt         161.626          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               7             true  avgt           0.679          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               7            false  avgt           1.002          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               8             true  avgt           0.644          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               8            false  avgt           0.618          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               9             true  avgt           0.546          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               9            false  avgt           0.588          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              10             true  avgt           0.366          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              10            false  avgt           0.327          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              11             true  avgt           1.556          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              11            false  avgt           3.032          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              12             true  avgt         279.525          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              12            false  avgt         272.983          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              13             true  avgt          21.101          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              13            false  avgt          56.152          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               0             true  avgt         208.638          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               0            false  avgt         203.424          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               1             true  avgt         736.770          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               1            false  avgt         752.229          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               2             true  avgt         220.574          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               2            false  avgt         230.406          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               3             true  avgt          67.360          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               3            false  avgt          85.549          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               4             true  avgt         119.049          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               4            false  avgt         116.681          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               5             true  avgt          58.778          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               5            false  avgt          58.206          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               6             true  avgt         688.553          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               6            false  avgt         895.844          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               7             true  avgt         103.183          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               7            false  avgt          55.082          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               8             true  avgt         337.895          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               8            false  avgt         347.294          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               9             true  avgt         726.785          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               9            false  avgt         920.578          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              10             true  avgt       22480.351          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              10            false  avgt       22305.631          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              11             true  avgt         124.264          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              11            false  avgt         174.735          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              12             true  avgt         157.619          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              12            false  avgt         159.851          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              13             true  avgt        7279.796          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              13            false  avgt       34611.661          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               0             true  avgt          13.361          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               0            false  avgt          13.907          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               1             true  avgt          25.913          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               1            false  avgt          25.812          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               2             true  avgt           1.209          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               2            false  avgt           1.226          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               3             true  avgt          59.543          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               3            false  avgt          55.735          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               4             true  avgt          45.019          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               4            false  avgt          46.335          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               5             true  avgt           9.501          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               5            false  avgt           7.544          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               6             true  avgt          43.335          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               6            false  avgt          37.184          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               7             true  avgt          25.961          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               7            false  avgt          21.996          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               8             true  avgt          43.241          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               8            false  avgt          61.591          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               9             true  avgt         110.969          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               9            false  avgt         110.055          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              10             true  avgt         124.811          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              10            false  avgt         124.745          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              11             true  avgt          29.733          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              11            false  avgt          31.160          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              12             true  avgt          88.978          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              12            false  avgt         107.696          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              13             true  avgt          30.277          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              13            false  avgt          36.375          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               0             true  avgt          17.538          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               0            false  avgt          18.441          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               1             true  avgt          16.381          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               1            false  avgt          15.984          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               2             true  avgt           0.549          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               2            false  avgt           0.578          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               3             true  avgt         106.342          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               3            false  avgt         153.662          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               4             true  avgt           3.980          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               4            false  avgt           0.502          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               5             true  avgt           2.901          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               5            false  avgt           2.295          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               6             true  avgt          38.730          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               6            false  avgt          40.632          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               7             true  avgt          32.824          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               7            false  avgt          30.407          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               8             true  avgt          15.506          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               8            false  avgt           3.365          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               9             true  avgt           1.480          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               9            false  avgt           1.337          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              10             true  avgt         123.532          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              10            false  avgt         153.108          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              11             true  avgt         117.224          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              11            false  avgt         131.843          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              12             true  avgt          38.439          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              12            false  avgt          39.931          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              13             true  avgt         127.537          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              13            false  avgt         146.198          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               0             true  avgt           0.123          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               0            false  avgt           0.113          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               1             true  avgt           0.488          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               1            false  avgt           0.560          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               2             true  avgt           9.637          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               2            false  avgt        3715.401          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               3             true  avgt           2.749          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               3            false  avgt           3.115          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               4             true  avgt           9.031          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               4            false  avgt          10.369          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               5             true  avgt           0.159          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               5            false  avgt           0.128          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               6             true  avgt           1.706          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               6            false  avgt           1.074          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               7             true  avgt           4.958          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               7            false  avgt           5.000          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               8             true  avgt          11.416          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               8            false  avgt           9.634          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               9             true  avgt           5.893          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               9            false  avgt           5.433          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              10            false  avgt        7454.922          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              11             true  avgt         399.788          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              11            false  avgt          58.509          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              12             true  avgt           0.712          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              12            false  avgt           1.630          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              13             true  avgt           0.241          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              13            false  avgt           0.283          ms/op

@hmottestad
Copy link
Copy Markdown
Contributor Author


Benchmark                              (themeName)  (x_queryIndex)  (z_useSparqlUo)  Mode  Cnt      Score   Error  Units
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               0             true  avgt          22.025          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               0            false  avgt          23.742          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               1             true  avgt          66.383          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               1            false  avgt          68.374          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               2             true  avgt          16.408          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               2            false  avgt          16.649          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               3             true  avgt          47.584          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               3            false  avgt          48.528          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               4             true  avgt          38.660          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               4            false  avgt          40.254          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               5             true  avgt          36.726          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               5            false  avgt          22.889          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               6             true  avgt          21.120          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               6            false  avgt          19.728          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               7             true  avgt          12.719          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               7            false  avgt          12.899          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               8             true  avgt          24.314          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               8            false  avgt          21.727          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               9             true  avgt         102.074          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               9            false  avgt         109.307          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              10             true  avgt          34.884          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              10            false  avgt          51.531          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              11             true  avgt          61.803          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              11            false  avgt         133.663          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              12             true  avgt          28.298          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              12            false  avgt          39.313          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              13             true  avgt          33.991          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              13            false  avgt          65.163          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               0             true  avgt           0.054          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               0            false  avgt           0.036          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               1             true  avgt           2.123          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               1            false  avgt           1.794          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               2             true  avgt           0.065          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               2            false  avgt           0.044          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               3             true  avgt           0.059          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               3            false  avgt           0.046          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               4             true  avgt           0.077          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               4            false  avgt           0.045          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               5             true  avgt         319.141          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               5            false  avgt         584.023          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               6             true  avgt           0.067          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               6            false  avgt           0.056          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               7             true  avgt           2.054          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               7            false  avgt           2.119          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               8             true  avgt         240.534          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               8            false  avgt         241.578          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               9             true  avgt           3.898          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               9            false  avgt           1.863          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              10             true  avgt           0.578          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              10            false  avgt           1.022          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              11             true  avgt       17789.146          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              11            false  avgt       17801.780          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              12             true  avgt          38.926          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              12            false  avgt          35.169          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              13             true  avgt         275.071          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              13            false  avgt         928.360          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               0             true  avgt         318.233          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               0            false  avgt         318.522          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               1             true  avgt         156.379          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               1            false  avgt         153.409          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               2             true  avgt           8.661          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               2            false  avgt           9.185          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               3             true  avgt          27.364          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               3            false  avgt          25.684          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               4             true  avgt          54.859          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               4            false  avgt          53.733          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               5             true  avgt           4.642          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               5            false  avgt           4.896          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               6             true  avgt       14350.453          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               6            false  avgt       18289.833          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               7             true  avgt       32197.657          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               7            false  avgt       29862.100          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               8             true  avgt          23.838          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               8            false  avgt          26.827          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               9             true  avgt          65.976          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               9            false  avgt          67.430          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              10             true  avgt         347.784          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              10            false  avgt         365.773          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              11             true  avgt         388.328          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              11            false  avgt         635.993          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              12             true  avgt         713.541          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              12            false  avgt        1300.433          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              13             true  avgt           9.884          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              13            false  avgt          11.941          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               0             true  avgt          93.664          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               0            false  avgt          92.989          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               1             true  avgt         132.811          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               1            false  avgt         142.430          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               2             true  avgt           0.206          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               2            false  avgt           0.203          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               3             true  avgt          38.187          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               3            false  avgt          69.956          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               4             true  avgt          44.929          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               4            false  avgt          41.662          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               5             true  avgt           0.319          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               5            false  avgt           0.307          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               6             true  avgt         163.609          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               6            false  avgt         147.235          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               7             true  avgt           0.691          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               7            false  avgt           1.014          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               8             true  avgt           0.657          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               8            false  avgt           0.623          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               9             true  avgt           0.561          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               9            false  avgt           0.583          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              10             true  avgt           0.374          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              10            false  avgt           0.327          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              11             true  avgt           1.711          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              11            false  avgt           3.798          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              12             true  avgt         280.203          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              12            false  avgt         269.363          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              13             true  avgt          21.137          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              13            false  avgt          56.815          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               0             true  avgt         205.272          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               0            false  avgt         204.560          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               1             true  avgt         759.477          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               1            false  avgt         748.975          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               2             true  avgt         227.712          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               2            false  avgt         218.800          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               3             true  avgt          69.958          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               3            false  avgt          82.828          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               4             true  avgt         119.693          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               4            false  avgt         131.278          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               5             true  avgt          59.380          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               5            false  avgt          62.773          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               6             true  avgt         670.946          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               6            false  avgt         870.334          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               7             true  avgt          57.233          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               7            false  avgt          56.879          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               8             true  avgt         356.234          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               8            false  avgt         347.304          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               9             true  avgt         710.699          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               9            false  avgt         861.725          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              10             true  avgt       23132.691          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              10            false  avgt       22838.946          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              11             true  avgt         129.361          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              11            false  avgt         178.177          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              12             true  avgt         163.586          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              12            false  avgt         160.115          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              13             true  avgt        7378.516          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              13            false  avgt       35165.281          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               0             true  avgt          13.387          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               0            false  avgt          13.770          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               1             true  avgt          26.767          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               1            false  avgt          24.739          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               2             true  avgt           1.292          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               2            false  avgt           1.210          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               3             true  avgt          56.657          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               3            false  avgt          56.394          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               4             true  avgt          44.599          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               4            false  avgt          43.978          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               5             true  avgt           8.170          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               5            false  avgt           7.600          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               6             true  avgt          42.949          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               6            false  avgt          38.104          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               7             true  avgt          23.759          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               7            false  avgt          23.271          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               8             true  avgt          43.674          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               8            false  avgt          62.252          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               9             true  avgt         110.092          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               9            false  avgt         107.826          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              10             true  avgt         138.372          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              10            false  avgt         127.595          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              11             true  avgt          29.762          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              11            false  avgt          33.232          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              12             true  avgt          91.373          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              12            false  avgt         108.401          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              13             true  avgt          33.927          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              13            false  avgt          37.652          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               0             true  avgt          18.258          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               0            false  avgt          18.857          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               1             true  avgt          16.037          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               1            false  avgt          15.840          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               2             true  avgt           0.590          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               2            false  avgt           0.557          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               3             true  avgt         106.136          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               3            false  avgt         156.161          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               4             true  avgt           0.542          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               4            false  avgt           0.509          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               5             true  avgt           2.773          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               5            false  avgt           3.419          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               6             true  avgt          43.400          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               6            false  avgt          35.712          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               7             true  avgt          32.363          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               7            false  avgt          29.012          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               8             true  avgt           2.821          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               8            false  avgt           3.024          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               9             true  avgt           1.478          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               9            false  avgt           1.222          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              10             true  avgt         120.073          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              10            false  avgt         154.729          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              11             true  avgt         124.878          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              11            false  avgt         133.815          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              12             true  avgt          40.748          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              12            false  avgt          40.975          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              13             true  avgt         129.643          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              13            false  avgt         148.822          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               0             true  avgt           0.151          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               0            false  avgt           0.116          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               1             true  avgt           0.495          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               1            false  avgt           0.538          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               2             true  avgt           8.481          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               2            false  avgt        3659.400          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               3             true  avgt           2.712          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               3            false  avgt           3.124          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               4             true  avgt           9.174          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               4            false  avgt           9.628          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               5             true  avgt           0.172          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               5            false  avgt           0.138          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               6             true  avgt           0.986          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               6            false  avgt           1.059          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               7             true  avgt           5.017          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               7            false  avgt           5.473          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               8             true  avgt          11.472          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               8            false  avgt           9.593          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               9             true  avgt           5.049          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               9            false  avgt           5.789          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              10             true  avgt        5669.485          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              10            false  avgt        6808.880          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              11             true  avgt          38.365          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              11            false  avgt          57.221          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              12             true  avgt           0.728          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              12            false  avgt           2.074          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              13             true  avgt           0.228          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              13            false  avgt           0.257          ms/op

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants