1. Comparison of quality of query system
|
S. no. |
Search engines |
Flexibility of query |
Available field selections |
Query refinement |
Other aspects of query system |
Total score |
|||||
|
Total score |
Score in % |
Total score |
Score in % |
Total score |
Score in % |
Total score |
Score in % |
Total score |
Score in % |
||
|
|
Maximum score |
25.5 |
|
33 |
|
21.5 |
|
12 |
|
92 |
|
|
1 |
askMEDLINE |
7.5 |
29.4 |
12.1 |
36.7 |
0.0 |
0.0 |
3.5 |
29.2 |
23.1 |
25.1 |
|
2 |
PubMed |
18.6 |
72.9 |
25.9 |
78.5 |
12.0 |
55.8 |
8.0 |
66.7 |
64.5 |
70.1 |
|
3 |
PubMed Assistant |
18.6 |
72.9 |
22.6 |
68.5 |
1.0 |
4.7 |
7.2 |
60.0 |
49.4 |
53.7 |
|
4 |
PubMed Interact |
13.2 |
51.8 |
20.2 |
61.2 |
0.0 |
0.0 |
6.5 |
54.2 |
39.9 |
43.4 |
|
5 |
Brij.in |
9.0 |
35.3 |
5.0 |
15.2 |
0.4 |
1.9 |
1.6 |
13.3 |
16.0 |
17.4 |
|
6 |
Google Scholar |
8.0 |
31.4 |
10.0 |
30.3 |
0.0 |
0.0 |
3.0 |
25.0 |
21.0 |
22.8 |
|
7 |
HighWire Press |
10.8 |
42.4 |
14.3 |
43.3 |
6.8 |
31.6 |
3.0 |
25.0 |
34.9 |
37.9 |
|
8 |
PubMed Central |
18.4 |
72.2 |
23.7 |
71.8 |
12.0 |
55.8 |
7.2 |
60.0 |
61.3 |
66.6 |
|
9 |
Scirus |
20.3 |
79.6 |
12.5 |
37.9 |
0.5 |
2.3 |
3.8 |
31.7 |
37.1 |
40.3 |
|
10 |
BioAsk |
13.0 |
51.0 |
8.5 |
25.8 |
7.0 |
32.6 |
7.0 |
58.3 |
35.5 |
38.6 |
|
11 |
BioIE |
19.1 |
74.9 |
17.3 |
52.4 |
2.0 |
9.3 |
5.5 |
45.8 |
43.9 |
47.7 |
|
12 |
CiteXplore |
12.5 |
49.0 |
14.3 |
43.3 |
3.7 |
17.2 |
5.0 |
41.7 |
35.5 |
38.6 |
|
13 |
ClusterMed |
17.6 |
69.0 |
16.9 |
51.2 |
4.5 |
20.9 |
5.1 |
42.5 |
44.1 |
47.9 |
|
14 |
EBIMed |
14.3 |
56.1 |
12.1 |
36.7 |
4.7 |
21.9 |
3.0 |
25.0 |
34.1 |
37.1 |
|
15 |
GoPubMed |
15.1 |
59.2 |
17.9 |
54.2 |
5.0 |
23.3 |
7.5 |
62.5 |
45.5 |
49.5 |
|
16 |
HubMed |
17.6 |
69.0 |
18.5 |
56.1 |
0.5 |
2.3 |
8.0 |
66.7 |
44.6 |
48.5 |
|
17 |
Scopus |
22.9 |
89.8 |
16.1 |
48.8 |
17.5 |
81.4 |
9.0 |
75.0 |
65.5 |
71.2 |
|
18 |
XplorMed |
18.2 |
71.4 |
18.1 |
54.8 |
6.7 |
31.2 |
4.5 |
37.5 |
47.5 |
51.6 |
NOTE: The scores of the top three tools in every parameter considered are highlighted in bold letters.
Please refer to http://resource.ibab.ac.in/resource/LITsearch2/ for details on the scoring system used.
2. Comparison of output quality
|
S. no. |
Search engines |
Primary output quality |
Bio-entities |
Statistical features |
Sorting efficiency |
Visualization features |
Other aspects |
Total output score |
Corrective measure |
Total corrected output score |
|||||||
|
Total score |
Score in % |
Total score |
Score in % |
Total score |
Score in % |
Total score |
Score in % |
Total score |
Score in % |
Total score |
Score in % |
Total score |
Score in % |
||||
|
|
Maximum score |
16 |
|
18 |
|
6 |
|
12 |
|
5 |
|
5 |
|
62 |
18.75 |
80.75 |
|
|
1 |
askMEDLINE |
3.2 |
20.0 |
0.0 |
0.0 |
0.0 |
0.0 |
1.0 |
8.3 |
0.0 |
0.0 |
0.6 |
12.0 |
4.8 |
2.5 |
7.3 |
9.0 |
|
2 |
PubMed |
10.9 |
68.1 |
1.5 |
8.3 |
0.0 |
0.0 |
5.1 |
42.5 |
0.0 |
0.0 |
3.4 |
68.0 |
20.9 |
5.0 |
25.9 |
32.1 |
|
3 |
PubMed Assistant |
6.4 |
40.0 |
0.5 |
2.8 |
0.0 |
0.0 |
5.9 |
49.2 |
0.0 |
0.0 |
1.2 |
24.0 |
14.0 |
2.0 |
16.0 |
19.8 |
|
4 |
PubMed Interact |
6.9 |
43.1 |
0.1 |
0.6 |
0.0 |
0.0 |
1.9 |
15.8 |
0.0 |
0.0 |
0.2 |
4.0 |
9.1 |
5.0 |
14.1 |
17.5 |
|
5 |
Brij.in |
6.2 |
38.4 |
0.0 |
0.0 |
0.0 |
0.0 |
0.1 |
0.8 |
0.0 |
0.0 |
0.0 |
0.0 |
6.3 |
0.5 |
6.8 |
8.4 |
|
6 |
Google Scholar |
7.2 |
45.0 |
0.0 |
0.0 |
0.1 |
1.7 |
1.5 |
12.5 |
0.0 |
0.0 |
0.4 |
8.0 |
9.2 |
3.0 |
12.2 |
15.1 |
|
7 |
HighWire Press |
11.3 |
70.6 |
0.0 |
0.0 |
0.0 |
0.0 |
3.9 |
32.5 |
4.2 |
84.0 |
2.2 |
44.0 |
21.6 |
18.8 |
40.4 |
50.0 |
|
8 |
PubMed Central |
5.1 |
31.9 |
0.0 |
0.0 |
0.0 |
0.0 |
3.8 |
31.7 |
0.0 |
0.0 |
3.0 |
60.0 |
11.9 |
2.5 |
14.4 |
17.8 |
|
9 |
Scirus |
7.6 |
47.5 |
2.9 |
16.1 |
0.0 |
0.0 |
3.9 |
32.5 |
0.0 |
0.0 |
0.8 |
16.0 |
15.2 |
0.4 |
15.6 |
19.3 |
|
10 |
BioAsk |
2.7 |
16.9 |
12.8 |
71.1 |
3.0 |
50.0 |
4.7 |
39.2 |
2.0 |
40.0 |
1.0 |
20.0 |
26.2 |
3.8 |
30.0 |
37.1 |
|
11 |
BioIE |
5.6 |
35.0 |
2.1 |
11.7 |
0.0 |
0.0 |
1.5 |
12.5 |
0.0 |
0.0 |
0.0 |
0.0 |
9.2 |
0.0 |
9.2 |
11.4 |
|
12 |
CiteXplore |
5.4 |
33.8 |
2.4 |
13.3 |
0.0 |
0.0 |
2.9 |
24.2 |
0.0 |
0.0 |
1.0 |
20.0 |
11.7 |
12.5 |
24.2 |
30.0 |
|
13 |
ClusterMed |
6.5 |
40.6 |
5.8 |
32.2 |
2.0 |
33.3 |
2.9 |
24.2 |
0.0 |
0.0 |
0.3 |
6.0 |
17.5 |
1.0 |
18.5 |
22.9 |
|
14 |
EBIMed |
8.5 |
53.1 |
11.5 |
63.9 |
0.0 |
0.0 |
1.0 |
8.3 |
1.9 |
38.0 |
0.0 |
0.0 |
22.9 |
1.3 |
24.2 |
29.9 |
|
15 |
GoPubMed |
11.2 |
70.0 |
15.2 |
84.4 |
6.0 |
100.0 |
1.5 |
12.5 |
3.0 |
60.0 |
0.2 |
4.0 |
37.1 |
5.0 |
42.1 |
52.1 |
|
16 |
HubMed |
7.7 |
48.1 |
1.0 |
5.6 |
0.0 |
0.0 |
1.9 |
15.8 |
1.0 |
20.0 |
2.0 |
40.0 |
13.6 |
5.0 |
18.6 |
23.0 |
|
17 |
Scopus |
6.9 |
43.1 |
5.3 |
29.4 |
4.8 |
80.0 |
8.0 |
66.7 |
2.5 |
50.0 |
5.0 |
100.0 |
32.5 |
6.3 |
38.8 |
48.0 |
|
18 |
XplorMed |
0.9 |
5.9 |
1.6 |
8.9 |
0.0 |
0.0 |
0.0 |
0.0 |
0.2 |
4.0 |
0.2 |
4.0 |
3.0 |
1.0 |
4.0 |
4.9 |
NOTE: The output quality can be meaningless without reasonable speed, recall and precision. Hence, penalties were given to the tools when they performed badly in the above mentioned parameters. Different weightage was determined for each of these three aspects and a corrective measure was added. The scores of the top three tools in every parameter considered are highlighted in bold letters.
Please refer to http://resource.ibab.ac.in/resource/LITsearch2/ for details on the scoring system used.
3. Comparison of coverage efficiency
|
S. no. |
Search engines |
Breadth / coverage of journal sources |
Clinical trials covered |
Breadth / coverage of other web sources |
Patents covered |
Data update |
Sub-total |
Additional scores following analysis of exclusive contributions# |
TOTAL SCORE |
Score in % |
|
|
Maximum score |
10 |
1 |
2 |
1 |
2 |
16 |
5 |
21 |
|
|
1 |
askMEDLINE |
8 |
1 |
0 |
0 |
2 |
11 |
0.0 |
11 |
50.0 |
|
2 |
PubMed |
8 |
1 |
0 |
0 |
2 |
11 |
0.0 |
11 |
50.0 |
|
3 |
PubMed Assistant |
8 |
1 |
0 |
0 |
2 |
11 |
0.0 |
11 |
50.0 |
|
4 |
PubMed Interact |
8 |
1 |
0 |
0 |
2 |
11 |
0.0 |
11 |
50.0 |
|
5 |
Brij.in |
4.8 |
1 |
1 |
1 |
1 |
8.8 |
0.0 |
8.8 |
40.0 |
|
6 |
Google Scholar |
9 |
0 |
1 |
1 |
1 |
12 |
5.0 |
17 |
77.3 |
|
7 |
HighWire Press |
8.5 |
0 |
0 |
0 |
1 |
9.5 |
-5.0 |
4.5 |
20.5 |
|
8 |
PubMed Central* |
2.4 |
0.2 |
0 |
0 |
2 |
4.6 |
0.0 |
4.6 |
20.9 |
|
9 |
Scirus |
9 |
0 |
2 |
1 |
0.5 |
12.5 |
0.0 |
12.5 |
56.8 |
|
10 |
BioAsk |
8 |
1 |
0 |
1 |
2 |
12 |
0.0 |
12 |
54.5 |
|
11 |
BioIE |
8 |
1 |
0 |
0 |
2 |
11 |
0.0 |
11 |
50.0 |
|
12 |
CiteXplore |
8 |
1 |
0.5 |
1 |
2 |
12.5 |
0.0 |
12.5 |
56.8 |
|
13 |
ClusterMed |
8 |
1 |
0 |
0 |
2 |
11 |
0.0 |
11 |
50.0 |
|
14 |
EBIMed |
8 |
1 |
0 |
0 |
2 |
11 |
0.0 |
11 |
50.0 |
|
15 |
GoPubMed |
8 |
1 |
0.5 |
0 |
2 |
11.5 |
0.0 |
11.5 |
52.3 |
|
16 |
HubMed |
8 |
1 |
0 |
0 |
2 |
11 |
0.0 |
11 |
50.0 |
|
17 |
Scopus |
10 |
0 |
2 |
1 |
2 |
15 |
1.0 |
16 |
72.7 |
|
18 |
XplorMed |
8 |
1 |
0 |
0 |
2 |
11 |
0.0 |
11 |
50.0 |
* The
coverage of PubMed Central has been enhanced as consequence of the mandatory NIH Public Access Policy that went
into effect on 7 April 2008. It is also the repository for all final peer-reviewed manuscripts arising from research using NIH funds.
The scores of the top three tools are highlighted in bold letters.
* An analysis of the exclusive citations was performed. During the analysis, we counted the number of exclusively relevant citations contributed by each tool, which could not be retrieved by any other tool even after an independent search for those specific articles (see Supplementary notes 7, Table 6). One-fifth of the actual count was added to the previously assigned scores.
Please refer to http://resource.ibab.ac.in/resource/LITsearch2/ for details on the scoring system used.
4. Comparison of miscellaneous features
|
S. no. |
Search engines |
Temporary storage |
Long term storage |
Organizing, tagging and annotation possible |
Saving/export/import/ downloading possible |
TOTAL |
Score in % |
|
|
Maximum score |
2 |
3 |
2 |
2 |
9 |
|
|
1 |
askMEDLINE |
0 |
0 |
0 |
0 |
0 |
0.0 |
|
2 |
PubMed |
2 |
3 |
1.9 |
2 |
8.9 |
98.9 |
|
3 |
PubMed Assistant |
0.2 |
0.5 |
0 |
0.6 |
1.3 |
14.4 |
|
4 |
PubMed Interact |
0 |
0 |
0 |
0 |
0 |
0.0 |
|
5 |
Brij.in |
0 |
0 |
0 |
0 |
0 |
0.0 |
|
6 |
Google Scholar |
0 |
0 |
0 |
0.8 |
0.8 |
8.9 |
|
7 |
HighWire Press |
0.5 |
0 |
0 |
0.8 |
1.3 |
14.4 |
|
8 |
PubMed Central |
2 |
3 |
1.9 |
1.9 |
8.8 |
97.8 |
|
9 |
Scirus |
0 |
1 |
0 |
1.5 |
2.5 |
27.8 |
|
10 |
BioAsk |
2 |
3 |
2 |
1.6 |
8.6 |
95.6 |
|
11 |
BioIE |
0 |
0 |
0 |
0 |
0 |
0.0 |
|
12 |
CiteXplore |
1 |
0 |
0 |
0.9 |
1.9 |
21.1 |
|
13 |
ClusterMed |
0 |
0 |
0 |
1.9 |
1.9 |
21.1 |
|
14 |
EBIMed |
0 |
0 |
0 |
0 |
0 |
0.0 |
|
15 |
GoPubMed |
1 |
2.5 |
0 |
0.9 |
4.4 |
48.9 |
|
16 |
HubMed |
1.8 |
2.5 |
1.9 |
0.8 |
7 |
77.8 |
|
17 |
Scopus |
2 |
3 |
2 |
2 |
9 |
100.0 |
|
18 |
XplorMed |
0.5 |
0 |
0 |
0 |
0.5 |
5.6 |
NOTE: The scores of the top three tools are highlighted in bold letters.
Please refer to http://resource.ibab.ac.in/resource/LITsearch2/ for details on the scoring system used.