|
Laboratory for Computational Biology and Bioinformatics
Conference Impact
While there is no doubt that the two best known conferences in the
area are RECOMB, the Annual International Conference on Research in
Computational Molecular Biology, and ISMB, the Symposium on Intelligent
Systems for Molecular Biology, impact factors seem to tell a somewhat
different story.
The table below lists 8 of the main annual conferences in the area,
along with the year in which they first took place and their
h-index and g-index (as of December 2007).
The h-index of a conference
is the largest number x of articles that have appeared in that
conference and have been cited at least x times; the g-index is the
largest number y of articles such that these y articles together have
been cited at least y2 times (it increases the h-index to
reflect heavily cited papers). Both are standard measures of the
impact of research of individuals and equally valid for journals and
conferences. (For a thorough discussion of, and tools to compute,
these indices, see the Publish or
Perish site.)
| Conference | 1st Year | h-index | g-index |
| ECCB | 2002 | 5 | 7 |
| APBC | 2003 | 10 | 14 |
| CSB | 2002 | 10 | 16 |
| BIBE | 2003 | 13 | 20 |
| RECOMB | 1997 | 14 | 19 |
| ISMB | 1993 | 14 | 21 |
| WABI | 2001 | 18 | 30 |
| PSB | 1996 | 35 | 69 |
Note that, while various factors affect the accuracy of these searches,
it is certain that all counts are too low and those for
ISMB much too low, as discussed below under caveats.
The 8 conferences (my own idiosyncratic pick -- many other conferences
have emerged in the last few years, but have not yet had a chance to
establish a significant citation record) are:
-
ECCB: the European Conference on Computational Biology
-
APBC: the Asia-Pacific Bioinformatics Conference
-
CSB: the Conference on Computational Systems Bioinformatics
-
BIBE: the IEEE Symposium on Bioinformatics and Bioengineering
-
RECOMB: the Conference on Research in Computational Molecular Biology
-
ISMB: the Symposium on Intelligent Systems for Molecular Biology
-
WABI: the Workshop on Algorithms in Bioinformatics
-
PSB: the Pacific Symposium on Biocomputing
Some important caveats:
-
The results were obtained by searching Google Scholar with the
query (for RECOMB)
RECOMB OR "Computational Molecular Biology"
then eliminating results from other publications (in this
case, mostly Recomb. DNA Tech Bull).
Strenuous efforts were made to compose queries that would capture
as many of the references as possible without returning so many
spurious hits as to make hand-filtering impossible; in all cases,
a single (compound) query was used.
However, conferences (RECOMB and ISMB in particular) are often
poorly identified by authors in their citations (many omit the acronym,
others mistype it, and those who use the full name of the conference
all too often "approximate" it and use a bewildering range of
abbreviations for the main words), so that many citations may not be
captured by Google Scholar with the query used. (Assuming that Google
Scholar does capture all relevant citations, the only thorough search
would be one that searches for each article separately, but that
would be a full research project in its own right ;-)
The problem is compounded in the cases of ISMB and RECOMB by their
having had a number of different mechanisms for publishing their
proceedings, which has reduced their presence online.
Finally, the problem is clearly worst for ISMB, as its proceedings
have been published for the last 5 years in the journal Bioinformatics,
and many citations to these papers make no reference whatsoever to
the conference, treating the citation as a journal article.
(Tracking these down would require looking for page numbers
that identify supplementary material or querying every article
separately.) Thus the values for ISMB, at least, are certainly much
too low.
(The same problem looms for ECCB, which has followed ISMB's model;
in the case of ECCB, it is further complicated by the fact that,
for the last 4 years, ISMB and ECCB have been held jointly on alternate
years, in which case any references made to conference proceedings
typically only bear the ISMB identification.)
-
The age of the conference plays an important role, since h- and
g-indices are cumulative in terms of both having more papers published
and having more time to collect citations. But some of
these conferences, such as ISMB, started very small, with no published
proceedings, whereas others have published in the same outlet
(e.g., Springer LNCS/LNBI) since their beginning. So age should,
like everything else in this table, be considered with caution.
-
Rates of citation are well known to vary enormously among fields
(see Podlubny, I. (2005) Comparison of scientific impact expressed by
the number of citations in different fields of science, Scientometrics
64(1):95-99). For instance, if Mathematics, which has
the lowest rate, is taken as the basis, with a rating of 1, then
Engineering (incl. Computer Science) has a rating of 5, Biology
a rating of 8, Physics a rating of 19, and Biomedical Sciences
a rating of 78---and these ratings are consistent across many years.
Moreover, the size of the research community in the area obviously
has a large influence on the number of citations: strong papers
in the Life Sciences typically accumulate over 1,000 citations in
just a few years, but only a few dozen papers with such citation
counts exist in all of Computer Science and a majority of these
are classic papers from 20 or more years ago.
Thus conferences closer to Life Sciences applications (such as
ISMB or PSB) may be expected to have significantly higher citation
counts than conferences closer to Computer Science (such as RECOMB
or WABI).
-
Most of these conferences feature small numbers of papers (typical
numbers are in the 30-45 range), but some publish many more
(e.g., BIBE).
While the h- and g-indices factor out sheer volume, a larger
assortment of published papers across a broad spectrum of topics
does increase the probability that some will collect a good number
of citations.
-
Finally, many conference papers eventually appear in extended form
in a journal,
in which case citations made to the work after the appearance of
the journal version are often for the journal version, not for the
conference version. Whether this phenomenon affects the citation
rates of these various conferences more or less uniformly or in
an uneven fashion is not clear, however. (As mentioned above,
ISMB is a special case, since its proceedings have systematically
appeared in the journal Bioinformatics since 2004.)
|