(English only)
School of Computer and Communication Sciences
Laboratory for Computational Biology and Bioinformatics
EPFL >  I&C School > LCBB > Conference Impact


LCBB
People
Publications
Presentations
Activities
Conference Calendar
Software
Facilities
Collaborators
Sponsors
Links
 
Internal Use
Laboratory for Computational Biology and Bioinformatics


Conference Impact



While there is no doubt that the two best known conferences in the area are RECOMB, the Annual International Conference on Research in Computational Molecular Biology, and ISMB, the Symposium on Intelligent Systems for Molecular Biology, impact factors seem to tell a somewhat different story.

The table below lists 8 of the main annual conferences in the area, along with the year in which they first took place and their h-index and g-index (as of December 2007). The h-index of a conference is the largest number x of articles that have appeared in that conference and have been cited at least x times; the g-index is the largest number y of articles such that these y articles together have been cited at least y2 times (it increases the h-index to reflect heavily cited papers). Both are standard measures of the impact of research of individuals and equally valid for journals and conferences. (For a thorough discussion of, and tools to compute, these indices, see the Publish or Perish site.)


Conference1st Yearh-indexg-index
ECCB200257
APBC20031014
CSB20021016
BIBE20031320
RECOMB19971419
ISMB19931421
WABI20011830
PSB19963569



Note that, while various factors affect the accuracy of these searches, it is certain that all counts are too low and those for ISMB much too low, as discussed below under caveats.

The 8 conferences (my own idiosyncratic pick -- many other conferences have emerged in the last few years, but have not yet had a chance to establish a significant citation record) are:
  • ECCB: the European Conference on Computational Biology
  • APBC: the Asia-Pacific Bioinformatics Conference
  • CSB: the Conference on Computational Systems Bioinformatics
  • BIBE: the IEEE Symposium on Bioinformatics and Bioengineering
  • RECOMB: the Conference on Research in Computational Molecular Biology
  • ISMB: the Symposium on Intelligent Systems for Molecular Biology
  • WABI: the Workshop on Algorithms in Bioinformatics
  • PSB: the Pacific Symposium on Biocomputing


Some important caveats:
  • The results were obtained by searching Google Scholar with the query (for RECOMB)
    RECOMB OR "Computational Molecular Biology"
    then eliminating results from other publications (in this case, mostly Recomb. DNA Tech Bull).

    Strenuous efforts were made to compose queries that would capture as many of the references as possible without returning so many spurious hits as to make hand-filtering impossible; in all cases, a single (compound) query was used.

    However, conferences (RECOMB and ISMB in particular) are often poorly identified by authors in their citations (many omit the acronym, others mistype it, and those who use the full name of the conference all too often "approximate" it and use a bewildering range of abbreviations for the main words), so that many citations may not be captured by Google Scholar with the query used. (Assuming that Google Scholar does capture all relevant citations, the only thorough search would be one that searches for each article separately, but that would be a full research project in its own right ;-) The problem is compounded in the cases of ISMB and RECOMB by their having had a number of different mechanisms for publishing their proceedings, which has reduced their presence online. Finally, the problem is clearly worst for ISMB, as its proceedings have been published for the last 5 years in the journal Bioinformatics, and many citations to these papers make no reference whatsoever to the conference, treating the citation as a journal article. (Tracking these down would require looking for page numbers that identify supplementary material or querying every article separately.) Thus the values for ISMB, at least, are certainly much too low. (The same problem looms for ECCB, which has followed ISMB's model; in the case of ECCB, it is further complicated by the fact that, for the last 4 years, ISMB and ECCB have been held jointly on alternate years, in which case any references made to conference proceedings typically only bear the ISMB identification.)

  • The age of the conference plays an important role, since h- and g-indices are cumulative in terms of both having more papers published and having more time to collect citations. But some of these conferences, such as ISMB, started very small, with no published proceedings, whereas others have published in the same outlet (e.g., Springer LNCS/LNBI) since their beginning. So age should, like everything else in this table, be considered with caution.
  • Rates of citation are well known to vary enormously among fields (see Podlubny, I. (2005) Comparison of scientific impact expressed by the number of citations in different fields of science, Scientometrics 64(1):95-99). For instance, if Mathematics, which has the lowest rate, is taken as the basis, with a rating of 1, then Engineering (incl. Computer Science) has a rating of 5, Biology a rating of 8, Physics a rating of 19, and Biomedical Sciences a rating of 78---and these ratings are consistent across many years. Moreover, the size of the research community in the area obviously has a large influence on the number of citations: strong papers in the Life Sciences typically accumulate over 1,000 citations in just a few years, but only a few dozen papers with such citation counts exist in all of Computer Science and a majority of these are classic papers from 20 or more years ago. Thus conferences closer to Life Sciences applications (such as ISMB or PSB) may be expected to have significantly higher citation counts than conferences closer to Computer Science (such as RECOMB or WABI).
  • Most of these conferences feature small numbers of papers (typical numbers are in the 30-45 range), but some publish many more (e.g., BIBE). While the h- and g-indices factor out sheer volume, a larger assortment of published papers across a broad spectrum of topics does increase the probability that some will collect a good number of citations.
  • Finally, many conference papers eventually appear in extended form in a journal, in which case citations made to the work after the appearance of the journal version are often for the journal version, not for the conference version. Whether this phenomenon affects the citation rates of these various conferences more or less uniformly or in an uneven fashion is not clear, however. (As mentioned above, ISMB is a special case, since its proceedings have systematically appeared in the journal Bioinformatics since 2004.)