Journal and Report Coverage in ERIC
| Some data on coverage |
After the initial load of new material in June/July 2005, there appears to be an emphasis on journal indexing for current indexing. In August they added 4525 items, only 240 were EDs. In September 3392 items went in, 73 EDs. I looked at how many items were being indexed per month before the changes, how many are being indexed now and what that might mean for how long to fill the gap. In addition to the obvious problems with such a rough model, there is the fact that the new system generated a huge initial output that they have not come close to matching since. So very roughly it appears that it will take somewhere between a year and a half and three years to catch up with the number of citations that would have been expected under the prior system. Several people are bringing journal coverage gaps to my attention. The clearinghouses officially closed in December 2003 and the contract with the new ERIC provider assumes that they indexed through the end of that year. (It specifies that the new contractor will index beginning with 2004 publications.) But in fact there are issues of some important journals from 2003, and even 2002 that are not in the database. I checked 10 highly rated education journals and found only two had complete indexing for 2002 and 2003. For most, coverage is missing for several issues. |
|
List of journals covered |
On June
25, 2005, the list
of journals indexed in ERIC became available online. It includes
all journals from the earlier version of ERIC and so is not a list of
currently indexed titles. Those are indicated by a The contractor has repeatedly assured ERIC users that coverage will exceed prior ERIC coverage levels. There will be some efforts to label items as an indicator of quality (e.g. peer review status) but practitioner oriented materials and other non-research items will not be totally eliminated from the database |
|
Report
Submission
|
In april 2004, the Open Online Submission System became available in Beta version. At the ERIC Users Group meeting in June 2005 the contractor indicated that many papers had been submitted, but none had yet been made available. |
| Selecting journals for coverage | Content Experts and Curators work together to decide what will be covered. Only journals which can/will provide an electronic feed of information are being included at this time. |
|
What
does the contract say?
|
|
| The job of picking materials to index | (p. 11) The contractor shall provide skilled staff to meet contract requirements, including a project director, technical experts, and curators with expertise in closing the achievement gap, educational practices that improve academic achievement and promote learning, research methodology, and the 16 ERIC topics. |
| (p. 4) The content experts shall provide recommendations to help the contractor's curators ensure that the database reflects a high level of expertise in each of the 16 ERIC topics as well as other content areas required by the authorizing legislation. | |
| Screening of selections | (p. 10) contractor shall propose (a) journals to be included in the ERIC database, including journal titles, publishers, and brief descriptions and rationales for inclusion, consistent with approved standards and criteria, and (b) sources of non-journal materials, including brief descriptions and rationales for inclusion, to be included in the database, consistent with approved standards and criteria. |
| Note that official approval is required for standards for inclusion,but not for specific titles/sources of materials. |
(p. 8) COR approval of the contractor's proposed standards and criteria and specified types of non-journal materials is required prior to implementation.... Screening criteria for conference papers. ..., the contractor, after fully considering Steering Committee, COR, and public recommendations, shall provide draft screening criteria for conference papers .... COR approval of the contractor's proposed screening criteria is required prior to implementation. (COR is the contract officer at the Department of Education) |
|
Background
information
|
|
| Content Experts | The
Content Experts are an oversight group suggesting sources of content to
the Curators. The Department of Education has posted excellent information
about the role of the Content Experts and brief biographies at http://www.eric.ed.gov/ERICWebPortal/resources/ html/about/about_eric_experts.html |
|
Research Triangle Institute (RTI) subcontractor for curator work The contractor shall provide skilled staff to meet contract requirements, including a project director, technical experts, and curators with expertise in closing the achievement gap, educational practices that improve academic achievement and promote learning, research methodology, and the 16 ERIC topics. (Contract p. 11) The curators role was clarified at the ERIC Users Group meeting in Boston in January 2005. They are the folks who are actually selecting items to be indexed. The actual indexing is being done by CSC employees. |
RTI,
short for the Research Triangle Institute International, is based at the
Research Triangle Park in North Carolina. It was founded by Duke University,
North Carolina State University, and the University of North Carolina
at Chapel Hill in 1958. The institute now has over 2300 employees in 30
countries. They are involved in both government and privately sponsored
research. According to their web site, they are "dedicated to improving
the human condition through cutting-edge study and analysis in health,
environmental protection, education and training, economic and social
development, and advanced technology" (http://www.rti.org/page.cfm?objectid=E4550DC8-C1E5-4A9D-A4EFB3CF60379343).
The company has several divisions, including Social and Statistical Sciences (presumably that's where the ERIC work will be done), Statistical, Survey, and Computing Sciences, Health, Social, and Economics Research, Federal Healthcare Optimization and Strategic Solutions, Partnership for Genomics and Molecular Epidemiology, International Development, Science and Engineering, Health Sciences, Engineering and Technology, Environmental Sciences, RTI Health Solutions. They also have an "Entrepreneur in Residence," which is interesting. They seem to be especially strong in healthcare related research. However, they've also done numerous education related research studies. Their web page states "RTI has a long history of supporting local, state, and federal efforts to ensure a solid foundation in elementary and secondary education. Today, our research activities---including program evaluation, needs assessment, policy analysis, and development of performance measurement systems---are well positioned to further federal education goals" (http://www.rti.org/page.cfm?nav=172). They have partnerships with numerous universities, including the University of California, Berkley, the University of Micbigan, and Yale University (a full list is available at http://www.rti.org/page.cfm?objectid=9EB95F1E-C540-46AE-9BF2BFCE0DD49746). Clients include Johnson & Johnson, the Mayo Clinic, the U.S. Department of Health and Human Services, the U.S. Agency for International Development, the Environmental Protection Agency, the Department of Education, the Department of Defense, and many others (a full list is available at http://www.rti.org/page.cfm?objectid=1F591C75-ABC2-4A84-9951C76CD07E0437). As has been noted elsewhere, RTI has had numerous U.S. government contracts (they are also one of the contractors in Iraq). Databases and software that they have developed include SimSITE ("Helping environmental managers understand how data quality affects their decisions"), Virtual Customer Experience, Virtual Standardized Patient, and Geode ("Facilitating the management of environmental data by enabling users to instantly produce maps, graphs, and tables"). According to Hoover's, RTI had $333.3 million in sales in 2003, with a net profit of $10.3 million. Its 2003 1 year increase in sales was 16.4% and its net profit growth was 90.7%. RTI's growth is further evidenced by the fact that its number of employees increased by 12.2%. Annual reports from 2001, 2002, and 2003 are available at http://www.rti.org/page.cfm?objectid=9080A887-156F-4352-8E94838384BAEEC6&nav =156 |
January 9, 2006