Marcive loads

From SharedBib

Jump to: navigation, search

Contents

Summary

Libraries at all SUS institutions receive regular shipments of government documents from the U.S. Government Printing Office (GPO). Libraries at every institution except FGCU participate to one degree or another in the Federal Depository Library Program:

“The Federal Depository Library Program was established by Congress to ensure that the American public has access to its Government’s information. GPO administers the FDLP on behalf of the participating libraries and the public. Information products from the Federal Government are disseminated to these nationwide libraries that, in turn, ensure the American public has free access to the materials, both in print and online.” -- http://www.gpo.gov/libraries/

To support discovery of and access to government documents at each institution, bibliographic records are loaded on a regular basis into the university bibliographic databases. The records are acquired from Marcive, Inc. (home.marcive.com) through a consortial contract brokered by FLVC.

Before shared bib, libraries loaded the records for their documents themselves. FLVC-Gainesville has taken on the responsibility for loading the records for everyone post-shared-bib. This is a logical change, as Marcive issues a single monthly file for all the SUS libraries, with indentifiers in each record for the libraries that should receive the record. Now that all libraries are sharing the same bib records, the Marcive bib records need to be loaded just once, with holdings added for each library that has the title.

Marcive issues two kinds of files for the GPO records. There are weekly files of brief records based on GPO Shipping Lists (lists of titles that accompany a shipment of gov docs). These are for physical items only, e.g. paper reports, paper maps, CDs. There is a monthly file of full GPO records for all titles issued that month for the FDLP program, including titles available only in electronic form. Not all libraries have the Shipping List records loaded. All libraries have GPO records loaded for the documents they receive from the FLDP. Most libraries are also interested in having records loaded for all documents issued in electronic form only, whether or not the titles are part of their FDLP profile.

In summary, there are three subprojects under Marcive dataloading:

  • weekly Shipping List records
  • monthly GPO records
  • special processing for monthly GPO records for documents issued only in electronic form

No SLS or GPO records have been loaded for the SUS libraries since the implementation of shared bib in June. There are backlogs of weekly SLS files and monthly GPO files that must be loaded before the ongoing loads.

PROJECT OBJECTIVES

  • a. Load backlog of weekly SLS files (mid June to present)
  • b. Load ongoing SLS files as received
  • c. Load backlog of monthly GPO records (July 2012 to present)
  • d. Load ongoing GPO files as received
  • e. Retrospective project to add interested libraries’ holdings to e-only records
  • f. Add library holdings to e-only records in ongoing GPO loads

Timeline

  • Process for weekly Shipping List Service (SLS)loads finished on test server – 12/20/2012
  • LAPS (/laps) partition and laps_user account created on FLVC-G test and production servers – 01/07/2013
  • LAPS menu for batch loaders ready – 01/15/2013
  • Begin testing weekly SLS loads for FIU and USF on test server – 01/15/2013
  • End testing weekly SLS loads on test server – 01/25/2013
  • Begin weekly SLS loads for FIU and USF in production – 01/25/2013
  • Begin development for monthly GPO loads on test server for FAMU, FAU, FGCU, FIU, UCF, UF, USF, UWF (FSU is e-doc only, UNF and NCF will add holdings manually) – 02/01/2013
  • End development for monthly GPO loads on test server – 02/15/2013
  • Begin testing monthly GPO loads on test server -- 02/15/2013
    • Parallel development: Short-term, load using GenLoad. Long-term, load using scripted batch process.
  • End testing monthly GPO loads on test server –-
    • Parallel development: Short-term, Genload -- end testing 3/11/13. Long-term, scripted process, open end date.
  • Begin monthly GPO loads for FAMU, FAU, FGCU, FIU, UCF, UF, USF, UWF in production – 03/11/2013
  • Notes
  1. LAPS (Library Automated Processing Services) is FLVC-TLH tool for managing data loads.
  2. Each monthly GPO file must be loaded for all libraries before the next month's file can be loaded because files for later months may contain updates to records in files for earlier months.
  3. Centralized loading of e-doc records is a new project separate from the regular monthly GPO loads.

Plan

  • Gather information about which libraries want which of the three record loads.
  • Document most recent SLS file loaded and the load specs use pre-shared bib
  • Document most recent GPO file loaded and load specs use pre-shared bib
  • Load first SLS file into SB Test; work with libraries on load parameters and approval
  • Determine best method/s for loading SLS long-term; for loading GPO and e-doc records short-term and long-term; for scheduling e-doc loads
  • Load first SLS file into Production
  • Load first GPO file into Test; work with libraries on load parameters and approval
  • Load remaining backlog of SLS files into Production and document process
  • SLS files loaded into Production as received
  • Load first GPO file into Production and document process
  • Load remaining backlog of GPO files into Production (through December file)
  • GPO files loaded into Production as received
  • Process first e-doc file in Test (add holdings). To be decided: whether done as part of the GPO test load or as a separate project
  • Process first e-doc file in Production and document process. To be decided: whether done as part of the GPO test load or as a separate project
  • Process remaining backlog of e-doc files in Production. To be decided: whether done as part of the GPO test load or as a separate project
  • E-doc files processed in Production as received

Status

Weekly Shipping List Records

  • Identify the libraries wanting holdings added for them - yes: FIU & USF (yes); no: FAU, UCF, UWF - DONE
  • Write load specs for each library - DONE 1/11/13
  • Identify records to load for participating libraries - DONE 1/11/13
  • LAPS menu for loading records - FIU menus DONE 1/11/13
  • Emails with load results - DONE 1/25/13
  • Run test loads to test load parameters and methodology - small test 1/11/13
  • Load bib records and and create holdings and items for each library - small test 1/11/13
  • Load 3 months of SLS files into Test; to libraries for review - DONE 1/18/13
  • Backlog of weekly SLS files (FCLA0626 through FCLA0113 for 6/26/12-1/13/13) loaded into Production - DONE 1/25/13
  • Weekly file loaded upon receipt - DONE 1/29/13

Monthly GPO Records Other Than E-Only

  • Identify the libraries wanting holdings added for them - DONE 2/22/13
    • Batch-load holdings for FAMU, FAU, FGCU, FIU, UCF, UF, USF, UWF
    • NCF will add holdings manually, UNF will add holdings manually to physical material records.
    • FSU and UNF are e-only (next project).
  • Write load specs for each library
    • FGCU - approved 2/22/13 -- DONE
    • UWF - approved 2/22/13 -- DONE
    • UF - approved 2/26/13 -- DONE
    • FAU - 1st draft done 2/28/13; revised 3/1/13; approved 3/5/13; revised 3/6/13 -- DONE
    • UCF - 1st draft done 3/1/13; revised & approved 3/5/13 -- DONE
    • FAMU - 1st draft done 3/5/13; revised 3/5/13; approved 3/19/13 -- DONE
    • USF - 1st draft done 3/5/13; revised & approved 3/6/13 -- DONE
    • FIU - 1st draft done 3/27/13; revised 3/28/13, 4/3/13; tentative approval 4/9/13; revised 4/11/13; revised 4/22/13; approved 4/23/13
  • Run test loads to test load parameters and methodology - February/March

GENLOAD Process

Test Loads

  • UF test load - 1st test done 2/26/13; approved 3/5/13 -- DONE
  • FGCU test load - 1st test done 2/27/13; reload 3/1/13; reload approved 3/4/13 -- DONE
  • UWF test load - 1st test done 3/1/13; approved 3/5/13 -- DONE
  • FAU test load - 1st test done 3/8/13; approved 3/12/13 -- DONE
  • UCF test load - 1st test done 3/14/13; approved 3/19/13 -- DONE
  • USF test load - 1st test done 3/19/13; approved 3/25/13 -- DONE
  • FAMU test load - 1st test done 3/22/13; approved 3/25/13 -- DONE
  • FIU test load - 1st test done 4/11/13; approved 4/23/13 -- DONE

Production Load

  • Pre-load cleanup of duplicate records that match records in July 2012 file -- DONE 3/8/13
NOTE: multiple copies of serial records not deduped; this is complex and requires library evaluation
  • FGCU production load, July 2012 -- DONE 3/11/13
  • UF production load, July 2012 -- DONE 3/12/13
  • UWF production load, July 2012 -- DONE 3/15/13
  • FAU production load, July 2012 -- DONE 3/18/13
  • UCF production load, July 2012 -- DONE 3/20/13
  • USF production load, July 2012 -- DONE 3/28/13
  • FAMU production load, July 2012 -- DONE 4/3/13
  • FIU production load, July 2012 -- DONE 4/24/13

Scripted Aleph Process

Test 1 (August 2012 file)

  • FGCU, UWF - scripts DONE 3/15/13
  • UF, FAU, UCF - scripts DONE 3/25/13
  • FAMU, USF - scripts DONE 3/29/13
  • FAU scripted test load - 1st test done 3/29/13; to FAU for review 4/3/13
  • USF scripted test load - 1st test done 3/29/13; to USF for review 4/3/13
  • UF scripted test load - 1st test done 3/29/13; to UF for review 4/3/13
  • FGCU scripted test load - 1st test done 3/29/13; to FGCU for review 4/3/13
  • UWF scripted test load - 1st test done 3/29/13; to UWF for review 4/3/13
  • FAMU scripted test load - 1st test done 3/29/13; to FAMU for review 4/3/13
  • UCF scripted test load - 1st test done 3/29/13; to UCF for review 4/3/13

Test 2 (August 2012 file)

  • FAMU scripted test load - 2nd test done 8/8/13; to FAMU for review 8/26/13; approved 9/4/13
  • FGCU scripted test load - 2nd test done 8/8/13; to FGCU for review 8/30/13; approved 9/3/13
  • UCF scripted test load - 2nd test done 8/8/13; to UCF for review 8/28/13; approved 9/11/13
  • UF scripted test load - 2nd test done 8/8/13; to UF for review 9/5/13; approved 9/12/13
  • USF scripted test load - 2nd test done 8/8/13; to USF for review 9/5/13; approved 9/25/13
  • FAU scripted test load - 2nd test done 8/8/13; to FAU for review 9/9/13; approved 9/11/13
  • FIU scripted test load - 1st test done 8/8/13; to FIU for review 9/9/13; approved 9/11/13
  • UWF scripted test load - 2nd test done 8/8/13; to UWF for review 9/9/13; approved 9/18/13

Production Load (August 2012 file)

  • Pre-load cleanup of duplicate records that match records in August 2012-September 2013 files -- DONE 9/12/13
NOTE: multiple copies of serial records not deduped; this is complex and requires library evaluation
  • FGCU production load, August 2012 -- DONE 9/4/13
  • FAMU production load, August 2012 -- DONE 9/5/13
  • FAU production load, August 2012 -- DONE 9/11/13
  • UCF production load, August 2012 -- DONE 9/11/13
  • FIU production load, August 2012 -- DONE 9/11/13
  • UF production load, August 2012 -- DONE 9/12/13
  • UWF production load, August 2012 -- DONE 9/18/13
  • USF production load, August 2012 -- DONE 9/26/13

Post-load Cleanup

  • Remove $5's from merged records
  • Remove STA $$a DO NOT OFFLOAD

Monthly GPO Records for E-Only

  • GPO e-only loads in Production is a separate project that will follow the implementation of regular GPO loads in Production
  • Identify the titles issued in electronic format only
  • Research the libraries wanting holdings added for them
  • Write load specs for each library
  • Run test loads to test load parameters and methodology
  • Run iterative processes to create the holdings for each library.
Personal tools