XQuery is a simple, yet powerful, scripting language designed to enable users without formal programming training to extract, transform, and manipulate XML data. Moreover, the language is an accepted standard and a W3C recommendation much like its sister standards, XML […]
by Christina Harlow Data munging, or the work of remediating, enhancing and transforming library datasets for new or improved uses, has become more important and staff-inclusive in many library technology discussions and projects. Many times we know how we want […]
by Christina Harlow An OpenRefine reconciliation service for GeoNames. Tested with, working on python 2.7.10, 3.4.3. The service queries the GeoNames API and provides normalized scores across queries for reconciling in Refine. https://github.com/cmh2166/geonames-reconcile
by Mark Phillips Python script for breaking or atomizing OAI-PMH repositories into simpler text formats. https://github.com/vphill/metadata_breakers
Many in the VIVO community use Python for data manipulation and transformation tasks (ETL). petl is a framework for reading data from various sources, transforming it, and passing it along to another source. https://gist.github.com/lawlesst/52c622e172c5ab452d3c
Blog post written by the Digital Scholarship Unit, University of Toronto Scarborough Library Lately we’ve been trying to come up with a better way to create metadata for batch ingestion into Islandora. We often work with faculty and other people outside […]
Blog post by Noah Huffman, Duke University Libraries As part of a recent project to migrate data from EAD (Encoded Archival Description) toArchivesSpace, I needed to clean up about 27,000 name and subject headings spread across over 2,000 EAD records […]
I’m working currently on migrating a lot of our non-MARC metadata collections from older platforms using a kind of simple Dublin Core to MODS/XML (version 3.5, we’re currently looking at 3.6) that will be ingested into Islandora. That ‘kind of […]
The Bentley Historical Library’s ArchivesSpace-Archivematica-DSpace Workflow Integration project seeks to improve the creation and reuse of metadata among systems and streamline the ingest and deposit of content in preservation repositories. Read our inaugural post for more information on the project! […]
The pose slide and artwork collections were batch loaded into the Knowledge Bank (a DSpace repository). Our routine process for batch loading involves creating a spreadsheet (.csv) containing the metadata and filename for each item. A stand-alone Java tool (SAFBuilder) […]