The Metadata Management Tool offers a wide variety of user tasks, with the aim of producing descriptive metadata. Notably the tool offers persistence of metadata sets via its save and load functionality and batch modification.
Meta-fy, a Metadata Management Tool was developed in order to assist with the difficult task of creating metadata for a large amount of data. The tool was developed using the requirements of the Zamani Project team. It is able to handle a wide variety of user tasks and offers the ability to expand in the future via its Javadoc. This component needed to enable the creation of descriptive metadata for the cultural heritage data that can be exported in FOXML and then ingested into the archive.
Performance testing was performed for the Metadata Management Tool as processing a large amount of data in a Java Applet proved to be significantly slow. The processing of data located on a shared drive is regarded as the most expensive process of the Metadata Management Tool. Tasks that were identified as slow were making use of a recursive directory iterator in order to process data. Due to the processing of data being the source of performance issues, a number of alternative algorithms were considered in an attempt to optimize such tasks. One of the regularly used file directory count methods was examined and compared to these algorithms. The algorithms were also compared whilst running in two different environments, namely a Java Applet and Java Application. This was done to identify if the cause of the problem was the Java Applet itself. Additionally, a comparison between using a simple heuristic as opposed to Java’s native File class’s isDirectory() method was evaluated. The simple heuristic consisted of a condition that considered digital objects with a “.” in their filename as files and the rest as directories. The results obtained over 1000 iterations, resulting in a mean execution time are as follows:
A usability test was conducted with 15 participants, consisting of University of Cape Town students. The System Usability Scale (SUS) was used to measure user’s perceived usability of the Metadata Management Tool. The main results obtained are as follows:
Mean SUS Score | Cronbach Alpha | Std. Alpha | Average R |
---|---|---|---|
73.12 | 0.85 | 0.84 | 5.5 |
In order to demonstrate that the project requirements had been met, a User Acceptance Test was conducted with the Zamani Project team. A list of requirement based test case criteria was compiled using the in-scope functionality of the Metadata Management Tool. This ensured that all of the functionality that was in-scope was demonstrated to the team. The requirement test case criteria are shown below.
ID | Criteria |
---|---|
1.1 | Open Meta-fy in the browser from the Web-based Backend |
1.2 | Automate fields using the Automate Tab |
1.3 | View the Console Tab after executing actions |
1.4 | Select a metadata item to view its preview image and use the Toolbar to manipulate the image as desired |
1.5 | Sort metadata by: Identity, File, Status, Tag, and Contains |
1.6 | Demonstrate Persistence by saving and loading a .metafy file |
1.7 | Open files & open directories (clears previously open files) |
1.8 | Add files & add directories (adds to previously open/added files) |
1.9 | Import coordinate triplets from a text file |
1.10 | Import camera calibration settings from a text file |
1.11 | Remove already added camera calibration settings |
1.12 | Calculate metadata titles for all metadata present in the Metadata Table |
1.13 | Associate new files from an Aluka transformed .metafy file |
1.14 | Validate metadata after associating new files |
1.15 | Modify a batch of metadata |
1.16 | Transform an Aluka generated .xml file into a .metafy file |
1.17 | Export a set of metadata |
IDs | Pass/Fail | Tested By | Date Tested |
---|---|---|---|
1.1 - 1.17 | Pass | Zamani team | 20/10/2014 |
The Metadata Management Tool component of the Zamani Data Archive was developed to assist with the difficult task of creating metadata for a large amount of data. A subjective label for this component’s usability can be obtained with the use of the adjective rating scale and the component’s mean SUS score of 73.12. Thus the Metadata Management Tool’s usability is ‘Good’. There is a high level of internal consistency, this can be seen above, in the table in the Usability Testing section, with a Chronbach’s alpha of 0.7 ≤ α < 0.9. The system was evaluated and determined to be a success. All of the functionality that was specified as in-scope and was a requirement of the Zamani team was successfully implemented and approved by the team. The team responded positively to the system and are interested in the system being implemented in a production environment in the future.