Archives Outside

For people who love, use and manage archives

Archives Outside - For people who love, use and manage archives

Digitising your collection – Part 2: The Golden Rule of Digitisation

So you’ve started to lay out your digitisation plan and have made the decision to scan in-house, outsource the work or split between the two.

This is the second post in a series on starting a digitisation program. The series covers: project planning; technical specifications; handling the archives; scanning tips; file storage, and; metadata and access.

The golden rule

‘Capture once, use many times’

By following this philosophy we digitise without an output in mind.

Capture once, use many times

Avoid the trap of creating a digital image to meet an immediate need. You may find that later on that another digital image (with a different file format requirement) of the same archive is requested. This means you will have to access that archive a second time, resulting in further moving and handling and potential damage.

Always create a high-resolution master file

…regardless of the original purpose. Many derivatives can be created from the one master file to meet many different needs in the future.

Future uses have not yet been thought of

Needs change over time, as does the digital life of an archive. Our archives often make the must-digitise list for a Digital Gallery on our website. A low res jpeg is suitable for web access but a master file is still digitised and a low res derivative created from it. If a web visitor likes a gallery image and submits a copy order request then a high-quality derivative of the master file can be generated without having to access the original item.

Example of the ‘capture once’ philosophy

A while ago we digitised some railway posters and brochures for an exhibition installation at the Western Sydney Records Centre…you remember, the one where our boss woke up at 3am? The documents were digitised as high res (master) TIFFs.

One derivative was generated as a print-quality file to be displayed as a poster in an exhibition case here:

Photo of exhibition display

See the poster front and centre?

And one derivative was created to become the whopping, great window transparency here at the front doors:

Window poster of the same image - capture once use many times

Window poster of the same image – capture once, use many times

Even if we think an image is only to be used as low/web resolution jpeg for web delivery we still create a high resolution master TIFF. If someone places a reading room request for a high quality image – or our boss has another 3am moment – we can provide it without disturbing the original archive.

Keep your program cost-effective

For a digitisation program to be cost effective and achieve its access and preservation goals the image file needs be created with flexibility in mind. Maximise the preservation/access benefits and avoid unnecessary handling of the original records.

And remember the Golden Rule…

Next week we get into the nitty gritty of technical specifications (without giving you a headache).

 

Digitising your collection – Part 1: Project Planning

This is the first in a series of posts on starting a digitisation program. In the series we’ll be talking about: project planning; technical specifications; handling the archives; scanning tips; file storage, and; metadata and access.

Much of this advice is based on experiences at State Records and we’ll be using examples of State Records practices along the way.

You’ve had the big ‘digitisation’ idea, now where to start?

Whether it be a large-scale project to digitise a whole collection or a more targeted preservation-priority strategy you need to have a plan.

Various scanned archival items

Factors to consider in your plan

We’ll go into some of these in more detail in later posts:

  • scanning – to scan in-house or to outsource
  • prioritising the workload – will you begin with the most requested series in the collection or the more fragile items that are in need of preservation, or will you embark on a digitisation-on-demand approach
  • prepping the records – is conservation required, do the archives need re-housing after digitisation, are the items being indexed as part of the project
  • technicalities – what resolution for the ‘master’ file, what is bit-depth, what is file compression, what equipment will be needed
  • time-frames – and workflows depend on the size of the collection and the number of staff allocated to the digitisation project
  • metadata – what are the requirements, generating a unique identifier etc
  • quality assurance checks
  • storage of digital images – long-term and ongoing costs involved
  • what is the plan for the image files – will they become accessible on your website, in an online gallery, in a searchable database, on a social media site such as Flickr, will you need IT expertise to fulfil your vision.

Remember: A digitisation project requires a financial investment – from the initial scanning of the archives (whether it be in-house or outsourced) to the ongoing digital image storage costs. Defining expected costs as part of your planning process will ensure you have adequate resources.

Consult far-and-wide

A digitisation program will have an impact on other areas in your organisation. Are you the sole full-time staff member assigned to the program? Will staff from other areas be involved part-time or will there be a new team dedicated to the cause?

An in-house advisory group will allow managers and staff across the board to discuss possible issues and modify existing workflows before the program begins.

Some of the questions we had to consider here at State Records:

Conservation

Will Conservation staff suddenly be flooded with extra work to prepare archives for scanning? How will the workload be prioritised? Has time for preservation been allotted into the overall time-frame of the project?

Your Conservation team may need to do a ‘health-check’ on the archives that have been flagged for digitisation. The more fragile the records, the more time may be needed in Conservation. This may change digitisation priorities – other records could be pushed to the top of the digitisation list while the less robust records undergo conservation work. Be prepared to be flexible.

Reading room requests

Will archives become inaccessible to researchers while digitisation is in progress? How long for? Public Access staff will need to be made aware of any delays so that notices (online and offline) can be issued to the public that certain records are temporarily unavailable.

Arrangement and Description – archives control and management

Will workflows for staff processing archives be interrupted? Record series on the digitisation list that are not fully processed might need to be slotted in to current work schedules.

Do the archives need re-housing post-digitisation? And if so, will databases need to be updated listing new storage locations?

The digitisation team

Whether or not you have a dedicated digitisation team for in-house scanning the staff involved may need training (or refresher courses) on using equipment such as scanners, cameras, computer software, file storage and advice on handling the archives. You will also need to stay up-to-date with new technologies, equipment and processes.

If you are planning to scan in-house, scope out the equipment you will need and costs involved.

Other organisations

When our Project Officer, Digitisation was appointed and began scoping out the program – way back in 2001 – she started by consulting other cultural organisations who already had digitisation programs in place. Via websites, on the phone and by email, she formulated a list of standards, processes and equipment required.

Some organisations have fully fledged digitisation programs with large budgets and can fulfil large quotas of scanning. It’s a matter of finding the balance of do-able digitisation within the boundaries of your own resources.

Visualising your program

You’ve read some ideas above on what you need to consider in your plan so now it’s time to put pen to paper: visualise your program, consult with staff and begin costing equipment, storage (a handy equation will be available in a later post) and staff resources.

Before we go, a quick look at what you can digitise and some pros and cons of in-house versus outsourced scanning.

What can you digitise?

Practically anything! A range of historic material can be digitised including:

  • large books/registers/volumes
  • manuscripts/documents/files
  • maps/plans
  • illustrations/photographs
  • negatives/transparencies (including glass plates and lantern slides)
  • audio recordings, and
  • cinematic film.

In-house scanning vs outsourced digitisation

In-house scanning Outsource scanning
You retain control of handling and storage of archives Archives need to go off-site, less control over the records
Technical process can be fully controlled & modified as/if needed – a dedicated ‘digitisation’ space required Less control over imaging process, therefore a need to clearly define technical specifications at the outset
Costs for staff training, scanning/storage equipment and software Pay for the cost of scanning only, storage equipment still required

As you can see in the table above there are pros and cons for both in-house and outsourced scanning. At State Records NSW we scan our original archives in-house and digitising of microformed records is outsourced.

In the next post we’ll talk about the golden rule of digitisation.

So you want to digitise your collection?

Access and preservation are two of the main reasons for digitising your archival collection:

  1. Digitisation improves access to your archives
    It provides the opportunity to reach a worldwide audience through online access and simultaneously promotes your organisation – some users may never have known you existed and what interesting, useful and amazing content you hold in your environmentally controlled repository.
  2. Digitisation is a preservation strategy and protects the collection
    Every time an original item is moved or handled it is at risk of damage, especially those that have already suffered wear and tear and have become fragile. Offering a digital surrogate in place of the original archive means your collection can stay safely stored away.

Next week we start a new blog series that is all about digitisation. We’ll talk about: project planning; technical specifications; handling the archives; scanning tips; file storage; metadata, and; access.

State Records NSW has presented talks and written articles and guidance on digitisation. This series encompasses all these tools and resources (and links out to other experts) for a comprehensive look at the process from start to finish.

You’ve had the big ‘digitisation’ idea, now where to start? Find out next week.

Michael using laptop with camera and archive in background

This year History Week 2012 looks at threads, fabrics and clothing…they wore what?

We’re celebrating History Week 2012 this week. This year’s theme is Threads: They wore what?!

Long before the fashionistas of today decided ‘the look’, dress was an important element of human expression. From status to style, culture to professional identity, clothes have defined us. History Week 2012 will explore the history of threads and unpick the meaning behind the wardrobes of the past.

from the History Council website

The link above takes you to the program of events on the History Council website so make sure you check to see what’s on in your area.

State Records staff have put together a new webpage called The Threads of history in the State archives:

Showcasing some of our archives made from threads and fabrics. Non-paper materials are not common in our collection and the wonderful details, colours and textures captured in these items are a beautiful sight to see.

from the State Records NSW website

Attire

Fashion sure has changed in the last 100 years. For instance this head-wear was worn by women working in a cannery in 1925.

Cannery head-wear. Women working in the factory wore this type of cap.This cap was found in a Murrumbidgee Irrigation Area file – NRS 14511

Non-clothing cloth

And on a non-clothing, but nevertheless threaded theme, there is this beautiful watercolour-on-silkscreen plan of the town of Leeton, 1913. The plan was designed by architect Walter Burley Griffin and his wife Marion Mahony Griffin prepared coloured sketches on silk.

Silkscreen Plan of Leeton, 1913 [Document No 224]Silkscreen Plan of Leeton, 1913. The plan was designed by architect Walter Burley Griffin; the plan was prepared by his brother-in-law, architect Roy Alstan Lippincott, and; Walter’s wife Marion Mahony Griffin prepared the coloured sketches on silk

What else have you seen online for History Week 2012?

Our brilliant digital archives team has won a Mander Jones Award

The awards were announced at the end of the ICA 2012 Conference in Brisbane. And we are delighted to tell you that Richard @richardlehane and Nott @airgear01 from the State Records NSW Digital Archives team have won the Mander Jones Award for “best finding aid to an archival collection held by an Australian institution…” for their excellent work in creating an API to our online catalogue, Archives Investigator.

Congratulations Richard and Nott!

Certificate - Mander Jones Award 2011

 

Exclusive celebrity interview

On hearing this good news we asked Richard a few questions, Q&A-style.

Q: What was the original purpose for the API?

A: API stands for application programming interface. The key thing here is that this new interface was originally designed for computer programs, not people. The idea is that if we can provide structured access to the data within State Records NSW’s catalogue we can open up new possibilities for the re-use of that information, for example in mobile phone applications or federated search portals. Because we had to create a whole new application to do this, it was quite easy to add a new user interface to this application too. Oddly enough it is as a new user face (branded as our new ‘experimental search tool’) that the API has been most successful, so perhaps we shouldn’t have called it an API at all.

Q: What was the biggest surprise in how you saw the API being used?

A: As an interface for regular users, I had originally thought that the API should aim to satisfy users’ queries as quickly as possible: do a simple search, find the right record series or item, and you’re done. One thing that is immediately apparent from our web statistics is that this isn’t happening at all. Users are actually spending a lot more time on the site than they do for Archives Investigator.  For each of our unique visits, we get about 80 web pages viewed where Archives Investigator gets about 18. On reflection, this is fantastic because it means that users are having a good dig around in the collection. It means that users are following the relationships between entities much more (for example, clicking on a creating government agency and then viewing other records created by that agency) and that’s brilliant because that is what archival research is all about. I’ve come to believe that a good archival catalogue should aim to be like Wikipedia: you visit looking for one specific thing but find yourself on the site half an hour later, having followed links to a bunch of other related concepts and having built up a detailed mental map of all of those connections.

Q: How do you see – or how would you like to see – the API being used in the future?

A: I’d like to see the API side of the project (the computer interface) fade into the background. Providing structured access to data is important because it gives State Records NSW a platform for collaboration and innovation. This open approach, I think, should be the way State Records NSW goes about building all of its online tools. It is great as infrastructure. But raw data isn’t an end product that many of our users are interested in, and I’d like to see the user interface side of the project become its focus. In the future, I’d like to see this user interface expand to become a complete discovery service, encompassing all of State Records NSW’s online resources: the indexes, digitised material, and eventually born digital records too. We have a lot to work on!

It certainly sounds like it and we’re excited! More information about the use and development of the API is at Richard’s blog Opening the Catalogue.

The API is very simple to use, especially as there is just the one search box. Try a search and see for yourself.

Archives and Flickr: a perfect fit?

There’s been some recent discussion about Flickr following an article called How Yahoo Killed Flickr and Lost the Internet.

Kate Theimer raised the topic on her blog ArchivesNext and we thought we’d highlight it here:

…And if Flickr isn’t the cool shiny toy it once was (and it certainly is not), are archives moving to something else to share images? Pinterest is addicting…but it doesn’t have all the features of Flickr. Is Flickr still the go-to site for archives to share images, or have we moved on to something else? Facebook, perhaps? Or do you use both?

Read the full post here

What about State Records NSW on Flickr?

We still like using Flickr for showcasing the SRNSW collection. Apart from anything it’s simple to use and a friendly and informative community has sprung up around our photostream. Flickr reaches an infinitely larger audience than we ever could from our website and we can easily interact with visitors who are interested in our photos (which we can’t do in our own image database).

We’re still not on The Commons, though; we’ve been on a waiting list for the last five years or so. Perhaps that part of Flickr has ground to a halt…?

We have also been experimenting with the Flickr API and feeding visitors’ photos of our archives back into our catalogue. So, if someone chooses to post to our Flickr group then the image ends up visible to people browsing our catalogue – see here for example.

I think being part of Web 2.0 keep us (as archival institutions) relevant: people see what we have; who we are, and; possibly more importantly they know we exist. It’s an opportunity to be in the places where people live/work/play online and not trying to force them elsewhere. We don’t participate in tons of social media sites, we do what is manageable and experiment with what works for us.

Flickr has definitely been successful and it would be sad to see it go. What would the alternative be?

What are your thoughts?

We’re on Historypin

…and having fun!

You might remember last year we had a guest post from the friendly folks at Historypin who wrote about this exciting new way of viewing and sharing history.

From the post:

Historypin is a public history collaboration working with individuals and communities, in partnership with Google and over 100 institutions around the world, to share their collections and build community around local history.

One of the initiatives on Historypin for this year is to create a ‘global interactive archive’ of the Diamond Jubilee celebrations of Queen Elizabeth II. Libraries, museums and archives dove into their collections looking for photos, documents, audio and video to pin the Queen’s history. Including us! You can see our contribution to the Jubilee here.

Diamond Jubilee ‘Tour’

Overlaying photos onto Google streetview

We’ve been adding non-Royal items, too. Being able to match, or almost match old photos onto Google streetview is quite a feat. A warning though: if you’re too heavy-handed in clicking through streetview, most likely due to over-enthusiasm, you may find you get a little sea-sick as you get through streetview at a rapid pace. For instance, it took a while pinning this image below of Bourke Street, Sydney – and it’s not even a perfect fit as I kept getting thrown into the Eastern Distributor tunnel if I clicked a little too far into the /streetmap.

By the way, this photo was a recent Moment in Time which has been identified as Bourke Street…thank you!

Matching topography…

Where streets have changed considerably over time the topography might help to match up content and the transparency slider comes in very handy for this.  Below, is a 1929 view of Tamworth – Google maps showed just one original building still remained. So the building and the mountains in the background could be used as markers.

 …and finding new information to update our catalogue

We also managed to determine the street in which this photo was taken (Brisbane Street) and update our catalogue as a result.

So far, joining Historypin has been a great experience.  We’re also thinking of ways in which we can use this tool to create new types of exhibitions, ones that we have not had the technology to do undertake thus far. We’re very much looking forward to increased functionality which will allow us to overlay old maps onto the Google maps. Maps are one thing we have a lot of in our collection – can you imagine, with the transparency slider, fading in and out the old to the new.

Watch this space…

More about Historypin

Revisiting: Australian Soldiers in black and white

Back in April 2010 we highlighted some photos of Australian soldiers from our collection. Quite early ones, in fact, perhaps dating back to the 1870s. We received many comments on the post at the time with most suggestions pointing to around 1870-1890. With only a rural landscape and no obvious landmarks/features, the site remains a bit of a mystery.

This post has been a bit of a slow burner; eight months after it was initially published it caught a second wave of  interest and has just recently grabbed the attention of some of our readers. One in particular has made several observations about the possible location of the photos.

Can you help?

Some comments are also on the photo pages themselves and not on the post. Select a photo below to read more comments:

  

  

We’ve also replaced the Flickr versions with larger images so the uniforms and civilian clothing are now much clearer.