Archives Outside

For people who love, use and manage archives

Archives Outside - For people who love, use and manage archives

Digitising your collection – Part 2: The Golden Rule of Digitisation

So you’ve started to lay out your digitisation plan and have made the decision to scan in-house, outsource the work or split between the two.

This is the second post in a series on starting a digitisation program. The series covers: project planning; technical specifications; handling the archives; scanning tips; file storage, and; metadata and access.

The golden rule

‘Capture once, use many times’

By following this philosophy we digitise without an output in mind.

Capture once, use many times

Avoid the trap of creating a digital image to meet an immediate need. You may find that later on that another digital image (with a different file format requirement) of the same archive is requested. This means you will have to access that archive a second time, resulting in further moving and handling and potential damage.

Always create a high-resolution master file

…regardless of the original purpose. Many derivatives can be created from the one master file to meet many different needs in the future.

Future uses have not yet been thought of

Needs change over time, as does the digital life of an archive. Our archives often make the must-digitise list for a Digital Gallery on our website. A low res jpeg is suitable for web access but a master file is still digitised and a low res derivative created from it. If a web visitor likes a gallery image and submits a copy order request then a high-quality derivative of the master file can be generated without having to access the original item.

Example of the ‘capture once’ philosophy

A while ago we digitised some railway posters and brochures for an exhibition installation at the Western Sydney Records Centre…you remember, the one where our boss woke up at 3am? The documents were digitised as high res (master) TIFFs.

One derivative was generated as a print-quality file to be displayed as a poster in an exhibition case here:

Photo of exhibition display

See the poster front and centre?

And one derivative was created to become the whopping, great window transparency here at the front doors:

Window poster of the same image - capture once use many times

Window poster of the same image – capture once, use many times

Even if we think an image is only to be used as low/web resolution jpeg for web delivery we still create a high resolution master TIFF. If someone places a reading room request for a high quality image – or our boss has another 3am moment – we can provide it without disturbing the original archive.

Keep your program cost-effective

For a digitisation program to be cost effective and achieve its access and preservation goals the image file needs be created with flexibility in mind. Maximise the preservation/access benefits and avoid unnecessary handling of the original records.

And remember the Golden Rule…

Next week we get into the nitty gritty of technical specifications (without giving you a headache).

 

Digitising your collection – Part 1: Project Planning

This is the first in a series of posts on starting a digitisation program. In the series we’ll be talking about: project planning; technical specifications; handling the archives; scanning tips; file storage, and; metadata and access.

Much of this advice is based on experiences at State Records and we’ll be using examples of State Records practices along the way.

You’ve had the big ‘digitisation’ idea, now where to start?

Whether it be a large-scale project to digitise a whole collection or a more targeted preservation-priority strategy you need to have a plan.

Various scanned archival items

Factors to consider in your plan

We’ll go into some of these in more detail in later posts:

  • scanning – to scan in-house or to outsource
  • prioritising the workload – will you begin with the most requested series in the collection or the more fragile items that are in need of preservation, or will you embark on a digitisation-on-demand approach
  • prepping the records – is conservation required, do the archives need re-housing after digitisation, are the items being indexed as part of the project
  • technicalities – what resolution for the ‘master’ file, what is bit-depth, what is file compression, what equipment will be needed
  • time-frames – and workflows depend on the size of the collection and the number of staff allocated to the digitisation project
  • metadata – what are the requirements, generating a unique identifier etc
  • quality assurance checks
  • storage of digital images – long-term and ongoing costs involved
  • what is the plan for the image files – will they become accessible on your website, in an online gallery, in a searchable database, on a social media site such as Flickr, will you need IT expertise to fulfil your vision.

Remember: A digitisation project requires a financial investment – from the initial scanning of the archives (whether it be in-house or outsourced) to the ongoing digital image storage costs. Defining expected costs as part of your planning process will ensure you have adequate resources.

Consult far-and-wide

A digitisation program will have an impact on other areas in your organisation. Are you the sole full-time staff member assigned to the program? Will staff from other areas be involved part-time or will there be a new team dedicated to the cause?

An in-house advisory group will allow managers and staff across the board to discuss possible issues and modify existing workflows before the program begins.

Some of the questions we had to consider here at State Records:

Conservation

Will Conservation staff suddenly be flooded with extra work to prepare archives for scanning? How will the workload be prioritised? Has time for preservation been allotted into the overall time-frame of the project?

Your Conservation team may need to do a ‘health-check’ on the archives that have been flagged for digitisation. The more fragile the records, the more time may be needed in Conservation. This may change digitisation priorities – other records could be pushed to the top of the digitisation list while the less robust records undergo conservation work. Be prepared to be flexible.

Reading room requests

Will archives become inaccessible to researchers while digitisation is in progress? How long for? Public Access staff will need to be made aware of any delays so that notices (online and offline) can be issued to the public that certain records are temporarily unavailable.

Arrangement and Description – archives control and management

Will workflows for staff processing archives be interrupted? Record series on the digitisation list that are not fully processed might need to be slotted in to current work schedules.

Do the archives need re-housing post-digitisation? And if so, will databases need to be updated listing new storage locations?

The digitisation team

Whether or not you have a dedicated digitisation team for in-house scanning the staff involved may need training (or refresher courses) on using equipment such as scanners, cameras, computer software, file storage and advice on handling the archives. You will also need to stay up-to-date with new technologies, equipment and processes.

If you are planning to scan in-house, scope out the equipment you will need and costs involved.

Other organisations

When our Project Officer, Digitisation was appointed and began scoping out the program – way back in 2001 – she started by consulting other cultural organisations who already had digitisation programs in place. Via websites, on the phone and by email, she formulated a list of standards, processes and equipment required.

Some organisations have fully fledged digitisation programs with large budgets and can fulfil large quotas of scanning. It’s a matter of finding the balance of do-able digitisation within the boundaries of your own resources.

Visualising your program

You’ve read some ideas above on what you need to consider in your plan so now it’s time to put pen to paper: visualise your program, consult with staff and begin costing equipment, storage (a handy equation will be available in a later post) and staff resources.

Before we go, a quick look at what you can digitise and some pros and cons of in-house versus outsourced scanning.

What can you digitise?

Practically anything! A range of historic material can be digitised including:

  • large books/registers/volumes
  • manuscripts/documents/files
  • maps/plans
  • illustrations/photographs
  • negatives/transparencies (including glass plates and lantern slides)
  • audio recordings, and
  • cinematic film.

In-house scanning vs outsourced digitisation

In-house scanning Outsource scanning
You retain control of handling and storage of archives Archives need to go off-site, less control over the records
Technical process can be fully controlled & modified as/if needed – a dedicated ‘digitisation’ space required Less control over imaging process, therefore a need to clearly define technical specifications at the outset
Costs for staff training, scanning/storage equipment and software Pay for the cost of scanning only, storage equipment still required

As you can see in the table above there are pros and cons for both in-house and outsourced scanning. At State Records NSW we scan our original archives in-house and digitising of microformed records is outsourced.

In the next post we’ll talk about the golden rule of digitisation.

So you want to digitise your collection?

Access and preservation are two of the main reasons for digitising your archival collection:

  1. Digitisation improves access to your archives
    It provides the opportunity to reach a worldwide audience through online access and simultaneously promotes your organisation – some users may never have known you existed and what interesting, useful and amazing content you hold in your environmentally controlled repository.
  2. Digitisation is a preservation strategy and protects the collection
    Every time an original item is moved or handled it is at risk of damage, especially those that have already suffered wear and tear and have become fragile. Offering a digital surrogate in place of the original archive means your collection can stay safely stored away.

Next week we start a new blog series that is all about digitisation. We’ll talk about: project planning; technical specifications; handling the archives; scanning tips; file storage; metadata, and; access.

State Records NSW has presented talks and written articles and guidance on digitisation. This series encompasses all these tools and resources (and links out to other experts) for a comprehensive look at the process from start to finish.

You’ve had the big ‘digitisation’ idea, now where to start? Find out next week.

Michael using laptop with camera and archive in background

September 2012 – Link Roundup

Our link love for September

QueryPic Exploring digitised newspapers from Australia & New Zealand

Check out the coolest new digital history tool from @wragge.

 

QueryPic provides a new way of seeing, searching and understanding the digitised newspapers made available by Trove and Papers Past.

Follow changes over time. Map trends and patterns. Follow a hunch. Frame a question. Explore…

To start using QueryPic visit the Home page.

To learn more about QueryPic visit the Help page.

For inspiration and possibilities check out the Explore page.

Bristol's traumatic last public hanging

Guides to the Gallows

The archives in the Harvard Law School Library include broadsides that accompanied executions in England. The collection of broadsides at Harvard began in 1932, complementing the extensive collection of 18th and 19th century British and American trial documents.

On Nov. 30, 1824, a London banker named Henry Fauntleroy was hanged in public outside Newgate Prison, one month after being sentenced to death for embezzlement. There were 100,000 onlookers.

Many of those watching paid a penny each for a broadside printed just that morning. The single sheet describes Fauntleroy’s reaction when his appeal was denied….

…During England’s Bloody Code period, the number of crimes punishable by death escalated from 50 in 1688 to 220 by 1800. By then, a man, woman, or child could be sentenced to death for “uttering” (passing along fake documents), forgery (Fauntleroy’s crime), poaching, prostitution, insanity, petty theft, or fortune telling.

Read more at the Harvard Gazette

Bilateral Digitization at Digital Frontiers 2012

A transcript of a talk given by one of our favourite crowdsourcing bloggers Ben W. Brumfield.

……. In 2012, the democratization of digitization technology may favor informal collections over institutional ones, privileging online access over quality, completeness, preservation and professionalism.

Will the “cult of the amateur” destroy scholarly and archival standards? Will crowdsourcing unlock a vast, previously invisible archive of material scattered among the public for analysis by scholars? How can we influence the headlong rush to digitize through education and software design? This presentation will discuss the possibilities and challenges of mass digitization for amateurs, traditional scholars, libraries and archives, with a focus on handwritten documents.

View the full talk and slides at Collaborative Manuscript Transcription

shreds

Govt Wages War on paper

The decades-old pipedream of the paperless office will be within reach in three years – because taxpayers can no longer afford to put it off.

National Archives of Australia director-general David Fricker says federal government agencies are now spending about $220 million a year storing their paper records.

“And that amount is only going to grow, as more information is created,” Mr Fricker said. “Two-hundred-and-twenty-million dollars is not sustainable; it’s wasteful.”

The director-general and Arts Minister Simon Crean, who oversees the archives, toured the agency’s Mitchell repository today, where some of the government’s most important historical documents are conserved.

Advertisement

Mr Crean warned public servants they had until 2015 to shift to a digital archiving system, as the government would not allow paper files to be produced after that date.

Read the full article at The Sydney Morning Herald

Library seeks help to digitise collection

THE NATIONAL Library is seeking a partner to digitise its collection of genealogical and other material in a move that may mean the state institution puts its collections behind an online paywall.

The library has sought expressions of interest from potential commercial partners as well as the not-for-profit sector. A link-up with a commercial entity would almost certainly involve charging for online access to records, particularly genealogical records.

“We are open-minded as to who we partner with. It could be a philanthropic donor, an academic institution or a commercial business; it could be Irish or international. The core issue for us is that the partner must have the resources, funding and people and we bring the collection,” said Fiona Ross, director of the library.

Learn More at The Irish Times.

Paper flowers and box

“Thank you very, very much J. Edgar Hoover”

On May 10, 1966 J. Edgar Hoover, the Director of the Federal Bureau of Investigation, wrote Alex Rosen, head of the Bureau’s General Investigation Division, thanking him for a gift certificate to a Washington, D.C. nursery.  The gift was in honor of Hoover’s anniversary as director.  “I shall derive much enjoyment in selecting what I want for my yard and home,” Hoover wrote.

For almost fifty years Hoover received such gifts from Bureau personnel as well as friends and admirers.  Copies of various congratulatory communications to Hoover, many enclosing gifts, and his responses are contained in over thirty boxes found in Record Group 65, Records of the Federal Bureau of Investigation (Congratulatory Letters to J. Edgar Hoover, 1924-1971, Director’s Office Records and Memorabilia).

Learn more about J. Edgar Hoover and his gifts

Web Sites With a Historical Bent Join a Place to an Image

A number of photo-sharing sites are being transformed from places to look at pictures into tools to connect historical documents and give more people a sense of history.

Most sites do not yet take advantage of location-based data as a means to search, as historypin.com does. But the other collections are going to take you back in time.

Historypin.com is clearly one of the most ambitious of these sites. It is aggressively courting local historical societies to encourage them to upload their archives to the site. Already, several hundred institutions have used the site’s bulk uploading tools to add thousands of photographs.

 

Read the full story at the New York Times

Listeners in the Mist – Episode 16: Book Conservation with Jill Gurney

Listeners in the Mist is a series of podcasts produced by Blue Mountains City Library. It is book lover heaven. I can definitely recommend having a trawl through their interviews.

In this instalment Book Conservator Jill Gurney is interviewed by Naomi and discusses her career and the intricacies involved in her work.


Podcast Powered By Podbean

N.B. If the embedded player doesn’t work for you check it out at the source

This year History Week 2012 looks at threads, fabrics and clothing…they wore what?

We’re celebrating History Week 2012 this week. This year’s theme is Threads: They wore what?!

Long before the fashionistas of today decided ‘the look’, dress was an important element of human expression. From status to style, culture to professional identity, clothes have defined us. History Week 2012 will explore the history of threads and unpick the meaning behind the wardrobes of the past.

from the History Council website

The link above takes you to the program of events on the History Council website so make sure you check to see what’s on in your area.

State Records staff have put together a new webpage called The Threads of history in the State archives:

Showcasing some of our archives made from threads and fabrics. Non-paper materials are not common in our collection and the wonderful details, colours and textures captured in these items are a beautiful sight to see.

from the State Records NSW website

Attire

Fashion sure has changed in the last 100 years. For instance this head-wear was worn by women working in a cannery in 1925.

Cannery head-wear. Women working in the factory wore this type of cap.This cap was found in a Murrumbidgee Irrigation Area file – NRS 14511

Non-clothing cloth

And on a non-clothing, but nevertheless threaded theme, there is this beautiful watercolour-on-silkscreen plan of the town of Leeton, 1913. The plan was designed by architect Walter Burley Griffin and his wife Marion Mahony Griffin prepared coloured sketches on silk.

Silkscreen Plan of Leeton, 1913 [Document No 224]Silkscreen Plan of Leeton, 1913. The plan was designed by architect Walter Burley Griffin; the plan was prepared by his brother-in-law, architect Roy Alstan Lippincott, and; Walter’s wife Marion Mahony Griffin prepared the coloured sketches on silk

What else have you seen online for History Week 2012?