: Creating bounding boxes for parish maps in the SLV collection The State Library of Victoria holds a collection of 8,804 parish maps. As part of my residency at …
: Exploring SLV urls I like urls. They take you places. And if you know how to read them, they can tell you things about …
: Creative Technologist-in-Residence at the State Library of Victoria! I’m very excited to be the new Creative Technologist-in-Residence at the SLV LAB. For the next …
: WikiFest at the State Library of Victoria This week I was lucky enough to participate in WikiFest at the State Library of Victoria. Organised …
: GLAM hacking with userscripts In teaching and workshops I used to get students to question the idea that websites are …
: The rebirth of Wragge Labs (and moving my Heroku apps) It looks like some paid work I was counting on won’t be going ahead, so I’m trying to …
: The future of the past... in the present I’ve been on a bit of a self-archiving binge lately. It started because I needed to cut back …
: Mining for meanings In 2012, I was lucky enough to be awarded a Harold White Fellowship by the National Library of …
: A brief and biased history of Trove Twitter bots The socials recently alerted me to an interesting article by Dominique Carlon, Jean Burgess, and …
: Some Archives Week goodies It’s International Archives Week and I’m feeling a bit crook after being double-vaxxed …
: New dataset – Trove links shared on Twitter, 2009 to 2020 A few years ago, I harvested the details of tweets that included links to Trove. The data has just …
: GLAM Workbench – preprint for 'Building User-Friendly Toolkits and Platforms for Digital Humanities' This is a preprint of my contribution to the publication ‘Building User-Friendly Toolkits and …
: No more harvesting data from the National Archives of Australia A couple of weeks ago I bid farewell to Trove due to the cancellation of my API keys and the …
: Farewell Trove Over the last few months I’ve been grappling with the cancellation of my Trove API keys by the …
: SLV LAB and GLAM Workbench updates Last week the State Library of Victoria launched SLV LAB, a prototyping and innovation lab that …
: New PROV section added to the GLAM Workbench There’s a brand new GLAM Workbench section to help you work with data from the Public Record …
: The GLAM Workbench introduction to how notebooks work now runs in Jupyter Lite I’ve just updated my introduction to using Jupyter notebooks in the GLAM Workbench so that it …
: Update on Trove data access and my suspended API keys On 21 February, my Trove API keys were cancelled without warning. A week later, I met with NLA staff …
: Using the Public Record Office Victoria's API to build an overview of their collection Over the past few weeks I’ve been exploring the Public Record Office Victoria’s public …
: More than 6 million rows of data from Public Record Office Victoria added to the GLAM Name Index Search The GLAM Name Index Search now includes more than 6 million rows of data from the Public Record …
: Introducing PROVBot – sharing photos from Public Record Office Victoria With poor old TroveNewsBot killed by the NLA, my Mastodon feed has had less GLAM goodness of late. …
: Trove API users beware! – the latest in the saga of my cancelled API keys After my Trove API keys were cancelled without warning on 21 February, I reluctantly agreed to a …
: 15 years of work on Trove threatened by the NLA See my latest post for an update! On Friday, without warning, I received an email from the National …
: The Primary Source – GLAM collection news and help I’ve created a new site (or in fact, renovated an old site) to aggregate news from GLAM …
: National Archives of Australia Digitisation Dashboard Since March 2021, I’ve been harvesting details of newly-digitised files in the National …
: Search the content of periodicals uploaded to Trove through the National eDeposit service I’ve added a notebook to the GLAM Workbench that walks through the steps involved in creating …
: Ten years of data! The files you're not allowed to see in the National Archives of Australia I’ve created a new dataset containing 10 years of data that can be used to explore the …
: A Community Data Lab (CDL) wishlist The ARDC is holding an event on 18 February to begin shaping the next phase of the Community Data …
: Files digitised by the National Archives of Australia in 2024 In 2024, the National Archives of Australia digitised 254,953 files (down from 416,602 in 2023). …
: Changes to Trove newspapers in 2024 Every Sunday I harvest information about the number of digitised newspaper articles in Trove. You …
: @trovenewsbot has a new home @trovenewsbot has been around for more than eleven years now – originally sharing Trove newspaper …
: Six more volumes added to the searchable database of Tasmanian Post Office Directories! A couple of months ago I realised my big, searchable database of Tasmanian Post Office Directories …
: Where's 1920? Missing volume added to Tasmanian Post Office Directories! Visualisation is a great way to find problems in your data. As part of the Everyday Heritage …
: Major update for the Trove Newspapers section of the GLAM Workbench The Trove newspapers section of the GLAM Workbench was updated last week. Over the last year …
: Preserving the history of online collections (my love letter to future historians) It’s pretty obvious that access to digitised resources, like Trove’s newspapers, has …
: Saving Trove's digitised periodicals as PDFs I was recently contacted by a researcher who wanted to be able to automatically download the issues …
: The future (and past) of Historic Hansard Don’t panic! Historic Hansard is not closing down – on the contrary, I’m planning a …
: Join the Research Data Alliance's new Collections as Data Interest Group! If you’re interested in opening up GLAM collections for use in research, you might like to …
: More datasets added to GLAM Name Index Search – now almost 12 million rows of data! The GLAM Name Index Search brings datasets from 10 Australian GLAM organisations together into a …
: New Zotero translators for PROV and Queensland State Archives Good news for Australian archives users – you can now use Zotero to capture item details and …
: Explore Trove's digitised maps Trove contains thousands of digitised maps from the collections of the National Library of …
: Share your spreadsheet as a searchable online database using Datasette-Lite HASS researchers often compile data in spreadsheets. Sometimes they want to ‘publish’ …
: Home renovations at timsherratt.au I had to update my sadly-neglected CV, so of course I ended up renovating the whole of my personal …
: Updated datasets describing Trove's digitised newspapers The Trove newspapers section of the GLAM Workbench includes a number of notebooks and datasets that …
: Digital History stream at the AHA conference The recently finished Australian Historical Association conference in Adelaide included a digital …
: Understanding Trove at the AHA annual conference A fairly intensive period of work came to an end today as I delivered a workshop on …
: Who is the Trove Data Guide for? The Trove Data Guide aims to help researchers understand, access, and use data from Trove. But just …
: Loading locations of Trove's digitised maps into the Gazetteer of Historical Australian Placenames For this part of the ARDC’s Community Data Lab project, I’ve been focusing in particular …
: Instant exhibitions with Trove and CollectionBuilder You’ve been collecting and annotating items relating to your research project in a Trove List. You’d …
: Keyword analysis of Trove newspapers with the GLAM Workbench & ATAP There’s a new draft tutorial in the development version of the Trove Data Guide. It walks …
: Running Mirador on GitHub Pages I’ve just created a GitHub repository template that you can use to get your own Mirador …
: Commonwealth Hansard XML repository updates Hey Australian Hansard fans, I’ve done a complete reharvest of all of the Commonwealth Hansard …
: More tools for harvesting Trove newspaper articles I’ve just added a couple of new notebooks to the Trove Newspaper & Gazette Harvester …
: Trove to Tropy via IIIF – documenting data pathways in the Trove Data Guide Last week I added a notebook to the GLAM Workbench that saves a collection of images from Trove as …
: Using IIIF to explore Trove's digitised images I’ve just added a new notebook to the Trove images section of the GLAM Workbench. It helps you …
: Using Pandora's collection of archived websites There’s a brand new section of the GLAM Workbench to help you use data from Pandora’s …
: How to download all the images from a digitised collection in Trove (& learn some cool Trove tricks) Digitised resources in Trove are sometimes grouped into collections – an album of photographs, a set …
: What do you want to do with Trove data? In my work on the Trove Data Guide I’ve started sketching out a series of research pathways. …
: Update! Saving Trove newspaper articles and pages as images You probably know that when you select the Download as Image option for a digitised newspaper …
: Getting to know NED – born-digital periodicals in Trove I spend a lot of my time trying to highlight the wealth of resources available through Trove – …
: More tools and data for working with Trove's digitised periodicals The Trove Periodicals section of the GLAM Workbench has been updated! Some changes were necessary to …
: A new way to explore editorial cartoons from *The Bulletin* About five years ago I created a collection of full-page editorial cartoons from The Bulletin, …
: New GLAM Workbench section for working with government publications in Trove The GLAM Workbench has a brand new section aimed at helping you find and use government publications …
: Digital history stream at AHA annual conference in July This year the annual conference of the Australian Historical Association will include a digital …
: Some recent presentations on the GLAM Workbench and Trove Data Guide Last week I attended the ARDC Workshop on Repositories & Workspaces where I gave a quick intro …
: Exploring Trove’s digitised periodicals While Trove’s digitised newspapers get all the attention, there are many other digitised periodicals …
: The Trove Newspaper Data Dashboard now has an archive! Since July 2022 I’ve been generating weekly snapshots of the contents of the Trove newspaper corpus. …
: Customising Datasette-Lite to explore datasets in the GLAM Workbench As well as tools and code, the GLAM Workbench includes a number of pre-harvested datasets for …
: What’s going on? The hardest part of developing tools and resources like the GLAM Workbench is getting information …
: Exploring oral histories in Trove The National Library of Australia holds over 55,000 hours of oral history and folklore recordings …
: Mapping MARC Geographic Area codes to Wikidata Trove uses codes from the MARC Geographic Areas list to identify locations in metadata records. I …
: National Archives of Australia in 2023 – digitisation of files In 2023 the National Archives of Australia digitised 416,602 files (down from 575,597 in 2022). This …
: Trove newspapers in 2023 I’ve been capturing weekly snapshots of the Trove newspaper corpus for the last couple of years. You …
: Trove Data Guide update – accessing data from newspapers and gazettes I’m continuing to slog away at the Trove Data Guide (part of the ARDC’s HASS Community Data Lab) – …
: Some important updates for the Trove Newspaper & Gazette Harvester Version 3 of the Trove API is out, and version 2 is scheduled to be decommissioned in early 2023 – …
: Run GLAM Workbench notebooks on the ARDC’s new Binder service There are a number of different ways to run the Jupyter notebooks in the GLAM Workbench depending on …
: Trove Query Parser updated! I’ve just updated the Trove Query Parser to work with version 3 of the Trove API. You just …
: Family history resources in the GLAM Workbench It’s Family History Month, so I thought a brief post was in order describing some of the family …
: Bye bye birdsite In early June I pinned a “nobody’s home” post to my profile and said goodbye to …
: Exploring the front pages of newspapers (10 years on) Way back in 2012, I used the brand new Trove API to download the details of 4 million articles …
: Trove API Console updates The Trove API Console provides examples of the Trove API in action that you can run, edit, and …
: Getting to work on the Trove Data Guide The ARDC has started work on the development of a HASS Community Data Lab to support digital …
: Updated harvest of NSW State Archives indexes – more than 2 million rows of data! The NSW State Archives (now part of Museums of History NSW) publishes a series of useful indexes to …
: A big milestone, Trove contributor data, and the coming of API v3 – recent GLAM Workbench updates There have been quite a few GLAM Workbench updates over the last month, here’s some notes. (See …
: Maps, people, lists & more – recent updates to Trove resources in the GLAM Workbench Once again I’ve gotten a bit behind in noting GLAM Workbench updates, so here’s a quick catch up on …
: Real Face of White Australia – updated site to transcribe records from the National Archives of Australia Back in 2017, I worked with students from my ‘Exploring Digital Heritage’ class at the University of …
: Recent presentations – Library of Congress Data Jam, Everyday Heritage, Wikidata, and GLAM Workbench! October and November brought a flurry of presentations from which I’m still recovering. Here’s a few …
: The Australian history industry and the impact of digitisation (open access preprint chapter) The Australian History Industry was published recently. Edited by Paul Ashton and Paula Hamilton, …
: Recent updates to trove-newspaper-harvester and trove-newspaper-images Catching up on some software package updates over the last few months. The trove-newspaper-harvester …
: Do you want your Trove newspaper articles in bulk? Meet the new Trove Newspaper Harvester Python package! The Trove Newspaper Harvester has been around in different forms for more than a decade. It helps …
: From 48 PDFs to one searchable database – opening up the Tasmanian Post Office Directories with the GLAM Workbench A few weeks ago I created a new search interface to the NSW Post Office Directories from 1886 to …
: Fresh harvest of OCRd text from Trove's digitised periodicals – 9gb of text to explore and analyse! I’ve updated the GLAM Workbench’s harvest of OCRd text from Trove’s digitised periodicals. …
: Explore Trove's digitised newspapers by place I’ve updated my map displaying places where Trove digitised newspapers were published or …
: Making NSW Postal Directories (and other digitised directories) easier to search with the GLAM Workbench and Datasette As part of my work on the Everyday Heritage project I’m looking at how we can make better use of …
: Interested in Victorian shipwrecks? Kim Doyle and Mitchell Harrop have added a new notebook to the …
: Updates! troveharvester Python package updated to v0.5.1: github.com/wragge/tr… Trove …
: Minor update to RecordSearch Data Scraper – now captures ‘institution title’ for …
: Many thanks to the British Library – sponsors of the GLAM Workbench’s web archives section! You might have noticed some changes to the web archives section of the GLAM Workbench. I’m very …
: New GLAM data to search, visualise and explore using the GLAM Workbench! There’s lots of GLAM data out there if you know where to look! For the past few years I’ve been …
: Zotero now saves links to digitised items in Trove from the NLA catalogue! I’ve made a small change to the Zotero translator for the National Library of …
: View embedded JSON metadata for Trove's digitised books and journals The metadata for digitised books and journals in Trove can seem a bit sparse, but there’s …
: Where did all those NSW articles go? Trove Newspapers Data Dashboard update! I was looking at my Trove Newspapers Data Dashboard again last night trying to figure out why the …
: Catching up – some recent GLAM Workbench updates! There’s been lots of small updates to the GLAM Workbench over the last couple of months and I’ve …
: Calling all Tasmanian historians – you can now save resources from Libraries Tasmania into Zotero! I’ve created a Zotero translator for the Libraries Tasmania catalogue. Using it, you can save …
: Updated dataset! Harvests of Trove list metadata from 2018, 2020, and 2022 are now available on …
: Updated dataset! Details of 2,201,090 unique public tags added to 9,370,614 resources in Trove …
: Ok, I’ve created a Zenodo community for datasets documenting changes in the content and …
: Coz I love making work for myself, I’ve started pulling datasets out of #GLAMWorkbench code …
: Ahead of my session at #OzHA2022 tomorrow, I’ve updated the NAA section of the #GLAMWorkbench. …
: 55,633 items digitised by the National Archives of Australia last week. Including: Bonegilla name …
: Newspapers added to Trove last week Freelance (WA) The Standard (WA) Berrigan Advocate (NSW) …
: Noticed that QueryPic was having a problem with some date queries. Should be fixed in the latest …
: The Trove Newspapers section of the #GLAMWorkbench has been updated! Voilá was causing a problem in …
: Some more #GLAMWorkbench maintenance – this app to download a high-res page images from Trove …
: The Trove Newspaper and Gazette Harvester section of the #GLAMWorkbench has been updated! No major …
: Main changes to individual Trove newspapers last week: +19,862 articles in Daily News (WA) +10,822 …
: Changes to Trove newspapers last week: +86,761 articles +16,367 articles with corrections +5,355 …
: 42,472 files were digitised by the National Archives of Australia last week. 36,238 of these were …
: I wrote up something for the #GLAMWorkbook on ‘Empty searches and hacking urls’: …
: Under development – a Zotero translator for Libraries Tasmania! I’ve created a Zotero translator for the Libraries Tasmania catalogue. Using it, you can save …
: Ok, I’ve submitted my Libraries Tasmania translator to the Zotero repository for inclusion. No …
: Getting to work migrating the Real Face of White Australia transcription site from scribeAPI (no …
: It’s getting there – new Real Face of White Australia site using Datasette, IIIF, and …
: Ordering some #GLAMWorkbench stickers…
: After much faffing about today I’ve got the latest version of the UniversalViewer building …
: Files digitised by the National Archives of Australia this week: 25,981 Top series: +14,025 in B884 …
: New in Trove this week: Berrigan Advocate (NSW) Tingha Spectator & North Western Journal (NSW) …
: Major changes to Trove newspaper titles this week: +30,713 in Queanbeyan Age (NSW, end date now …
: Added to Trove newspapers this week: +43,015 articles +10,263 articles with corrections +7,499 …
: Using Datasette on Nectar If you have a dataset that you want to share as a searchable online database then check out …
: This week the National Archives of Australia digitised 21,488 files: +10,305 in B884 (CMF personnel …
: Major changes to individual Trove newspapers this week: +52,543 articles from The Daily News (WA) …
: Changes to Trove newspapers this week: +74,859 articles +15,852 articles with corrections +8,668 …
: Convert your Trove newspaper searches to an API query with just one click! I’m thinking about the Trove Researcher Platform discussions & ways of integrating Trove …
: Also on tonight’s episode of ‘In GLAM This Week’, the NAA digitised 20,517 files. …
: This week’s changes in Trove newspapers: +7,451 articles +16,628 articles with corrections …
: Another overdue maintenance task completed! The Tung Wah Newspaper index has been migrated from a …
: TIL you can do date maths in Trove. Searching for date:[NOW-10YEAR TO NOW] in newspapers & …
: My Trove researcher platform wishlist The ARDC is collecting user requirements for the Trove researcher platform for advanced research. …
: Spending the evening updating the NAA section of the #GLAMWorkbench. Here’s a fresh harvest of …
: This morning has been all bug hunting. But at least I’ve now found & fixed the problem, …
: Changes in Trove newspaper titles in the last week: +26,731 articles from Daily News (WA) +88,485 …
: Changes in Trove newspapers in the past week: +124,404 articles available +17,306 articles with …
: Somewhat unexpectedly the US National Archives & Records Administration catalogue includes some …
: I’ve got a site, I suppose I need to add some content now… glam-workbook.net …
: Working with Trove data – a collection of tools and resources The ARDC is organising a couple of public forums to help gather researcher requirements for the …
: New articles available this week from specific Trove newspapers: +39,296 from Daily News (WA) …
: Changes to Trove newspapers in the last week: +211,393 articles available +15,738 articles with …
: And so it starts… #GLAMWorkbench
: Followed up my last FOI request about HASS research infrastructure to find out why the appendix was …
: And with that I think I’ll call it quits for #DayofDH2022 in this part of the world. Time to …
: Ok, I’ve created a new #GLAMWorkbench meta issue to try and bring together all the things …
: A couple of hours of #DayofDH2022 left – feeling a bit uninspired, so I’m going to do some …
: Hmm, didn’t get any writing done and now it’s time to cook dinner for the family. Bit of …
: Workspace photo for #DayofDH2022. Old iMac for the socials & meetings. Newish laptop running …
: Now after coding, bug chasing, meeting, & prototype demo, I have to try and get into a headspace …
: Meeting and demo done. Love working with ANU Archives, & really excited about the latest version …
: I’ve hit a bit of a brick wall with my Datasette deployment. I’m probably missing …
: And Cloudstor is down for maintenance. I suppose I wan’t be doing that demo then… …
: Perhaps appropriately for #DayofDH2022, I’ve spent most of the morning trying to hunt down a …
: Micro.blog offers another alternative for people wanting more control over their socials. I’m …
: Tracking Trove changes over time I’ve been doing a bit of cleaning up, trying to make some old datasets more easily available. …
: Adventures in FOI – HASS RDC Scoping Studies So my FOI request to release the scoping studies that informed investments in the current round of …
: The GLAM Workbench wants you! Over the past few months I’ve been doing a lot of behind-the-scenes work on the GLAM Workbench …
: Omeka S Tools – new Python package Over the last couple of years I've been fiddling with bits of Python code to work with the Omeka S …
: Zotero support in Australian GLAMs Last year I started compiling information about the level of Zotero integration provided by …
: Testing, testing... I regularly update the Python packages used in the different sections of the GLAM Workbench; though …
: Some big pictures of newspapers in Trove and DigitalNZ One of the things I really like about Jupyter is the fact that I can share notebooks in a variety of …
: Exploring GLAM data at ResBaz The video of my key story presentation at ResBaz Queensland (simulcast via ResBaz Sydney) is now …
: GLAM Workbench Nectar Cloud Application updated! The newly-updated DigitalNZ and Te Papa sections of the GLAM Workbench have been added to the list …
: DigitalNZ & Te Papa sections of the GLAMWorkbench updated! In preparation for my talk at ResBaz Aotearoa, I updated the DigitalNZ and Te Papa sections of the …
: A template for GLAM Workbench development I’m hoping that the GLAM Workbench will encourage GLAM organisations and GLAM data nerds (like me) …
: More thoughts on the Trove researcher platform for advanced research Previously on ‘What could we do with $2.3 million?’, the National Library of Australia produced a …
: Coming up! GLAM Workbench at ResBaz(s) Want a bit of added GLAM with your digital research skills? You’re in luck, as I’ll be speaking at …
: New video – using the Trove Newspaper & Gazette Harvester The latest help video for the GLAM Workbench walks through the web app version of the Trove …
: Harvest newspaper issues as PDFs An inquiry on Twitter prompted me to put together a notebook that you can use to download all …
: GLAM Workbench now in the Nectar Research Cloud! The GLAM Workbench isn’t dependent on one big piece of technological infrastructure. It’s basically …
: More GLAM Name Index updates from Queensland State Archives and SLWA A new version of the GLAM Name Index Search is available. An additional 49 indexes have been added, …
: Getting data about newspaper issues in Trove When you search Trove’s newspapers, you find articles – these articles are grouped by page, …
: GLAM Workbench at eResearch Australasia 2021 Way back in 2013, I went to the eResearch Australasia conference as the manager of Trove to talk …
: New Python package to download Trove newspaper images There’s no reliable way of downloading an image of a Trove newspaper article from the web …
: More records for the GLAM Name Index Search Two more datasets have been added to the GLAM Name Index Search! From the History Trust of South …
: New preprint – ‘More than newspapers’ Here’s the preprint version of an article, ‘More than newspapers’, that I’ve submitted for a forum …
: More QueryPic in action Recently I created a list of publications that made use of QueryPic, my tool to visualise searches …
: Some thoughts on the ‘Trove Researcher Platform for Advanced Research’ draft plan Late last year the Federal Government announced it was making an $8.9 million investment in HASS and …
: Some research projects that have used QueryPic A Twitter thread about some of the research uses of QueryPic… QueryPic, my tool for …
: Government publications in Trove Over the last few weeks I’ve been updating my harvests of OCRd text from digitised books and …
: GLAM Workbench – a platform for digital HASS research We’re in the midst of planning for the HASS Research Data Commons, which will deliver some …
: A Family History Month experiment – search millions of name records from GLAM organisations There’s a lot of rich historical data contained within the indexes that Australian GLAM …
: Explore Trove’s digitised books The Trove books section of the GLAM Workbench has been updated! There’s freshly-harvested data, as …
: A miscellany of ephemera, oddities, & estrays I’m just in the midst of updating my harvest of OCRd text from Trove’s digitised books (more about …
: Everyday heritage and the GLAM Workbench Some good news on the funding front with the success of the Everyday Heritage project in the latest …
: Recent GLAM Workbench presentations So far this year I’ve given eight workshops or presentations relating to the GLAM Workbench, with …
: Updated! Lots and lots of text freshly harvested from Trove periodicals For a few years now I’ve been harvesting downloadable text from digitised periodicals in Trove and …
: New dataset – Politicians talking about COVID The Trove Journals section of the GLAM Workbench includes a notebook that helps you download press …
: 8 million Trove tags to explore! I’ve always been interested in the way people add value to resources in Trove. OCR correction tends …
: Integrating GLAM Workbench news and discussion I’ve spent a lot of time this year working on ways of improving the GLAM Workbench’s documentation …
: GLAM Workbench now on YouTube! I’ve started creating short videos to introduce or explain various components of the GLAM Workbench. …
: GLAM Workbench office hours To help you make use of the GLAM Workbench, I’ve set up an ‘office hours’ time slot every Friday …
: ‘Missing Links’ – new open access article! An article written by Kate Bagnall and me has just been published in a special issue of the Journal …
: QueryPic: The Next Generation QueryPic is a tool to visualise searches in Trove’s digitised newspapers. I created the first …
: Everyone gets a Lab! I recently took part in a panel at the IIPC Web Archiving Conference discussing ‘Research use of web …
: Minor change to Reclaim Cloud config When the 1-click installer for Reclaim Cloud works its magic and turns GLAM Workbench repositories …
: Preprint! The limits and affordances of online collections I’ve been working on an essay for publication in a forthcoming edited collection. I wanted to …
: Trove Query Parser Here’s a new little Python package that you might find useful. It simply takes a search url from …
: Some GLAM Workbench stats I deliberately don’t keep any stats about GLAM Workbench visits, because I think they’re pretty …
: More Reclaim Cloud integrations! Five of the GLAM Workbench repositories now have automatically built Docker images and 1-click …
: Get your GLAM datasets here! I’ve updated my harvest of Australian GLAM datasets from state/national government open data …
: NAA RecordSearch section of the GLAM Workbench updated! If you work with the collections of the National Archives of Australia, you might find the …
: Web archives section of GLAM Workbench updated! My program of rolling out new features and integrations across the GLAM Workbench continues. The …
: Using web archives to find out when newspapers were added to Trove There’s no doubt that Trove’s digitised newspapers have had a significant impact on the practice of …
: GLAM Jupyter Resources To make it easier for people to suggest additions, I’ve created a GitHub repository for my list of …
: Running notebooks – a sign of things to come in the GLAM Workbench I recently made some changes in the GLAM Workbench’s Help documentation, adding a new Running …
: Sponsor my work on GitHub! As I foreshadowed some weeks ago, I’ve shut down my Patreon page. Thanks to everyone who has …
: Updates to the Trove Newspapers section of GLAM Workbench I’ve updated, refreshed, and reorganised the Trove newspapers section of the GLAM Workbench. There’s …
: Introducing the new, improved RecordSearch Data Scraper! It was way back in 2009 that I created my first scraper for getting machine-readable data out of the …
: Secrets and lives Here’s the video of my presentation, ‘Secrets and lies’, for the (Re)create symposium at the …
: Recently digitised files in the National Archives of Australia I’m interested in understanding what gets digitised and when by our cultural institutions, but …
: Moving on from Patreon... Over the last few years, I’ve been very grateful for the support of my Patreon subscribers. …
: What can you do with the GLAM Workbench? You might have noticed some changes to the GLAM Workbench home page recently. One of the …
: Reclaim Cloud integration coming soon to the GLAM Workbench I’ve been doing a bit of work behind the scenes lately to prepare for a major update to the GLAM …
: Some recent GLAM Workbench presentations I’ve given a couple of talks lately on the GLAM Workbench and some of my other work relating to the …
: Some GLAM Workbench datasets to explore for Open Data Day It was Open Data Day on Saturday 6 March – here’s some of the ready-to-go datasets you can find in …
: Zotero translator for NAA RecordSearch updated The recent change of labels from ‘Barcode' to ‘ItemID’ in the National Archives of Australia’s …
: TroveNewsBot upgraded – now sharing articles published 'on this day'! @TroveNewsBot has been sharing Trove newspaper articles on Twitter for over 7 years. With its latest …
: The NAA recently changed field labels in RecordSearch, so that ‘Barcode' is now ‘Item ID’. This …
: Open access publishing for Australian historians After some recent investigations of the availability of open access versions of articles published …
: Who was linking to Trove newspapers in 2014? In 2014 I pulled together a sample of web pages that included links back to digitised newspaper …
: New! DigitalNZ API Query Builder added to GLAM Workbench I’ve added an API Query Builder to the DigitalNZ section of the GLAM Workbench. You can use it to …
: OpenGLAM fireworks! Finding open collections in DigitalNZ Lately I’ve been updating and expanding the notebooks in the DigitalNZ section of the GLAM …
: Easy browsing of Trove newspapers with these keyboard shortcuts! If you like browsing Trove’s digitised newspapers page by page, you might have found that the …
: New dataset and notebooks – twenty years of ABC Radio National There’s a new GLAM Workbench section for working with data from Trove’s Music & Sound zone! …
: Finding non-English newspapers in Trove There are a growing number of non-English newspapers in Trove, but how do you know what’s …
: Open access versions of Australian history articles Last year I did some analysis of the availability of open access versions of research articles …
: A long thread exploring files in the National Archives of Australia with the access status of …
: More updates from The Real Face of White Australia – running facial detection code over NAA: SP42/1. …
: I reharvested NAA: ST84/1 and ended up with 14,545 images from 461 digitised files (about 17% of the …
: GLAM Workbench wins British Library Labs Research Award! Asking questions with web archives – introductory notebooks for historians has won the British …
: Want to relive the early days of digital humanities in Australia? I’ve archived the websites created …
: The Invisible Australians website has been given a much needed overhaul, and we’ve brought all our …
: The GLAM Workbench as research infrastructure (some basic stats) Repositories in the GLAM Workbench have been launched on Binder 3,529 times since the start of this …
: Earlier this year I gave a seminar for the International Internet Preservation Consortium (IIPC) …
: Harvest text from the Australian Women's Weekly! The Trove Newspaper & Gazette Harvester has been updated to version 0.4.0. The major change is …
: Beyond the copyright cliff of death If you’ve done any searching in Trove’s digitised newspapers, you’ve probably …
: Updated! Find Trove newspapers by place of publication by using this simple interface – just click …
: I’ve added a new section to the GLAM Workbench for the ANU Archives. The first set of notebooks …
: Any regular user of RecordSearch, the National Archives of Australia’s online database, will …
: I’ve added more years to my repository of Commonwealth Hansard! The repository now includes …
: It was Open Access Week last week, so I tried a little experiment. How many research articles …
: The Trove Newspaper and Gazette Harvester has been updated to include the snippet field in the …
: Calling users of Australian galleries, libraries, archives, & museums – OzGLAM Help is now live! …
: The Zotero translator for RecordSearch (the National Archives of Australia’s online database) …
: If you try to share or bookmark the url of an item in RecordSearch (the National Archives of …
: The Zotero translator for Trove was failing on newspaper articles with tags. I’ve submitted a fix …
: Another #GLAMWorkbench update! Snip words out of @TroveAustralia newspaper pages and create big …
: Just in time for #GovHack, I’ve given the Trove API Console a major overhaul. It’s been updated for …
: Ok, so do you want to make your own ‘scissors & paste’ messages using words from @TroveAustralia …
: Another #GLAMWorkbench update! The Trove Harvester will now download both newspaper and gazette …
: Interested in using web archives in your research? Join us on 5/6 August for a free @netpreserve …
: Introducing a brand new section of the #GLAMWorkbench, exploring the @MuseumsVictoria collection …
: New additions to the @TroveAustralia books section of the #GLAMWorkbench – word frequency examples …
: With the recent changes to @TroveAustralia, the Australian Women’s Weekly cover browser was retired. …
: The Trove books section of the #GLAMWorkbench has been updated. There’s a fresh harvest of …
: Revisiting my Historic Hansard XML repository & realising how easy it is to load files as needed …
: The Trove Journals section of the #GLAMWorkbench has been updated to work with the new …
: New in #GLAMWorkbench! After you’ve used the @TroveAustralia Newspaper Harvester to download lots …
: Download newspaper articles in bulk! The Trove Newspaper Harvester has been updated to work with the …
: My app for searching in @TroveAustralia’s digitised journals has been updated to work with the new …
: Another db migrated and app updated! Have you ever wondered what interjections in historic hansard …
: Here’s a map of places where @TroveAustralia digitised newspapers were published/circulated. …
: New GLAM Workbench section on web archives! We tend to think of a web archive as a site we go to when links are broken – a useful fallback, …
: Thanks to @NetPreserve, I’ve been spending time lately working on a set of web archive exploration …
: Do you have a CSV file you’d like to make searchable, maybe even share online? New on …
: New on #dhhacks – make your own @TroveAustralia newspaper game! Thanks to @glitch, just edit a …
: I’ve given my #dhhacks site a refresh, and updated my @TroveAustralia Twitter bot tutorial to …
: If you’d ever wished you could get a random(ish) newspaper article from @TroveAustralia’s API, …
: The GLAM CSV Explorer has had a few updates — you can now filter by organisation, and upload your …
: Buildings might be closed, but the data is open – explore hundreds of datasets from Australian GLAM organisations! For a couple of years I’ve been harvesting datasets created or published by Australian GLAM …
: Updated! My notebook to upload digitised newspapers from @TroveAustralia to an @Omeka-S site has …
: My data file of public holidays in NSW from 1900-1950 has been updated – now including variations in …
: My harvest of OCRd text from @TroveAustralia digitised books, ephemera, and parliamentary papers has …
: The simple Trove proxy that you can use to get to download links for PDFs of newspaper articles from …
: I’ve added some more documentation to the Trove Newspaper Harvester page in the #GLAMWorkbench. Get …
: New section added to the #GLAMWorkbench with examples from @Library_Vic! #slvdata #dhhacks …
: More fun with @iiif_io and images from @library_vic – resize, rotate, crop and more! Try it out with …
: New #GLAMWorkbench notebook! Download images from @Library_Vic using IIIF and Handle… #dhhacks
: And for a taste of the recent additions to @TroveAustralia’s digitised journals, check out …
: Explore @TroveAustralia’s digitised journals with this simple app. Now updated with the latest …
: Want to save @TroveAustralia newspaper articles as images (that aren’t sliced up in annoying …
: I’ve updated the repository of data transcribed from White Australia policy records in @naagovau. …
: I’ve added a few updates to my ‘Digital tools and such like…’ list for Australian historians. Hope …
: New ‘Trove images' section added to the #GLAMWorkbench! Here you’ll find my latest Jupyter notebook …
: Ok, the LODBook Jekyll plugin is cleaned & commented enough for me to put it aside for a while …
: Voting in the 2019 @dhawards is now open! Go and check out all the cool #DigitalHumanities projects …
: Gathering together videos of past presentations. Here they are on YT: …
: Archived via Zenodo – ‘Inigo Jones: the weather prophet’ – exploring our desire for certainty amidst …
: Archived via Zenodo – ‘Civilization versus the giant, winged lizards’ – a thing I wrote about the …
: One of my favourite things this year was finally publishing ‘The People Inside' with @baibi — …
: New #GLAMWorkbench section with examples of how to get random-ish works and newspaper articles from …
: Did you make a DIY Exhibition from a @TroveAustralia list using my GitHub starter kit? If so, …
: The death and (hopefully) resurrection of Trove Twitter bots Today version 1 of the Trove API was decommissioned. As I explained elsewhere, this meant that a …
: Updated my NSW public holidays data to include a few extras proclaimed by the government: …
: Creators and users of my Trove Twitter Bots, please read and share this update! tl;dr Version 1 of the Trove API will be discontinued soon so Trove Twitter bots need to be …
: Over the last few weeks I’ve been exploring ways of recording dates for 70,000 digitised pages …
: Here’s my attempt to calculate NSW holidays from 1900 to 1950. It’s probably incomplete, …
: A couple of years ago I gave a talk in which I tried to justify what I do as research. I was going …
: The @naagovau RecordSearch section of the #GLAMWorkbench has been updated with more notebooks to …
: Crikey, my notebook for getting useful data out of @naagovau keeps growing! Now with sections on …
: Want to save searches for items in @naagovau’s RecordSearch as CSVs for exploration & …
: I’ve updated my harvest of OCRd text from digitised journals in @TroveAustralia. The complete …
: My app to browse & search @TroveAustralia’s digitised journals has been updated! Since 4 …
: Another WIP notebook in need of additional documentation… This one explores the stats around …
: And this notebook uses TF-IDF to explore the OCRd text of a digitised journal from Trove. Get the …
: This notebooks lets you download the OCRd text of a digitised journal from @TroveAustralia (via …
: A new notebook looking at the data about digitised journals on @TroveAustralia. #dhhacks
: There’s a new section of the GLAM Workbench devoted to the National Museum of Australia collection …
: The second new notebook looks at @TroveAustralia’s newspapers as a whole, visualising both by time …
: Some brand new Jupyter notebooks for those interested in #ozhist & digital exploration of …
: I’ve updated the @invisibleaus data repository with latest transcriptions/markings from White …
: According to my last harvest, @TroveAustralia’s digitised journals comprise 31,216 separate issues. …
: Updates to the Trove newspapers section of GLAM Workbench – adding links to app-ified versions of …
: Download & explore 1,499,259 rows of open data from NSW State Archives Online Indexes NSW State Archives publishes a number of detailed indexes containing data manually extracted from …
: Visualising CV-detected column widths across 100 volumes (30,000+ pages) of Sydney Stock Exchange …
: New in GLAM Workbench! Notebooks to harvest, index, analyse, and aggregate transcripts of speeches …
: I’ve updated my harvest of the PM Transcripts site — 22,814 XML files with transcripts of speeches, …
: Reorganising things a little at GLAM Workbench. @statelibrarynsw gets its own section. Hansard and …
: What’s that? You want MORE GLAM data? Well, I’ve started a list of sources for Australian GLAM data. …
: I’ve updated my harvest of GLAM datasets from data.gov.au. Now there’s 584 CSV files available …
: I’ve put a copy of my article on using @TroveAustralia for digital research/play, written for the …
: I’ve updated the list of orgs who have supported the digitisation of @TroveAustralia’s …
: Today I finished updating a harvest of all OCRd text available from Trove’s digitised journals. …
: Update time! Yesterday I updated my Trove digitised journals app to include all the exciting new …
: A quick interactive view of newspaper articles in @TroveAustralia by state and year. Click on the …
: Anyone who’s been to one of my Trove workshops will be pleased to know that the WWI effect is still …
: So there are now almost twice as many newspaper articles in @TroveAustralia from NSW as there are …
: Well look at that! – a selection of my @TroveAustralia related Jupyter notebooks turned into simple …
: Kicked off a new GLAM Workbench repository dedicated to @SLSA with a quick notebook hack to get …
: Search @TroveAustralia newspapers without leaving Twitter using the updated and enhanced …
: Recent additions to the Trove Newspapers section of the GLAM Workbench: getting images from …
: Want to upload @TroveAustralia newspaper articles to @Omeka-S to create an exhibition or populate a …
: Slides ready for tomorrow’s workshop at @unicanberra – Trove as a pltform for digital research …
: Ever wanted to save a @TroveAustralia newspaper article as an image? This notebook lets you do just …
: More GLAM Workbench updates! More full text of Australian books! I’ve added the notebook & …
: 2019 has been pretty busy so far! I just compiled a list of tools, updates, and examples from the …
: Here’s how you can get the text of Australian books in @TroveAustralia from the Internet …
: I’ve updated the data that sits behind my Trove Places app and added more than 140 newspaper …
: If you’re researching foreign policy using @naagovau you might find this little tool useful – …
: And what can you do with 400 CSV files? Well, you could explore their contents using my GLAM CSV …
: Some overdue updates to the GLAM Workbench. First here’s details, data, and code from a …
: Over the last week I’ve been downloading editorial cartoons published in The Bulletin from …
: After a number of unsuccessful attempts, I seem to be getting The Bulletin title art fairly reliably …
: Here’s the notebook-ified version of the code I used to harvest all the Australian …
: I’ve reharvested Commonwealth Hansard from 1901 to 1980 and updated my repository of XML …
: And now my GLAM Workbench has a ‘Trove Maps’ section to document examples and …
: The other night @OpenGLAM was sharing collections of high-res images from GLAM orgs that are free to …
: If you’d like to make your own big, composite images from lots of @TroveAustralia newspaper …
: Australian pilots, aviators, airmen, and flyers — 4,950 thumbnails from a search in …
: I’ve been busy lately harvesting LOTS of full text data from @TroveAustralia’s digitised …
: I’ve added a section for the @TroveAustralia ‘book’ zone to the GLAM Workbench.
: Ok, so I’ve downloaded the OCRd text from 27,426 issues of 358 digitised journals/series in …
: All 9,738 OCRd text files harvested from books, pamphlets and leaflets in @TroveAustralia’s …
: So @TroveAustralia includes more than 370,000 press releases, speeches, and interview transcripts …
: Among the OCRd texts I’m currently harvesting from Trove’s journals zone are things like the …
: Wow, there are now over 371,000 press releases, interview transcripts and more from the @ParlLibrary …
: Another collection of OCRd text from @TroveAustralia is on its way…
: Playing with @TroveAustralia newspaper results. Here’s illustrated articles with ‘White Australia …
: The final tally – after much tweaking I’ve downloaded OCRd text from 9,738 works in the …
: I’m looking for books in @TroveAustralia, but there’s lots of ephemera (pamphlets, posters etc) in …
: Text of over 3 thousand digitised books and pamphlets downloaded so far from @TroveAustralia…
: After talking to @PrimahadiWijaya today about work at @MonashLing, I started harvesting metadata …
: What I did at #valatechcamp! Here’s a CSV with basic details of 7,719 digitised books …
: TIL that the web pages for digitised works (like books and journal issues) on @TroveAustralia embed …
: Just posting the link to my ‘Introducing APIs’ slides for #VALATechCamp again, so that …
: Hmm, it occurs to me that the method I used to generate newspaper article thumbnails from Trove, …
: So, I’ve finally figured out a way to automatically generate nice-looking thumbnails from …
: So I put the recent report into Australia’s national cultural institutions into the @TDHASSN …
: Train from Canberra to Melbourne booked for #VALATechCamp. I’ll be hanging around both days, …
: Sneak preview of my GLAM CSV Explorer now live on @MyBinderTeam! Select one of 447 GLAM-related CSVs …
: Having ripped out a lot of code and simplified a mess of conditionals, I think this CSV Explorer …
: Now to load that new CSV of GLAM CSVs into my CSV Explorer…
: Quick notebook to harvest GLAM datasets via the new(ish) @datagovau API. Includes 447 CSVs from 19 …
: This is why we can’t have nice things…
: Still plenty to do, but my CSV Explorer is taking shape… (coming soon to @TDHASSN & elsewhere!) …
: Doesn’t take much to show when there’s a problem with dates in metadata… (Yep, post 1900 …
: Fun day talking to the @dhpanu team at ANU about digital history possibilities. Slides/links are all …
: Currently working on a CSV explorer to give researchers an overview of the contents of GLAM …
: A bit more progress. Having found columns with OpenCV, I can use Tesseract to help me find the rows…
: After much OpenCV fiddling & tweaking, sorry… iteration, I’m pretty pleased with this. Columns …
: So right around now I think I’m talking (via video) about my adventures with #HistoricHansard …
: More updates! Latest data and images from The Real Face of White Australia transcription project are …
: I’ve finally updated the @TroveAustralia API Console to use version 2 of the API & https by …
: Lots of exciting new stuff has been added to @TroveAustralia’s digitised journals in the last few …
: Art & Architecture: the journal of the Institute of Architects NSW, 51 issues from 1905 to 1912 …
: Only 12 issues, but check out the fabulous covers on The New Triad from 1927-8. Now on …
: Want some arts? 130 issues of RealTime from 1994 to 2016 now on @TroveAustralia.
: Hey #ozhist, 295 issues of the journal of the Royal Australian Historical Society from 1918 to 1954 …
: Also amongst the latest batch of digitised journals on @TroveAustralia, 39 issues of Camp Ink from …
: There’s more literary journals digitised in @TroveAustralia as well. Including 18 issues of …
: But wait, there’s more — the KCC Kennel Gazette was renamed, wait for it, Dogs. Another 94 …
: People, you need to know that @TroveAustralia has digitised 360 issues of the KCC Kennel Gazette …
: Updating my list of digitised journals on @TroveAustralia this morning and seeing what’s new. …
: I’ll be running some more @TroveAustralia workshops for @UniCanberraReD this year. On 13 May …
: #dhhacks — Save a page image from the State Archives of NSW's Bubonic Plague Register So NSW State Archives has digitised the Register of Cases of Bubonic Plague 1900-1908. Great work! …
: I’ve updated the notebook for harvesting records from @archivesnz’s Archway database in …
: Uh, ok — so an advanced search for keywords only in Archway gives me a maximum of 1000 results. But …
: Looks like I’ll be heading to the VALA Tech Camp in April to talk APIs. See you there!
: New section added to my GLAM Workbench for the Queensland State Archives (@qsarchives). Includes a …
: So in case you’re wondering, the @qsarchives ‘Naturalisations 1851 to 1904’ index …
: Whoops. Here’s the actual full list of countries of origin from the @nswarchives NSW …
: Here’s the full list of countries of origin from the NSW naturalisations data, 1834-1903.
: NSW naturalisations 1834 to 1903. The sudden rise in Chinese naturalisations followed the …
: Suggestions of new topics and collections for my GLAM workbench are welcome!
: Here’s an example dataset harvested from Library and Archives Canada’s naturalisation …
: I’ve added a section for Library and Archives Canada to my GLAM workbench. The first notebook …
: Current status — extracting data from Library and Archives Canada’s 1915-1946 naturalisation …
: The full text of ‘Who belongs? Reading identity, ownership, and legitimacy’, my talk for …
: My talk for #text2data at the National Library of Sweden looks at occurence of the words …
: Back to school report — what I did on my holidays…
: Another slide for Sweden — this one comparing words appearing before ‘aliens’ in The …
: Working on my slides for From Text to Data in Stockholm this week…
: I’ve added a ‘save chart’ option to the QueryPic app in my GLAM Workbench. …
: Pleased and proud to see the chapter @baibi & I wrote on the Real Face of White Australia now …
: In a bit over a week I’ll be heading to Stockholm for the ‘From text to data’ …
: Talking about 'immigrants' in Trove's digitised newspapers I’m giving a talk in a week or so (eep!) that looks at some of the changing contexts in which …
: In case you’re wondering, it took about 13 hours to download the metadata and full text of …
: Ok, so let’s see how I go harvesting 2 million newspaper articles from @TroveAustralia …
: 30,000+ occurences of the word ‘Chinese’ in the OCRd full text of The Bulletin, …
: One more and I’m done for the night… New GLAM Workbench page for the ‘Trove API …
: I’ve finished putting details of all the current GLAM Workbench repositories into the new …
: Added a ‘data’ section to the GLAM Workbench docs, with info on harvests from government …
: And now a GLAM Workbench page for @Te_Papa…
: Added a page for @ArchivesNZ’s Archway to the GLAM Workbench docs…
: So here’s some fun things to do with @TroveAustralia newspapers… (via GLAM Workbench)
: Ok, more documentation for you — page for the @DigitalNZ API in GLAM Workbench updated!
: Slowly working my way through the documentation for my GLAM Workbench. Still lots to do, but I think …
: If there are APIs or other data sources you’d like me to add to my GLAM Workbench, feel free …
: Updated list of the fifty most common words occuring before the word ‘aliens’ in …
: Just updated my harvest of metadata and full text from The Bulletin in @TroveAustralia. …
: Fifty most common words occuring before the word ‘aliens’ in @TroveAustralia newspapers …
: You want big data? I just harvested 213,340 newspaper articles (including full OCRd text) from …
: So now I’ve updated TroveHarvester and built a new interface I can get back to the task I …
: Want an easy way to download @TroveAustralia newspaper articles in bulk? No installation? Point and …
: And version 0.2.2 of TroveHarvester quickly follows 0.2.1 as I squash a bug when downloading …
: TroveHarvester 0.2.1 — updated to work with version 2 of the @TroveAustralia API. Now on pypi! More …
: Ok, that’s more like it. Full text and metadata of 29,203 newspaper articles harvested using …
: Ah ok, I forgot about the new ‘bulkHarvest’ parameter in the @TroveAustralia API. …
: Uh, never come across one of these before from the @TroveAustralia API. Needless to say it causes …
: Testing the updated Trove Newspaper Harvester… Run into a problem with the @TroveAustralia …
: Thanks to the @TroveAustralia API upgrade, the new version of the Trove Newspaper Harvester should …
: Since I’m updating the Trove Newspaper Harvester to work with version 2 of the @TroveAustralia …
: I’m enjoying using micro.blog as a way of capturing what I’m working on: …
: Finally biting the bullet and getting to work on updating the TroveHarvester to work with version 2 …
: That’s cool — just realised I can share easily share live versions of Altair charts from …
: And also “coloured alien” which, not suprisingly, peaks in 1901 when the Immigration …
: Exploring some of the adjectives attached to ‘alien’ in @TroveAustralia …
: Just to emphasise my point the other day about the impact of stemming on searches for …
: Nothing like browsing the databases of another country’s national/state archives to make you …
: The Australian version of ‘Who’s responsible?’ is up! Just select a government …
: New notebook added to the #GLAMWorkbench RecordSearch repository — get the basic details of agencies …
: Hmm, wondering why the ‘National Council of Women of the Australian Capital Territory’ …
: As well as cross-posting updates to Twitter and Mastodon, I’ve now set up IFTTT to keep an eye …
: Adventures in stemming, or what happens when you search Trove for 'naturalization' Fun fact — the Porter stemming algorithm treats the words ‘naturalisation’ and …