Category Archives: Technical

The Hidden Shifting Lens of Browsers

Some time ago, I wrote about the interesting situation we had with emulation and Version 51 of the Chrome browser – that is, our emulations stopped working in a very strange way and many people came to the Archive’s inboxes … Continue reading

Posted in Emulation, Technical, Wayback Machine | 2 Comments

Those Hilarious Times When Emulations Stop Working

Jason Scott, Software Curator and Your Emulation Buddy, writing in. With tens of thousands of items in the archive.org stacks that are in some way running in-browser emulations, we’ve got a pretty strong library of computing history afoot, with many more joining … Continue reading

Posted in Emulation, Software Archive, Technical | 2 Comments

Distributed Preservation Made Simple

Library partners of the Internet Archive now have at their fingertips an easy way – from a Unix-like command line in a terminal window – to download digital collections for local preservation and access. This post will show how to … Continue reading

Posted in News, Technical | 6 Comments

archive.org download counts of collections of items updates and fixes

Every month, we look over the total download counts for all public items at archive.org.  We sum item counts into their collections.  At year end 2014, we found various source reliability issues, as well as overcounting for “top collections” and … Continue reading

Posted in Audio Archive, Books Archive, Education Archive, Image Archive, Live Music Archive, Movie Archive, Music, Software Archive, Technical, Video Archive | Tagged , , , | Comments Off on archive.org download counts of collections of items updates and fixes

Using Docker to Encapsulate Complicated Program is Successful

The Internet Archive has been using docker in a useful way that is a bit out of the mainstream: to package a command-line binary and its dependencies so we can deploy it on a cluster and use it in the same … Continue reading

Posted in Music, Technical | 3 Comments

Job Posting: Web Application/Software Developer for Archive-It

The Internet Archive is looking for a smart, collaborative and resourceful engineer to lead and do the development of the next generation of the Archive-It service, a web based application used by libraries and archives around the world. The Internet … Continue reading

Posted in Archive-It, Jobs, News, Technical | Comments Off on Job Posting: Web Application/Software Developer for Archive-It

How to use the Virtual Machine for Researchers

Some researchers that are working with the Internet Archive, such as those at University of Massachusetts, have wanted closer access to some of our collections. We are learning how to support this type of “on-campus” use of the collections. This … Continue reading

Posted in Technical | Tagged | 2 Comments

Site down some of Tuesday and Wednesday for Power Upgrade

[Update:   Upgrade is done, we were offline twice, as we predicted (and are sorry about), but now we have twice the power. Thank you PG&E, Ralf Muehlen, and the Archive engineers.] This week, we are doubling the power coming into … Continue reading

Posted in News, Technical | 3 Comments

Celebrating 100 million tasks (uploading and modifying archive.org content)

Just over 8-1/2 years ago, I wrote a multi-process daemon in PHP that we refer to as “catalogd”.  It runs 24 hours a day, 7 days a week, no rest! It is in charge of uploading all content to our … Continue reading

Posted in News, Technical | Tagged , , , , | 1 Comment

new mp4 (h.264) derivative technique — simpler and easy!

Greetings video geeks!  😎 We’ve updated the process and way we create our .mp4 files that are shown on video pages on archive.org It’s a much cleaner/clearer process, namely: We opted to ditch ffpreset files in favor of command-line argument … Continue reading

Posted in Technical, Television Archive, Video Archive | Tagged , , , , , | 3 Comments

new video and audio player — video multiple qualities, related videos, and more!

Many of you have already noticed that since the New Year, we have migrated our new “beta” player to be the primary/default player, then to be the only player. We are excited about this new player! It features the very … Continue reading

Posted in Audio Archive, Live Music Archive, Technical, Television Archive, Video Archive | Tagged , , , , | 4 Comments

getting only certain formats in .zip files from items — new feature

Per some requests from our friends in the Live Music Archive community… You can get any archive.org item downloaded to your local machine as a .zip file (that we’ve been doing for 5+ years!) But whereas before it would be … Continue reading

Posted in Audio Archive, Live Music Archive, Technical | Tagged , , , | Comments Off on getting only certain formats in .zip files from items — new feature

Uploading images for text items (update on *_images.zip format)

The old news Until about a year ago, if you wanted to upload a set of individual page images and have them be recognized as a “book” so we’d create the usual derivative formats from them, you had to mimic … Continue reading

Posted in Books Archive, Technical | 1 Comment

Improved theora/ogg video derivatives!

We’ve made our ogg video derivatives slightly better via: minor bump up to “thusnelda” release “upgrade” from 1-pass video encoding to 2-pass video encoding direct ffmpeg creation of the video (you’ll need to re/compile ffmpeg minimally with “–enable-libtheora –enable-libvorbis” configure … Continue reading

Posted in Technical, Video Archive | Tagged , , , , | 3 Comments

Downloading in bulk using wget

If you’ve ever wanted to download files from many different archive.org items in an automated way, here is one method to do it. ____________________________________________________________ Here’s an overview of what we’ll do: 1. Confirm or install a terminal emulator and wget … Continue reading

Posted in Technical | 34 Comments

IA forums now do “inline reply”

One thing that’s driven me a bit kooky is every time I “reply to this post” in the Internet Archive forums, it drives the browser to a new form page with no context/content of the post I was just looking … Continue reading

Posted in Technical | Tagged | 1 Comment

new off-site video/audio embed codes

We are about to rollout a “new new” video/audio player 😎 You can see it in action now with our upcoming embed codes to go with this new player. It will allow for additional much wanted features like: – off-site … Continue reading

Posted in Technical, Video Archive | Tagged , , , | 11 Comments

Open Hardware: Inexpensive Enclosures From Junction Boxes.

I had a need for a cheap, standard enclosure for a humidity and temperature monitoring project. While there are many, many options for enclosures out there, few are cheap AND locally available. It occurred to me that electrical junction boxes … Continue reading

Posted in Technical | 14 Comments