Tag Archives: Kalev Leetaru

Reflecting on 9/11: Twenty Years of Archived TV News – Special Event and Resources

On Thursday, September 9, the Internet Archive will host an online webinar, “Reflecting on 9/11: Twenty Years of Archived TV News” Learn from scholars, journalists, archivists, and data scientists about the importance of archived television for gaining insights into our evolving understanding of history and society.

Participants include the Internet Archive, The American Archive of Public Broadcasting, The Vanderbilt Television News Archive and UCLA Library’s NewsScape TV News Archive. Speakers will include Roger Macdonald (Founder, Internet Archive’s TV News Archive), Jim Duran (Director, Vanderbilt Television News Archives), Karen Cariani (David O. Ives Executive Director, GBH Archives and GBH Project Director, American Archive of Public Broadcasting), Todd Grappone (UCLA Associate University Librarian for Digital Initiatives and Information Technology), Kalev Leetaru (Founder, Global Database of Events, Language and Tone Project), and Philip Bump (Washington Post national correspondent focused largely on the numbers behind politics)

Please register in advance for the September 9 webinar (11:00 AM – 12:30 PM PDT)

Journalists and scholars: as you prepare 20th anniversary 9/11 reporting and analysis, these unique resources are available:

  • Internet Archive’s 9/11 Television News Archive – a browsable library of TV news from U.S. and international broadcasters from 19 networks, over seven days, from the morning of September 11 through September 17, 2001. Contact: Josh Baran 917-797-1799
  • The Vanderbilt Television News Archive (VTNA) – Founded in 1968, the Archive’s collection includes TV news of attacks on 9/11/2001 coverage during the following weeks broadcast by ABC, NBC, CBS and CNN. Over 270 hours of footage is available for viewing and research. The VTNA records and preserves national television broadcasts of the evening news on ABC, CBS, and NBC with the addition of the primetime news program on CNN in 1995 and the Fox News Channel in 2004. In addition to these nightly recordings, the VTNA also monitors television news networks for breaking live events. Contact: Jim Duran – 615-936-4019  
  • The American Archive of Public Broadcasting (AAPB) marks the 20th anniversary of the 9/11 terrorist attacks by releasing a new 9/11 Special Coverage Collection of 68 public television and radio programs from stations across the country covering the events of the attacks and the aftermath. Among the featured programs are coverage of 9/11 and its anniversaries by The Newshour with Jim Lehrer, the PBS News Hour, and much more. The AAPB is a collaboration between Boston public media producer GBH and the Library of Congress to preserve and make accessible culturally significant public media programs from across the country. Contact: Emily Balk, GBH External Communications Manager – 617-300-5317
  • UCLA Library’s NewsScape TV News Archive contains digitized television news programs collected from cable and broadcast sources in the Los Angeles area from 2005 to the present, as well as a smaller number of news programs from other domestic, international, and online sources collected from 2004 to the present. The archive includes hundreds of thousands of hours of news programs, which are indexed and time-referenced via their closed captions and other associated metadata to enable full-text searching and interactive streaming playback.
Interface for browsing TV news on 19 networks – September 11, 2001 through September 17th – Internet Archive

Background:

  • 500+ archived 9/11-related websites curated by The National September 11 Memorial Museum using the Internet Archive’s Archive-It service
  • Internet Archive’s Open Library offers a list of 2,630 published works about the 9/11 attack
  • A decade ago, on the 10th anniversary of 9/11, NYU’s Department of Cinema Studies hosted a conference that featured work by scholars using television news materials to help us understand how TV news presented the events of 9/11 and the international response. “Learning from Recorded Memory”
  • This fall, the Internet Archive celebrates its 25th anniversary.
  • The Internet Archive’s TV News Archive repurposes closed captioning as a search index for nearly three million hours of U.S. local and national TV news (2,239,000+ individual shows) from mid-2009 to the present. The public interest library is dedicated to facilitating journalists, scholars, and the public to compare, contrast, cite, and borrow specific portions of the collection. Advanced quantitive analysis opportunities and data visualizations are available via the collaborating GDELT Project’s Television Explorer and AI Television Explorer.
  • Roger Macdonald, founder of the Internet Archive’s TV News Archive, is available for background interviews and to help journalists access the archive.

Internet Archive 9/11 Event and Resources Media Contact:  pressinfo@archive.org

TV News Record: Television Explorer 2.0, shooting coverage & more

A round up on what’s happening at the TV News Archive by Katie Dahl and Nancy Watzman. 

Explore Television Explorer 2.0

Television Explorer, a tool to search closed captions from the TV News Archive, keeps getting better. Last week GDELT’s Kalev Leetaru added new and improved features:

  • 163 channels are now available to search, from C-Span to Al Jazeera to Spanish language content from Univision and Telemundo.
  • Results now come as a percentage of 15 second clips, making comparisons between simpler.
  • The context word function for searches is similarly redesigned, counting a matching 15-second clip as well searching the 15 second clips immediately before and after, helping to alleviate some previous issues with overcounting.
  • You can now see normalization timelines on the site, with newly available data about the total number of 15-second clips monitored each day and hour included in your query.

Take the revamped Television Explorer for a spin.

Here’s what we found when we used the new tools to track the use of the term, “cryptocurrency.” The rapid ascent, and sometimes fall, of the value of cryptocurrencies such as bitcoin have led to rises and dips in TV news coverage as well. In May 2017, international TV news channels began to run stories featuring the term, rapidly increasing in November and peaking just last week with BBC News. Television Explorer shows that Deutsche Welle led the pack ahead of BBC News and Al Jazeera in covering cryptocurrency. Among US networks, Bloomberg uses the term more than twice as often as Deutsche Welle. A search of the term bitcoin shows a similar trajectory, with CNBC coverage spiking December 11, 2017, a few days before bitcoin hit its historic peak in value to date.

Florida high school shooting TV news coverage shows familiar pattern

Within a broader analysis of how responses to the most recent school shooting compare with others, The Washington Post’s Philip Bump used TV News Archive closed caption data using GDELT’s Television Explorer to examine the pattern of use of the term “gun control” on CNN, Fox, and MSNBC. “After the mass shooting in Las Vegas last October, a political discussion about banning ‘bump stocks’ — devices that allowed the shooter to increase his rate of fire — soon collapsed.” “So far, the conversation after Parkland looks similar to past patterns.”

Washington Post graphic

Fact-check: Trump never said Russia didn’t meddle in election (Pants on Fire!)

“I never said Russia did not meddle in the election”

Reacting to the indictments of Russian nationals by Special Counsel Robert Mueller, President Donald Trump wrote, “I never said Russia did not meddle in the election, I said, ‘It may be Russia, or China or another country or group, or it may be a 400 pound genius sitting in bed and playing with his computer.’ The Russian “hoax” was that the Trump campaign colluded with Russia – it never did!”

Fact-checkers moved quickly to investigate this claim.

The Washington Post’s Fact Checker, Glenn Kessler: “According to The Fact Checker’s database of Trump claims, Trump in his first year as president then 44 more times denounced the Russian probe as a hoax or witch hunt perpetuated by Democrats. For instance, here’s a tweet from the president after reports emerged about the use of Facebook by Russian operatives, a key part of the indictment: ‘The Russia hoax continues, now it’s ads on Facebook. What about the totally biased and dishonest Media coverage in favor of Crooked Hillary?’”

PolitiFact’s Jon Greenberg:  “Pants on Fire!” The president “called the matter a ‘made-up story,’ and a ‘hoax.’ He has said that he believes Russian President Putin’s denial of any Russian involvement. He told Time, ‘I don’t believe they (Russia) interfered.’”

Vox on Fox (& CNN & MSNBC): Mueller indictment, Florida shooting

In an analysis of Fox News, CNN, and MSNBC during the 72 hours following the announcement of the indictment of 13 Russians, Vox’s Alvin Chang used TV News Archive closed captioning data and the GDELT Project’s Television Explorer to show “how Fox News spun the Mueller indictment and Florida shooting into a defense of the president.” Chang uses the data to show that “[I]nstead of focusing on the details of the indictment itself, pundits on Fox News spent a good chunk of their airtime pointing out that this isn’t proof of the Trump administration colluding with Russia.”


TV news coverage and analysis in one place

Scholars, pundits, and reporters have used the data we’ve created here in the TV News Archive in ways that continue to inspire us, adding much-needed context to our chaotic public discourse as seen on TV.  All that content is now in one place, showcasing the work of these researchers and reporters who turned TV news data into something meaningful.

Follow us @tvnewsarchive, and subscribe to our weekly newsletter here.

Get your Dem debate visualizations here

Hot off the internet presses, here is media analyst’s Kalev Leetaru’s visualization tool, fueled by Internet Archive data, which enables users to trace particular phrases used in broadcast news coverage in the first 24 hours after would-be presidential nominees appeared in the first Democratic debate of the 2016 election.

Scroll down and what sticks out immediately are the two subjects that captured most of the news broadcasters’ attention: “Bernie Sanders’ “damn emails” quote and guns.

When the subject came up of the controversy over Clinton’s decision to do public work from a private email server, rather than attack Clinton, Sanders defended her:

“Let me say — let me say something that may not be great politics. But I think the secretary is right, and that is that the American people are sick and tired of hearing about your damn e-mails.”

According to Internet Archive data, that sound bite aired 496 times across stations.

The other issue that grabbed attention was gun violence: Sanders, who hails from gun-friendly rural Vermont, was called to task for his vote to make it tougher to hold gun manufacturers liable when the guns they make are used in a crime. Answering a question by CNN moderator Anderson Cooper, on whether Sanders is tough enough on guns, Clinton said:

“No, not at all. I think that we have to look at the fact that we lose 90 people a day from gun violence. This has gone on too long and it’s time the entire country stood up against the NRA. The majority of our country…(APPLAUSE)… supports background checks, and even the majority of gun owners do.”

This clip aired 260 times across stations.

However, these are just the top take-aways from this massive data crunching tool. It provides a search mechanism for the user to do deeper dives into the data and discover trends across and within certain types of news broadcasts.

Leetaru’s own analysis is here, on the Washington Post’s Monkey Cage. Among his observations:

There was also variation in how much attention each network paid to each candidate (you can see for yourself using the interactive visualization). Telemundo favored Sanders with 41 percent, followed by O’Malley with 24 percent and Clinton at just 21 percent, though admittedly, they broadcast a relatively small number of excerpts. FOX Business also favored Sanders 50 percent to Clinton’s 38 percent, as did CSPAN with Sanders at 52 percent to Clinton’s 44 percent. All other networks favored Clinton, though sometimes by a relatively close margin — like CNBC (50 percent Clinton to 43 percent Sanders) or PBS affiliates (41 percent Clinton to 38 percent Sanders).

This tool is also part of the Internet Archive’s testing of technology that we’ll use in our new Knight Foundation funded project to track political TV ads in key primary states, which will launch in early December.

Dig in and have fun.

As Democratic candidates debate, Internet Archive will be gathering data

When Hillary Clinton and Bernie Sanders take the podium tonight along with other contenders for the Democratic presidential nomination in 2016, their debate will be televised. The Television Archive will be tracking the news coverage surrounding the debate, viewable and searchable, here.

And this tool, developed by political scientist Kalev Leetaru  and fueled by Internet Archive data, allows users to see how many times a particular candidate’s name is mentioned in news coverage. Going into the debate, Hillary Clinton is getting more than twice as mentions as Sen. Bernie Sanders.

We take for granted that candidates will debate on screen, but it wasn’t always so. The faceoff between Republican Vice President Richard Nixon and Democrat U.S. Senator Jack Kennedy in 1960, 55 years ago last month, marked the first time that Americans were able to watch candidates for the nation’s highest office from the comfort of their living rooms. You can see part one of the debate here, preserved on the Archive’s servers:

The received wisdom about this famous debate was that, from this point on, candidates had to think not just about what they said on the campaign stump, but how they looked. This could make a huge difference in how the public and the media perceived who “won” the debate. Nixon looked tired and like he needed a shave. Kennedy looked healthy and vibrant. Those who listened on the radio thought Nixon won.

“It’s one of those unusual points in the timeline of history where you say things changed very dramatically–in this case, in a single night,” Alan Schroeder, a media historian and associate professor at Northeastern University, told Time Magazine in 2010.

Here’s part II of the Kennedy-Nixon 1960 debate:

We don’t know yet who the perceived winner of tonight’s debate will be. The Internet Archive’s data will provide one way to evaluate this. Stay tuned.

Who’s Really Winning the Media Wars in the 2016 Campaign?

When it comes to media coverage, it seems as if Donald Trump is “trumping” all his rivals, Republicans and Democrats alike.  But is that true?  And how does it vary by print, digital and television media?  Using the Internet Archive’s Television Archive and the GDELT Project, researcher Kalev Leetaru is able to analyze daily data to see who is winning the media wars of 2016.  Today we are excited to announce three new visualizations that explore American politics through the lens of television: a live campaign tracker hosted by The Atlantic that offers a running tally of all mentions of the 2016 presidential candidates across national television monitored by the Archive, and two visualizations that show which statements from the first Republican debate went viral on television.  Finally, an analysis published in The Guardian shows just how unique television coverage of the campaign is and how much it differs from print and online coverage.  Candidates live and die by their ability to capture media attention.  Now, thanks to Leetaru, citizens have the tools to examine the election media data daily.

A Live 2016 Campaign Tracker

atlantic-television-tracker

 

Media coverage of the 2016 presidential candidates has been dominating the news cycle for the last few months, with article after article asking which candidate is dominating the headlines at the moment.   Working with The Atlantic, we created the visualization above that tallies how many times each candidate has been mentioned on domestic national television networks thus far in 2015.  The list updates each morning, providing an incredibly unique peek into who is pulling ahead at the moment.  For those interested in drilling further into the data, an interactive explorer dashboard allows you to drill down by candidate and network.

Who Won the First Republican Debate?

debate

This past July we used audio fingerprinting technology from the Laboratory for the Recognition and Organization of Speech and Audio at Columbia University to scan the audio of all monitored television shows for two weeks after the President’s January 2015 State of the Union address and identified every time an excerpted clip of his speech was broadcast on another television show.  In this way we were able to create an interactive timeline of which portions of his speech went “viral”.

We’ve repeated that process for the first Republican debate, both the “prime” and “undercard” events, exploring which soundbites made the rounds across television news shows in the week following the debate.

For the undercard debate, Carly Fiorina was the clear winner, account for 45% of the soundbites from the debate that subsequently aired elsewhere in the following week, followed by Rick Perry at 15.7%.  Both of the most-excerpted responses from the undercard debate belonged to her, with her quote “Hillary Clinton lies about Benghazi, she lies about emails. She is still defending Planned Parenthood, and she is still her party’s frontrunner” appearing 53 times and her quote “Did any of you get a phone call from Bill Clinton? I didn’t. Maybe it’s because I hadn’t given money to the foundation or donated to his wife’s Senate campaign.” appearing 47 times.

For the prime debate, Trump was the overall winner, with 30.7% of the subsequently aired soundbites being his, followed by Rand Paul at 14.1% and Chris Christie at 13.7%.  The two most-excerpted statements of the debate were both by Trump, one regarding his refusal to pledge not to run as an Independent, which aired 199 times, and the second about his past misogynic Twitter comments, which aired 337 times.  Rand Paul and Chris Christie’s exchange about the fourth amendment and government surveillance aired 190 times, culminating in Rand Paul’s now-famous “I know you gave [President Obama] a big hug, and if you want to give him a big hug again, go right ahead.”  Ben Carson’s closing remarks about his work as a surgeon were the most-repeated of any of the candidates, with 86 rebroadcasts over the following week.

How Much Coverage is Trump Really Getting?

guardian-trump-analysis

Finally, with all of the hyperbole swirling about Trump’s utter domination of media coverage of the Republican race, a key question is just how much his lead differs across media modalities.  Is online news coverage of 2016 campaign cycle identical to print coverage identical to television coverage?  In a piece for The Guardian’s Data Blog, I explored election coverage across these different forms of media and found that Trump’s lead is entirely dependent on where you look, emphasizing just how important it is to be able to analyze television coverage directly.

As the 2016 political season begins to shift into high gear stay tuned for so much more to come as we explore television and politics!

Mapping 400,000 Hours of U.S. TV News

TVnewMap2
We are excited to unveil a couple experimental data-driven visualizations that literally map 400,000 hours of U.S. television news. One of our collaborating scholars, Kalev Leetaru, applied “fulltext geocoding” software to our entire television news research service collection. These algorithms scan the closed captioning of each broadcast looking for any mention of a location anywhere in the world, disambiguate them using the surrounding discussion (Springfield, Illinois vs Springfield, Massachusetts), and ultimately map each location. The resulting CartoDB visualizations provide what we believe is one of the first large-scale glimpses of the geography of American television news, beginning to reveal which areas receive outsized attention and which are neglected.

Watch4-year

 

Watch TV news mentions of places throughout the world for each day.

 

Compare-Contrast

 

Select a TV station and time window to view their representations of places.

 

Keep in mind that as you explore, zoom-in and click the locations in these pilot maps, you are going to find a lot of errors. Those range from errors in the underlying closed captioning (“two Paris of shoes”) to locations that are paired with onscreen information (a mention of “Springfield” while displaying a map of Massachusetts on the screen). Thus, as you click around, you’re going to find that some locations work great, while others have a lot more error, especially small towns with common names.

What you see here represents our very first experiment with revealing the geography of television news and required bringing together a bunch of cutting-edge technologies that are still very much active areas of research. While there is still lots of work to be done, we think this represents a tremendously exciting prototype for new ways of interacting with the world’s information by organizing it geographically and putting it on a map where it belongs!

Virtual Machines: Unlocking Media for Research

In addition to our public web-based research service, we are facilitating scholars, like Kalev, and other researchers in applying advanced data treatments to our entire collection, at a speed and scale beyond any individual’s capacity. As responsible custodians of an enormous collection of television news content created by others, we endeavor to secure their work within the context of our library. Therefore, rather than lending out copies of large portions of the collection for study, researchers instead work in our “virtual reading room” where they may run their computer algorithms on our servers within the physical confines of the Archive. We hope our evolving demonstrations of this data queries in — results out — process may help forge a new model for how exceptional public interest value can be derived from media without challenging their value and integrity to their creators.

The Knight Foundation and other insightful donors are providing critical support in our ongoing efforts to open television news and join with others in re-visioning how digital libraries can respectfully address the educational potential of other diverse media. We hope you will consider lending your support.

The Atlantic