Human Face of Big Data (April 30, 2015)

human-face-big-data2_april2015 human-face-big-data3_april2015 human-face-big-date_april2015

Posted in Presentations | Comments Off on Human Face of Big Data (April 30, 2015)

The Human Face of Big Data (April 30, 7pm)

human-big-data

The Human Face of Big Data: the Promise and Perils of a Planetary Nervous System

Come watch the award-wining documentary, The Human Face of Big Data.
Thursday, April 30, 7pm – Wells Fargo Auditorium (MIKC 124)

Stay for hors d’oeuvres and a panel discussion featuring UNR faculty:

  • Dr. Chris Church, Dept. of History
  • Dr. Katherine Hepworth, Dept. of Journalism
  • Kari Barber, MFA, Dept. of Journalism
  • Dr. David Alvarez, Dept. of Biology
  • Dr. Nicholas Seltzer, Dept. of Political Philosophy

 

Posted in Presentations | Comments Off on The Human Face of Big Data (April 30, 7pm)

Fight For Your Right to Think film festival

Thursdays in March, 7pm
MIKC 124, Wells Fargo Auditorium

privacy-film-festival_spring2015

Posted in Presentations | Comments Off on Fight For Your Right to Think film festival

Pryor’s Peoria Nominated for a DH Award

Pryor’s Peoria has been nominated for “Best Use of DH For Public Engagement.” Voting is determined by popular vote, so if you like the project, please vote!


227px-Red_Checkmark.svg_ Click here to vote!

Posted in Digital Humanities | Comments Off on Pryor’s Peoria Nominated for a DH Award

HIST703 – Introduction to Digital History for Graduate Students

 

hist703-screenshot

Welcome to HIST 703: Introduction to Digital History! This is where you will blog about your experience this semester. You’ll respond to the readings on the syllabus, essentially creating an online annotated bibliography of the semester’s readings. You will also blog about new tools you’ve found, other readings on digital history you’ve read (outside of the official reading list), ideas you have for projects, and your experience with learning technical skills, from databases to XML to Python.

You are encouraged to comment on each other’s posts, as well as read them. We’re all in this together as we explore what it means to do digital history.

 

Posted in Courses, Digital Humanities | Comments Off on HIST703 – Introduction to Digital History for Graduate Students

HIST 498 (Adv Topics): Sugar, Slaves, and Revolution: Caribbean History

HIST489_flyer-picture

Description

The modern world was forged in the coves of the Caribbean. Its pirates and smugglers built and destroyed European states; its sugar plantations started the industrial revolution; its revolutionaries changed how Western societies think about liberty and justice; and its philosophers have defined social identity in the modern world. This course will examine Caribbean history from Columbus to Blackbeard to Toussaint Louverture to CLR James to Bob Marley, looking at how the region’s constant struggle between freedom and slavery, between unity and disunity, has shaped the world we live in today.

Required Texts

Textbook: The Caribbean: History of the Region and its Peoples. (txtbk)

Sidney Mintz, Sweetness and Power

 

Schedule

Week 1: The Pre-Columbus Caribbean: 7200 BC – AD 1492

Tu: Syllabus and Welcome

Th: The First Peoples and their Geography

· David Barker, “Geographies of Opportunity, Geographies of Constraint”, 25-38 (txtbk)

· L. Antonio Curet, “The Earliest Settlers,” 53-68 (txtbk)

Week 2: The Columbian Cataclysm: 1492 – 1630

Tu: First Encounters and the Columbian Exchange

Th: Discussion

· Reinaldo Funes Monzote, “The Columbian Moment: Politics, Ideology, and Biohistory,” 83-96 (txtbk)

· Lynne A. Guitar, “Negotiations of Conquest,” 115-130 (txtbk)

Week 3: A New World with the Old World’s Problems

Tu: Crusades, Millennialism, and the Caribbean

Th: Discussion

· Pauline Moffitt Watts. “Science, Religion, and Columbus’s Enterprise of the Indies.” OAH Magazine of History, 5(4). 14-17.

· William Phillips. “Old World Precedents: Sugar and Slavery in the Mediterranean.” 69-79 (txtbk)

Week 4: Plantations and the Rise of Agro-Industrial Capital: 1630 – 1770

Tu: The Sugar Revolution

Th: Discussion

· Hilary Beckles, “Servants and Slaves during the 17th Century Sugar Revolution” 205-216 (txtbk)

– Sidney Mintz, Sweetness and Power.

Week 5: Challenges to the Caribbean Order: 1630 – 1720

Tu: The Golden Age of Piracy and the Caribbean Alternative

Th: Discussion

· Isaac Curtis, “Masterless People: Maroons, Pirates, and Commoners,” 149-162. (txtbk)

Week 6: Unfree Labor, Forced Migration, and Slave Society: 1630-1770

Tu: The Slave Trade

Th: Discussion

· Carrington and Noel. “Slaves and Tropical Commodities: The Caribbean in the South Atlantic System,” 231-242. (txtbk)

Week 7: Rebels and Revolutionaries: 1770-1870

Tu: Maroons and Slave Resistance

Th: Discussion

· Philip Morgan, “Slave Cultures: Systems of Domination and Forms of Resistance,” 245-261 (txtbk)

· Richard Price, “Maroons and their Communities.” pp 1-30 in Maroon Societies.

Week 8: Rebels and Revolutionaries: 1770-1870

Tu: The Age of Atlantic Revolutions

Th: Discussion

· Laurent Dubois, “The Haitian Revolution,” 273-286 (txtbk)

· Robert Whitney, “War and Nation Building: Cuban and Dominican Experience.” 361-372. (txtbk)

Week 9: Midterm

Tu: Review

Th: Midterm

Week 10: Abolition and the Rise of Labor: 1807 – 1900

Tu: Abolition: Causes and Effects

Th: Discussion

– Eric Williams, Capitalism and Slavery

· Dale Toich, “Econocide: From Abolition to Emancipation in the British and French Caribbean.” 303-316 (txtbk)

Week 11: What has Changed? : 1807 – 1900

Tu: There’s Revolution and then there’s Revolution

Th: Discussion

· Christpher Schmidt-Nowara. “A Second Slavery: the 19th-Century Sugar Revolutions in Cuba and Puerto Rico.” 333-345 (txtbk)

· Gad Heuman. “Peasants, Immigrants, and Workers: The British and French Caribbean after Emancipation.” 347-360 (txtbk)

Week 12: America and New Imperialism: 1898 – 1945

Tu: The US Walks Softly: Caribbean Occupation and the American Empire

Th: Discussion

· Cesar Ayala, “The American Sugar Kingdom. 1898-1934” 433-444 (txtbk)

– Hans Schmidt. “Introduction,” United States Occupation of Haiti: 1915-1934, 1-18.

Week 13: The Caribbean Since 1945

Tu: Decolonization and the Empire Strikes Back

Th: Discussion

· Humberto Garcia Muniz. “The Colonial Persuasion: Puerto Rico and the Dutch and French Antilles.” 537-551 (txtbk)

· Anne Macpherson. “Toward Decolonization: Impulses, Processes, and Consequences since the 1930s.” 475-488. (txtbk)

Week 14: The Caribbean Since 1945

Tu: The Cuban Revolution

Th: Discussion

· Michael Zueske, “The Long Cuban Revolution.” 507-522 (txtbk)

· Marifeli Perez-Stable. “Revolution and Radical Nationalism, 1959-1961,” The Cuban Revolution. 61-81

Week 15: Independence? American and European Hegemony

Tu: Tourism and the New Plantations

Th: Discussion

· Robert Goddard. “Tourism, Drugs, Offshore Finance, and the Perils of Neoliberal Development.” 571-582. (txtbk)

· Ian Strachan. “Introduction: Paradise Discourse.” Paradise and Plantation. 1-16

Week 16: Tying it all Together

Tu: The History of a Fragmented Nationalism

Th: Review

Posted in Courses | Comments Off on HIST 498 (Adv Topics): Sugar, Slaves, and Revolution: Caribbean History

Draft for New Course: Introduction to the Digital Humanities (UNR)


Introduction to the Digital Humanities: Syllabus

Professor Christopher Church
Department of History
University of Nevada, Reno

 Course Description

In the past three decades, our world has become increasingly digitized, and today the use of computers is unavoidable. All humanists today are digital humanists whether they realize it or not. Every day, we use digital tools that we take for granted: search engines and keyword searches, digital databases and online publications, email and scholarly collaboration, and the list goes on. Humanists need to approach the use of these tools critically, because their use has dramatically shaped the course and tenor of our research today.

With an eye to the methodological implications of digital scholarship, this course will provide students with a hand-on introduction to some of the core technologies that are necessary for courseconducting digital humanities research: databases, text encoding, and scripting. Being versed in these three technologies is vital to engaging with scholarship in the digital age, because all digital information is structured and manipulated using these fundamental tools. The goal of the course is not to become an expert in these technologies, which is not possible in a single 16-week course, but to be exposed to them and to think about their ramifications for the digital humanities.

This course address the historical methodological issues raised by digital scholarship and provide technical training in the core digital tools. The course will also meet in a computer lab every week for 2 hours, and each course meeting will consist of two parts: practical training and methodological implications.

Readings (selections from below)

1. Cameron and Richardson. Using Computers in History. New York: Palgrave Macmillan, 2005.

2. A Companion to Digital Humanities, ed. Susan Scriebman, Ray Siemens, John Unsworth. Oxford: Blackwell, 2004. http://www.digitalhumanities.org/companion

3. Mark Merry. Databases for Historians: Designing Databases for Historical Research. London: Inst. for Historical Research, 2012. http://training.historyspot.org.uk/mod/book/view.php?id=75

4. Turkel, Crymble and MacEachern, The Programming Historian, 2nd ed. Network in Canadian History & Environment, 2009. http://niche-canada.org/files/programming-historian-1.pdf

5. Salminen and Tompa. Communicating with XML. New York: Springer, 2011.

6. “Learn the TEI”. Text Encoding Initiative. http://www.tei-c.org/Support/Learn/

7. The Virtual Representation of the Past. Ed. Mark Greengrass; Lorna Hughes. Farnham, UK: Ashgate, 2008.

8. Kristen Nawrotzki; Jack Dougherty. Writing History in the Digital Age. Ann Arbor, MI: University of Michigan Press, 2013.

http://www.digitalculture.org/books/writing-history-in-the-digital-age/

9. Hacking the Academy. Eds. Dan Cohen and Tom Scheinfeldt, 2013. Center for History and New Media, George Mason University.

http://www.digitalculture.org/books/hacking-the-academy-new-approaches-to-scholarship-and-teaching-from-digital-humanities/

10. Todd Presner et al. Digital_Humanities. 

Recommended Online Companion Courses

 

Course Assignments

1. A short paper (5-7 pages) on the methodological implications of digitization and digital tools (30%)

2. Weekly practice exercises with the digital tools (20%)

3. A final project using the digital tools to conduct primary source research (50%)

 

Schedule of Classes

D: Discussion
L: Lab

Week 1 – Introduction to Digital Scholarship

D) What is (digital) history?

Readings:

• Sherman Dorn. “Is (Digital) History More than an argument about the Past?”
• Stefan Tanaka. “Pasts in a Digital Age”
• Lorna Hughes. “Conclusion: virtual representation of the past: new research methods, tools and communities of practice.” Virtual Representation of the Past.

Week 2 – A Critical Approach to the Digital World

D) Who gets to be an historian, and why? History and the Digital Public

Readings:

• Leslie Madsen-Brooks. ““I Nevertheless Am a Historian”: Digital Historical Practice and Malpractice around Black Confederate Soldiers.”

• Robert S. Wolff. “The Historian’s Craft, Popular Memory, and Wikipedia.”

• Jons Unsworth. “The Crisis of Audience and the Open-Access Solution.”

L) Exploring Blogs and Online Archives

• Creating your own blog (wordpress.com)

• Exploring Online Archives:

Old Bailey

• Online Archive of California

French Revolution Digital Archive

UNR Shared History Program

Week 3 – Digital Databases and Database Management Software

D) Historians as information scientists

Readings:

• Ansley T. Erickson. “Historical Research and the Problem of Categories: Reflections on 10,000 Digital Note Cards”

• Tim Hitchcock. “Digital searching and the re-formulation of historical knowledge.” Virtual Representation of the Past.

L) Building an Historical Database in Open Office Base

Readings:

• Mark Merry. Databases for Historians: Designing Databases for Historical Research.

Week 4 – Digital Databases and Database Management Software

D) History as Data?

Readings:

• Gibbs and Owens. “The Hermeneutics of Data and Historical Writing.”

• Donald Spaeth. “Representations of sources and data: working with exceptions to hierarchy in historical documents.” Virtual Representation of the Past.

L) Building an Historical Database in Open Office Base

Readings:

• Mark Merry. Databases for Historians: Designing Databases for Historical Research.

Week 5 – Database Management Software, Data Sets, and Data Analysis

D) Interpreting Historical Data

Readings:

• Fabio Ciravegna et al. “Finding needles in haystacks: data-mining in distributed historical datasets.” Virtual Representation of the Past.

• Helle Porsdam. “Digital Humanities: On Finding the Proper Balance between Qualitative and Quantitative Ways of Doing Research in the
Humanities.” Digital humanities Quarterly. Vol 7. No 3. (2013).

L) Building an Historical Database in Open Office Base

Readings:

• Mark Merry. Databases for Historians: Designing Databases for Historical Research.

Week 6 – XML, Markup Languages, and Textual Data

D) Data, Metadata, and the Stuff of Digital History

• Shlomo Argamon. Mark Olsen. “Words, Patterns and Documents: Experiments in Machine Learning and Text Analysis.” Digital Humanities Quarterly. Vol 3, No. 2 (2009).

• Michael Gramer. “Going Meta on Metadata.” Journal of Digital Humanities. Vol. 3, No. 2. (2014).

L) Activity: Marking Up Text in XML

• (Video) Lynda. What is XML.

Week 7 – HTML, CSS, and the Web

L) Codecademy

• HTML BASSICS I, II, III

L) Codecademy

• CSS: An Overview, Selectors, Positioning

Week 7 – XML and TEI

D) Markup, Historical Preservation, and Interoperabiltiy

Readings:

• “Learn the TEI”. Text Encoding Initiative. http://www.tei-c.org/Support/Learn/

• Jerome McDonough. “XML, Interoperability and the Social Construction of Markup Languages: The Library Example.” Digital Humanities Quarterly. Vol 3, N.3 (2009).

• “John Walsh. “Comic Book Markup Language: An Introduction and Rationale.” Digital Humanities Quarterly. Vol 6, No. 1.
(2012).

D) History and Born-Digital Sources

Readings:

• Matthew Kirschenbaum. “The .txtual Condition: Digital Humanities, Born-Digital Archives, and the Future Literary.” Digital Humanities
Quarterly. Vol 7. N. 1. (2013).

• Aden Events. “Web 2.0 and the Ontology of the Digital.” Digital Humanities Quarterly. Vol 6, no. 2.

Week 9 – Scripting Programming Languages – Python

D) Do you need to code to be a digital historian?

Readings:

• Lee Ann Ghajar, I code, you code, we code…Why Code?, February 16,
2012

• Michael Widner, Learn to Code; Learn Code Culture.

• Miriam Posner. “Some things to think about before you exhort everyone to code.”

Week 10 – Scripting Programming Languages – Python

L) Intro and Syntax: Codecademy

L) Strings and Console Output: Codecademy

Week 11 – Scripting Programming Languages – Python

L) Conditionals and Control Flow: Codecademy

L) Functions: Codecademy

Week 12 – Scripting Programming Languages – Python (Web Scraping)

L) Lists and Dictionaries: Codecademy

L) Lists and Functions: Codecademy

Week 13 – Scripting Programming Languages – Python (Web Scraping)

L) Loops: Codecademy

L) Programming Historian

Python Introduction and Installation

Working with Text Files

Code Reuse and Modularity

Working with Web Pages

Manipulating Strings in Python

From HTML to a List of Words (part 1)

From HTML to a List of Words (part 2)

Week 14 – Practical Applications of Digital Research Tools: Text Mining

D) Text and Data Mining in the Discipline of History

Readings:

Ted Underwood, “Where to start with Text Mining.”

• Justin Grimmer. “Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts.” Political Analysis. (2013):1-31.

• Strange et al. “Mining for the Meanings of a Murder: The Impact of OCR Quality on the Use of Digitized Historical Newspapers.” Digital Humanities Quarterly. Vol 8, No. 1 (2014).

L) Programming Historian

Normalizing Data

Counting Frequency

Creating and Viewing HTML Files with Python

Week 15 – Practical Applications of Digital Research Tools: Visualizing Data

L) Programming Historian

Output Data as an HTML File

Keywords in Context (Using n-grams)

Output Keywords in Context in HTML File

L) Visualizing Text with Voyant Tools

http://voyant-tools.org/

Brian Croxall, “Comparing Corpora in Voyant Tools”

Week 16 – Workshop on Final Projects

Posted in Courses | Comments Off on Draft for New Course: Introduction to the Digital Humanities (UNR)

Update to My Struggle with OCR scans –

Follow-up to My Struggles with OCR and Microfilm Scans – No end in sight (yet)

In my quest to achieve better OCR results on newspaper scans, I have stumbled upon Imagemagick’s morphology commands (see here for more). I’ve been able to dramatically reduce the noise in my binary (black/white) scans using morphology, which compares each pixel in an image against its neighbors and then transforms it in some way (add, remove, brighten, or darken). The basic idea, as proposed by @HugoRune on the imagemagick forums, is to close the gaps in a sliding 4×4 rectangle and then erode around the rectangle, using the original image as a mask. This will eventually fill in the letters while removing the noise around them. While the results are not yet perfect, I’m definitely making headway.

The code

You can also change the number of times it erodes by adding more switches. This is what I ran to do a lot of eroding.

And in case you want it in a handy-dandy script, here it is. Just put it in “erode.sh” and call it using “bash infile.png outfile.png #” (i.e. bash erode.sh img.png out.png 5)

 

And here are the results:

Before morphology dilate/erode:

image:

img

Tesseract output:

.ru‘iha Jerpqpvoir usufpé.ïlèïfl‘çïlgdùnäÿouï
:Shogdu’ns, (et releyà l”qüloritfé_dùEMil{ado.-.’-
gChaque‘a‘nnéevdès fêteswiennentrràppelefî
‘ lëàrm’iyersairïe ‘de’rcetterrévb’lutîqn; Èhes’ réa”
Qu‘issa’n’c‘es 5 duren_t- _,trjoië_s” jo’upsfiqcfimrrie’,
ultvl‘ïe fioisï ch‘ez 1 n oug? Ou ‘I: 4‘19âäŒñôÎSAfi l ol-I

gfiel; Asles. ÉLçI’fpremièrç :jôïim1ée-‘e’ät_jçrä fille”;

Îp‘ar les coùias’esufle ch’evaùx‘ïlajgstagènäg-‘j
jpa’q unsrgq’ gçlfiàgçifîcçîliré ’66 i’yîldi‘hïgspllèi-l-Ç Av
‘avec’r- gelfifibswde ï’fuznéç Virp’uïtiéôlçinélfîLe 4‘;
tfôisiènfiejjpürgpâaiitienbapxâ—iîSQp’iriÉSÎL;

0p_‘-lu_llèurs.’

q

After morphology dilate/erode:

image:out2

Tesseract output:

ruina lerpouvoir usurpe de Tallxouns ou
‘Shogouns, ‘et releva l’autorite du Mikado.
.Chaque année, des l‘êtes viennent-rappeler
l’anniversaire de cette révolutionJLes re-
jou‘issances durent trois jours, comme—r
autlef‘ois chez nous pounles ‘Erois.__Glo-
rieuses. La’première journée est remplie
par les courses de chemuxplauseconde
par un ’feu d’artifice’tiré en plein,soleîl,
avec gel-Les de ‘fumce muÏticoloreË‘Le-
troisiènfie‘jour qppantient aux. «Souinôs »
ou luueurs. * t “I

Posted in Digital Humanities | Comments Off on Update to My Struggle with OCR scans –

Services Views API – Add-on Module

In creating the REST API for the Atlantic World Disasters Project,  I realized that I would need some metadata on the results returned (total results, pagination information, etc). Unfortunately, neither the Services nor Services Views module, which I used to create the REST API, allows this sort of metadata out-of-the-box.

API results - json

The same is true for JSON.

API-example

Now in the returned XML  there is a metadata element contains information relevant to the request results.

 

Fortunately, I was able to create a hook_alter that renders the necessary metadata into the API results, including current page, total pages, items per page, display start, display end, and total results. This will allow users to make more fine-tuned requests of the API, and it’ll permit me to funnel information into Python’s NLTK and eventually D3 in a systematized way.

After installing Services and Services Views , you can pull the module from my Github into your Drupal installation’s /sites/default/modules, enable it, and you’re good to go with metadata for your Services Views API.

Here’s the code. Hopefully it’ll help if you want some global results / metadata added to your REST API.

Full Module – Services Views Totals

 

Posted in Digital Humanities | Comments Off on Services Views API – Add-on Module

New Course (Spring 2015) – UNR – Villains of the Nation

What is the relationship between illegal activity and state power? How has state-sanctioned illicit action helped create the modern world? Are pirates a boon or liability to technological and political progress? Has the Internet become the new “high seas”?

All these questions and more will be addressed in HIST 226 – Villains of the Nation: Piracy and the State from the 16th century to the present.

piracy_flyer

Course Outline

  • Week 1: Syllabus and Welcome | Pirates in Popular Culture
  • Week 2: Why Pirates? From Caribbean Sea to Cyberspace
  • Week 3: The Modus Operandi of Piracy
  • Week 4: The Rise of Piracy and the Early State System
  • Week 5: Gender and sexuality among pirates
  • Week 6: The Decline of New World Piracy
  • Week 7: Piracy, Smuggling, and the Illicit Slave Trade in the 19th Century
  • Week 8: Midterm
  • Week 9: Espionage and Piratical Activity in the 20th Century
  • Week 10: De-stabilized states: Piracy in the 20th and 21st Centuries
  • Week 11: The Hacker Ethic and the Rise of New Piracy
  • Week 12: Hacking as a Tool: Open-Source and Free (Intellectual) Trade
  • Week 13: Hacking as a Weapon and its Relationship to State Authority
  • Week 14: Cyberpunks and Cyber-Culture
  • Week 15: Corporations and the Para-State
  • Week 16: Final Exam

Selected Bibliography

  • Markus Rediker. Villains of all nations: Atlantic Pirates in the Golden Age. (2005).
  • C.R. Pennell, ed.  Bandits at Sea: A Pirates Reader.  New York: NYU Press. (2001).
  • David Cordingly. Under the Black Flag: The Romance and the Reality of Life Among the Pirates. (2006).
  • Eric J. Hobsbawm. Bandits. (1969).
  • Alan L. Karras. Smuggling: Contraband and Corruption in World History. (2011)
  • John Earl Haynes, Harvey Klehr. Early Cold War Spies: The Espionage Trials that Shaped American Politics. (2006).
  • Stephen Levy. Hackers: Heroes of the Computer Revolution, 2 ed. (2010).
  • Adrian Johns. Piracy: The Intellectual Property Wars from Gutenberg to Gates. (2010).
  • Parmy Olson. We Are Anonymous: Inside the Hacker World of LulzSec, Anonymous, and the Global Cyber Insurgency. (2013).
  • William Gibson. Neuromancer. (1984).
Posted in Courses | Comments Off on New Course (Spring 2015) – UNR – Villains of the Nation