Learning by Doing: Labs and Pedagogy in the Digital Humanities

The digital humanities adore labs. Labs both symbolize and enable many of the field’s overarching themes: interdisciplinary teamwork, making/building, and the computing process itself. Labs give digital humanists a science-y legitimation that, whether we admit it or not, we find appealing. Labs aren’t necessary for doing digital humanities research, but in terms of infrastructure, collaboration, and institutional backing they certainly help. Along with “collaboration” and “open” (and possibly “nice“), “lab” is one of the field’s power words. With a period of accelerated growth over the past five years, world-wide digital humanities labs and centers now run into the hundreds. We overwhelmingly focus on labs in this kind of context: labs as physical research spaces. I’d like to move away from this familiar ground to discuss the role of lab assignments within a digital humanities curriculum. While reflecting on my own recent experience of designing and using labs in the classroom, I realized it spoke to many of the current issues facing the digital humanities.

Let me start with some background. This past autumn I taught my first college course, “The Digital Historian’s Toolkit: Studying the West in an Age of Big Data.” It was one of Stanford History Department’s Sources & Methods seminars, which are classes aimed at history majors to get them working intensively with primary sources. When I was designing my course a year ago, I decided to blend a digital humanities curriculum with more traditional historical pedagogy. Under the broad umbrella of the nineteenth-century American West, I used a specific historical theme each week (mining, communications, tourism, etc.) to tie together both traditional analysis and digital methodology. As part of this, over five different class periods students met in the Center for Spatial and Textual Analysis to complete a weekly lab assignment.

In designing the course, I wrestled with a problem that faces every digital humanist: the balancing of “traditional” (for lack of a better term) and “digital.” How much of my curriculum should follow a seminar model based on reading and discussion? How much should it follow a lab model based on technical tools and techniques? As is often the case, pragmatism partially informed my decision. Because my class was part of a required series of courses offered by the department, I couldn’t simply design a full-blown digital humanities methods course. It had to have a strong historical component in order to get approved. This juggling act is not uncommon for digital humanists. But more philosophically, I believed that digital tools were best learned in the context of historical inquiry. An overarching theme (in my case, the late nineteenth-century West) helped answer the question of why a student was learning a particular piece of software. Without it, digital pedagogy can stray into the bugaboo waved about by skeptics: teaching technology for technology’s sake.

I designed my labs with three goals in mind. First, I wanted my students to come away with at least an introduction to technical skills they wouldn’t otherwise get in a typical history course. Given my background, I focused largely on GIS, textual analysis, and visual design. I didn’t expect my students to become geospatial technicians in ten weeks, but I did want them to try out these kinds of methods and understand how they could be applied to historical problems. This first goal speaks to the alarmist rhetoric of a “crisis in the humanities,” of falling enrollments and shrinking budgets and growing irrelevance. In this caricature, the digital humanities often get remade as a life-boat for a sinking ship. This view is obviously overblown. But it is important to remember that the vast majority of our students are not going to end up as professors of history, literature, or philosophy. While there is a strong case to be made for the value of the humanities, I also think we need to do a better job of grafting other kinds of skills onto the field’s reading/writing/thinking foundation.

Second, I wanted students to learn technical skills as part of a larger intellectual framework. I pursued this in part by assigning specific techniques to answer larger questions. For instance, how does Mark Twain’s western novel Roughing It compare to other iconic nineteenth-century works of literature? Instead of assigning thousands of pages of text, I had my students use topic modeling to compare Roughing It to other books such as Uncle Tom’s Cabin and Little Women. But labs were also an effective way to concretize some of the contemporary issues swirling around technology. In one of the labs, students applied different kinds OCR software to a sampling of pages from an Overland Trail diary they had read earlier in the week. This gave them a chance to peer behind the curtain of large-scale digitization projects. When you experience first-hand just how many words and characters the OCR process can miss, it makes you think more critically about resources like Google Books or LexisNexis. Teaching in the digital humanities should, in part, force students to think critically about the issues surrounding the tools we use: copyrightaccessmarginalization.

Finally, I wanted students to learn by doing. There’s a certain passive mode of learning endemic to so many humanities courses: go to lectures, write a few papers, study for an exam, make comments in discussion. Student passivity can be inherent to both the pedagogical form itself and how it’s practiced, as anyone who has sat in a lecture hall or watched a student coast through discussion can tell you. Don’t get me wrong: bad labs can be just as passive as lectures. But done right, they emphasize active learning based on immediate feedback. As much as I’ve soured on the term “hacking” and all the privileged baggage it can carry, it is a useful term to describe the type of learning I want my students to engage in. Try something out. If it doesn’t work, try something else. Under this rubric, mistakes are a necessary part of the process. Feedback is more immediate in a way that enables exploration, tinkering, tangents, and restarts. It’s a lot harder to do this with traditional assignments; trying out something new in a paper is riskier than trying out something new in a lab.

This last goal proved the hardest to meet and constitutes one of the major hurdles facing digital humanities pedagogy. We want to teach digital methods not for their own sake, but to fit them within a broader framework, such as how they help us understand the past. But to get to that point, students need to make a fairly substantial investment of time and energy into learning the basics of a particular tool or technique. I tried to scaffold my lab assignments so that they became less and less prescriptive and more and more open-ended with each passing week. The idea was that students needed heavy doses of step-by-step instruction when they were still unfamiliar with the technology. My first lab, for instance, spelled out instructions in excruciating detail. Unfortunately, this led to exactly the kind of passive learning I wanted to avoid. I liken it to the “tutorial glaze” – focusing so much on getting through individual tasks that you lose track of how they all fit together or how you would apply them beyond the dataset at hand. The ability to teach early-stage technical skills involves a litany of pedagogical challenges that humanities instructors are simply not used to tackling.

By contrast, my final lab gave students a dataset (a map of Denver and enumeration district data from the 1880 census) and asked them to formulate and then answer a historical question through GIS. By nearly any metric – enthusiasm, results, feedback – this proved to be the most effective lab. It forced students to engage in the messy process of digital history: exploring the data enough to formulate a question, returning to the data to answer that question, realizing the data can’t even begin to answer that question, formulating a different question, figuring out how to answer it, and deciding how to visualize an argument. I was even more satisfied with their reflections on the process. Some described the frustrations that came with discovering the limits or gaps in census data. Others remarked on how their own mapmaking decisions, such as changing classification breaks or using different symbology, could completely alter the presentation of their argument. It’s one thing for students to read an essay by J.B. Harley on the subjectivity of maps (which they did). It’s another for students to experience the subjective process of map-making for themselves. Learning by doing: this is what was labs are all about.

To try and help others who want to integrate labs into their curriculum, I’ve made the labs and datasets available to download on the course website. Even as I posted them, though, I was reminded of one last problem facing the digital humanities: the problem of ephemerality. I spent hours and hours designing labs that will likely be unusable in a matter of years. Some of them require expensive software licenses, others rely on tools that could fall completely out of development. That’s one of the downside of labs. Ten years from now, I’ll still be able to re-use my lesson plan for discussing Roughing It. The lab on topic-modeling Twain and other novelists? Doubtful. But ephemerality is one of the necessary costs of teaching digital humanities. Because labs, and the broader pedagogical ethos of the digital humanities they embody, are ultimately worth it.

6 thoughts on “Learning by Doing: Labs and Pedagogy in the Digital Humanities

  1. Great post! One comment:
    “Others remarked on how their own mapmaking decisions, such as changing classification breaks or using different symbology, could completely alter the presentation of their argument.”

    What we realized was not that it altered the *presentation* of the argument (which is obvious), but its meaning.

  2. Hi Cameron — very interesting to hear how your S&M course went, and exciting to hear that it sounds like it was a success! Congrats on teaching your first college class!

    This post sparked a lot of thoughts for me about how (if) we should distinguish “digital” vs. “traditional” history pedagogy, which, with the caveat that these are very provisional thoughts, I post in bullet-point form below:

    – First, you write:

    Finally, I wanted students to learn by doing. There’s a certain passive mode of learning endemic to so many humanities courses: go to lectures, write a few papers, study for an exam, make comments in discussion. Student passivity can be inherent to both the pedagogical form itself and how it’s practiced, as anyone who has sat in a lecture hall or watched a student coast through discussion can tell you.

    I can see the point with lectures, but — and admittedly, maybe I am old-fashioned — I am not sure what is passive (inherently or otherwise) about writing papers. Now, it may be that in practice, professors tend to give formulaic paper assignments that students can complete without much thinking, and/or that today’s students tend to approach paper assignments with less enthusiasm/vigor/effort because they are so used to getting them, but if so, I’m not sure whether that is “passivity” per se — the student still has to take some action in writing the paper. (cf. a multiple-choice exam which is really “passive” if you ask me.) It might, rather, be a sign that professors should be putting more thought into coming up with more challenging, thought-provoking paper assignments. Presumably if all history professors gave solely digital lab assignments, some of those assignments would get to be pretty formulaic also, but again, that wouldn’t be anything inherent to the digital form (and to be clear, I don’t think that you’re at all arguing or implying anywhere that digital = active vs. traditional = passive, only that these distinctions might be worth further thinking about for all of us).

    – This leads to a broader question — to what extent is digital pedagogy useful simply for motivating/exciting students who’ve become bored by exams and papers; and to what extent does it have distinct utility (i.e., teach or emphasize different skills) from writing exams and papers? In other words, does digital pedagogy work especially well *for today’s students* because they’re used to just having to take exams and write papers, and thus, having to do a map lab breaks them out of that mold and thereby they pay attention more? (After all, as educational psychology teaches, novelty attracts attention, and attention improves learning outcomes.) Or does digital pedagogy also have benefits even for students who have never written an exam or a paper, because it teaches something unique about history or the humanities or the human experience that can’t be taught otherwise? (Certainly you get at something like this in your description of the final lab, and the difference between reading about vs. experiencing the subjectivity of cartography — but it might be worth brainstorming further about other benefits like this inherent to digital or lab work.)

    To be clear, even if digital pedagogy were only or mainly useful because it’s different and sparks student engagement, that would be nontrivial and awesome in itself; I just think it might be helpful to isolate the benefits that it has above and beyond that, of which I am sure there are many. And not just helpful for theoretical reasons; also for reasons like getting grants, drafting teaching statements, etc. Because for instance, at a school like Stanford, we can sometimes assume (depending on the course, whether it’s intro or advanced, etc.) that (some/all/most of) our students can write a formulaic term paper without having to think much about it and that conversely digital pedagogy will be novel for them — but there are lots of pedagogical settings where that assumption wouldn’t obtain. In a community college setting, for instance, you might encounter students for whom writing a full history research paper would be very difficult and not something they have ever been asked to do before, but who have experience or even currently work in a workplace setting where they’ve used technology — for such students, a computer lab might actually be more familiar than a paper and perhaps more “passive” in that sense, but could still be as or even more pedagogically useful than a paper, depending on how you are defining your pedagogical goals.

    – Lastly, this post got me thinking about how what we are currently calling digital pedagogy could reinvigorate traditional pedagogy. To wit, it seems to me that your goals for digital pedagogy — that students will try new things, and do so in an iterative process — are equally applicable to writing. (I certainly learned the most about writing in my college courses that required me to do multiple drafts — not so much because of anything I learned from the specific revisions, but because the very requirement forced me to confront the brute fact that you should generally not be turning in your first draft of anything.) So maybe the problem is not so much that traditional history courses assign papers, but rather that the way the typical paper assignment is structured is not effective. I.e., typically students are told to write a paper and given a due date for the paper. So, most students turn to the assignment the night before it’s due and type enough thoughts until they have the requisite number of pages and then turn in the printout. This is not effective writing instruction, of course, but mainly because (as Capote famously said of Kerouac) it’s not writing, it’s typing. So how can we structure writing assignments that would force students to write, not just type?

    To that end, you provide some ideas when you write:

    Under this rubric, mistakes are a necessary part of the process. Feedback is more immediate in a way that enables exploration, tinkering, tangents, and restarts. It’s a lot harder to do this with traditional assignments; trying out something new in a paper is riskier than trying out something new in a lab.

    It doesn’t seem to me to be necessarily the case that “trying out something new in a paper is riskier than trying out something new in a lab” — that’s only true because of how most professors assign and evaluate papers, as a singular, final product. What if we thought of paper-writing instead as more like a lab assignment, where you tried out new things and got feedback from peers and your instructor along the way and then finally decided on a final version to turn in? After all, this is how most writing actually happens in the real world, whether you are A/B testing a marketing email or collaborating on an appellate brief in a law firm or a journalist working on an article with your editor.

    Anyway — sorry for the length of this comment and abudance of thinking aloud, but really interesting stuff and lots of food for thought; perhaps we should all be thinking about whether (in what ways) papers can be labs and labs can be papers!

    1. Sara,

      Thanks so much for all of your thought-provoking comments! Some of my responses:

      – I agree that papers are certainly a less passive form of learning. I think my problem with them is, as you point out, that they’re easy to become one-off kind of things. Without more active engagement throughout the process – brainstorming ideas with students, requiring drafts and revisions – they risk becoming formulaic. My point is that labs offer such an immediate and flexible form of feedback in a way that papers don’t, even ones where you get multiple points of feedback from the teacher. The case can certainly be made that this fosters more independent thought and forces students to take more intellectual ownership over the writing process, but it also has the downside of potential passivity. To that end, I love your idea of trying to shake up the paper assignment to make it more iterative and/or collaborative.

      – Good point on the utility of digital pedagogy with regards to simple novelty. While I certainly hope that it’s more than just “look at this shiny new thing!”, there is something to be said for grabbing and engaging student attention. On this note, I think novelty works better on the scale of the day-to-day. I don’t think we need to revamp the entire pedagogical foundations of, say, a US survey course, but I do think it’s important to weave in potentially new or interesting assignments, activities, or approaches. And sometimes novelty for novelty’s sake, provided it’s done on this small-scale, isn’t such a bad thing. This is probably an obvious point, but I think it’s a good reminder for all of us.

      -Cameron

Leave a Reply

Your email address will not be published. Required fields are marked *