An Experiential Quasi-Experiment

Audrey Neville and I will be conducting a quasi-experiment next semester in my lecture course on environmental politics. Students can decide to go on a field trip with me to Indiana Dunes National Lakeshore. If they prefer, they can go on an online “virtual field trip” to the same place. Either way, they will complete the same assignments – some quiz-like questions along the way, some discussion, and a take-home essay at the end.

We’re interested in how the physicality of experiential learning affects learning outcomes. I won’t go into our expectations here, but they follow in a straightforward way from the literature on experiential learning. Some earlier work with Carie Steele has evaluated field experiences in a non-experimental way. Audrey and I see this second project as a quasi-experiment in which we compare two modes of learning. It’s important to note that we do not compare either learning mode to a null (no field trip), but only against one another.

The field trip is embedded in a larger course, and presents material equal to about 1.5-2 weeks in that course. All students engage in an online learning activity (OLA) that introduces key analytics and concepts relevant to the field trip. The unit focuses on the relations of humans and nature in the abstract, drawing from issues you may know from William Cronon’s Uncommon Ground. Then we apply those issues to the concrete landscape of Northwest Indiana, where a national park unit coexists with three steel mills, two power plants, the Port of Indiana, two US highways, three interstates, and a mix of communities that range from second homes for the wealthy to the post-industrial cities of Gary and Hammond.

The physical field trip lasts an entire Saturday, about 11-12 hours from door to door. About half of that experience is driving. Our target is to make the virtual field trip take about 5-6 hours, though it’s possible that students can work through it a bit faster. The virtual field trip has quite a bit of video, taken on a pseudo field trip in September with three Illinois students acting as stand-ins for the virtual students. This was the third time I’ve taken students to Indiana Dunes, so my “shticks” are pretty stable.

We designed the OLA and the two field trips with the experiment in mind, but we did not design them to serve the experiment. The material serves pre-existing learning objectives in the course. We followed several principles in our OLA and field trip designs, and these principles affect the quasi-experiment.

 

Autonomy. Students choose their own experience, based on their own interests and commitments. We do not randomly assign them to either. (Random assignment would also introduce some injustices that we want to avoid.) We expect some differences in the two student populations, and we will have to control for those differences instead of getting rid of them through random assignment.

Access. All students should have access to whatever modes help them learn best. Following the conventions of experimental design would require a control group of students who would not be allowed to access either field trip. These conventions would undermine pedagogical principles of access. We will thus use a nonequivalent groups design to examine how the treatments affect student learning. Though an experimental design would have better internal validity, it seems strange to sacrifice student learning in pursuit of greater understanding of student learning.

 

Student learning first. We want both options to provide great learning experiences, and we’re not going to sacrifice learning in either option to make the other option look better. If we need to make tradeoffs between the purity of the experiment and pedagogy, pedagogy will always triumph.

 

For this reason, we allow students who take the physical field trip to view the virtual field trip if they like. We will also provide students who take the virtual field trip with enough information to drive up to Indiana Dunes on their own and obtain a physical experience. We want students to be able to do whatever they want to do in order to succeed in the course. We realize that this is not ideal in terms of experimental design, and we’ll have to control for any students who do this.

Neutrality. We want the physical and virtual field trips to be as similar as we can make them. We want both to be successful learning experiences. Students may mention things that they “saw” without revealing whether it was virtual or physical. their choice. We should not know whether a student chose the virtual or physical field trip, and will grade without that information.


Online learning is popular among administrators and some faculty, controversial among other faculty. People usually contrast online learning with classroom learning, whether lectures or seminars. However, advocates of experiential learning believe that it provides much better learning outcomes. I teach across all three “platforms,” and want to understand better what each platform does best.

Thank you for reading so far. We would be grateful for your comments and reactions as we finalize our course design and research design.

Bailly Beach

 

 

 

Yellowstone 2013 – The Grand Tetons

Emma Matilda Lake

In previous years, we have started class in Grand Teton National Park.  We often have students who choose to fly, so we pick them up at the Jackson airport. Being further south than Yellowstone, GTNP is also a little bit closer to Illinois, and we can cover the 1350 miles in two days.

 

Dependable moose

Seeing the Tetons first can shape students’ views of Yellowstone in negative ways.  For many students, Yellowstone can be a bit of a disappointment, as they decide that they like the spectacular scenery of the Tetons more. Jackson Hole also has a more visible elk population, which shapes students’ perceptions of the landscape.  Wildlife such as moose is more dependably visible on Teton trails.

The Tetons are hard to beat

Interestingly, seeing Yellowstone first in 2013 produced the same result – the Tetons show better.  The reasons varied a little. Students preferred the scenery in the Tetons to that in Yellowstone. Students preferred the feel of Teton trails over the boardwalks and greater development of Yellowstone’s trails, even in the backcountry.

Making bad choices?

Students also though that the Tetons attracted “higher quality” hikers, even on the very popular trail to Inspiration Point. It’s been interesting to me that “lower quality” hikers (unprepared in clothing, supplies and demeanor) make my students view a trail as more like developed frontcountry.

This year’s wildlife viewing was not noticeably better in either park. We did not see pronghorns in either park, though we saw many outside the parks. We did not see moose, wolves or bighorn. We did see some smaller species for the first time in my classes, notably badger and pika. Yet even without wildlife sightings, students preferred the Tetons.

 

Tetons at Dawn

Is there something wrong with Yellowstone? You can’t do much about the scenery.  The Tetons are one of the world’s great mountain ranges in scenic terms. Yellowstone has the Absaroka, Beartooth, Gallatin, Red, and Washburn ranges — all beautiful but they do not match the Tetons. Spectacular as Yellowstone Lake is, Jackson Lake has the better setting.

Far from the madding crowd

More important than the scenery, the visitor experience in Yellowstone clearly impacts the students’ own visitor experiences in undesirable ways.  Visitors are more likely to seem ill-prepared in Yellowstone, are more likely to stick to the parking lots, and seem to crowd the wildlife more. That makes Yellowstone seem less natural, even less “wild.”

Better without people?

Sadly, in the world’s first national park, visitors can be a problem for other visitors.

 

Yellowstone 2013 – Getting there

Reading material on the road

In a regular classroom, it’s relatively easy to arrange topics in the order you want. You have to work around constraints like Thanksgiving break, and obviously the number of topics has to fit the number of class sessions in one way or another.  But that’s about it.

A field course also has constraints of the calendar. The biggest challenge is somewhat different: making geography fit both a chronological sequence and an analytical one.  We don’t have transporters that get us from place to place in whatever sequence we like. Instead, the geography must tell a story.

Windmill blade in Iowa

In past years, I’ve been constrained by the airport at Jackson Hole – some students have chosen to ride the van with me while others have flown. I’ve used that to tell a story of tourism, starting with a superficial engagement of the Grand Teton range. We see the Tetons as a tourist sees it while driving through, and then engage the landscape more deeply with hikes and an introduction to wildlife and ecosystems. Then we engage wildlife more deeply in Yellowstone, and loop back to Jackson Hole and the airport.

 

 

Back to the mythic West!

This year I had the freedom to do something different, a great crescent through the parks. We began at Cody, Wyoming, with an overview of the mythic West. My impressions over the years is that “the West” often helps recruit students to the class, but students vary considerably in terms of how detailed this vision is. They do know what a rodeo is, however.

Rooting for the calf

After a long drive on the second day, students had the option of attending the nightly rodeo in Cody, Wyoming. Questions of animal welfare sparked some reactions, especially when they saw calf roping and bull riding.

 

 

Rodeo clown and bull riding

Another cultural surprise came as the announcer and rodeo clown engaged in some banter that consisted mostly of bad jokes. A few of those jokes used stereotypes that would be socially unacceptable back in Illinois. That introduction to Western ways had most of us rooting for the bull against the rodeo clown.

Peregrine falcon and handler

We formally began class at the Buffalo Bill Historic Center the next morning. We visited the Draper Museum of Natural History, providing an introduction to the Greater Yellowstone Ecosystem from low-elevation sagebrush flats to high-elevation tundra. Students explored the other four museums according to interest (Plains Indians, Art, Firearms and Buffalo Bill). We finished with a live raptor show.

Then . . . off to Yellowstone !

The entire set of 2013 Yellowstone photos is on my Flickr page here.