Categories
research

New Epistemological Perspectives on Quantitative Methods: An Example Using Topological Data Analysis

Authors: Allison Godwin, Brianna Benedict, Jacqueline Rohde, Aaron Thielmeyer, Heather Perkins, Justin Major, Herman Clements & Zhihui Chen

Background: Education researchers use quantitative methodologies to examine generalizable correlational trends or causal mechanisms in phenomena or behaviors. These methodologies stem from (post)positivist epistemologies and often rely on statistical methods that use the means of groups or categories to determine significant results. The results can often essentialize findings to all members of a group as truth knowable within some quantifiable error. Additionally, the attitudes and beliefs of the majority (i.e., in engineering, White cis men) often dominate conclusions drawn and underemphasizes responses from minoritized individuals. In recent years, engineering education research has pursued more epistemologically and methodologically diverse perspectives. However, quantitative methodologies remain relatively fixed in their fundamental epistemological framings, goals, and practices.

Purpose: In this theory paper, we discuss the epistemic groundings of traditional quantitative methods and describe an opportunity for new quantitative methods that expand the possible ways of framing and conducting quantitative research—person-centered analyses. This article invites readers to re-examine quantitative research methods.

Scope: This article discusses the challenges and opportunities of novel quantitative methods in engineering education, particularly in the limited epistemic framings associated with traditional statistical methods. The affordances of person-centered analyses within different epistemological paradigms and research methods are considered. Then, we provide an example of a person-centered method, topological data analysis (TDA), to illustrate the unique insights that can be gained from person-centered analyses. TDA is a statistical method that maps the underlying structure of highly dimensional data.

Discussion/Conclusions: This article advances the discussion of quantitative methodologies and methods in engineering education research to offer new epistemological approaches. Considering the foundational epistemic framings of quantitative research can expand the kinds of questions that can be asked and answered. These new approaches offer ways to conduct more interpretive and inclusive quantitative research.

Read online for free at Studies in Engineering Education: New Epistemological Perspectives on Quantitative Methods: An Example Using Topological Data Analysis

Tags:
Categories
research

(VIDEO) Equipping Educators with Tools to Promote Latently Diverse Students

Presenters: Allison Godwin, Brianna Benedict, Jacqueline Rohde, H. Ronald Clements, Joana Marques Melo, & Heather Perkins

Summary: The history of look-a-like and think-a-like engineers means those who look or think like a “stereotypical engineer” may feel more welcome in engineering and may be why engineering has attracted and graduated similar students. This workshop considers the unique ways of being, thinking, and knowing—what we call latent diversity—that can be highlighted and valued. We will explore these through students’ narratives and engage educators in reflecting on ways to promote inclusion.

View online at YouTube: Equipping Educators with Tools to Promote Latently Diverse Students

Tags:
Categories
research

Using Topological Data Analysis in Social Science Research: Unpacking Decisions and Opportunities for a New Method

Authors: Allison Godwin, Aaron Robert Hamilton Thielmeyer, Jacqueline Rohde, Dina Verdín, Brianna Shani Benedict, Rachel Ann Baker & Jacqueline Doyle

Abstract: This research paper describes a new statistical method for engineering education, Topological Data Analysis (TDA), and considers the important decisions made during analysis and their impact on the quality of the results. We also describe why this new method may provide novel ways of understanding multidimensional data for student attitudes, beliefs, and mindsets.

TDA is a statistical method that can map structure within highly dimensional, noisy, and incomplete data. It is also insensitive to the particular distance function chosen to detect the persistent structure or typology in the data. In some ways, TDA is like a robust cluster analysis. However, unlike cluster analysis, which attempts to break datasets into distinct (or probabilistic) groups, TDA allows for data with progressions rather than clear distinctions. Rather than being focused on breaking data into defined groups, TDA maps the connections among data and provides additional details within the data structure that cannot be captured using cluster analysis. Since its development in 2009, TDA has been used in a number of different fields including medicine, business, and sports. However, few studies have used this technique with social science data. We believe that this technique can be particularly useful to engineering education researchers who deal with complex data that is often multidimensional, noisy, and incomplete.

In this paper, we discuss the considerations that researchers must understand in conducting TDA with engineering education data. In analysis, a researcher must choose a filtering method, number of nearest neighbors (k), number of filter slices (n), overlap in data, and cut height (ε) for each dimension. The importance and effect on the consistency and quality of the data differs for each decision. Some have a large impact on the results of the analysis [e.g., cut height (ε)], while others have a moderate impact on the resulting map appearance but not key structural features identified [e.g., number of filter slices (n)].

We illustrate these methodological decisions as well as the results of TDA and its usefulness for engineering education using data from a project investigating first-year engineering students’ underling attitudes, beliefs, and mindsets to characterize the latent diversity of these students. A paper-and-pencil survey was administered to 3,855 students at 32 ABET accredited institutions across the U.S. in fall 2017. After cleaning the data using attention checks within the survey, a total of 3,711 student responses were examined for validity evidence. Exploratory factor analysis (for newly developed scales) and confirmatory factor analysis (for existing scales) was conducted. The resulting factors with strong validity evidence and high variability among engineering students were used in the TDA to map students’ latent diversity. The results of this map indicate six distinct data progressions as well as a sparse group of students whose responses were not similar to the majority of the dataset. This work illustrates the opportunities for using TDA and provides a discussion of the different researcher decisions that are involved in this statistical technique.

Read online for free at ASEE PEER: Using Topological Data Analysis in Social Science Research: Unpacking Decisions and Opportunities for a New Method

Tags:
Categories
research

Uncovering Latent Diversity: Steps Towards Understanding ‘What Counts’ and ‘Who Belongs’ in Engineering Culture

Authors: Brianna Shani Benedict, Dina Verdín, Rachel Ann Baker, Allison Godwin & Thaddeus Milton

Abstract: Curricular expectations for engineering students are steadily expanding to encompass a diverse set of competencies and skills that ensure students are prepared to address the global challenges of engineering. This expansion highlights a need for educators to not only rethink how they educate the next generation of engineers, but also a need to cultivate “diversity of thought” within the culture of engineering. Earlier studies about diversity have focused on understanding how to increase the number of underrepresented students (i.e., women, students of color, and first-generation college students) who persist in STEM fields. However, there is a shift in how we (i.e., society, industry, and academia) define what it means to be diverse. In this paper, we examined how 12 diverse first-year engineering students described how their peers enact different ways of thinking and being in engineering, as well as how those differences influence whether their peers are perceived as someone who belongs in engineering. The participants acknowledged the cultural and gender differences among their peers; however, they primarily described how their peers were different based on their skill-set (i.e., technical, creative, and interpersonal), ways of thinking, and interests. These findings begin to help us understand how students define normative attitudes in engineering and the perception of what it means to be an engineer.

Read online for free at ASEE PEER: Uncovering Latent Diversity: Steps Towards Understanding ‘What Counts’ and ‘Who Belongs’ in Engineering Culture

Tags:
Categories
research

Unpacking Latent Diversity

Authors: Allison Godwin

Abstract: This theory paper explores how diversity apart from social identities like race and gender is framed in the engineering education literature and how these concepts promote a different but compatible approach to understanding diversity—latent diversity. Latent diversity is a new approach to diversity work that captures underlying affective and cognitive differences that provide potential sources for innovation but are not visible. This approach does not examine other non-visible social identities like sexual orientation, first-generation status, socioeconomic status, etc. Prior literature suggests that diversity in approaches, problem solving, and ways of thinking improve innovation in engineering design more reliably than does diversity along the lines of age, race, gender, etc. However, the process of enculturating students into engineering through engineering curriculum often creates homogeneity in students’ approaches to problems, ways of thinking, and attitudes. In this paper, I explore a limited set of existing research on diversity from these underlying perspectives including identities, alternative ways of thinking and being, motivation, cognitive diversity, and innovation and creativity. This work synthesizes the findings of these studies to paint a rich picture of how students develop different attitudes and skills to navigate their paths within engineering. Additionally, this work provides an evidence-based argument for the importance of recognizing and understanding latent diversity to promote a more inclusive environment in engineering and recruit, educate, retain, and graduate more innovative and diverse engineers. This paper opens the conversation about a new, but complementary, focus for developing a STEM workforce rich in talent and capable of adapting to the changing STEM landscape.

Read online for free at ASEE PEER: Unpacking Latent Diversity

Tags:
Categories
participants tchuck

Meet Tchuck

Tchuck is a white man attending a east coast university and majoring in biomedical engineering. Always a good student, Tchuck attended a STEM academy for high school and took an engineering class in his senior year. Although the focus was on mechanical engineering, he was interested in what he saw and was drawn to his chosen university’s research on blindness and robotic limbs. Tchuck is looking forward to his junior and senior research projects in which he’ll have the opportunity to steer his own projects and designs. As the oldest of four children and the son of an engineer, Tchuck describes his desire to succeed and his enjoyment in knowing how things work as the forces that led to his interest in engineering.

My dad is an engineer, so I was from that young age I had that influence over me, I still do. So that was a big part. So I’m the oldest of four, so I have three other siblings. So I felt like there’s always that pressure to succeed, do well in school and all that stuff. […] I like knowing how things work and all that generic stuff. So yeah I’d say it’s a mix between. I do want to do it and I do like it, but I think also a big part of it was also my dad.

From Tchuck’s first interview.

The image below is a journey map that Tchuck created summarizing some of the highs and lows from his second year as an engineering student.

Tchuck’s second-semester, second-year journey map.

Want to learn more about Tchuck’s journey? Check out his tag here (or by clicking the ‘Tchuck’ tag below) to see quotes from his interviews over the years.

Tags:
Categories
quotes tchuck

Tchuck’s Family & Childhood

[91-94; 96-98] My dad is an engineer, so I was from that young age I had that influence over me, I still do. So that was a big part. So I’m the oldest of four, so I have three other siblings. So I felt like there’s always that pressure to succeed, do well in school and all that stuff. […] I like knowing how things work and all that generic stuff. So yeah I’d say it’s a mix between. I do want to do it and I do like it, but I think also a big part of it was also my dad.

[9-11; 28-30; 38-44] …in terms of my academics at least, I always try very hard. I’ve always taken the hardest classes. I was in STEM Academy for my high school… it was everyone that was looking for majors involving science, technology, engineering and math and all that types of stuff, basically you get put in a cohort, to an extent. There was specific trips we were able to go on since we were in the STEM academy. The biggest thing, […] was an agreement they had with […] a local community college, and I got to transfer out, 16 college credits. I just picked whatever class I had, and if I got an A or B in them for the transfer credit I was able to do that, so I got to bring in those into [East coast university].

[58-62; 66-68; 70-72] they just introduced it in my senior year, an engineering class. So obviously I took it, because I was like, “You know, why not? Maybe it will be relevant, maybe it will be interesting.” So I took it, it was all right. It was mostly based on mechanical engineering which like, I’m biomedical engineering, so it’s still useful, I suppose, but I am not as interested in it. It was a good class. We watched […an] open-heart surgery, we got to watch that. So that was kind of interesting to watch. […]. I remember watching it and I found it pretty interesting, cause like I don’t know, I think that stuff is interesting, I don’t care about the blood or anything like that.

[76-78] So, the only thing I didn’t like about [the STEM Academy was], I don’t get to into it, but today nowadays they stress the women in engineering thing, I don’t have a problem with that, except then they have the trips only for women in engineering so I couldn’t even go.

Tags:
Categories
quotes tchuck

Tchuck on Choosing Engineering

[15-21] [East coast university] was kind of my back up. But I ended up getting the best worth for my money basically I got a bunch of money from [East coast university] and also [East coast university] has a really good engineering school, like all the schools I applied to had a decent engineering school but [East coast university]’s obviously very good for engineering. So I ended up coming here. I’m in honors college here. I also pledged, I’m also in a fraternity here.

[113-119] When I came to [East coast university] I looked at them and I thought biomedical sounded pretty cool. I went through and they showed me this tour and it was like, I think the people at [East coast university] that do research were looking at something like eyedrops that fix blindness to an extent, there was something about a robotic arm that would be able to perform surgery. So I was like that’s pretty cool. And I did well in bio and I like science and obviously I like math. So that’s what I ended up going with.

[125-127; 130-132] I actually came in under the major engineering entrepreneurship, which initially I applied to that because I was like, alright I’m not 100% sure what I want to do, like I like biomedical, but I wanted to come in as generic […]And what it ended up being was a completely different thing, like it’s what you would think trying to start your own company and make stuff, whatever along those lines. So pretty quickly I transferred into biomed.

Tags:
Categories
quotes tchuck

Tchuck’s Quotes #1

[195-201] So basically the idea is to get experience with engineering and all this stuff. What ended up happening was freshman engineering clinic was, it was alright, basically. They talked about a lot of stuff that I already knew. They went over like units and sig figs, conversions, stuff along those lines that wasn’t too difficult. They also went over, we went over engineering ethics which obviously is important so I do appreciate that although that’s been talked about in like every single one of the engineering classes so it gets a little repetitive. Obviously it’s important.

[232-236] And for the second half we had to, we had to use code to optimize a wind turbine and then build it. So we had to figure out what parameters we wanted, what we wanted it to look like, the shape of the blades and all that stuff. And then we built it and tested it at the end. So that I feel like is relevant.

[213-217] I would say the clinic as a whole I’m pretty sure is good. I’m looking forward to junior and senior clinic because that’s when we get like actually research projects. We’re literally going to be doing and making stuff. And I think we work our entire junior year on one thing, and our entire senior year on another thing. So it’ll actually be relevant and something that we get some say in it.

Tags:
Categories
quotes tchuck

Tchuck’s Quotes #2

[94-99] This summer I ended up going back to my warehouse job that I’ve been working since senior high school. I’ve already started applying for internships now, and I plan to continue until I eventually land one, and even then, probably still after just to get more options.

[105-121; 124-129; 191-192] This semester I’m taking all biomedical engineering classes: Foundations in Mechanics, Physiological Foundations, and Electro Foundations. Funny enough, all three of the classes are literally in the same classroom, and it’s a three minute walk from my dorm, which is nice. Most of the teachers use the time as a double lecture period, instead of using the period for lab. Like Literally, on most days I end up sitting in that classroom for hours, and literally sometimes I don’t even move. On Friday’s, we have class from 9:30 am to 2:00 pm, and it’s two different classes, but they’re all in the same classroom so we sit there the whole time, which I don’t know, it’s not too bad. But for mech founds, I think I do like this professor the best.

[130-136; 192-193] He’s very, very smart. He basically does most of his examples off the top of his brain. He makes a problem and solves it himself, which he does mess up every now and then, but for the most part he’s pretty good about it and if he does mess up. Literally after class, he’ll go back to his office and solve it and then email us the solution for it, but yeah he’s pretty good. He goes through the problems a little fast. It is complicated topics, but it’s not too bad. I can still follow for the most part, and then if you have any questions, he is always able to answer them. Also, we haven’t done any labs. I’m not 100% sure, but I don’t think we’re doing any labs for mech founds.

Tags: