Monday, March 18, 2019
Greetings AEA Colleagues! When we learned of the 2019 AEA conference theme,
Speaking Truth to Power, we instantly knew our evaluative work with Historically Black Colleges and Universities (HBCUs) held meaningful resonance.
Our team includes:
John Chikwem (
jchikwem@lincoln.edu) – NSF PI Lincoln University of Pennsylvania;
Toks Fashola – American University;
Kevin Favor (
kfavor@lincoln.edu) – Lincoln University of Pennsylvania; and
Monica Mitchell (
mmitchell@merassociates.com) – MERAssociates, LLC.
In our STEM equity and access work, we have always recognized that despite 3% representation of HBCUs among all US institutions of higher education (IHEs), they continue to defy odds by disproportionately producing STEM bachelor’s degrees earned by African Americans. Our student focus groups reflect the
2017 New York Times On Campus Opinion piece written by a Spelman student who recounted her decision-making process to attend an HBCU was based on a culturally-affirming and high expectations environment.
Hot Tip: Institutional diversity does exist among HBCUs (e.g., public, private, small, large) and affords ample opportunities to conduct culturally responsive evaluation.
In our work as evaluators, we use culturally responsive strategies and frameworks to examine broadening participation interventions. While availability of STEM evaluation instruments has been increasing, we normally find ourselves having to adapt available instruments in order to explicitly address cultural responsiveness.
Rad Resource: A new
STEM Evaluation Repository is available on the AEA website to identify STEM-related instruments for adaptation. Remember, always seek permission to adapt from the instrument’s author/developer.
We adapted mentor and mentee versions of the
Mentoring Competency Assessment (MCA) to assess the extent of culturally responsiveness in mentoring undergraduate STEM students at Lincoln University. We created a culturally responsive mentoring construct by combining existing survey items with items we developed. The newly developed construct provided insight on the extent to which STEM mentoring accommodated different communication styles, considered cultural differences, and accounted for bias and prejudice. Unexpectedly we found striking gender differences. Female faculty mentors and female students were more in tune with cultural responsiveness than their male counterparts. This finding shed light on the need for STEM faculty development in culturally responsive mentoring. The strengths of female STEM faculty can support the design and delivery of faculty development.
Lessons Learned: The use of culturally responsive evaluation in the STEM context is not meant to suddenly produce a silver bullet but rather to provide greater insights and the framing of additional unforeseen but useful questions.
We acknowledge the need to develop validated culturally responsive instruments to evaluate STEM broadening participation interventions. In the meantime, we recommend instrument adaptation as a useful mechanism to support the conduct of culturally responsive STEM evaluation.
As the community of culturally responsive STEM evaluators grows, you will find us at the upcoming
Center for Culturally Responsive Evaluation and Assessment Annual Conference in Chicago on March 27-29, 2019. An increasing number of STEM sessions is added to the conference program each year. Join us at the March 2019 CREA conference as we continue to share information and learn together as STEM evaluators.
The American Evaluation Association is celebrating STEM Education and Training TIG Week with our colleagues in the STEM Education and Training Topical Interest Group. The contributions all this week to aea365 come from our STEM TIG members. Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to aea365@eval.org. aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators.
About AEA
The American Evaluation Association is an international professional association and the largest in its field. Evaluation involves assessing the strengths and weaknesses of programs, policies, personnel, products and organizations to improve their effectiveness. AEA’s mission is to improve evaluation practices and methods worldwide, to increase evaluation use, promote evaluation as a profession and support the contribution of evaluation to the generation of theory and knowledge about effective human action. For more information about AEA, visit www.eval.org.