A Curriculum
for Introducing Web-based Research Tools
http://personal.centenary.edu/~rmweeks/ACS_tech/
Matthew Weeks, Ph.D
Department of Psychology
Centenary College of Louisiana
Overview and Description:
Given the proliferation of the World Wide Web (WWW)
and the importance importance society places on the Internet, it should
come as no surprise researchers are increasingly exploiting this new venue.
However, knowledge of Web-based research tools, and the special issues
involved in their use, can be slow in coming. This project developed
a website for introducing ACS social science faculty to some of these tools
and issues. There were 2 primary goals for introducing these tools
the faculty. First, it allows researchers to expand their tools for
their own research. I focused on tools that allowed for outsourcing
of as much work as possible (e.g., survey hosting, data collection), thinking
that researchers at small institutions could most benefit from these tools.
Second, I wanted to provide a means of introducing these tools to students
(the next line of researchers). For this purpose, I developed a learning
exercise for each of several survey development tools. These provided
step-by-step instructions for creating an online survey. Also, there
were suggestions for using the tools in class.
I've found these tools help for a variety of reasons
and worked them into various courses. For example, in research methods
courses, a tool like Factorwiz
(http://psych.fullerton.edu/mbirnbaum/web/factorWiz.htm) helps students see the various permutations necessary in making a factorial
design and gives them the opportunity to create such stimuli. In
my General Psychology course, I have students complete several on-line
surveys I have developed (e.g., a personality survey). I can then
score the test prior to covering it in class and present the results when
I get there. This way students get familiar with the material and
even see their scores so we can discuss them, but I didn't have to take
up valuable class time to give and score the procedure. In my behavior
statistics course, students complete a short questionnaire (developed with
WWW Survey Assistant: http://survey.psy.buffalo.edu/)
at the beginning of the semester. I then convert the data into an
SPSS data file for use in the lab portion of the course. This serves
as an interest and motivating factor to students as they analyze their
data.
The Website is primarily composed of 3 sections, all accessible from the main page.
Sections:
1) An overview
of issues pertinent to Web-based experimenting (http://personal.centenary.edu/~rmweeks/ACS_tech/information_1.html). While not meant
to be a comprehensive review, a variety of issues are addressed along with
citations for further study. These issues include advantages and
disadvantages to web-based experimenting, distribution of surveys, response
and attrition rates, and issues of anonymity and confidentiality.
2) A description
of the various tools and services (http://personal.centenary.edu/~rmweeks/ACS_tech/survey_tools.html) available for online experimenting.
A larger description is provided of several tools (of varying levels of
outsourcing) free for academic use. Also, a sample survey is provided
for each of the main tools covered.
3) A section
of learning projects and suggestions (http://personal.centenary.edu/~rmweeks/ACS_tech/sample_projects.html) for class learning activities.
A step-by-step example is available for 4 tools. These would be appropriate
for students to complete or faculty could use them for their own edification.
Technical Information
The tools covered in the project require no special knowledge
of HTML or HTML forms, though a little bit of knowledge does increase their
functionality. In some cases, the tools themselves are free for academic
use (e.g., WWW Survey Assistant (http://survey.psy.buffalo.edu/),
Surveywiz (http://psych.fullerton.edu/mbirnbaum/programs/surveywiz.htm) ,
Factorwiz (http://psych.fullerton.edu/mbirnbaum/web/factorWiz.htm) ).
The PsychExperiments web experiment hosting site is free, but the authoring
tool (Authorware, by Macromedia) is not.
Overall, this site and the tools discussed are designed
for those researchers or students who have little technical knowledge of
HTML. Simple surveys can be constructed and implemented in no time.
Also, most tools are accessible via the WWW, so no new software must be
purchased.
Dissemination and Evaluation:
Information about the Website was disseminated via
email to social science faculty at ACS institutions. An initial email announced
the proposed project and solicited suggestions/requests for project ideas.
In mid August of 2003, the finalized Website was emailed to the same group
of faculty. I have received little word of its use (e.g., questions,
complaints, comments, etc.). A follow-up email is scheduled to be
sent the week of Oct. 15 to solicit questions/comments and a final evaluation
will involve a survey to be completed by anyone visiting/using the website.
This final evaluation is scheduled for the end of the fall semester.
An updated copy of this report will be made available following each of
these assessments.
Example Project:
An example of a learning project for familiarization
with one of the survey development tools illustrates the nature of the
project. Factorwiz is a simple Javascript tool for developing
factorial design questionnaires and materials (http://personal.centenary.edu/~rmweeks/ACS_tech/Factorwiz.html). A step-by-step
exercise is provided for students to develop a survey assessing the importance
of being tall, dark, and handsome in being attractive. The survey
is constructed using both verbal labels, and then a modification is made
to use visual stimuli. The final survey with the visual stimuli can
be found at http://personal.centenary.edu/~rmweeks/ACS_tech/FactorWiz_pix.html.