Action research and evaluation on line

Session C:  Program overview

 

 

This is the fourth orientation session in areol, action research and evaluation on line, a 14-week public course offered as a public service by Southern Cross University and the Southern Cross Institute of Action Research.

 ...in which an overview of the program and some of its associated archived resource files is given

(In the spirit of action research, I think we should reserve the right to change our minds about this if that comes to appear desirable)

 

 

In this fourth orientation session, the four orientation sessions and the 14 learning sessions are summarised

Orientation
sessions:    
1    2    3    4

Learning
sessions:    
1    2    3    4    5    6    7    8    9    10    11    12    13    14

 

This is a description of the files archived from the mailing list areol-r-l, an on line course in action research and evaluation.  The session files are available as web pages in the following directory

URL http://www.uq.net.au/action_research/areol/

with names from areol-intro01.html to areol-intro04.html     and
areol-session01.html to areol-session14.html

The additional resource files will be found at

URL http://www.uq.net.au/action_research/arr/filename.html

(of course, with the actual file name replacing "filename").

You will also find them as plain ascii text files at

URL ftp://ftp.scu.edu.au/www/arr/filename.txt

with names

areol-intro01.txt to areol-intro04.txt and areol-session01.txt to areol-session14.txt

Below I identify the web version of the files.  The text files have the same file name but with "txt" substituted for "html".

 index ]


There are four orientation files, sent to people before the program begins, to help them prepare for the actual sessions
 

areol-intro01.html
 
gives some indication of the time commitment required of those taking part in the program
 
areol-intro02.html    Session A:  Orientation
 
a welcome to the program and a summary of its structure.  Action research is briefly described as a family of methods which pursue the dual outcomes of action and research.  The session also describes the content and structure of the workshops.  It explains that the emphasis will be on a few specific models of action research.  It describes how pointers to further reading will be given, including archived materials you can access.  There will be suggestions for activities, and (for some) an accompanying discussion group
 
areol-intro03.html    Session B:  Learning groups
 
an account of the learning groups, and how they may be started and maintained.  The recommended early emphasis is on community building, agreeing about goals, and deciding about the process to be used
 
areol-intro04.html    Session C:  Program overview
 
this file:  an overview of the files and other resources -- see above

 index ]


 

Session 1 gives a number of examples of action research, including practitioner or research activities for which action research is suitable. 

areol-session01.html
 
a number of examples of action-~~ research-like processes are given.  Reference is made to two files describing action research case studies in more detail.
 
A number of ways of describing action research are briefly mentioned.  The main emphasis is on the combination of action and research, and on the cyclic nature.

Archived resources:

case1.html
an evaluation case study using convergent inter-viewing and focus groups to improve the quality of data and interpretations
 
URL:  http://www.uq.net.au/action_research/arp/case1.html
 
 
case2.html
an action case study in community consultation, demonstrating high stakeholder involvement
 
URL:  http://www.uq.net.au/action_research/arp/case2.html
 
arfaq.html
a partial "frequently-asked-questions" file
 
URL:  http://www.uq.net.au/action_research/arp/arfaq.html
 
guide.html
a beginners guide to action research
 
URL:  http://www.uq.net.au/action_research/arp/guide.html
 
actlearn.html
the relationship between action research and action learning
 
URL:  http://www.uq.net.au/action_research/arp/actlearn.html
 

 index ]


  

 

Session 2 describes the overall change process

areol-session02.html
 
the change process and action research:  a broad overview of processes for both action and research.  The action is achieved by applying the principles of change -- most often participative change.  In planning and conducting action research, change and understanding can be achieved together, and each can assist the other

Archived resources:

rigour.html
 
methods of achieving rigour in situations also requiring flexibility
 
URL:  http://www.uq.net.au/action_research/arp/rigour.html
 
change.html
a more detailed description of the overall change process and its incorporation within action research
 
URL:  http://www.uq.net.au/action_research/arp/change.html
 
choice.html
a brief account of some of the factors which might influence your choice of action research as a research methodology
 
URL:  http://www.uq.net.au/action_research/arp/choice.html
 
philos.html
A paper by Pam Swepson on some of the philosophical underpinnings of research
 
URL:  http://www.uq.net.au/action_research/arp/philos.html
 
naive.html
An account of a naive philosophy of science, and its relationship to action research
 
URL:  http://www.uq.net.au/action_research/arp/naive.html
 

 index ]


 

 

Sessions 3 to 5 cover the important issues to do with entry and contracting, and participation and involvement

 

areol-session03.html    entry and contracting
 
This session addresses the beginnings of an action research project.  It suggests that the important elements of the start of a project are the forming of close and trusting relationships, and the negotiation of goals and roles.  It suggests that entry and contracting are ongoing, repeated from time to time, and for each new client who becomes involved
 
Archived resources:
 
communicn.html
an overview of communication skills for expression and listening, and for managing the overall process
 
URL:  http://www.uq.net.au/action_research/arp/communicn.html
 
argyris.html
a summary by Liane Anderson of the views of Chris Argyris.  In particular it deals with the difference between what we think we believe, and the beliefs that might be deduced from our actions
 
URL:  http://www.uq.net.au/action_research/arp/argyris.html
 
argyris2.html
This fairly lengthy file is the first part of the book Values in action:  applying the ideas of Argyris and Schon, by Bob Dick and Tim Dalmau.  It describes some of the concepts which the authors have found most practical in their design of processes
 
URL:  http://www.uq.net.au/action_research/arp/argyris2.html
 
valwb.html
a summary of a workbook exercise, based on concepts from Argyris, which enables the analysis of a situation which you didn't handle as well as you would wish
 
URL:  http://www.uq.net.au/action_research/arp/valwb.html
 
   index ]
 
areol-session04.html    participation and involvement
 
Different varieties of stakeholders are identified, as are different levels of involvement.  This session provides some overall concepts in preparation for the next, more practical, session
 
Archived resources
 
stake.html
A description of a process for stakeholder analysis.  It helps you to decide when you need more information about a stakeholder, and which stakeholders it is most important to involve
 
URL:  http://www.uq.net.au/action_research/arp/stake.html
 
partproc.html
In this file I identify seven differentfunctions in which participants might becomeinvolved.  I suggest that, for each function, adifferent decision about who to involve may be made
 
URL:  http://www.uq.net.au/action_research/arp/partproc.html
 
comcon.html
This file, in the form of a checklist, guides the reader through the design of a process for community consultation
 
URL:  http://www.uq.net.au/action_research/arp/comcon.html
 
involv.html
This file outlines some of the issues in creating involvement in an organisational setting
 
URL:  http://www.uq.net.au/action_research/arp/involv.html
 
partic.html
A brief listing prepared by Vikki Uhlmann of the main advantages of participation
URL:  http://www.uq.net.au/action_research/arp/partic.html
 

   index ]

areol-session05.html    achieving participation
 
Applying the principles of the two preceding sessions, this session describes in more detail how high involvement can be achieved.  In particular, it addresses the selection of representatives, the need for communication between them and other stakeholders, and ways of building high-quality involvement into group work
 
Archived resources
 
focus.html
a form of focus group, more than usually structured to increase data quality, to involve participants more in interpretation, and to allow more diverse participants to be involved in a group
 
URL:  http://www.uq.net.au/action_research/arp/focus.html
 
consulpro.html
is a resource document for members of consultative groups.  It contains some general advice, and brief descriptions of some useful participative processes
 
URL:  http://www.uq.net.au/action_research/arp/consulpro.html
 
localmeet.html
gives a step-by-step process for organising neighbourhood meetings, local meetings hosted by a member of the community, and capable of achieving high participation rates
 
URL:  http://www.uq.net.au/action_research/arp/localmeet.html
 
gfa.html
describes a participative and action-oriented version of group feedback analysis, a small group survey technique which can be substituted for a large-sample written survey with data feedback
 
URL:  http://www.uq.net.au/action_research/arp/gfa.html
 
dtuwb.html
An ascii file based on the "Discussing the undiscussable" workbook.  It can be used to help a small group or learning group learn more about the factors that inhibit openness and directness of communication
 
URL:  http://www.uq.net.au/action_research/arp/dtuwb.html
 

  index ]


 

Some action research is done mainly for the action.  Sessions 2 to 5, above, dealt primarily with issues more relevant in such research

Other action research is more for the research than the action.  Session 6 addresses ways of achieving rigour.  It also refers to archived resources relevant to action research for publication, or for theses

 

areol-session06.html    Achieving rigour
 
A number of ways of increasing the rigour of action research are discussed.  These include:  the use of multiple cycles which alternate action with critical reflection; combining data collection and interpretation; and the use of later cycles to test the data and interpretations from earlier cycles.  Overall, the emphasis is on the vigorous pursuit of disconfirming evidence and interpretations
 
Archived resources
 
rigour.html
describes, from a practitioner's perspective, whyexperimental and quasi-experimental methods areoften hard to apply in field settings
 
URL:  http://www.uq.net.au/action_research/arp/rigour.html
 
rigour2.html
explains how rigour and economy of effort can bothbe improved without sacrificing flexibility
 
URL:  http://www.uq.net.au/action_research/arp/rigour2.html
 
rigour3.html
is a paper delivered to the 1999 qualitative research conference on sources of rigour in action research,some of which are also applicable to qualitative research generally
 
URL:  http://www.uq.net.au/action_research/arp/rigour2.html
 
phd.html
A brief account of one approach to action research for thesis purposes; it offers some suggestions for checking that your study is adequate both as a change process and a research process
 
URL:  http://www.uq.net.au/action_research/arp/phd.html
 
research.html
Action research for publication and for theses,with particular attention to documentation andwriting-up
 
URL:  http://www.uq.net.au/action_research/arp/research.html
 

  index ]


 

Sessions 7 to 9 introduce the topic of process design, and illustrate it through a variety of processes which can be used for data collection and analysis in action research

 

areol-session07.html    Data collection
 
This session provides a categorisation of process types.  It distinguishes between adversarial, consensual and dialectic processes, and recommends using either consensual or dialectical.  Consensual process work when agreement is easily established.  Dialectical processes are indicated where agreement is substantial:  they create agreement from disagreement.  Delphi, a forecasting technique drawing on a panel of experts, is used to illustrate some of the features of dialectical processes
 
Archived resources
 
dialectic.html
This document offers a slightly extended discussion of adversarial, consensual and dialectical processes
 
URL:  http://www.uq.net.au/action_research/arp/dialectic.html
 
delphi.html
Descriptions of a conventional delphi, conducted by mail, and a face-to-face version
 
URL:  http://www.uq.net.au/action_research/arp/delphi.html
 
  index ]
 
areol-session08.html    convergent interviewing
 
Convergent interviewing is an example of a style of interviewing which includes dialectical processes as a way of developing a higher quality of information and interpretation.  Like delphi, it attempts to resolve disagreements.  It does this by developing probe questions which delve for deeper information and interpretations from interview to interview
 
Archived resources
 
iview.html
This document provides a more detailed description of a typical interview, and of a series of interviews
 
URL:  http://www.uq.net.au/action_research/arp/iview.html
 
  index ]
 
areol-session09.html    Focus groups
 
This session returns to the theme of simultaneous action and research.  It uses a more structured form of focus group to demonstrate how higher involvement and a better quality of data can be achieved at the same time
 
Archived resources
 
focus.html
was mentioned earlier; it gives a detailed description of structured focus groups
 
URL:  http://www.uq.net.au/action_research/arp/focus.html
 
communicn.html
was also mentioned earlier; it provides some helpful suggestions to aid the researcher facilitating a group process such as focus groups
 
URL:  http://www.uq.net.au/action_research/arp/communicn.html
 

Some other archived resources (not specifically mentioned in this session but some mentioned in previous sessions) describe various forms of data collection:

voting.html
the use of voting techniques to collapse long lists, or arrange them in priority
 
URL:  http://www.uq.net.au/action_research/arp/voting.html
 
delphi.html
mentioned previously, a dialectic process
 
URL:  http://www.uq.net.au/action_research/arp/delphi.html
 
gfa.html
group feedback analysis, an alternative to survey-feedback
 
URL:  http://www.uq.net.au/action_research/arp/gfa.html
 
search.html
is a future oriented goal-setting or visioning process which can be used for data collection when agreement is likely to be easily reached
 
URL:  http://www.uq.net.au/action_research/arp/search.html
 
options.html
a dialectical process for choosing between two alternatives
 
URL:  http://www.uq.net.au/action_research/arp/options.html
 
  index ]


 

Sessions 10 to 12 deal specifically with an action research style of evaluation.  They apply the previously-discussed principles to evaluation, using a particular detailed process (the Snyder process) as a vehicle

 

areol-session10.html    Evaluation as action research
 
The features of action research, described in earlier sessions, are noted here as relevant for evaluation too.  The motives of the evaluator and those who employ here are also identified as important
 
Archived resources
 
qualeval.html
is a document which uses a particular evaluation process (the Snyder process) to illustrate some of the features of qualitative action research
 
URL:  http://www.uq.net.au/action_research/arp/qualeval.html
 

 

Some bibliographic resources which contain references to evaluation literature are also mentioned:
 
meta-eval-bib.html
a bibliography prepared by Patricia Rogers, containing references to evaluation and meta-evaluation literature
 
URL:  http://www.uq.net.au/action_research/arp/meta-eval-bib.html
 
trdbooks.html
a bibliography prepared by Marcia Connor on books on training and development, some of them relevant to evaluation
 
URL:  http://www.uq.net.au/action_research/arp/trdbooks.html
 
biblio.html
a general action research bibliography, also referencing other material (such as qualitative research) relevant to action research
 
URL:  http://www.uq.net.au/action_research/arp/biblio.html
 
books.html
The previous file lists books only up to 1993.  This file lists action research books published since then.  It is again partly annotated, and the intention is to update it regularly
 
URL:  http://www.uq.net.au/action_research/arp/books.html
 

  index ]

 
areol-session11.html    The Snyder evaluation process
 
This file describes the Snyder evaluation process.  It is a process which combines formative and summative evaluation with the design of mechanisms for ongoing monitoring and improvement
 
Archived resources
 
snyder.html
is a fairly detailed description of the process, with a rational given for most steps of the process
 
URL:  http://www.uq.net.au/action_research/arp/snyder.html
 
snyder-b.html
is a briefer description of the same process
 
URL:  http://www.uq.net.au/action_research/arp/snyder-b.html
 
darts.html
is an activity to help you think about some of the dimensions of performance appraisal and feedback, and therefore about evaluation feedback.  It was emailed to you just before session 13 if you are a subscriber to the one-semester email version of areol
 
URL:  http://www.uq.net.au/action_research/arp/darts.html
 

  index ]

areol-session12.html    The Snyder process (2)
 
examines in a little more detail two aspects of the Snyder process:  the comparisons within the process evaluation phase, and the develop-ment and use of performance indicators.  The Snyder process is also briefly compared to Total Quality Management, and to appraisal processes
 
The relevant archived resources are those listed above for session 11
 

  index ]


  

Session 13 examines a different action research process, soft systems methodology

 

areol-session13.html    Soft systems methodology
 
This action research methodology is first described, and its use as an evaluation process is then considered
 
Archived resources
 
sofsys2.html
uses soft systems methodology to illustrate some of the ways in which rigour can be achieved in action research processes
 
URL:  http://www.uq.net.au/action_research/arp/sofsys2.html
 

  index ]


  

Finally, session 14 provides some suggestions for follow-up through reading

 

areol-session14.html    Where now?
 
A number of relevant electronic mailing lists for action research and evaluation are identified.  Other resources are also mentioned, including some archived resources
 
Archived resources
 
al-biblio.html
A bibliography on action learning, compiled by Shankar Sankaran
 
URL:  http://www.uq.net.au/action_research/arp/al-biblio.html
 
biblio.html
an annotated bibliography on action research, including also some references on other qualitative research, and some evaluation
 
URL:  http://www.uq.net.au/action_research/arp/biblio.html
 
books.html
The previous file lists books only up to 1993.  This file lists action research books published since then.  It is again partly annotated, and the intention is to update it regularly
 
URL:  http://www.uq.net.au/action_research/arp/books.html
 
meta-eval-bib.html
A bibliography on meta-evaluation, arranged by category, compiled by Patricia Rogers
 
URL:  http://www.uq.net.au/action_research/arp/meta-eval-bib.html
 

 


Let's practice action research on areol.  What ideas do you have for improving this orientation?  What didn't you understand?  What examples and resources can you provide from your own experience?  What else?  If you are subscribed to the email version, send your comments to the discussion list.  Otherwise, send them to Bob Dick.

_____

 

Copyright (c) Bob Dick 2002.  May be copied provided it is not included in material sold at a profit, and this and the following notice are shown

This document may be cited as follows:

Dick, B.  (2000) Program overview.  Session C of Areol - action research and evaluation on line.  URL:  http://www.uq.net.au/action_research/areol/areol-intro04.html

  index ]


 

 

 

Maintained by Bob Dick;  this version 11.02w;  last revised 20020712

A text version is available at URL ftp://ftp.scu.edu.au/www/arr/areol-intro04.txt