From ben@cs.umd.edu Tue Oct 6 16:23:56 1998 Received: (known []) by bedrock.cs.umd.edu (8.8.5/UMIACS-0.9/04-05-88) id QAA17663; Tue, 6 Oct 1998 16:34:36 -0400 (EDT) Date: Tue, 6 Oct 1998 16:34:36 -0400 (EDT) From: ben@cs.umd.edu (Ben Shneiderman) Message-Id: <199810062034.QAA17663@bedrock.cs.umd.edu> To: perlman@turing.acm.org Subject: Re: Web-Based User Interface Evaluation with Questionnaires Cc: ben@cs.umd.edu, kn8@umail.umd.edu X-IMAPbase: 1054869022 24 Status: RO X-Status: X-Keywords: X-UID: 1 HI Gary, Thanks for your prompt response...I will let Kent reply too, but I think you leave visitors with the impression that they can use this freely. I'm not sure what copyright notice was used in 1988, but your web page should at least repeat that copyright notice - much better would be your indicating clearly on each web page that QUIS is copyrighted by the University of Maryland 1986-1998 and that this display is for educational uses only. Commercial use requires a license from the Office of Technology Liaison - (301) 405-4210 Kristin_GRAY@umail.umd.edu I hope Kent can reply soon...the UMD might be quite unhappy... They do derive income from licenses...and we do support some student work from that income. Plus a portion goes to the student developers, to Kent and to me. -- Ben From ben@cs.umd.edu Tue Oct 6 15:47:23 1998 Received: (known []) by bedrock.cs.umd.edu (8.8.5/UMIACS-0.9/04-05-88) id PAA17451; Tue, 6 Oct 1998 15:58:03 -0400 (EDT) Date: Tue, 6 Oct 1998 15:58:03 -0400 (EDT) From: ben@cs.umd.edu (Ben Shneiderman) Message-Id: <199810061958.PAA17451@bedrock.cs.umd.edu> To: perlman@TURING.ACM.ORG Subject: Re: Web-Based User Interface Evaluation with Questionnaires Cc: ben@cs.umd.edu, kn8@Umail.umd.edu Status: RO X-Status: X-Keywords: X-UID: 2 HI Gary, I'm intrigued to see your notice and online portion of QUIS...I'm pleased you are telling the world about QUIS, but I so have some feeling that you are violating our copyright....have you gotten permission? What is happening? -- Ben Ben Shneiderman email: ben@cs.umd.edu Dept. of Computer Science (301) 405-2680 University of Maryland (301) 405-6707 FAX College Park, MD 20742 http://www.cs.umd.edu/hcil From jakob@useit.com Wed Oct 7 17:29:18 1998 Received: from jakob (dynamic40.pm10.mv.best.com [209.24.242.104]) by proxy4.ba.best.com (8.9.0/8.9.0/best.out) with SMTP id OAA05813 for ; Wed, 7 Oct 1998 14:38:46 -0700 (PDT) From: "Jakob Nielsen" To: "Gary PERLMAN" Subject: RE: Web-Based User Interface Evaluation with Questionnaires Date: Wed, 7 Oct 1998 14:38:37 -0700 Message-Id: <001a01bdf23a$d7884960$909bfea9@jakob> Mime-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-Msmail-Priority: Normal X-Mailer: Microsoft Outlook 8.5, Build 4.71.2377.0 X-Mimeole: Produced By Microsoft MimeOLE V4.72.3155.0 Importance: Normal In-Reply-To: <9810070253.AA06763@turing.acm.org> Status: RO X-Status: X-Keywords: X-UID: 3 It's certainly OK. As you said, the more links, the merrier. It is not clear to me what kinds of disclaimers might be appropriate. Maybe we will find out as we get more experience. > -----Original Message----- > From: Gary PERLMAN [mailto:perlman@turing.acm.org] > Sent: Tuesday, October 06, 1998 7:53 PM > To: jacob@useit.com > Cc: perlman@turing.acm.org > Subject: Web-Based User Interface Evaluation with Questionnaires > > > As an example, perhaps misguided in the application, > I put your 1993 definition of usability and heuristics > into my question.cgi script described at: > http://www.acm.org/~perlman/question.html > A couple of links get people to useit.com, > which I know you like. > > I wanted to know.... > > Is it okay for me to have the two instruments > (5 attributes and 10 heuristics). > > If so, do you want to suggest some disclaimers > about how these could/should be applied? > > Gary > From perlman Wed Oct 28 23:35:46 1998 Received: by turing.acm.org; id AA29970; Wed, 28 Oct 1998 23:35:46 -0500 Date: Wed, 28 Oct 1998 23:35:46 -0500 From: Gary PERLMAN Message-Id: <9810290435.AA29970@turing.acm.org> To: sylvie@crim.ca Subject: UI Evaluation Questionnaires (en Francais) Cc: perlman Status: O X-Status: X-Keywords: X-UID: 4 Bonjour Sylvie, As you may recall from my CHI tutorial, I have an interest in UI evaluation questionnaires. Recently, I created a perl/CGI script to administer a variety of questionnaires on the Web. I have a draft working document on the script at: http://www.acm.org/~perlman/question.html The script itself is at: http://www.acm.org/~perlman/question.cgi which runs with a default questionnaire. The HTML overview has a form that allows you to design your own questionnaire based on parameters in a form. Default values for parameters are contained in files, so each set of questions and help is modular. Some of the questionnaires can be used freely, others for non-commercial use, and one requires a license for commercial use, so in general, many sites can use the sets of questions for free. I am giving away the software for free as a service to the HCI community. ACM interactions magazine asked me to prepare a paper on the tool for its Methods and Tools column. While working on it, I've been generalizing the code. Now to my proposal. I've gathered all (I think) the English labels and phrases in the files and now use variables instead, so the script is internationalized. I'd like to distribute files to localize the tool in French. I'd like to translate some of the questionnaires into French and eventually Spanish and ... Most of the questionnaires and associated help are a few hundred words. They are very regular, which makes them even easier to translate. I think you or someone at CRIM would have the language and domain knowledge to do the translation. In return for the effort, I'd provide a prominent acknowledgement in the script and writeup. Also, you would be able to point to the script as an example of multilingual HCI evaluation. Finally, you could use the script for bilingual Web-based evaluation. If you are interested, I'll send something short to translate and we can try it out. Gary From sylvie@crim.ca Thu Oct 29 00:21:27 1998 Received: from crim.ca (as5200-7.crim.ca [132.218.5.7]) by summerset.crim.ca (8.8.7/8.8.4) with ESMTP id AAA01434 for ; Thu, 29 Oct 1998 00:21:41 -0500 (EST) Message-Id: <3637FBD7.C0751AB2@crim.ca> Date: Thu, 29 Oct 1998 00:23:38 -0500 From: Sylvie Turcotte X-Mailer: Mozilla 4.05 [en] (Win95; I) Mime-Version: 1.0 To: Gary PERLMAN Subject: Re: UI Evaluation Questionnaires (en Francais) References: <9810290435.AA29970@turing.acm.org> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Status: O X-Status: X-Keywords: X-UID: 5 I am interested and waiting for the questions you want me to translate. I am going to sleep now. This is 12:30 am in Mtl and my one year-old baby has a cold...The father is taking care of her now... Sylvie Gary PERLMAN wrote: > Bonjour Sylvie, > > As you may recall from my CHI tutorial, > I have an interest in UI evaluation questionnaires. > Recently, I created a perl/CGI script to > administer a variety of questionnaires on the Web. > I have a draft working document on the script at: > http://www.acm.org/~perlman/question.html > The script itself is at: > http://www.acm.org/~perlman/question.cgi > which runs with a default questionnaire. > The HTML overview has a form that allows you to design > your own questionnaire based on parameters in a form. > Default values for parameters are contained in files, > so each set of questions and help is modular. > > Some of the questionnaires can be used freely, > others for non-commercial use, and one requires > a license for commercial use, so in general, > many sites can use the sets of questions for free. > I am giving away the software for free as a service > to the HCI community. > > ACM interactions magazine asked me to prepare a > paper on the tool for its Methods and Tools column. > While working on it, I've been generalizing the code. > > Now to my proposal. > > I've gathered all (I think) the English labels and phrases > in the files and now use variables instead, so the script > is internationalized. I'd like to distribute files > to localize the tool in French. > > I'd like to translate some of the questionnaires > into French and eventually Spanish and ... > Most of the questionnaires and associated help > are a few hundred words. They are very regular, > which makes them even easier to translate. > > I think you or someone at CRIM would have the > language and domain knowledge to do the translation. > In return for the effort, I'd provide a prominent > acknowledgement in the script and writeup. > Also, you would be able to point to the script > as an example of multilingual HCI evaluation. > Finally, you could use the script for bilingual > Web-based evaluation. > > If you are interested, I'll send something short > to translate and we can try it out. > > Gary From perlman Thu Oct 29 13:01:35 1998 Received: by turing.acm.org; id AA13304; Thu, 29 Oct 1998 13:01:32 -0500 From: Gary PERLMAN Message-Id: <9810291801.AA13304@turing.acm.org> Subject: Re: UI Evaluation Questionnaires (en Francais) To: sylvie@crim.ca (Sylvie Turcotte) Date: Thu, 29 Oct 1998 13:01:32 -0500 (EST) Cc: perlman In-Reply-To: <3637FBD7.C0751AB2@crim.ca> from "Sylvie Turcotte" at Oct 29, 98 00:23:38 am X-Mailer: ELM [version 2.4 PL25] Content-Type: text Content-Length: 4222 Status: O X-Status: X-Keywords: X-UID: 6 > I am interested and waiting for the questions you want me to translate. Great. I'd really like to make this work. It would be really cool. I think the questionnaire designers would be thrilled. I set up the script for browser language recognition and also language setting from form parameters. If your browser is set up for French, you will already see a few example parts translated (poorly however). I thought I hasd everything set up for the CSUQ to get started, but looking over the questionnaire-specific text, it's intricately intermixed with perl variables. I'd like to try to clean it up a bit before sending you that part. I'll start by saying that the "translation environment" is not pretty. I hope you can ignore the perl variable names and make use of the embedded one and HTML, but I'll make corrections to what you send me. There is one general set of phrases (16, I think) to translate. These apply to all all questionnaires. How about starting with this? I'll insert those phrases, and then we can move on to the language that is specific to the individual questionnaires. I did a little bit to give you an idea of what I'd like back, but my translation is likely to have about one error per word. Here are a few questionnaire-specific labels and phrases to translate and send back. The parts in (parentheses) are notes to you, not material to translate. strongly agree (labels for ends of rating scales) strongly disagree NA (not applicable) System (e.g., software system, perhaps logiciel). ENGLISH (to give you some context) # BUTTON LABELS $Lang{'Addall'} = "Comment All"; $Lang{'Submit'} = "Mail Data"; # FEEDBACK $Lang{'Submitted'} = "Your data has been mailed. Thank you."; $Lang{'NotSubmitted'} = "Your data was not mailed."; $Lang{'AddedComment'} = "Added Comment Field to Item"; $Lang{'NeedEmail'} = "You must supply a valid email address"; # HELP $Lang{'AddComment'} = "Add a comment about an item by clicking on its icon, or add comment fields for all items by clicking on $Lang{'Addall'}."; $Lang{'ListNegative'} = "List the most negative aspect(s) of"; $Lang{'ListPositive'} = "List the most positive aspect(s) of"; # OBJECT LABELS (will be followed by :) $Lang{'Email'} = "Email to"; $Lang{'BasedOn'} = "Based on"; $Lang{'NewNote'} = "Comments"; # LINK LABELS $Lang{'FormTop'} = "Top of Form"; $Lang{'Abstract'} = "Abstract"; $Lang{'About'} = "About"; $Lang{'RETURN'} = "RETURN TO REFERRING PAGE"; FRENCH (this is the part you fill in/change/correct and mail back) # BUTTON LABELS $Lang{'Addall'} = "Comment All"; # add comments to all questions $Lang{'Submit'} = "Envoyer DATA"; # submit data # FEEDBACK # data was submitted $Lang{'Submitted'} = "Votre données a été envoyé. Merci." ; # data was not submitted $Lang{'NotSubmitted'} = "Votre données n'a pas été envoyé. "; # comment field added to an item $Lang{'AddedComment'} = "Added Comment Field to Item"; # email missing or bad format $Lang{'NeedEmail'} = "You must supply a valid email address"; # HELP # help about adding comments -- using the variables $Lang{'AddComment'} = "Add a comment about an item by clicking on its icon, or add comment fields for all items by clicking on $Lang{'Addall'}."; # list instructions $Lang{'ListNegative'} = "List the most negative aspect(s) of"; $Lang{'ListPositive'} = "List the most positive aspect(s) of"; # OBJECT LABELS (will be followed by :) $Lang{'Email'} = "Envoyer á"; # label for Email field $Lang{'BasedOn'} = "Based on"; # label for questionnaire reference $Lang{'NewNote'} = "Commentaires"; # default value for comment field # LINK LABELS $Lang{'FormTop'} = "DÉBUT"; # Top of Form $Lang{'Abstract'} = "Précis"; # Abstract (of article) $Lang{'About'} = "Au suject"; # label for "About question.cgi" $Lang{'RETURN'} = "RETURN TO REFERRING PAGE"; # return to referrer From perlman Wed Nov 4 15:22:42 1998 Received: by turing.acm.org; id AA08622; Wed, 4 Nov 1998 15:22:40 -0500 From: Gary PERLMAN Message-Id: <9811042022.AA08622@turing.acm.org> Subject: Re: Translation To: sylvie@crim.ca (Sylvie Turcotte) Date: Wed, 4 Nov 1998 15:22:40 -0500 (EST) Cc: perlman In-Reply-To: <3640AB6F.9C446B10@crim.ca> from "Sylvie Turcotte" at Nov 4, 98 02:30:55 pm X-Mailer: ELM [version 2.4 PL25] Content-Type: text Content-Length: 502 Status: O X-Status: X-Keywords: X-UID: 7 No problem. I did some more work and could send you something more organized later, when you have time. So, I'll work on sending you a new package by Monday. Gary > Hi Gary, > > I just want to keep you informed (I would have like to do it before) > that I have a BIG deadline for the next Monday (Nov. 9th) and won't have > the time to work on the translation this week. After Monday, I will have > plenty of time to do it. > > Is this cause you a problem? Please let me know, > > Sylvie > > From sylvie@crim.ca Wed Nov 4 14:29:57 1998 Received: from crim.ca (as5200-40.crim.ca [132.218.5.40]) by summerset.crim.ca (8.8.7/8.8.4) with ESMTP id OAA12883 for ; Wed, 4 Nov 1998 14:30:13 -0500 (EST) Message-Id: <3640AB6F.9C446B10@crim.ca> Date: Wed, 04 Nov 1998 14:30:55 -0500 From: Sylvie Turcotte X-Mailer: Mozilla 4.05 [en] (Win95; I) Mime-Version: 1.0 To: Gary PERLMAN Subject: Translation Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Status: RO X-Status: X-Keywords: X-UID: 8 Hi Gary, I just want to keep you informed (I would have like to do it before) that I have a BIG deadline for the next Monday (Nov. 9th) and won't have the time to work on the translation this week. After Monday, I will have plenty of time to do it. Is this cause you a problem? Please let me know, Sylvie From perlman Sun Nov 8 23:49:07 1998 Received: by turing.acm.org; id AA09629; Sun, 8 Nov 1998 23:49:07 -0500 From: Gary PERLMAN Message-Id: <9811090449.AA09629@turing.acm.org> Subject: Re: UI Evaluation Questionnaires (en Francais) To: perlman@turing.acm.org (Gary PERLMAN) Date: Sun, 8 Nov 1998 23:49:06 -0500 (EST) Cc: sylvie@crim.ca In-Reply-To: <9810291801.AA13304@turing.acm.org> from "Gary PERLMAN" at Oct 29, 98 01:01:32 pm X-Mailer: ELM [version 2.4 PL25] Content-Type: text Content-Length: 5698 Status: RO X-Status: X-Keywords: X-UID: 9 Here is a new version of the general trasnlation file. If it's too confusing, let me know and I'll try to humanize it. If you can figure it out, you can send back the "fr" section. Gary # This file contains the general language-localizing strings for question.cgi. # Each condition corresponds to a language (e.g., "en" or "fr") and contains # the same perl variables (stored in the Lang hashtable). # To provide a translation, start with the English versions, which have more comments. # Go to the corresponding names in the "target" language and chnage the text. # For example: # $Lang{'Email'} = "Email to"; # label for email address field # $Lang{'Email'} = "Envoyer á"; # label for email address field # Don't worry too much about the perl syntax; I can fix that later. # I prefer to have mnemonic HTML entities, but &#nnn; is okay, as are Latin-1 chars. if ($F{'language'} eq "en") { # English # BUTTON LABELS $Lang{'Addall'} = "Comment All"; # add comments to all questions $Lang{'Submit'} = "Mail Data"; # submit data # FEEDBACK $Lang{'Submitted'} = "Your data has been mailed. Thank you."; # data was submitted $Lang{'NotSubmitted'} = "Your data was not mailed."; # data was not submitted $Lang{'AddedComment'} = "Added Comment Field to Item"; # comment field was added # item number will be appended to the end of this string $Lang{'NeedEmail'} = "You must supply a valid email address"; # missing/bad format # HELP $Lang{'AddComment'} = "Add a comment about an item by clicking on its icon, or add comment fields for all items by clicking on $Lang{'Addall'}."; # help on adding comments $Lang{'RespondAll'} = "Try to respond to all the items."; # general help $Lang{'UseNA'} = "For items that are not applicable, use:"; # help for NA $Lang{'UseComment'} = "Optionally provide comments and your email address in the box."; # help for comment boxes, if they are present $Lang{'FillRequired'} = "Make sure these fields are fill in"; # will be followed by "System" and "Email to" $Lang{'HowSubmit'} = "To mail in your results, click on:"; # help for sending data # instructions to list positive/negative aspects $Lang{'ListNegative'} = "List the most negative aspect(s) of"; $Lang{'ListPositive'} = "List the most positive aspect(s) of"; # OBJECT LABELS (will be followed by :) $Lang{'Email'} = "Email to"; # label for email address field $Lang{'BasedOn'} = "Based on"; # label for reference field $Lang{'NewNote'} = "Comments"; # label inside comment field # LINK LABELS $Lang{'FormTop'} = "Top of Form"; # link to get to top of form $Lang{'Abstract'} = "Abstract"; # link to fid abstract in HCIBIB $Lang{'About'} = "About"; # label before link to "About question.cgi" $Lang{'RETURN'} = "RETURN TO REFERRING PAGE"; # label for link to return to page that got user to this form # MISC $Lang{'System'} = "System"; # type of object being evaluated $Lang{'NA'} = "NA"; # label for "Not Applicable" value $Lang{'StronglyDisagree'} = "strongly disagree"; # label for low end of scale $Lang{'StronglyAgree'} = "strongly agree"; # label for high end of scale $Lang{'Unlikely'} = "unlikely"; # label for low end of scale $Lang{'Likely'} = "likely"; # label for high end of scale $Lang{'Bad'} = "bad"; # label for low end of scale $Lang{'Good'} = "good"; # label for high end of scale } elsif ($F{'language'} eq "fr") { # French # BUTTON LABELS $Lang{'Addall'} = "Comment All"; # add comments to all questions $Lang{'Submit'} = "Envoyer DATA"; # submit data # FEEDBACK # data was submitted $Lang{'Submitted'} = "Votre données a été envoyé. Merci."; # data was not submitted $Lang{'NotSubmitted'} = "Votre données n'a pas été envoyé."; # comment field added to an item $Lang{'AddedComment'} = "Added Comment Field to Item"; # email missing or bad format $Lang{'NeedEmail'} = "You must supply a valid email address"; # HELP # help about adding comments -- using the variables $Lang{'AddComment'} = "Add a comment about an item by clicking on its icon, or add comment fields for all items by clicking on $Lang{'Addall'}."; $Lang{'RespondAll'} = "Try to respond to all the items."; $Lang{'UseNA'} = "For items that are not applicable, use:"; $Lang{'UseComment'} = "Optionally provide comments and your email address in the box."; $Lang{'FillRequired'} = "Make sure these fields are fill in"; $Lang{'HowSubmit'} = "To mail in your results, click on:"; # list instructions $Lang{'ListNegative'} = "List the most negative aspect(s) of"; $Lang{'ListPositive'} = "List the most positive aspect(s) of"; # OBJECT LABELS (will be followed by :) $Lang{'Email'} = "Envoyer á"; # label for Email field $Lang{'BasedOn'} = "Based on"; # label for questionnaire reference $Lang{'NewNote'} = "Commentaires"; # default value for comment field # LINK LABELS $Lang{'FormTop'} = "DÉBUT"; # Top of Form $Lang{'Abstract'} = "Précis"; # Abstract (of article) $Lang{'About'} = "Au suject"; # label for "About question.cgi" $Lang{'RETURN'} = "RETURN TO REFERRING PAGE"; # return to referrer # MISC $Lang{'System'} = "Systeme"; $Lang{'StronglyDisagree'} = "pas d'accord"; $Lang{'StronglyAgree'} = "d'accord"; $Lang{'NA'} = "NA"; $Lang{'Unlikely'} = "improbable"; $Lang{'Likely'} = "probable"; $Lang{'Bad'} = "mauvais"; $Lang{'Good'} = "bien"; } From sylvie@crim.ca Tue Nov 17 16:57:01 1998 Received: from crim.ca (meteor.crim.ca [132.218.30.56]) by summerset.crim.ca (8.8.7/8.8.4) with ESMTP id QAA12629 for ; Tue, 17 Nov 1998 16:58:02 -0500 (EST) Message-Id: <3651F146.FF39E51A@crim.ca> Date: Tue, 17 Nov 1998 16:57:27 -0500 From: Sylvie Turcotte X-Mailer: Mozilla 4.05 [en] (Win95; I) Mime-Version: 1.0 To: Gary PERLMAN Subject: Translation Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Mime-Autoconverted: from 8bit to quoted-printable by summerset.crim.ca id QAA12629 Status: O X-Status: X-Keywords: X-UID: 10 Hi Gary, Here is the French transation. I would like to see it on screen or interact with the system just to make sure that the help/feedback messages are all right. Also, I would like to do a usability test with a few collegues at CRIM and in France just to make sure that the French is perfectly "international". Do you want me to translate the questions? Sylvie } elsif ($F{'language'} eq "fr") { # French # BUTTON LABELS $Lang{'Addall'} =3D "Commentaires"; # add comments to all questions $Lang{'Submit'} =3D "Soumettre"; # submit data # FEEDBACK # data was submitted $Lang{'Submitted'} =3D "Nous avons re=E7u vos r=E9ponses. Merci."; # data was not submitted $Lang{'NotSubmitted'} =3D "Vos r=E9ponses n'ont pas =E9t=E9 transmises."; # comment field added to an item $Lang{'AddedComment'} =3D " Un champ pour =E9crire vos commentaires a =E9= t=E9 ajout=E9 =E0 l=92=E9nonc=E9"; # email missing or bad format $Lang{'NeedEmail'} =3D "Vous devez fournir une adresse =E9lectronique valide"; # HELP $Lang{'AddComment'} =3D "Faites un commentaire sp=E9cifique =E0 un =E9non= c=E9 en cliquant sur cet icone, ou faites afficher une bo=EE= te de commentaires qui s=92appliquent =E0 tous les =E9nonc=E9s en cliquant sur le bouton $Lang{'Addall'}."; # help on adding comments $Lang{'RespondAll'} =3D "Essayez de r=E9pondre =E0 tous les =E9nonc=E9s."= ; # general help $Lang{'UseNA'} =3D "Pour les =E9nonc=E9s qui ne s'appliquent pas, r=E9pon= dez : # help for NA $Lang{'UseComment'} =3D " Vous =EAtes invit=E9s =E0 donner vos commentair= es ainsi que votre adresse =E9lectronique dans l'espace r=E9serv=E9 =E0 cett= e fin."; # help for comment boxes, if they are present $Lang{'FillRequired'} =3D "Assurez vous que les champs suivant sont remplis"; # will be followed by "Syst=E8me" and "Envoyer =E0" $Lang{'HowSubmit'} =3D "Pour soumettre vos r=E9ponses, cliquez sur :"; # help for sending data # instructions to list positive/negative aspects $Lang{'ListNegative'} =3D "Inscrivez les principaux aspects n=E9gatifs du syst=E8me"; $Lang{'ListPositive'} =3D "Inscrivez les principaux aspects positifs" du syst=E8me; # OBJECT LABELS (will be followed by :) $Lang{'Email'} =3D "Envoyer =E0;"; # label for Email field $Lang{'BasedOn'} =3D "Inspir=E9 de"; # label for questionnaire reference $Lang{'NewNote'} =3D "Commentaires"; # default value for comment field # LINK LABELS $Lang{'FormTop'} =3D "Haut"; # Top of Form $Lang{'Abstract'} =3D "R=E9sum=E9"; # Abstract (of article) $Lang{'About'} =3D "Au sujet du questionnaire"; # label for "About question.cgi" $Lang{'RETURN'} =3D "Retour au site"; # return to referrer # MISC $Lang{'System'} =3D "Syst=E8me"; $Lang{'StronglyDisagree'} =3D "D=E9saccord"; $Lang{'StronglyAgree'} =3D "Accord"; $Lang{'NA'} =3D "NA"; $Lang{'Unlikely'} =3D "Improbable"; $Lang{'Likely'} =3D "Probable"; $Lang{'Bad'} =3D "Mauvais"; $Lang{'Good'} =3D "Bien"; } From perlman Tue Nov 17 22:26:43 1998 Received: by turing.acm.org; id AA22222; Tue, 17 Nov 1998 22:26:41 -0500 From: Gary PERLMAN Message-Id: <9811180326.AA22222@turing.acm.org> Subject: Re: Translation To: sylvie@crim.ca (Sylvie Turcotte) Date: Tue, 17 Nov 1998 22:26:41 -0500 (EST) Cc: perlman In-Reply-To: <3651F146.FF39E51A@crim.ca> from "Sylvie Turcotte" at Nov 17, 98 04:57:27 pm X-Mailer: ELM [version 2.4 PL25] Content-Type: text Content-Length: 3851 Status: O X-Status: X-Keywords: X-UID: 11 > Hi Gary, > > Here is the French transation. I would like to see it on screen or > interact with the system just to make sure that the help/feedback > messages are all right. Also, I would like to do a usability test with a > few collegues at CRIM and in France just to make sure that the French is > perfectly "international". > > Do you want me to translate the questions? > > Sylvie Thanks so much! It worked pretty well. It took five minutes to fix perl syntax errors, which is very acceptable. Five of seven problems were due to email formatting of long lines. You can see the translation with: http://www.acm.org/~perlman/question.cgi?language=fr Before discussing the translation of the questions, I have questions about translations: The button "Commentaires" may not convey that clicking on it adds comment fields to ALL questions. So maybe something like "Comment All" or "All Comments" would be clearer. The translations for "Strongly Disagree" and "Strongly Agree" seem weaker than I expected. Maybe add Très before each? Now on to the questions. I'll include the perl assignments for the CSUQ questions. After those, depending on your enthusiasm, we can consider other questionaires. There is one tricky aspect to the remaining translation. Try this URL: http://www.acm.org/~perlman/question.cgi?language=fr&system=SuperSite&object=WebSite Notice how WebSite replaces 'System' as the default object being evaluated, and how SuperSite replaces "the 'System' you used". This creates a problem translating "the System" because it it might be accompanied by "le" and "cet" or "la" and "cette", right? So, I need to make another pass through the system to use the article+object pairs as a single unit. That should take a day or two. In the meantime, you can look over the page and send me any feedback on my questions. Here is the csuq.pl file to be translated, although not quite yet. # HELP STRINGS # $help_system is the the string used in Help to refer to the system. # $help_system gets translated into "the system you used" by default. # $help_object_lc is lower case type of the object being evaluated (system) $help_system = "the $help_object_lc you used"; $help_system = $F{'system'} if $F{'system'}; # override if form data $D{'help'} = "Please rate the usability of $help_system."; # QUESTIONS $q[1] = "Overall, I am satisfied with how easy it is to use this $help_object_lc"; $q[2] = "It was simple to use this $help_object_lc"; $q[3] = "I can effectively complete my work using this $help_object_lc"; $q[4] = "I am able to complete my work quickly using this $help_object_lc"; $q[5] = "I am able to efficiently complete my work using this $help_object_lc"; $q[6] = "I feel comfortable using this $help_object_lc"; $q[7] = "It was easy to learn to use this $help_object_lc"; $q[8] = "I believe I became productive quickly using this $help_object_lc"; $q[9] = "The $help_object_lc gives error messages that clearly tell me how to fix problems"; $q[10] = "Whenever I make a mistake using the $help_object_lc, I recover easily and quickly"; $q[11] = "The information (such as online help, on-screen messages, and other documentation) provided with this $help_object_lc is clear"; $q[12] = "It is easy to find the information I needed"; $q[13] = "The information provided for the $help_object_lc is easy to understand"; $q[14] = "The information is effective in helping me complete the tasks and scenarios"; $q[15] = "The organization of information on the $help_object_lc screens is clear"; $q[16] = "The interface of this $help_object_lc is pleasant"; $q[17] = "I like using the interface of this $help_object_lc"; $q[18] = "This $help_object_lc has all the functions and capabilities I expect it to have"; $q[19] = "Overall, I am satisfied with this $help_object_lc"; From sylvie@crim.ca Wed Dec 9 16:34:33 1998 Received: from crim.ca (as5200-32.crim.ca [132.218.5.32]) by summerset.crim.ca (8.8.7/8.8.4) with ESMTP id QAA01700 for ; Wed, 9 Dec 1998 16:34:24 -0500 (EST) Message-Id: <366EEC9D.738F89DC@crim.ca> Date: Wed, 09 Dec 1998 16:33:17 -0500 From: Sylvie Turcotte X-Mailer: Mozilla 4.05 [en] (Win95; I) Mime-Version: 1.0 To: Gary PERLMAN Subject: Translation - Questions Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Mime-Autoconverted: from 8bit to quoted-printable by summerset.crim.ca id QAA01700 Status: RO X-Status: X-Keywords: X-UID: 12 Hi Gary, Sorry for the delay, I had some problems with my computer but now everything is OK. I was several days not having access to my files. Here is the translation of the questions. Question 12 is the only one which doesn't have the $help_object_lc in it! Just add it at the end of the sentence if you want, this is the good way for French in this case. Sylvie # QUESTIONS $q[1] =3D "En g=E9n=E9ral, je suis satisfait(e) de la facilit=E9 d=92util= isation de ce $help_object_lc"; $q[2] =3D "Ce $help_object_lc est simple =E0 utiliser"; $q[3] =3D "J=92ai pu compl=E9ter mon travail correctement en utilisant ce $help_object_lc"; $q[4] =3D "J=92ai =E9t=E9 en mesure de compl=E9ter rapidement ma t=E2che = avec ce $help_object_lc"; $q[5] =3D " J=92ai pu compl=E9ter mon travail efficacement en utilisant c= e $help_object_lc"; $q[6] =3D "Je me sens =E0 l=92aide avec ce $help_object_lc"; $q[7] =3D "Il m=92a =E9t=E9 facile d=92apprendre comment utiliser ce $help_object_lc"; $q[8] =3D "Je crois =EAtre devenu rapidement efficace avec l=92utilisatio= n de ce $help_object_lc"; $q[9] =3D "Le $help_object_lc pr=E9sente des messages d=92erreur qui m=92indiquent clairement comment r=E9soudre les probl=E8mes"; $q[10] =3D "Lorsque j=92ai fais une erreur d=92utilisation sur ce $help_object_lc, il m=92a =E9t=E9 facile et rapide de la corriger"; $q[11] =3D "Les outils d=92aide disponibles sur ce $help_object_lc (tels = que l=92aide en ligne, les messages =E0 l=92=E9cran et autres informations) s= ont claires"; $q[12] =3D "Il m=92a =E9t=E9 facile de trouver l=92information dont j=92a= vais besoin"; $q[13] =3D "L=92information fournie avec ce $help_object_lc est facile =E0 comprendre"; $q[14] =3D "L=92information disponible sur ce $help_object_lc contribue =E0 m=92aider dans la r=E9alisation des t=E2ches et des sc=E9narios"; $q[15] =3D "L=92organisation de l=92information dans les =E9crans du $help_object_lc est claire"; $q[16] =3D "L=92interface de ce $help_object_lc est agr=E9able"; $q[17] =3D "J=92aime utiliser l=92interface de ce $help_object_lc"; $q[18] =3D "Ce $help_object_lc poss=E8de toutes les fonctions et le potentiel que je m=92attendais de retrouver"; $q[19] =3D "En g=E9n=E9ral, je suis satisfait(e) de ce $help_object_lc"; From sylvie@crim.ca Thu Dec 17 21:26:44 1998 Received: from crim.ca (as5200-10.crim.ca [132.218.5.10]) by summerset.crim.ca (8.8.7/8.8.4) with ESMTP id VAA18420 for ; Thu, 17 Dec 1998 21:26:38 -0500 (EST) Message-Id: <3679BD4C.F291F56@crim.ca> Date: Thu, 17 Dec 1998 21:26:22 -0500 From: Sylvie Turcotte X-Mailer: Mozilla 4.05 [en] (Win95; I) Mime-Version: 1.0 To: Gary PERLMAN Subject: Help section Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Mime-Autoconverted: from 8bit to quoted-printable by summerset.crim.ca id VAA18420 Status: RO X-Status: A X-Keywords: X-UID: 13 Hi Gary, Again, take this # HELP section instead. Sylvie P.S. I have a question concerning "System" and "Email to" fields: Who fill in this section? The user? The questionnaire administrator? # HELP $Lang{'AddComment'} =3D "Faites un commentaire sp=E9cifique =E0 un =E9non= c=E9 en cliquant sur cet icone, ou faites afficher une bo=EE= te de commentaires qui s=92appliquent =E0 tous les =E9nonc=E9s en cliquant sur le bouton $Lang{'Addall'}."; # help on adding comments $Lang{'RespondAll'} =3D "Essayez de r=E9pondre =E0 tous les =E9nonc=E9s."= ; # general help $Lang{'UseNA'} =3D "Pour les =E9nonc=E9s qui ne s'appliquent pas, r=E9pon= dez : # help for NA $Lang{'UseComment'} =3D " Vous =EAtes invit=E9s =E0 faire des commentaire= s et =E0 inscrire votre adresse =E9lectronique dans l'espace r=E9serv=E9 =E0 cette= fin."; # help for comment boxes, if they are present $Lang{'FillRequired'} =3D "Assurez-vous que les champs suivants sont remplis"; # will be followed by "Syst=E8me" and "Envoyer =E0" $Lang{'HowSubmit'} =3D "Pour soumettre vos r=E9ponses, cliquez sur :"; # help for sending data # instructions to list positive/negative aspects $Lang{'ListNegative'} =3D "Inscrivez les principaux aspects n=E9gatifs du syst=E8me"; $Lang{'ListPositive'} =3D "Inscrivez les principaux aspects positifs" du syst=E8me; From sylvie@crim.ca Thu Dec 17 21:26:46 1998 Received: from crim.ca (as5200-10.crim.ca [132.218.5.10]) by summerset.crim.ca (8.8.7/8.8.4) with ESMTP id VAA18415 for ; Thu, 17 Dec 1998 21:26:35 -0500 (EST) Message-Id: <3679BD49.DCB3BCBE@crim.ca> Date: Thu, 17 Dec 1998 21:26:18 -0500 From: Sylvie Turcotte X-Mailer: Mozilla 4.05 [en] (Win95; I) Mime-Version: 1.0 To: Gary PERLMAN Subject: questions Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Mime-Autoconverted: from 8bit to quoted-printable by summerset.crim.ca id VAA18415 Status: RO X-Status: X-Keywords: X-UID: 14 Hi Gary, I will send you my corrections by email instead... Could you please replace the actual set of questions with this new one... Sylvie # QUESTIONS $q[1] =3D "En g=E9n=E9ral, je suis satisfait(e) de la facilit=E9 d=92util= isation de ce $help_object_lc"; $q[2] =3D "Ce $help_object_lc est simple =E0 utiliser"; $q[3] =3D "J=92ai compl=E9t=E9 mon travail correctement en utilisant ce $help_object_lc"; $q[4] =3D "J=92ai =E9t=E9 en mesure de compl=E9ter rapidement ma t=E2che = avec ce $help_object_lc"; $q[5] =3D " J=92ai compl=E9t=E9 mon travail efficacement en utilisant ce $help_object_lc"; $q[6] =3D "Je me sens =E0 l=92aise avec ce $help_object_lc"; $q[7] =3D "J=92ai eu de la facilit=E9 =E0 apprendre comment utiliser ce $help_object_lc"; $q[8] =3D "Je crois =EAtre devenu(e) rapidement efficace en utilisant ce $help_object_lc"; $q[9] =3D "Les messages d=92erreur pr=E9sent=E9s par ce $help_object_lc m=92indiquent clairement comment r=E9soudre les probl=E8mes"; $q[10] =3D "Lorsque j=92ai fais une erreur d=92utilisation sur ce $help_object_lc, il m=92a =E9t=E9 facile et rapide de la corriger"; $q[11] =3D "Les outils d=92aide disponibles sur ce $help_object_lc (tels = que l=92aide en ligne, les messages =E0 l=92=E9cran et autres informations) s= ont utiles"; $q[12] =3D "J=92ai facilement trouv=E9 l=92information que je cherchais"; $q[13] =3D "L=92information fournie avec ce $help_object_lc est facile =E0 comprendre"; $q[14] =3D "L=92information disponible sur ce $help_object_lc contribue =E0= me soutenir dans la r=E9alisation des t=E2ches et des sc=E9narios"; $q[15] =3D "L=92organisation de l=92information dans les =E9crans du $help_object_lc est claire"; $q[16] =3D "L=92interface de ce $help_object_lc est agr=E9able"; $q[17] =3D "J=92aime utiliser l=92interface de ce $help_object_lc"; $q[18] =3D "Ce $help_object_lc poss=E8de toutes les fonctions et le potentiel correspondant =E0 mes attentes"; $q[19] =3D "En g=E9n=E9ral, je suis satisfait(e) de ce $help_object_lc"; From sylvie@crim.ca Tue Nov 24 16:25:02 1998 Received: from crim.ca (meteor.crim.ca [132.218.30.56]) by summerset.crim.ca (8.8.7/8.8.4) with ESMTP id QAA11989 for ; Tue, 24 Nov 1998 16:26:20 -0500 (EST) Message-Id: <365B245A.2E240BFC@crim.ca> Date: Tue, 24 Nov 1998 16:25:46 -0500 From: Sylvie Turcotte X-Mailer: Mozilla 4.05 [en] (Win95; I) Mime-Version: 1.0 To: Gary PERLMAN Subject: Re: Translation References: <9811180326.AA22222@turing.acm.org> Content-Type: multipart/alternative; boundary="------------33244D8C268C8B6156043950" Status: RO X-Status: X-Keywords: X-UID: 15 --------------33244D8C268C8B6156043950 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-MIME-Autoconverted: from 8bit to quoted-printable by summerset.crim.ca id QAA11989 > I have questions about translations: > > The button "Commentaires" may not convey that clicking on > it adds comment fields to ALL questions. So maybe something > like "Comment All" or "All Comments" would be clearer. > This is the hardiest part to translate...Let's try : Commenter toutes les= questions. Also, I don't think this is necessary to put the label inside the text field because it takes a lot of space. I guess that the f= lashing pointer is enough. > The translations for "Strongly Disagree" and "Strongly Agree" > seem weaker than I expected. Maybe add Très before each? > Because of space constraint, I thought it was more convenient to use one = word. If you really want to add strongly, say: Totalement en d=E9saccord - Totalement en accord but note that it doesn't had much! I have a comment about the scales: From my experience, it is better to ha= ve an even number of choices to avoid having a neutral choice. Also, I would add the word Non-applicable in parenthesis after N/A on the Help = section. A question: Does the box below System and Email to need to be located at = the top of the screen? > Now on to the questions. I'll include the perl assignments > for the CSUQ questions. After those, depending on your > enthusiasm, we can consider other questionaires. > > There is one tricky aspect to the remaining translation. > Try this URL: > http://www.acm.org/~perlman/question.cgi?language=3Dfr&system=3D= SuperSite&object=3DWebSite > Notice how WebSite replaces 'System' as the default object being evalua= ted, > and how SuperSite replaces "the 'System' you used". > This creates a problem translating "the System" because it it might > be accompanied by "le" and "cet" or "la" and "cette", right? Not really because labels are rarely accompagnied by an article in French= . You can say Syst=E8me only, System you used =3D Syst=E8me utilis=E9. WebSite is Site Web. Questions are coming... Sylvie --------------33244D8C268C8B6156043950 Content-Type: text/html; charset=us-ascii Content-Transfer-Encoding: 7bit
I have questions about translations:

The button "Commentaires" may not convey that clicking on
it adds comment fields to ALL questions.  So maybe something
like "Comment All" or "All Comments" would be clearer.
 

This is the hardiest part to translate...Let's try : Commenter toutes les questions. Also, I don't think this is necessary to put the label inside the text field because it takes a lot of space. I guess that the flashing pointer is enough.
The translations for "Strongly Disagree" and "Strongly Agree"
seem weaker than I expected.  Maybe add Tr&egrave;s before each?
 
Because of space constraint, I thought it was more convenient to use one word. If you really want to add strongly, say: Totalement en désaccord - Totalement en accord but note that it doesn't had much!

I have a comment about the scales: From my experience, it is better to have an even number of choices to avoid having a neutral choice. Also, I would add the word Non-applicable in parenthesis after N/A on the Help section.

A question: Does the box below System and Email to need to be located at the top of the screen?

Now on to the questions.  I'll include the perl assignments
for the CSUQ questions.  After those, depending on your
enthusiasm, we can consider other questionaires.

There is one tricky aspect to the remaining translation.
Try this URL:
        http://www.acm.org/~perlman/question.cgi?language=fr&system=SuperSite&object=WebSite
Notice how WebSite replaces 'System' as the default object being evaluated,
and how SuperSite replaces "the 'System' you used".
This creates a problem translating "the System" because it it might
be accompanied by "le" and "cet" or "la" and "cette", right?

Not really because labels are rarely accompagnied by an article in French. You can say Système only, System you used = Système utilisé. WebSite is Site Web.

Questions are coming...

Sylvie
  --------------33244D8C268C8B6156043950-- From sylvie@crim.ca Tue Nov 24 16:44:18 1998 Received: from crim.ca (meteor.crim.ca [132.218.30.56]) by summerset.crim.ca (8.8.7/8.8.4) with ESMTP id QAA12920 for ; Tue, 24 Nov 1998 16:45:37 -0500 (EST) Message-Id: <365B28DD.F870B662@crim.ca> Date: Tue, 24 Nov 1998 16:45:01 -0500 From: Sylvie Turcotte X-Mailer: Mozilla 4.05 [en] (Win95; I) Mime-Version: 1.0 To: Gary PERLMAN Subject: Re: Translation References: <9811180326.AA22222@turing.acm.org> Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Mime-Autoconverted: from 8bit to quoted-printable by summerset.crim.ca id QAA12920 Status: RO X-Status: X-Keywords: X-UID: 16 Sorry but I think I misunderstood the tricky aspect... but again, there i= s not problem because you say CE before both Syst=E8me and Site Web (both are masculine!). Sylvie From perlman Tue Oct 6 22:53:23 1998 Received: by turing.acm.org; id AA06763; Tue, 6 Oct 1998 22:53:21 -0400 Date: Tue, 6 Oct 1998 22:53:21 -0400 From: Gary PERLMAN Message-Id: <9810070253.AA06763@turing.acm.org> To: jacob@useit.com Subject: Web-Based User Interface Evaluation with Questionnaires Cc: perlman Status: RO X-Status: X-Keywords: X-UID: 17 As an example, perhaps misguided in the application, I put your 1993 definition of usability and heuristics into my question.cgi script described at: http://www.acm.org/~perlman/question.html A couple of links get people to useit.com, which I know you like. I wanted to know.... Is it okay for me to have the two instruments (5 attributes and 10 heuristics). If so, do you want to suggest some disclaimers about how these could/should be applied? Gary From Michael_Muller/CAM/Lotus@lotus.com Thu Oct 8 09:02:15 1998 Received: from internet2.lotus.com (internet2 [9.95.4.236]) by lotus2.lotus.com (8.8.8/8.8.7) with ESMTP id JAA00450; Thu, 8 Oct 1998 09:16:24 -0400 (EDT) From: Michael_Muller/CAM/Lotus@lotus.com Received: from mta2.lotus.com (MTA2.lotus.com [9.95.5.6]) by internet2.lotus.com (8.8.8/8.8.7) with SMTP id JAA08928; Thu, 8 Oct 1998 09:10:22 -0400 (EDT) Received: by mta2.lotus.com(Lotus SMTP MTA v4.6.3 (723.2 9-26-1998)) id 85256697.0048FCE3 ; Thu, 8 Oct 1998 09:17:13 -0400 X-Lotus-Fromdomain: LOTUS@MTA To: Gary PERLMAN Cc: kensing@dat.ruc.dk Message-Id: <85256697.0048F662.00@mta2.lotus.com> Date: Thu, 8 Oct 1998 09:07:35 -0400 Subject: Re: Web-Based User Interface Evaluation with Questionnaires Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Status: RO X-Status: X-Keywords: X-UID: 18 Hi Gary, Would you consider writing about your survey instrument for the methods and tools column of interactions magazine? Thanks, michael -- Michael Muller Lotus Research Lotus Development Corporation 55 Cambridge Parkway Cambridge MA 02142 USA +1-617-693-4235 (voice) +1-617-693-1407 (fax) mullerm@acm.org or michael_muller@lotus.com -- Gary PERLMAN on 10/05/98 03:08:37 PM Please respond to Gary PERLMAN To: CHI-ANNOUNCEMENTS@ACM.ORG cc: (bcc: Michael Muller/CAM/Lotus) Subject: Web-Based User Interface Evaluation with Questionnaires I made an online usability survey script which may be of interest. You can use it to administer a variety of usability questionnaires on the Web without even having to install any software. You do not need to know perl, CGI, or HTML to use it. Or so I claim. Gary Perlman, perlman@acm.org http://www.acm.org/~perlman/ question.cgi is a customizable Web-based perl CGI script to administer and collect data according to a few "standard" user interface evaluation questionnaire forms (QUIS, PUEU, CSUQ, and PUTQ). The script can be customized and run from a remote server: http://www.acm.org/~perlman/question.cgi from which data are emailed in a simple format. The script accepts options as part of its form data: * general customizations such as system name, administrator email, ... * customizations to the rating scale such as number of points, labels, ... * number of open-ended positive/negative comments requested The script uses these options to present the questionnaire on the Web, gather ratings, general comments, and question-specific comments, and email the results to the designated survey administrator. The user manual allows the online reader to design and create their own questionnaire is available at: http://www.acm.org/~perlman/question.html The script is freely available, AS-IS, in a shell archive at: http://www.acm.org/~perlman/question.sh From perlman Thu Oct 8 09:16:35 1998 Received: by turing.acm.org; id AA27756; Thu, 8 Oct 1998 09:15:20 -0400 From: Gary PERLMAN Message-Id: <9810081315.AA27756@turing.acm.org> Subject: Re: Web-Based User Interface Evaluation with Questionnaires To: Michael_Muller/CAM/Lotus@lotus.com Date: Thu, 8 Oct 1998 09:15:20 -0400 (EDT) Cc: perlman In-Reply-To: <85256697.0048F662.00@mta2.lotus.com> from "Michael_Muller/CAM/Lotus@lotus.com" at Oct 8, 98 09:07:35 am X-Mailer: ELM [version 2.4 PL25] Content-Type: text Content-Length: 2924 Status: O X-Status: X-Keywords: X-UID: 19 Hi Michael, Lotus, eh? Boston's fun. I miss Rosie's bakery, especially Soho Globs. I could write about: 1. what it is and what it does: * read questionnaire design information (quesitons + options) * read over-riding options from form data * present survey * mail results 2. how it does it: * perl CGI script * perl file for each survey * form data processing 3. how it can be used * remote evaluation of things * comparative questionnaire analysis (educational) I suepct that for interactions, 3 would be the most interesting, supported by 1, and 2 could be determined by looking at the scripts. On my to-do list is internationalization of the script to allow translation. Which would also be of interest, but which might take a while to get translations done. Gary > Hi Gary, > > Would you consider writing about your survey instrument for the methods and > tools column of interactions magazine? > Thanks, > michael > -- > Michael Muller > Lotus Research > Lotus Development Corporation > 55 Cambridge Parkway > Cambridge MA 02142 USA > +1-617-693-4235 (voice) +1-617-693-1407 (fax) > mullerm@acm.org or michael_muller@lotus.com > -- > > > > > Gary PERLMAN on 10/05/98 03:08:37 PM > > Please respond to Gary PERLMAN > > To: CHI-ANNOUNCEMENTS@ACM.ORG > cc: (bcc: Michael Muller/CAM/Lotus) > > Subject: Web-Based User Interface Evaluation with Questionnaires > > > > > I made an online usability survey script which may be of interest. > You can use it to administer a variety of usability questionnaires > on the Web without even having to install any software. You do not > need to know perl, CGI, or HTML to use it. Or so I claim. > > Gary Perlman, perlman@acm.org http://www.acm.org/~perlman/ > > question.cgi is a customizable Web-based perl CGI script to administer > and collect data according to a few "standard" user interface > evaluation questionnaire forms (QUIS, PUEU, CSUQ, and PUTQ). The script > can be customized and run from a remote server: > http://www.acm.org/~perlman/question.cgi > from which data are emailed in a simple format. The script accepts > options as part of its form data: > * general customizations such as system name, administrator email, ... > * customizations to the rating scale such as number of points, labels, ... > * number of open-ended positive/negative comments requested > The script uses these options to present the questionnaire on the Web, > gather ratings, general comments, and question-specific comments, and > email the results to the designated survey administrator. The user > manual allows the online reader to design and create their own > questionnaire is available at: > http://www.acm.org/~perlman/question.html > The script is freely available, AS-IS, in a shell archive at: > http://www.acm.org/~perlman/question.sh > > > > > > > From Michael_Muller/CAM/Lotus@lotus.com Thu Oct 8 09:55:38 1998 Received: from internet2.lotus.com (internet2 [9.95.4.236]) by lotus2.lotus.com (8.8.8/8.8.7) with ESMTP id KAA05596; Thu, 8 Oct 1998 10:10:44 -0400 (EDT) From: Michael_Muller/CAM/Lotus@lotus.com Received: from mta2.lotus.com (MTA2.lotus.com [9.95.5.6]) by internet2.lotus.com (8.8.8/8.8.7) with SMTP id KAA13620; Thu, 8 Oct 1998 10:04:42 -0400 (EDT) Received: by mta2.lotus.com(Lotus SMTP MTA v4.6.3 (723.2 9-26-1998)) id 85256697.004DF500 ; Thu, 8 Oct 1998 10:11:29 -0400 X-Lotus-Fromdomain: LOTUS@MTA To: Gary PERLMAN Cc: kensing@dat.ruc.dk Message-Id: <85256697.004DE585.00@mta2.lotus.com> Date: Thu, 8 Oct 1998 10:01:24 -0400 Subject: Re: Web-Based User Interface Evaluation with Questionnaires Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Status: RO X-Status: X-Keywords: X-UID: 20 Hi Gary, Thanks for your prompt answer. I agree with your assessment of your ideas, with a little modification: - Idea 3: Yes, "how to use it" is the most important aspect for interactions - Idea 1: I think that the "what is it" and "what does it do" would be helpful, too. - Idea 2: I think that the details of implementation should go into a brief footnote, or a small sidebar. Would that work for you? Thanks! Michael p.s. Lotus is a really nice place, and Irene Greif is a terrific boss. I seem to have formed a real attachment to the North American West, so I'm having a bit of trouble with this return to the East. We'll see... Rosie's is still here. It's nice, but then so is the Bestseller Cafe, Quevado (?) in Arlington... -- Gary PERLMAN on 10/08/98 09:15:20 AM To: Michael Muller/CAM/Lotus@Lotus cc: perlman@turing.acm.org Subject: Re: Web-Based User Interface Evaluation with Questionnaires Hi Michael, Lotus, eh? Boston's fun. I miss Rosie's bakery, especially Soho Globs. I could write about: 1. what it is and what it does: * read questionnaire design information (quesitons + options) * read over-riding options from form data * present survey * mail results 2. how it does it: * perl CGI script * perl file for each survey * form data processing 3. how it can be used * remote evaluation of things * comparative questionnaire analysis (educational) I suepct that for interactions, 3 would be the most interesting, supported by 1, and 2 could be determined by looking at the scripts. On my to-do list is internationalization of the script to allow translation. Which would also be of interest, but which might take a while to get translations done. Gary > Hi Gary, > > Would you consider writing about your survey instrument for the methods and > tools column of interactions magazine? > Thanks, > michael > -- > Michael Muller > Lotus Research > Lotus Development Corporation > 55 Cambridge Parkway > Cambridge MA 02142 USA > +1-617-693-4235 (voice) +1-617-693-1407 (fax) > mullerm@acm.org or michael_muller@lotus.com > -- > > > > > Gary PERLMAN on 10/05/98 03:08:37 PM > > Please respond to Gary PERLMAN > > To: CHI-ANNOUNCEMENTS@ACM.ORG > cc: (bcc: Michael Muller/CAM/Lotus) > > Subject: Web-Based User Interface Evaluation with Questionnaires > > > > > I made an online usability survey script which may be of interest. > You can use it to administer a variety of usability questionnaires > on the Web without even having to install any software. You do not > need to know perl, CGI, or HTML to use it. Or so I claim. > > Gary Perlman, perlman@acm.org http://www.acm.org/~perlman/ > > question.cgi is a customizable Web-based perl CGI script to administer > and collect data according to a few "standard" user interface > evaluation questionnaire forms (QUIS, PUEU, CSUQ, and PUTQ). The script > can be customized and run from a remote server: > http://www.acm.org/~perlman/question.cgi > from which data are emailed in a simple format. The script accepts > options as part of its form data: > * general customizations such as system name, administrator email, ... > * customizations to the rating scale such as number of points, labels, ... > * number of open-ended positive/negative comments requested > The script uses these options to present the questionnaire on the Web, > gather ratings, general comments, and question-specific comments, and > email the results to the designated survey administrator. The user > manual allows the online reader to design and create their own > questionnaire is available at: > http://www.acm.org/~perlman/question.html > The script is freely available, AS-IS, in a shell archive at: > http://www.acm.org/~perlman/question.sh > > > > > > > From owner-chi-web@ACM.ORG Fri Nov 20 15:51:01 1998 Received: from mail (mail.acm.org [199.222.69.4]) by mail.acm.org (8.8.5/8.7.5) with ESMTP id PAA1258754; Fri, 20 Nov 1998 15:49:53 -0500 Received: from ACM.ORG by ACM.ORG (LISTSERV-TCP/IP release 1.8c) with spool id 111539 for CHI-WEB@ACM.ORG; Fri, 20 Nov 1998 15:49:52 -0500 Received: from mail (mail.acm.org [199.222.69.4]) by mail.acm.org (8.8.5/8.7.5) with ESMTP id PAA1035524 for ; Fri, 20 Nov 1998 15:39:47 -0500 Approved-By: instone@USABLEWEB.COM Received: from www.ashman.com (www.ashman.com [206.241.177.10]) by mail.acm.org (8.8.5/8.7.5) with ESMTP id PAA910706 for ; Fri, 20 Nov 1998 15:17:46 -0500 Received: from burroughs (burroughs.dc.usweb.com [206.241.177.102]) by www.ashman.com (8.8.5/8.7.3) with SMTP id OAA20813 for ; Fri, 20 Nov 1998 14:22:55 -0500 Mime-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 X-Msmail-Priority: Normal X-Mailer: Microsoft Outlook Express 4.72.3110.1 X-Mimeole: Produced By Microsoft MimeOLE V4.72.3110.3 Message-Id: <008301be14c2$758ae380$66b1f1ce@burroughs.dc.usweb.com> Date: Fri, 20 Nov 1998 15:15:03 -0500 Reply-To: Seth Gordon Sender: "ACM SIGCHI WWW Human Factors (Open Discussion)" From: Seth Gordon Subject: Data collection methods: online vs. paper To: CHI-WEB@ACM.ORG Status: RO X-Status: X-Keywords: X-UID: 21 Greetings List, As I prepare for an upcoming usability test of a web site, I was trying to figure if it would be better to collection questionnaire results on paper, or to have the users complete on-line forms while they are participating in the test. There are merits to each, a few of which are: On-line Forms: *User can supply answers without losing focus on computer tasks *Results are automatically cataloged into a database, eliminating transcription errors *Easier for many to type open-ended answers than write by hand. Paper Based *Familiar method for completing forms *More reliable - no chance of 'crashing' or interfering with the test system performance *May feel less urgent, allowing user to supply more thoughtful answer Obviously, this is not a complete list of the pros/cons of each, just a few items to start the brain rolling. I was curious if anyone knows of research done on the topic, or is the selection generally arbitrary? I want to select the collection method that is most accurate, but also least disturbing and distracting to the test participants. As with physics, any attempt to collect data on an item disrupts that items natural course of action. -Seth From owner-chi-web@ACM.ORG Fri Nov 20 15:53:42 1998 Received: from mail (mail.acm.org [199.222.69.4]) by mail.acm.org (8.8.5/8.7.5) with ESMTP id PAA963390; Fri, 20 Nov 1998 15:53:16 -0500 Received: from ACM.ORG by ACM.ORG (LISTSERV-TCP/IP release 1.8c) with spool id 111590 for CHI-WEB@ACM.ORG; Fri, 20 Nov 1998 15:53:14 -0500 Received: from mail (mail.acm.org [199.222.69.4]) by mail.acm.org (8.8.5/8.7.5) with ESMTP id PAA1012506 for ; Fri, 20 Nov 1998 15:39:49 -0500 Approved-By: instone@USABLEWEB.COM Received: from www.ashman.com (www.ashman.com [206.241.177.10]) by mail.acm.org (8.8.5/8.7.5) with ESMTP id OAA924892 for ; Fri, 20 Nov 1998 14:56:37 -0500 Received: from burroughs (burroughs.dc.usweb.com [206.241.177.102]) by www.ashman.com (8.8.5/8.7.3) with SMTP id OAA20698 for ; Fri, 20 Nov 1998 14:01:45 -0500 Mime-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 X-Msmail-Priority: Normal X-Mailer: Microsoft Outlook Express 4.72.3110.1 X-Mimeole: Produced By Microsoft MimeOLE V4.72.3110.3 Message-Id: <007901be14bf$80e5b780$66b1f1ce@burroughs.dc.usweb.com> Date: Fri, 20 Nov 1998 14:53:53 -0500 Reply-To: Seth Gordon Sender: "ACM SIGCHI WWW Human Factors (Open Discussion)" From: Seth Gordon Subject: Questionnaire formulation for usability test To: CHI-WEB@ACM.ORG Status: RO X-Status: X-Keywords: X-UID: 22 Greetings List, In addition to task/scenario lists, I am working on constructing questionnaires to evaluate the usability of an e-commerce web site. Basically, the client wishes to sell merchandise from their extensive catalog, so a significant portion of the site revolves around the ability of the user to find and purchase merchandise. I'm having a difficult time constructing unbiased and non-leading questions to ask the users. There are plenty of influences that may skew the results, and I don't want the wording of the questionnaire to be another. If any of you have samples you'd be willing to share, I'd be very appreciative. If they were used for sensitive clients, I certainly wouldn't mind if you removed any inappropriate references. On another note, we are looking for space in Boston to perform the tests. We anticipate 10 users (the client preferred 'full-price usability') who will require net connections. Also, the client (5 people) wishes to view the test through 1 way glass and be able to 'eavesdrop' on tester screens. Any recommendations or contact points in the Boston area that can support such a test? Thanks in advance, Seth. From shaik@ux1.cso.uiuc.edu Wed Mar 3 15:57:20 1999 Received: from mail.acm.org (mail.acm.org [199.222.69.4]) by turing.acm.org (8.9.2/8.9.2) with ESMTP id PAA08862 for ; Wed, 3 Mar 1999 15:57:18 -0500 (EST) Received: from staff2.cso.uiuc.edu (shaik@staff2.cso.uiuc.edu [128.174.5.53]) by mail.acm.org (8.8.5/8.7.5) with ESMTP id PAA29494 for ; Wed, 3 Mar 1999 15:57:17 -0500 Received: from localhost (shaik@localhost) by staff2.cso.uiuc.edu (8.8.8/8.8.8) with SMTP id OAA07190; Wed, 3 Mar 1999 14:57:27 -0600 (CST) X-Authentication-Warning: staff2.cso.uiuc.edu: shaik owned process doing -bs Date: Wed, 3 Mar 1999 14:57:27 -0600 (CST) From: najmuddin shaik X-Sender: shaik@staff2.cso.uiuc.edu To: perlman@acm.org cc: shaik@uiuc.edu Subject: Interface Evaluation Instrument Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Status: RO X-Status: X-Keywords: X-UID: 23 Dr. Perlman, The Department of Human Resource Education at the University of Illinois at Urbana-Champaign, as part of its ongoing research on online instruction, would like to ask for your permission to use the following web-based user-interface questionnaire that you have developed, to evaluate the department's web-based interface: Practical Heuristics for Usability Evaluation (Perlman, G. 1997) based on Nielsen's 1993 heuristics and Norman's 1990 Principles. http://www.acm.org/~perlman/question.html Proper credit will be given to you as creator of the questionnaire in our final report. Your assistance for this project is appreciated. thanq Naj Shaik From httpd@turing.acm.org Wed Mar 3 13:50:42 1999 Received: from mail.acm.org (mail.acm.org [199.222.69.4]) by turing.acm.org (8.9.2/8.9.2) with ESMTP id NAA07083 for ; Wed, 3 Mar 1999 13:50:41 -0500 (EST) Received: from turing.acm.org (turing.acm.org [199.222.69.20]) by mail.acm.org (8.8.5/8.7.5) with ESMTP id NAA32864 for ; Wed, 3 Mar 1999 13:50:40 -0500 Received: (from httpd@localhost) by turing.acm.org (8.9.2/8.9.2) id NAA30734 for perlman@acm.org; Wed, 3 Mar 1999 13:50:40 -0500 (EST) Date: Wed, 3 Mar 1999 13:50:40 -0500 (EST) Message-Id: <199903031850.NAA30734@turing.acm.org> Subject: spsu.administration: Questionnaire System Evaluation Sender: perlman@acm.org From: perlman@acm.org (question.cgi) Status: RO X-Status: X-Keywords: X-UID: 24 system=spsu.administration date=99-03-03 13:50:39 comment= q1=2 q2=1 q3=2 q4=1 q5=1 q6=1 q7=2 q8=1 q9=NA q10=2 q11=2 q12=NA q13=NA q14=NA q15=NA q16=2 q17=-1 q18=NA q19=NA q20=2 q21=2 q22=2 q23=2 q24=2 q25=1 q26=2 q27=2 q28=2 q29=2 q30=2 q31=-1 q32=1 q33=0 q34=2 q35=0 q36=0 q37=2 q38=2 q39=2 q40=2 q41=2 q42=2 q43=2 q44=1 q45=0 q46=-1 q47=2 q48=1 q49=1 q50=0 q51=-1 q52=1 q53= q54=1 q55=0 q56=0 q57=0 q58=1 q59=1 q60=2 q61=2 q62=2 q63=2 q64=1 q65=1 q66=1 q67=1 q68=-1 q69=2 q70=2 q71=2 q72=1 q73=1 q74=0 q75=2 q76=1 q77=1 q78=1 q79=1 q80=1 q81=1 q82=2 q83=2 q84=2 q85=2 q86=1 q87=1 q88=1 q89=0 q90=2 q91=0 q92=0 q93=1 q94=2 q95=2 q96=0 q97=0 q98=2 q99=0 q100=1 negative1=No UNDO function is provided to reverse control actions positive1=Consistency is provided positive2=Good user Guiders