The following table provides an overview of the major methods used for collecting data during evaluations. Also consider Appreciative Inquiry Survey Design.
Note that if you plan to include in your evaluation, the focus and reporting on personal information about customers or clients participating in the evaluation, then you should first gain their consent to do so. They should understand what you're doing with them in the evaluation and how any information associated with them will be reported. You should clearly convey terms of confidentiality regarding access to evaluation results. They should have the right to participate or not.
Have participants review and sign an informed consent form. See the sample informed-consent form. The overall goal in selecting evaluation method s is to get the most useful information to key decision makers in the most cost-effective and realistic fashion.
Consider the following questions: 1. What information is needed to make current decisions about a product or program? Of this information, how much can be collected and analyzed in a low-cost and practical manner, e.
How accurate will the information be reference the above table for disadvantages of methods? Will the methods get all of the needed information? What additional methods should and could be used if additional information is needed? Will the information appear as credible to decision makers, e. Will the nature of the audience conform to the methods, e. Who can administer the methods now or is training required? How can the information be analyzed?
Note that, ideally, the evaluator uses a combination of methods, for example, a questionnaire to quickly collect a great deal of information from a lot of people, and then interviews to get more in-depth information from certain respondents to the questionnaires.
Perhaps case studies could then be used for more in-depth analysis of unique and notable cases, e. There are four levels of evaluation information that can be gathered from clients, including getting their: 1. Usually, the farther your evaluation information gets down the list, the more useful is your evaluation. Unfortunately, it is quite difficult to reliably get information about effectiveness.
Still, information about learning and skills is quite useful. Analyzing quantitative and qualitative data is often the topic of advanced research and evaluation methods. There are certain basics which can help to make sense of reams of data.
Always start with your evaluation goals: When analyzing data whether from questionnaires, interviews, focus groups, or whatever , always start from review of your evaluation goals, i.
This will help you organize your data and focus your analysis. For example, if you wanted to improve your program by identifying its strengths and weaknesses, you can organize data into program strengths, weaknesses and suggestions to improve the program.
If you wanted to fully understand how your program works, you could organize data in the chronological order in which clients go through your program. If you are conducting an outcomes-based evaluation, you can categorize data according to the indicators for each outcome. Basic analysis of "quantitative" information for information other than commentary, e. Make copies of your data and store the master copy away. Use the copy for making edits, cutting and pasting, etc.
Tabulate the information, i. For ratings and rankings, consider computing a mean, or average, for each question. For example, "For question 1, the average ranking was 2. This is more meaningful than indicating, e. Consider conveying the range of answers, e. Basic analysis of "qualitative" information respondents' verbal answers in interviews, focus groups, or written commentary on questionnaires : 1.
Read through all the data. Organize comments into similar categories, e. Label the categories or themes, e. Attempt to identify patterns, or associations and causal relationships in the themes, e. Keep all commentary for several years after completion in case needed for future reference. Attempt to put the information in perspective, e. Consider recommendations to help program staff improve the program, conclusions about program operations or meeting goals, etc.
Record conclusions and recommendations in a report document, and associate interpretations to justify your conclusions or recommendations. The level and scope of content depends on to whom the report is intended, e. Be sure employees have a chance to carefully review and discuss the report. Translate recommendations to action plans, including who is going to do what about the program and by when. Bankers or funders will likely require a report that includes an executive summary this is a summary of conclusions and recommendations, not a listing of what sections of information are in the report -- that's a table of contents ; description of the organization and the program under evaluation; explanation of the evaluation goals, methods, and analysis procedures; listing of conclusions and recommendations; and any relevant attachments, e.
The banker or funder may want the report to be delivered as a presentation, accompanied by an overview of the report.
Or, the banker or funder may want to review the report alone. Be sure to record the evaluation plans and activities in an evaluation plan which can be referenced when a similar program evaluation is needed in the future. An example of evaluation report contents is included later on below in this document. Ideally, management decides what the evaluation goals should be.
Then an evaluation expert helps the organization to determine what the evaluation methods should be, and how the resulting data will be analyzed and reported back to the organization. Most organizations do not have the resources to carry out the ideal evaluation. If they can afford any outside help at all, it should be for identifying the appropriate evaluation methods and how the data can be collected.
The organization might find a less expensive resource to apply the methods, e. If no outside help can be obtained, the organization can still learn a great deal by applying the methods and analyzing results themselves. However, there is a strong chance that data about the strengths and weaknesses of a program will not be interpreted fairly if the data are analyzed by the people responsible for ensuring the program is a good one.
Program managers will be "policing" themselves. This caution is not to fault program managers, but to recognize the strong biases inherent in trying to objectively look at and publicly at least within the organization report about their programs.
Therefore, if at all possible, have someone other than the program managers look at and determine evaluation results. Develop an evaluation plan to ensure your program evaluations are carried out efficiently in the future.
Note that bankers or funders may want or benefit from a copy of this plan. Ensure your evaluation plan is documented so you can regularly and efficiently carry out your evaluation activities. Record enough information in the plan so that someone outside of the organization can understand what you're evaluating and how. Consider the following format for your report: 1.
Table of Contents 3. Executive Summary one-page, concise overview of findings and recommendations 4. Purpose of the Report what type of evaluation s was conducted, what decisions are being aided by the findings of the evaluation, who is making the decision, etc.
Don't balk at evaluation because it seems far too "scientific. There is no "perfect" evaluation design. Don't worry about the plan being perfect. It's far more important to do something, than to wait until every last detail has been tested. Work hard to include some interviews in your evaluation methods. Questionnaires don't capture "the story," and the story is usually the most powerful depiction of the benefits of your services.
Don't interview just the successes. You'll learn a great deal about the program by understanding its failures, dropouts, etc. Don't throw away evaluation results once a report has been generated. Results don't take up much room, and they can provide precious information later when trying to understand changes in the program.
Kellogg Foundation Evaluation Handbook. If you observe the above example, we inserted elements into the list at different index positions 0 , 3 by using the Insert method. Same way, by using the InsertRange method we are inserting all the elements of a newly created list lst2 into lst at index position 2. In visual basic, we have different methods to remove elements from the list i. Following is the example of deleting elements from the list in visual basic programming language.
If you observe the above example, we used Remove method to delete the particular value of the element from the list and another method RemoveAt is used to delete an element at the specified index position. Same way, we used RemoveRange method to delete the specified number of elements from the list starting from the specified index position. In case, if you want to remove all the elements from the list, then use the Clear method.
Same way, we can use different methods like Find method to find the elements of list and Reverse method to reverse the order of list elements, etc. By using Contains method, we can check whether the specified element exists in the list or not.
In case, if it exists it will return True otherwise False. Following is the example of using Contains method to check for an item that exists in the list or not in visual basic. Contains If you observe the above example, we used Contains method to check for an item 50 exists in the list lst or not. Visual Basic List. Visual Basic List Declaration In visual basic, list is a generic type of collection and it is provided by System.
Add 1 lst. Add 8 lst. Add "Hi" lst2. Add "Welcome" lst2. Add "to" lst2. Add "Tutlane" Console. Count Console. Capacity Console. If you have a Processor Tech VDM any display that reads directly from memory, and at least bytes of other memory, here is a random walk program you might like Send me your comments or questions regarding this program.
Even if they had the aptitude, the first thing many would do is create or load a version of BASIC for their system so that they could write programs more easily. BASIC was designed to make it easy for people to interact with their computer by accepting instructions in regular English.
BASIC also supplied functions that allowed a person to manipulate data, perform math operations, and parse strings. In parallel with the development of the microcomputer, BASIC quickly became the most popular programming language, and stayed prominent well until the late 's.
Computer magazines including Personal Computing began publishing free program listings in BASIC for their readers to type in a save on their systems. This easy-to-use approach introduced computers to a new type of audience, and this population wanted pre-written programs for their systems. This is a good example of the types of programs that were popular with the new appliance computer user. Complete BASIC program listings were very popular and were still distributed freely in with purchase of the magazine.
I have systems plus zounds of miscellaneous items for sale or trade. Note Biorhythm program running on display. Click thumbnail for larger image. I signed up for the RetroChallenge Winter Warmup. Nov Magnavox Mystery - a Computer, or? See my Vintage Computer Blog to search for older articles, or post your questions. Using another GRiD power supply that feeds The touchpad has some bad spots, but I was able to look around.
There are three drives, all stored in ROMS, no disk drives. Pictures of GRiD laptops I found ads for a similar system sold by the same company that appear in Byte magazines in , but no ads for the Discovery This is a "turnkey" system, note the key.
The multiprocessor calls the disk controller, but there is no functioning media. After checking for a disk in the floppy drive, the system searches the hard disk for an OS. The hard drive makes a horrible screeching, I doubt I will be able to get too far with it. The hard drive is a Disctron, Inc model D The floppy drive is a Mitsubishi M Photo of drives. Although this is an S system , the drive controller is not installed on the S backplane and receives it's power separately.
Instead the controller sits on the other side of the drives in it's own rails. Based on the date stamp of the chips, I believe that the Discovery was manufactured in Action Computer Enterprise, Inc. There was so much battery acid leakage I was amazed I could even power up the system at all after cleaning with a baking soda solution. When powered up, the system counts from 1 to 5 and then shows a code "".
Not much else.
0コメント