Monroe County, Local District of Social Services
Type: Post Survey
Created by: Center for Technology in Government
Administered by: Monroe County

Background

In June 2006, the Center for Technology in Government engaged with the NYS Office of Children and Family Services (OCFS) to assess the use of mobile technologies in child protective service work in Monroe County, New York City, and Westchester County. The aim of this assessment is to evaluate how portable technologies impact child protective service work. This post evaluation survey asks about your experiences in the pilot using the mobile technologies for CPS work. If you have questions about this survey, please contact Tom Corbett.

Please specify which mobile technology you are using/have used during the pilot, and the number weeks you used it: Please check all that apply.

Technology

Time in Weeks

□

Dragon Naturally Speaking (□ Version 8 □ Version 9)

□

Digital Pen

Data Input – Process Evaluation

1) For the tables below, please estimate the work time in hours per week during the pilot period you spent on each task. If you used Dragon Naturally Speaking or a digital pen for that task, please check the appropriate box to the right of the task.

CONX Related Activities

Task

Approximate

Hours/Week

Dragon Naturally

Speaking

Digital Pen

Progress Notes

□

□

Your To Do’s

□

□

Event List

□

□

Searches: Person, Address, Case, Resource

and Staff

□

□

Review Intake Information

□

□

Adding/Relating Person

□

□

Adding/Changing Case Worker or Planner

□

□

Demographics

□

□

Safety Assessment

□

□

Risk Assessment Profile

□

□

Reassigning a Stage

□

□

Investigating Conclusion

□

□

Create an FSI

□

□

Stage Progression to FSS

□

□

Changing Case Status

□

□

FASP

□

□

Other, Please explain

□

□

Non-CONX Related Activities

Task

Approximate

Hours/Week

Dragon Naturally

Speaking

Digital Pen

Microsoft Office Applications

□

□

E-Mail

□

□

Managing an Address book (Storing

Contacts)

□

□

Schedule Organizer

□

□

Network Drives (Containing your files)

□

□

Network Drives (Shared files with other

users)

□

□

Online Person Searches

□

□

Online Address Searches

□

□

Other, Please explain

□

□

2) During the pilot my progress notes have been/were about the right length.

Strongly Disagree
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Strongly Agree

3) During the pilot my progress notes have been/were usually complete.

Strongly Disagree
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Strongly Agree

4) During the pilot my progress notes have had/had adequate details.

Strongly Disagree
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Strongly Agree

5) During the pilot my progress notes have been/were usually up to date.

Strongly Disagree
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Strongly Agree

6) During the pilot I was usually able to prepare my progress notes while out of the office (e.g., waiting for a client, waiting at court, on the bus, etc.).

Strongly Disagree
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Strongly Agree

7) During the pilot I was usually able to enter my progress notes into CONX while out of the office (e.g., waiting for a client, waiting at court, on the bus, etc.).

Strongly Disagree
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Strongly Agree

8) During the pilot a mobile technology (Dragon Naturally Speaking, and Digital Pens) allowed me to enter progress notes into CONX while in the field.

Strongly Disagree
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Strongly Agree

9) During the pilot I usually entered my progress notes all at one sitting.

Strongly Disagree
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Strongly Agree

10) During the pilot I usually entered all my progress notes during regular working hours.

Strongly Disagree
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Strongly Agree

11) What were your normal working hours during the pilot?

start:__________ am pm end:__________ am pm

12) During the pilot, on average how many face-to-face field contacts did you have a week?

__________

Usefulness – Time Savings – Quality – Efficiency

13) During the pilot how frequently did you work at home to complete your progress notes?

[ ] Daily
[ ] A few times/week
[ ] Rarely
[ ] Never

14) During the pilot how frequently did you stay in the office after normal work hours to complete your progress notes?

[ ] Daily
[ ] A few times/week
[ ] Rarely
[ ] Never

15) During the pilot, did you have time during your regular work day for working on progress notes outside the office (i.e., waiting for a client, waiting at court, on the bus, etc.)?

Almost Always
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Almost Never

Questions Related to Specific Mobile technologies

16) How would you rate the EASE OF USE of each mobile technology for doing your work?

Strongly
Strongly
Disagree
Agree

Dragon Naturally Speaking
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

17) I found it quicker to enter/input/dictate my Progress Notes using the mobile technology?

Strongly
Strongly
Disagree
Agree

Dragon Naturally Speaking
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

18) How difficult was it to get comfortable using the mobile technology for doing your work?

Very
Very
Difficult
Easy

Dragon Naturally Speaking
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

19) After I was comfortable using it, the mobile technologies listed below saved me significant time:

Strongly
Strongly
Disagree
Agree

Dragon Naturally Speaking
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

20) After I was comfortable using it, the mobile technologies listed below allowed me to accomplish other tasks:

Strongly
Strongly
Disagree
Agree

Dragon Naturally Speaking
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

If so, which tasks, please check all that apply:

- Case openings/closings
[ ]

- CCRS Activity
[ ]

- Time spent with families
[ ]

- Time spent working on FASPs
[ ]

- None of the above, I am able to finish my work in less time
[ ]

Please explain your answer with as much detail and examples as possible:

__________________________________________________________________

21) To what extent do you think the mobile technology is a MORE EFFICIENT way to do work?

Much More
Much Less
Efficient
Efficient

Dragon Naturally Speaking
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

22) To what extent do you think the QUALITY of your work was enhanced by using the mobile technology?

Very
Not at all
Enhanced
Enhanced

Dragon Naturally Speaking
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

23) To what extent were you SATISFIED with the mobile technology?

Very
Not at all
Satisfied
Satisfied

Dragon Naturally Speaking
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

24) To what extent would you RECOMMEND the mobile technology to be used for CPS

Strongly
Not at all
Recommend
Recommend

Dragon Naturally Speaking
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

25) I have encountered problems with the mobile technology that were out of my control

Strongly
Strongly
Disagree
Agree

Dragon Naturally Speaking
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

Please explain your answer with as much detail and examples as possible:

__________________________________________________________________

26) How would you rate the SIZE of the mobile technology for doing your work?

Too Small
Too Large

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

27) How would you rate the WEIGHT of the mobile technology for doing your work?

Just Right
Too Heavy

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

28) How would you rate the PORTABILITY of the mobile technology for doing your work?

Excellent
Poor

Dragon Naturally Speaking
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

29) How would you rate the BATTERY LIFE of the mobile technology for doing your work?

Excellent
Poor

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

30) How would you rate the method of DATA ENTRY of the mobile technology for doing your work?

Excellent
Poor

Dragon Naturally Speaking
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

31) How would you rate the DURABILITY of the mobile technology for doing your work?

Durable
Not at all Durable

Digital Pens
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]

Job Stress

32) During the pilot, I normally was under a lot of work-related stress.

Strongly Disagree
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Strongly Agree

33) During the pilot my open cases caused me a lot of stress.

Strongly Disagree
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Strongly Agree

Data about the Technology

34) During the pilot, I considered myself to be technically savvy :

Strongly Disagree
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Strongly Agree

For the table below, please estimate the average work time in hours per week during the pilot period you spent in each location. If you used Dragon Naturally Speaking or a digital pen in that location please record the approximate time spent using each technology.

Location

Approximate Hours per Week

Doing all work activities

Using Dragon Naturally Speaking

Using a digital pen

Court

School

County / Private Vehicle

Public Transportation

Community Center

Office

Clients’ Residence

Facility’s Residence

Your Residence

Other, Please explain

Acceptance – Attitude

35) After having used the mobile technologies, please indicate which mobile technology (Dragon Naturally Speaking, and Digital Pens) you liked the most, and for what reasons

Please explain your answer with as much detail and examples as possible:

__________________________________________________________________

36) After having used the mobile technologies, please indicate which mobile technology (Dragon Naturally Speaking, and Digital Pens) you disliked the most, and for what reasons

Please explain your answer with as much detail and examples as possible:

__________________________________________________________________

37) After having used the mobile technologies (Dragon Naturally Speaking, and Digital, would you want to continue using it in the field?

YES [ ]
NO [ ]

Please explain your answer with as much detail and examples as possible:

__________________________________________________________________

38) After using the mobile technologies (Dragon Naturally Speaking, and Digital Pens), would you recommend to your staff/coworkers to use it in the field?

YES [ ]
NO [ ]

Please explain your answer with as much detail and examples as possible:

__________________________________________________________________

39) After using the mobile technologies (Dragon Naturally Speaking, and Digital Pens), are there any reasons you would hesitate to take it with you when you are in the field?

YES [ ]
NO [ ]

Please explain your answer with as much detail and examples as possible:

__________________________________________________________________

40) After having used the mobile technologies (Dragon Naturally Speaking, and Digital Pens), what are some of the key advantages of the mobile technology?

__________________________________________________________________

41) After having used the mobile technologies (Dragon Naturally Speaking, and Digital Pens), what are some of the key disadvantages of the mobile technology?

__________________________________________________________________

Expectations of the Technology

42) What is your opinion about the functionality (capabilities, features, how it would be used to do your job…etc.) of Dragon Naturally Speaking?

High
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Low
[ ]
no opinion

Please explain your answer with as much detail and examples as possible:

__________________________________________________________________

43) What is your opinion about the functionality (capabilities, features, how it would be used to do your job…etc.) of the Digital Pens?

High
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Low
[ ]
no opinion

Please explain your answer with as much detail and examples as possible:

__________________________________________________________________

44) What is your opinion about the ease of use of Dragon Naturally Speaking?

High
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Low
[ ]
no opinion

Please explain your answer with as much detail and examples as possible:

__________________________________________________________________

45) What is your opinion about the ease of use of the Digital Pens??

High
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Low
[ ]
no opinion

Please explain your answer with as much detail and examples as possible:

__________________________________________________________________

46) What is your overall assessment of Dragon Naturally Speaking for your work?

High
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Low
[ ]
no opinion

Please explain your answer with as much detail and examples as possible:

__________________________________________________________________

47) What is your overall assessment of the Digital Pens for your work?

High
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
[ ]
Low
[ ]
no opinion

Please explain your answer with as much detail and examples as possible:

__________________________________________________________________

48) Please specify which of the following mobile technologies you have used during the pilot to perform your job and explain your answer with as much detail and examples as possible:

a) Dragon Naturally Speaking:

YES [ ]
NO [ ]

Pros

__________________________________________________________________

Cons

__________________________________________________________________

b) Digital Pens:

YES [ ]
NO [ ]

Pros

__________________________________________________________________

Cons

__________________________________________________________________

If there is anything else you would like to add or let us know regarding this survey or Child Protective Services, please feel free to do so by attaching additional sheets to this survey with your comments.