Categories
News RITG Blog

Findings from the Video47 to Kaltura Transition Survey

Some Background

In spring 2022, ITS began efforts to migrate faculty from the College’s aging, in-house, academic video service, known as Video47. The migration began in earnest by summer 2022, with a series of communications, alerting those with files on Video47 to the need for the migration, as well as to keep them informed during the process. Kaltura, was chosen to replace Video47 as it offered many of the same capabilities as Video47, as well as many exciting new features. During the summer, a variety of support services including 6 group trainings, 20 student run clinics, multiple 1:1 consultations, and DIY materials were offered to help with the transition. In total, 43 faculty moved to Kaltura in this time.

In order to better understand the effectiveness of the Video47-to-Kaltura implementation as a whole, ITS asked all 134 faculty who had files on Video47, to take part in a survey, whether they had already moved to Kaltura or not. The survey included questions regarding ITS communications as well as the trainings and support offered during the process to help us improve our practices. 

Survey Results

Of the 134 faculty who had files on Video47, 21.64% (29 faculty) participated in the survey. Below are some highlights and interesting findings from the various quantitative and qualitative responses.  

Findings on ITS Communications
Bar graph of responses from the statement, "I have a clear idea of why it was necessary for Video47to be replaced".
Figure 1. Results from question 2 of the post-implementation survey.

Data indicates that overall, faculty felt informed throughout the Video47 to Kaltura transition.

When prompted with, “I have a clear understanding of why it was necessary for Video47 to be replaced”, the majority of faculty, overwhelmingly, 72.72% chose strongly agree and agree responses (figure 1) .

Bar graph of responses from the statement, "I have a clear understanding of why Kaltura was selected as the Video47 replacement".
Figure 2. Results from question 3 of the post-implementation survey.

However, when prompted with, “I have a clear understanding of why Kaltura was selected as the Vido47 replacement” the results indicate that the reason behind the selection of Kaltura may not have been communicated as effectively as some would have liked (figure 2). This information is important to us in ITS, as it clearly demonstrates areas we can strive to do better. 

In regards to the effectiveness and frequency of communications from ITS (figure 3) satisfaction appears to be high among faculty. 

Bar graphs of responses from the statements, "please rate your overall satisfaction with the effectiveness of the communications you received from us" and "The frequency of the communications distributed about the transition from Video47 to Kaltura were:".
Figure 3. Results from questions 5 and 6 of the post-implementation survey.

Rounding out the section regarding ITS communications, faculty were able to leave comments to elaborate on their responses. While some concerns were voiced in this section, such as, “…I may have missed the why behind it all”, many comments on ITS communications were positive. 

  • “I felt well informed that the transition was happening…” 
  • “…the necessity is clearly there, and IT staff did a fantastic job of informing us and guiding us through the process.” 
  • “It was actually a fairly easy transition and IT was very well organized.” 
Findings on ITS Trainings and Support

The next set of survey questions were focused on ITS trainings and support and the very first question used branch logic to separate faculty who used available resources with those that had not used resources. 

Of the 25 faculty who responded to this question, “Did you utilize any Kaltura training resources?”  about half (n=12) responded with “No”. Therefore, these 12 faculty  were then asked to respond to the prompt, “Which response best represents why you have not utilized Kaltura training resources?” and responses revealed a variety of reasons (figure 4). Also, of the 12 who had responded “No” previously, only 10 responded to this question. 

Bar graph of responses from the question, "Which response best represents why you have not utilized Kaltura training resources".
Figure 4. Results from question 17 of the post-implementation survey. Branch survey question for responses of “No” from Question 9.

Several write-in answers went on to explain that they were on sabbatical. 

There were 13 responses of “Yes” to the question, “Did you utilize any Kaltura training resources?”. These faculty continued with the survey in order, only skipping question 17 (seen above in figure 4).  

Many group trainings, clinics, and consultations occurred, however, not all were utilized by everyone who participated in this survey (figure 5).  

While survey results show some of the picture, ITS recorded the number of participants during the Video47-to-Kaltura transition (figure 6). 

Bar graph of responses from the question, "which of the following training resources did you attend/use? Check all that apply".
Figure 5. Results from question 10 of the post-implementation survey.
Bar graph of actual Video47 to Kaltura training attendance numbers.
Figure 6. Recorded ITS numbers during the Video47-to-Kaltura implementation.

In response to prompts regarding the satisfaction and usefulness of the Video47-to-Kaltura trainings hosted by ITS, overwhelming, faculty were very satisfied (figure 7). 

Bar graphs of responses from the statements, "Please rate your overall satisfaction with the quality of training(s) you received" and "The training(s) I attended/used met my needs (time, content, format, delivery)".
Figure 7. Results from questions 11 and 12 of the post-implementation survey.

In response to the question, “Which of the following steps have you completed?”, the responses showed that faculty completed the base steps to move from Video47 to Kaltura and had even begun utilizing some of the features new to them such as multiple playlists and captioning (figure 8). Results also showed that the majority of faculty respondents (66%) felt confident in using Kaltura, while only one person (~8%) stated that they did not feel comfortable with Kaltura (figure 9). Further, the survey results indicated that Kaltura met the video sharing needs of the majority of faculty respondents (figure 10). 

Bar graph of responses from the question, "Which of the following steps have you completed".
Figure 8. Results from question 13 of the post-implementation survey.
Bar graph of responses from the statement, "I feel confident using Kaltura in my course(s)".
Figure 9. Results from question 14 of the post-implementation survey.
Bar graph of responses from the statement, "Kaltura ,meets my video sharing needs".
Figure 10. Results from question 15 of the post-implementation survey.

Next Steps

One common theme throughout survey responses and in comment sections, was the desire for more Kaltura training opportunities. Rest assured, ITS will provide future training opportunities for both those who still need to move to Kaltura, and those who wish to learn more about Kaltura’s tools and features. ITS will also begin opening Kaltura up to faculty and staff who never before utilized Video47 but may want to use our new academic video service. 

Keep an eye out for these announcements in the spring! 

Finally, a big thank you to those who participated in the Video47-to-Kaltura trainings, as well as to those who participated in this survey. Your input helps us improve our practices.