
Module 3 - Usability & Reflection

Reflection on usability testing participants:
-
The four participants were fellow classmates, not the intended target audience.
-
The ideal candidates (current coworkers) were unwilling to participate.
-
This situation highlights a common challenge in usability testing: accessing the right participants.
-
To improve in the future:
-
Investigate reasons for coworkers' unwillingness and address their concerns
-
Consider offering incentives for participation
-
Explore alternative times or methods that might be more convenient for target users
-
Build relationships and communicate the value of their input to encourage participation
-
Impact of the platform (Canvas) on testing and results:
-
Canvas was used as the learning management system for testing.
-
The survey indicates that participants found the online learning platform user-friendly (5/5 rating).
-
Canvas's familiarity with fellow classmates might have positively influenced their experience.
-
To improve:
-
Gather more specific feedback on Canvas's features and how they impacted the learning experience
-
Consider how Canvas's functionality aligns with or differs from the platforms your actual target audience typically uses
-
Lessons learned from usability testing feedback:
-
The course structure and content were well received overall
-
Hands-on activities and collaborative elements were effective
-
The positive feedback from classmates, while encouraging, may not fully represent the experience of the intended audience (coworkers)
-
The ease of use reported by classmates might be influenced by their familiarity with Canvas and similar course structures
-
Some areas for improvement:
-
Simplify to-do lists in each module
-
Reduce text-heavy pages
-
Clarify the assignment submission process
-
Consider time requirements for those with full course loads
-
Design changes to address usability issues:
-
Based on feedback, consider:
-
Streamlining to-do lists
-
Breaking up text-heavy pages with more visual elements
-
Improving assignment submission instructions
-
Adjusting course pacing or providing time management resources
-
Consider how the proposed changes would impact the intended audience (coworkers), who may have different needs or expectations than classmates
-
Improvement of course and learner experience:
-
While the feedback from classmates is positive, it's crucial to consider how the course might need to be adapted for the intended audience
-
The high ratings from peers suggest a solid foundation, but further refinement may be needed to meet the specific needs of coworkers
Impact on alignment of outcomes, activities, and assessment:
-
The strong alignment noted by classmates is encouraging
-
However, it's important to verify if these outcomes, activities, and assessments would be equally relevant and effective for the intended audience
Addressing infrastructure, system, and support needs:
-
Consider how the transition from Canvas to the platform used by your coworkers might impact the course delivery
-
Evaluate if the technical support and resources planned would be sufficient for users less familiar with online learning platforms
Additional considerations:
-
The mismatch between intended and actual test participants underscores the importance of stakeholder buy-in and engagement
-
This experience highlights the need for a strategy to better involve the target audience in future iterations of the course
-
While the feedback from classmates is valuable, it's crucial to find ways to gather input from the intended audience before full implementation
-
Consider conducting interviews or surveys with coworkers to understand their reservations and tailor the course to their needs and preferences
Reflection:
Reflecting on my instructional design process for the interactive video creation course, I can see both successes and areas for improvement across the design, implementation, and usability testing phases.
My initial design, grounded in research-based principles and emphasizing hands-on learning with Adobe Captivate, showed promise in its comprehensive approach. The implementation on Canvas was smooth, with positive feedback on user-friendliness and course materials.
However, I faced a significant challenge in engaging my intended audience—my coworkers—revealing a gap between my design intentions and real-world implementation. The usability testing, while informative, was compromised by relying on classmates rather than my target audience. This mismatch highlighted the importance of stakeholder buy-in and the need for strategies to better involve my actual users.
Key lessons emerged around simplifying content, clarifying processes, and balancing course depth with time management for busy professionals. Moving forward, I need to bridge the gap between my test group and target audience, refine my content based on feedback, and develop strategies to overcome participation resistance.
This experience underscores that effective instructional design isn’t just about creating good content but also about understanding and adapting to my learners’ real-world context. My next steps should focus on refining my approach to better meet the needs and constraints of my target audience, ensuring my well-designed course achieves its intended impact in practice.
References:
Adobe Help Center. (2023, September 6). Create an interactive video with overlay in Adobe Captivate. Adobe.
https://helpx.adobe.com/captivate/help/create-interactive-video-overlay-captivate.html
Fink, L. D. (2003). A self-directed guide to designing courses for significant learning. Jossey-Bass.
www.deefinkandassociates.com_GuidetoCourseDesignAug05.pdf
Gulamhussein, A. (2013). Teaching the teachers: Effective professional development in an era of high stakes
accountability. Center for Public Education. https://Teaching_Effective_Professional_Developmt.pdf (dropbox.com)
Harapnuik. D. (2021). Assessment Of/For/As learning. https://www.harapnuik.org/?page_id=8900