Audience Engagement Platform

Archive for the ‘Development’ Category

Reflections on AEP Testing Process

testingHello everyone, my name is Ron Evans, and I’m a technology consultant who has worked on various levels of the design of AEP in the past, and recently I was brought back on board to lend a hand in the software testing process. My recent role included leading the interview process of early users of the software, which is always a fascinating experience.

The initial experience that a first-time user has with new software is an incredibly useful event to witness and record. And it only happens once for each person — after that, they are already somewhat aware of the software and how it works. So, user experience testing at this stage is designed to gather the most amount of feedback from users, on all aspects of their experience — things like their thoughts on the look and feel of the software, their expectations on what it should “do,” and how effectively it “does” that at this point in development. Even people’s facial expressions are important if you can get them — they can tell you when someone “doesn’t get it” right away, and how long it takes them to figure “it” out. It’s incredibly interesting from a software design perspective, but even more interesting from a psychological perspective.

For AEP, a number of individual artists and small organizations were invited to participate in this first round of testing. They were given the url and password to the AEP demo site, and asked to create an account, login, play around, create some content, and generally kick the software around a bit and see how it worked.

The testers were split into two groups — one group was given detailed instructions on how to login and do all of these things, and the other was given almost no information. This A/B test was designed to show how easily understood the functionality of this early stage of development was without training for the “B” group, vs. the “hand holding” of the “A” group.

After a set testing period, I contacted the testers individually, and scheduled interview times to meet with them and discuss their experience in AEP. The AEP staff and I had designed a number of questions to ask the testers to help them describe their experience in a way that would create useful feedback for the AEP developers. There were 15 questions, including:

* What do you think AEP is now? What is it being designed to accomplish?
* How do you hope those goals and functionality will fit into your organization?
* What did you think about the look and design of the site? How does it compare to other sites you frequent?

The feedback from the testers was very interesting — it’s remarkable how certain people are very focused on one aspect — say, look & feel — while others are totally focused on some other specific aspect. With the variety of testers we were able to interview, we received a healthy view of how these early users view AEP, and that info will be used to improve the product into the next testing stage.

Sharing a product at an early a stage is always somewhat anxiety-inducing for any developer. But the feedback you receive can offer the potential for detailed levels of course correction that would be too costly to discover later on, as well as validation that the choices you’ve made up to this point in development were ultimately accepted and understood by your users. I’d like to thank the initial testers for their dedication and great feedback, and I look forward to working with them in future testing stages!

Ron

Ron Evans, Principal
Groupofminds.com Arts Marketing Consulting

Aug. 10, 2010, Filed under category Development

10
Aug

Update on AEP’s status

AEP’s Alpha phase is starting soon! This means that for the first time, we’ll have a group of actual companies, artists, and audiences using an early version of the software to test it so that we can learn hands-on how to best craft and adjust the system to the needs of companies. We are excited to start working with initial users and look forward to keeping you updated on progress.

If you haven’t already, please sign up below to get updates when AEP is ready for public launch. We’ll reach-out to you at key milestones to seek your input on AEP. Thanks!

Feb. 19, 2010, Filed under category Announcements, Development

19
Feb

We have begun building the AEP platform

As we get into the process of developing AEP we want to involve the community as much as we can. This blog will serve as your window in the thoughts and ideas that will be come AEP. We encourage you to check back often and give us your feedback. It is our goal to create something that will help arts organization and artists alike.

The Idea
We are focusing on solving the problem of how to keep the connection between artists and patrons active and engaging in between performance seasons. AEP will allow you create a place where you communicate, entertain, and engage current and new patrons and will allow patrons to have a place where they can consume the artist expression that they enjoy on a regular basis. Every idea begins with some writing on a napkin. So I wanted to share ours with you. I’ll be following up soon with more posts on the specifics behind these but here’s a sneak peek!

Dec. 3, 2009, Filed under category Development

3
Dec

Switch to our mobile site