Monthly Archives: February 2014

Along with many of our colleagues from Hive NYC and many other Hive networks across the country, Hive Research Lab will be heading to Boston next week for the annual Digital Media and Learning conference. As many readers might be already be aware, the Hive Learning Network initiative emerged from the broader field of digital media and learning, building on the work of many pioneers in this space and centering its pedagogical commitments around Connected Learning, a research and design framework associated with this community. So, no surprise that Hive networks have a strong presence.

For those attending that want to check out the places where Hive Research Lab will be speaking, we wanted to share a round-up below:

As we mentioned in a previous post, we’re currently working on sharing interim briefs related to the Lab’s two research areas: supporting youth trajectories and pathways, and developing the Hive as a context for networked innovation. These briefs are based on early observations and conceptualizations and are designed to provide the Hive NYC community with ongoing frameworks, findings and recommendations as part of a broader effort to connect current research and emerging findings to issues of practical importance.

This is the first brief related to the YT strand and it generally serves as an introduction to our amazing “Hive Five,” a group of youth who have agreed to let us talk to them on a regular basis about their developing interests and the ways they are engaging with them. This brief provides an overview of how they discovered and got involved in Hive programs, what their experiences in these program were like, and what happened after the program ended. In future briefs, as we continue to describe the moves they are making to pursue their passions, we will pay particular attention to the ways they are leveraging their ‘social learning ecology’ (i.e, their circle of family adults, non-family adults and fellow peers) in order to do so.

We hope our briefs are useful to the Hive community and welcome any feedback to make them even more helpful in the future. We also would like to take this opportunity to thank all the Hive members who sat down with us and allowed us into their program spaces in order to help us round out the picture. Also, of course, it is such a privilege to be able to spend time with these incredible young people and to be let into a part of their lives. We hope you enjoy learning about (and from) them as much as we do.

As research partners of Hive NYC, we are invested in linking research to practice in order to address the network goals of supporting youth interest-driven pathways and strengthening Hive as a context for networked innovation. As part of that effect, we aim to regularly experiment with different kinds of knowledge production and sharing with the Hive NYC community. Here, we’re excited to introduce one of these experiments: HRL Jumpstarts, a series of tip sheets that we hope capture “good practices” of interest to the Hive NYC community. In essence, HRL Jumpstarts combine our fieldwork observations of Hive members doing their work and encountering challenges with our understanding of what existing literature recommends in order to come up with “conjectures,” or best guesses, as to what might support the work of the Hive.

Our first Jumpstart, available here and by clicking the image to the right, addresses Hive one-day events, which include Pop-Ups, Hack Jams and Maker Parties, with suggestions for both the host of the event as well as participants who are manning tables or stations. Much appreciation to the über-talented Jess Klein for creating such a playful visual template for us. We hope the community finds the suggestions we pulled together useful — we welcome any and all feedback! Also, as we’ll be releasing other Jumpstarts in the future, please tell us what you think could use a good jump start!

Our process

As ‘working open’ is a value that we share with the Hive NYC network overall, below we provide a recap of the process we underwent to create this Jumpstart.

In early November, Rafi Santo and I brainstormed some guidelines for what could be included in Jumpstarts, based on articles we’ve read, things we’ve observed occurring in the Hive and conversations we’ve had with Hive members. The primary guideline was that each suggestion should support our two research strands: Supporting youth interest-driven learning pathways and furthering innovation in the Hive network. Our first brainstorm of potential ways to support day-long events produced far too many candidates, and in the end we decided that 16 suggestions was probably a good target number to shoot for. After several rounds of revisions, we landed on a reasonable first draft for feedback from the Hive community.

At the November Hive community meet-up at WNET, we debuted our “Cheat Sheet” (the original framing we’d come up with) to Hive members and the responses overall seemed to indicate that this would be a useful resource (phew!). We passed out hardcopies and had members meet in small groups to “hack” the cheat sheet for about 10 minutes, then we all came back together for a whole group discussion. The feedback everyone gave was fantastic and helped us see where there were points of confusion. We took notes during the discussion and collected all the sheets people had marked up and any notes people had taken on our behalf (thank you again!)

In early December, we took every piece of feedback from the meet-up notes as well as the “hacked” cheat sheets where people wrote their thoughts and put them all into a google doc, grouping similar points and adding “+1s” to ones we thought were especially valuable. If multiple people seemed to say the same thing, that also signaled us that that was an important issue to pay attention to (for example: changing the “cheat sheet” framing to avoid the perception that this set of tips covered everything about such events; another one was clarifying the two roles, event host and station facilitator, that we were making recommendations for). We then discussed the consolidated and prioritized feedback and tried to come to some sort of consensus around how to change our current version while still keeping it short, sweet and usable.

Come mid-December, we were ready for the fun part — making our content look pretty! Lucky for us, Jess Klein had some spare cycles to work out a template for us, coming up with several great options, including a “recipe”-like format that would allow folks to cut out various tips and use them like a deck of cards, as well as the version we ended up with, which featured an array of colorful hexagons (a Hive visual brand “go-to”). In the end, we really liked the playful and flexible aspect of the hexagon design. Also, because it doesn’t use a ‘bullet-list’ convention, it encouraged us to pare down our sentences as much as possible.

Since we now have a word template, we’ll be able to pump out future Jumpstarts a bit more quickly than this first one. We’re looking forward to sharing more down the line!

Over the course of the coming weeks, Hive Research Lab will be releasing a series of interim briefs, short form writing based on early observations and conceptualizations that are designed to provide the Hive NYC community with ongoing frameworks, findings and recommendations related to the Lab’s two research areas: supporting youth trajectories and pathways, and developing the Hive as a context for networked innovation. The briefs are part of a broader effort to connect current research and emerging findings to issues of practical importance to the Hive NYC community in order to improve network activity. Recommendations are preliminary and based either on existing literature or observations of practice within the network, and we hope that they can serve to spark conversations both within member organizations as well as across the network.

Our first brief, which speaks to our Networked Innovation research strand, builds off of earlier work we’ve done to think about what counts as an innovation, but in it we take more of the perspective of what this question might mean for Hive members, as opposed to for our work as researchers. We include a set of “dimensions” that can be considered vis-a-vis a given innovation, consider how these dimensions might have import in the Hive NYC context, and provide a snapshot of things that might be considered innovations, broadly speaking, within Hive NYC.

Of course, thoughts and questions are welcome! Link to the brief is here.

This post features some early findings from my study on Hive NYC’s minigroup, an online listserv where members seek advice and share ideas, accomplishments, and opportunities. My final study will also include a qualitative and quantitative analysis of the content of minigroup posts, with attention to the network goals of sparking organizational innovation and supporting youth interest-driven learning trajectories. Here I will speak to trends in minigroup posting activity (rather than the content of the posts) based on posting metadata, including how active the minigroup is, who belongs to the minigroup, how members’ connections to the Hive relate to their posting patterns, and how minigroup activity has changed over time.

My Process

As a senior in high school, this has been my first time doing real, on-the-ground (in a manner of speaking) research. Since I posted about the launch of my study, I have learned quite a bit about how to ask and answer relevant research questions with efficiency and accuracy.

My research approach is two-pronged: I am using qualitative codes to explore the practices that minigroup users engage in through their posts, which include circulating opportunities, asking for information, and sharing successes. And I’m using meta-data information like organization size and join date to give context and find quantitative patterns. Dedoose, a research analysis tool, lets me organize and compare these qualitative and quantitative data.

I was surprised to discover the detailed planning involved in finding the basic descriptive data I focus on in this post. I needed to figure out the organizational affiliation for each poster as well as the characteristics, including size and when they joined the Hive, for each organization. Since this info doesn’t actually live in one place (until now!), I used LinkedIn, went through every organization’s website, and reached out to many Hive members – all of whom were very helpful – to compile and triangulate as much of this information as possible and ensure an accurate analysis.

Once I had my data, I had to figure out how to put it in an analyzable form. With guidance from Rafi, an HRL Project Lead, I created multiple research models in dedoose using small samples of data in order to figure out which approach would allow me to answer the questions I have. This saved me many hours and I only got a workable model on around my fifteenth try. I also learned that because many aspects of my data build on each other, it saves quite a bit of time to be precise and check my work.

At the culmination of months of experimenting, counting, checking, and rechecking, I began to find meaning in the numbers. It was exciting to transition from seeing a detailed, sectional view of each data set to examining the broader picture of minigroup activity and how it relates to Hive goals. Below is a summary of my initial findings with embedded big-picture analysis.

General Activity

First, I found some general statistics on who belongs to the Hive NYC minigroup, who posts to minigroup, and how frequently they do so.

Who are minigroup members?

364 people belong to Hive NYC minigroup. 77% (n=281) of minigroup members are “officially” Hive NYC-affiliated, and 23% (n=83) are non-affiliated.1In reviewing who is included in this group of non-members, I found that it was split among people from youth-oriented nonprofit organizations that are not Hive members, teachers and NYCDOE affiliates, and people with research interests relating to the Hive.²

Who is posting to minigroup?

Of the 364 minigroup members, 56% (n=205) posted to minigroup in the time frame of my data sample, October 26, 2011 – September 4, 2013. This means that a substantial proportion of minigroup members “lurk” without posting, which is not uncommon in online listservs. In fact, compared to other online listservs, minigroup sees a higher ratio of lurkers to posters. According to the 1% Rule, which is comprised of numbers from sites including YouTube, Wikipedia, and Yahoo Groups, only a small number of people (around 1-10%) actually post to participatory online communities – most people just “lurk” and absorb information. While it is important to note that these sites are public and minigroup is a closed community, compared to the vast majority, it is a particularly active online space.

Of the people that do post to minigroup, 90% (n=184) are Hive NYC affiliates and 10% (n=21) are not. While Hive affiliates are responsible for the majority of minigroup posts, non-affiliates are healthy contributors as well. This participation beyond just those that are “technically” Hive-affiliated fits with the Hive’s values of being an expansive community that welcomes voices beyond just members and wants to be exposed to outside ideas.

To date, all Hive NYC member organizations have posted to minigroup, which suggests healthy participation from the core Hive community. Still, it is important to note that a member only needed to post one time to be counted as a posting organization. Further investigation in this post and later on will reveal a more fine-grained picture of member organizations’ participation patterns.

How often are people posting to minigroup?

As of early September 2013, there had been 2492 posts to minigroup. 36.7% (n=914) are initial posts and 63.3% (n=1578) are comments. Minigroup activity has also seen a generally steady increase since its launch in late October of 2011, with some dips in activity. Summer dips, such as in August 2012, may be attributed to people going on vacation at the end of the summer. Other dips, such as in February 2013, are less easily explained.

Still, it is important to note that the Hive has significantly increased in membership in the span of my data sample from late October 2011 to early September 2013. Overall Hive has grown from 14 to 56 members since the network’s inception, and there were 28 members when the minigroup launched in October 2011. The following graph represents the growth of the Hive, in terms of number of member organizations, since the network launched in March 2009. To find these numbers, I triangulated information from historical Digital Media Fund Requests for Proposals (which list membership at the time of the RFP), the Hive Member Directory, and multiple blogs and websites that have documented the Hive. Still, note that because there was no single source that accurately states when every member organization joined, this graph should be seen as a “best guess” based on the available information.

It is also important to note that members of Hive NYC “HQ” are responsible for 25.3% (n=631) of minigroup posts. 53.6% (n=338) of Hive HQ’s participation is in the form of initial posts and 46.4% (n=293) is responses. Hive HQ’s high level of activity on minigroup is demonstrative of the role it plays in the network as a facilitator of communication. Hive HQ’s activity is distributed fairly evenly between initial posts and comments, which shows that it plays an important role not only in broadcasting communications but also in responding to the broader community.

What percentage of Hive member organizations post to minigroup each month?

To conduct this analysis, I calculated the exact number of member organizations posting each month from November 2011 to August 2013 and combined that with the total number of Hive member organizations during that month to arrive at the percentage. These numbers show that the percentage of organizations posting each month has not consistently increased, despite the increase of activity on minigroup overall.

Next, I broke down the data on a more specific, organizational level. This gives some insight into how member organizations participate in the minigroup.

Organizational Participation

How many active minigroup members are there from each organization?

On average, 3 people from each participating Hive-affiliated member organization have posted in minigroup. This suggests that member organizations tend to have a few “Hive ambassadors” that participate in the minigroup, rather than involving many employees. Member organizations tended to have a similar number of average posters despite differing characteristics like organization size. The range of posters per member organization is 1-8, though very few organizations had more than 6 posters.³

Does organization size correlate with minigroup activity?

I thought that looking at minigroup activity in relation to organization size would be interesting because it is possible that larger organizations with more human resources might be over-represented in a number of different ways. To give context for following data, here is a chart showing the distribution of sizes of all Hive member organizations, measured by number of paid employees.

This demonstrates that while there is of course a diversity of organization sizes within Hive NYC, the majority of member organizations have less than twenty employees.

This next chart shows the percentage of the total member minigroup posts by organizations of each size category. As I mentioned earlier, I found the number of paid employees each member has through organizations’ websites and self reports, and these sizes are accurate as of Fall 2013. In order to directly compare this chart to the distribution by size chart above, I only included data from the 56 Hive NYC member organizations.

We conducted a correlation between organization size and activity, and found that the amount an organization posts on minigroup is independent of organization size. This means that there aren’t statistically significant differences in how a big organization participates versus a small organization. This could be a result of the “Hive ambassador” approach many organizations have adopted, which means that regardless of the number of employees an organization has, it has just a few people participating in the minigroup.

General Conclusions

To identify the significance and implications of this preliminary data, it is helpful to look at Hive NYC goals that might apply to minigroup. The Hive strives to create a rich learning ecology with networked behavior and open participation. There is a healthy number of non-affiliates that belong to and even post to minigroup, which suggests that the Hive is indeed following an open participation model. Still, almost 90% of minigroup members that are unaffiliated with the Hive do not post. Though the Hive itself has grown faster than minigroup activity, minigroup’s increase in participation also generally supports the Hive’s goals: it enhances networked behavior by providing a platform for member organizations to efficiently share opportunities and seek assistance, and supports open participation by facilitating and encouraging affiliated and nonaffiliated minigroup members to openly engage with one another.

The data also suggests that minigroup – and possibly the Hive – is a network more made up of people within organizations than a group of organizations. Essentially, though the Hive has whole organizations that are technically members, there tend to be a few key people from each organization actively participating, as demonstrated with the average number of posters per organization (3) and the lack of correlation between organization size and minigroup activity. Ambassadors can certainly bring news back to their organizations, but most employees from the organizations do not have direct communication with the Hive through minigroup. Qualitative coding will reveal whether there are patterns relating to organization size in the content of posts.

Though these numbers were informative, they pose many more questions. What are Hive affiliates – member organizations, Mozilla, Hive NYC “HQ”, New York Community Trust, etc. – posting? What are unaffiliated minigroup members members posting? How has the content of posts changed over time? Does organization size – and other factors I will explore, such as join date and receipt of Hive grants – affect the content of posts? Are there certain kinds of posts that elicit responses? Are there organizational characteristics that correlate with ways that an organization responds to posts?

I will examine these questions in the next step of my research, in which I will apply qualitative codes to minigroup posts and analyze them alone and in relation to the metadata in this post. By synthesizing these preliminary numbers with more qualitative data and analysis, I hope to provide a fuller picture of minigroup activity.

____

Footnotes

1. Hive affiliates include those associated with Hive member organizations, Mozilla, Hive NYC “HQ”, New York Community Trust, MacArthur Foundation, Hive MakerCorps, and Hive Research Lab.

2. There are four people who moved between organizations with the Hive and posted to minigroup from both organizations they were a part of. I counted each of these people twice in my data because organizational affiliation at the time of the post were an important part of the analysis.

3. This statistic only accounts for participating minigroup member organizations – I did not include the number of posters from the small number of member organizations that did not post during my sample period in the average.

About Us
Hive Research Lab is an applied research partner of Mozilla Hive NYC Learning Network and a collaboration between Indiana University and New York University. Our mandate is to investigate and strengthen the network as a context for innovation in out-of-school learning organizations and as a support for interest-driven learning by young people.