Damned Lies and Contribution Metrics

The power of numbers is unquestionable. I never fully understood though, what it is. Possibly the urge of everyone to explain the world rationally. Or the need for reference to make any decision an “informed one”. Whatever it is, it drives people. Mozilla wouldn’t be an exception.

The ask was simple enough:

How many active contributors do we have in Mozilla?

No one knew last year, that a year in today we would only have scratched the surface of this question. But in the process of doing so we laid a solid foundation to move us forward.

Yesterday Adam Lofting announced the unified Mozilla Foundation and Mozilla Corporation contributors dashboard which you can check out visiting areweamillionyet.org This has been a collaborative effort between both teams and an incredible journey so far exploring and articulating notions of contribution metrics across the Mozilla Project.Screen Shot 2014-06-12 at 1.06.33 PMProject Baloo (intro post here) is underway to supply all the data that will fuel the unified dashboard, starting with Bugzilla, and Github data, thanks to Sheeri and Anurag from BI team. Next in line are Reps, SuMo and MDN. All data will be gathered in a central database, in a common schema, updated almost instantly by the systems that activities are happening. You can track the progress here.

Adam’s post has all the technical details about the current implementation (so I will not go into details here) but I would like to expand a bit around the importance of deduplication and cross-examination of metrics between different teams of Mozilla.

Being a Community Builder inside Mozilla you want metrics for your contribution area. You can see people come and go, but you have no idea whether those people are moving to other teams or leaving Mozilla completely. With cross examination of contribution metrics we will be able to see trends and movements of people across different projects and teams for the first time.

Using deduplication of identities (based on emails) we will get a much more accurate count of people, that will improve even more once we integrate with Mozillians.org and Workday so we can deduplicate people using multiple emails. Anecdotally (and based on the initial real data we have) we know for sure that the actual count of active contributors will be considerably lower that the sum of active contributors on all teams.

Deduplication(1)Expect more updates to come as we roll new integrations in and new data-sets become available.

Mozilla Location Services – A story of intentionality and growth

Since the start of this year I joined the Community Building team with a task (among others) to abstract community building best practices and apply them to teams that haven’t had any dedicated community building resource, forming a strategy around community with them.

Over 7 months ago the Services team of Mozilla announced a new project. The Mozilla Location Service (MLS for short). Given the priority of the project, community excitement and my passion about geo-related projects I was assigned as a community builder in a supportive function.

Since it started, over 4 thousand people have been contributing to the project. What is interesting about this contribution activity is that although engagement of potential contributors was relatively low, and the call to action was not widely advertised, the influx of people was steady and global. Though we can speculate in general about the source those contributions, we can also safely say that the vision behind the project and the low barrier to entry contributed a lot towards this influx of people.

As the months went by, location services team wanted to understand better the contribution that was happening, assess it, and act based on a community building strategy. The immediate need was the definition of a contribution path. Given the structure of the program that was fairly straightforward. A contributor downloads MozStumbler, installs it and then starts walking around. The next step for a contributor would be to opt-in for a nickname associated to his/her contributions so that he/she participate on the leaderboard and for us to have more meaningful contribution activity data. Articulating a pathway also helps on identifying bottlenecks and the overall health of the community, and we are now in the process of defining the active contribution thresholds.

At that point onwards, the question that was raised within our community building meetings for MLS was around the “intentionality” of the community building. It is one thing to have a program open for contributions and a totally different one to facilitate and encourage contributions, assessing the community health in parallel. The shift towards intentionality for community building, requires a significant resource commitment that any team within an organization would naturally be reluctant to make. As a supportive community builder I proposed a community building pilot approach to evaluate the community engagement and contribution possibilities.

Quoting Erin Lancaster, one of the key drivers of this effort:

A community builder is essential in order to connect the technical team directly to the very people who care enough about the project in order to devote their free time to helping us out. [A community builder is] also key to ensuring that the community is empowered with the details so they can hit the ground running and contribute while being able to distill information back to the dev team.

Our fantastic community in India was selected as the host for the first pilot. For our first event we would try to get people together for a stumbling-party in Bangalore and assess the contribution rates, spikes and ripples that the event would create, against our investment towards the event. Deb, Vineel and Galaxy, our awesome local leaders organized the event and by tweaking existing event-in-a-box templates from older Mozilla projects and using Mozilla Reps for supporting the event set the date for 26th of April.

14167122357_37c2ff0e53_bThe event was really successful. 30 people showed up and started stumbling and the local team made some slight twists on the event structure to facilitate better community engagement. (extended stumbling period, assigned areas for stumbling etc). What was really important for our pilot was to evaluate the contribution activity that we got from this small scale, low on resource event, and the result was stunning. We saw a 10x spike in our contribution rates in India for the following 2 weeks, and once the spike was over we were already 3x from the rates before the event (contribution activity ripples).hanno_data_2There were some concrete learnings from our first pilot, especially regarding the format, structure and communications needed before and after the event. In order to fortify our learnings and fine-tune the event format (for larger scale implementation) we decided to run a second pilot in three Indian cities (8th of June) in parallel with the same core team. Our first pilot clearly showcased the value of community contributions in MLS and based on the combined results of those two events we will be forming a community building growth strategy for MLS team transitioning towards a fully intentional approach.

All this would not be possible without the help of the fantastic people in MLS team (Vishy Krishnamoorthy, Erin Lancaster, Asa Dotzler, Richard Barnes, Hanno Schlichting, Ravikumar Dandu, Doug Turner) that have been really supportive since the early discussions around MLS community. A huge thanks, to all of you and onwards we go!

1000 events and counting…

When we embarked on our journey with Mozilla Reps almost two years ago we knew that the Mozilla Community was a vibrant and energetic ecosystem of contributors, full of activities and events. We set ourselves the goal to further empower the community, to help Reps grow their local communities, to raise visibility of activities and to document their achievements thoroughly.
 

Last week we hit an important milestone. On 14th of April 2013 we hit the 1,000 mark.  One thousand events that Mozilla Reps organized or have participated in more than 80 countries.

 

The increasing amount of Firefox OS related events organized by Reps in recent months  reflects the incredible momentum that the project is gaining. Reps are ready to play a critical role in our launch markets later this year, actively raising awareness about the project and inspiring new contributors to get involved.

Some “damned lies” for all the statistic lovers out there:

Total events: 1154

Rate of events so far: 1.93 events per day

Rate of events last 3 months: 3.18 events per day

Total Reps: 407

Special thanks to the previous and current council members for all their hard day to day work on the program, and their visionary inputs for the ways forward.

Onwards we go, Jedis!

Leading

 

photo credits: ashish0105, bobreyes, deimidis

Sweet new functionality in reps.mozilla.org

Over the past 4 weeks, the Mozilla Reps Web Development team has been
focused on delivering new discoverability features to enhance our
portal. Last night we landed what we believe to be the most awesome
version of Mozilla Reps portal ever!New features include:New timeline vizualization of events
Having a map to visualize all our events and better document and
manage our events throughout Mozilla was a breakthrough 6 months ago,
on how we . But we wanted to take it one step further. We envisioned
and implemented a timeline visualization for events that works with
our search bar in events. You can now visually identify and scroll
through community events worldwide and through different time periods
(!)


Vouched mozillians login
In true spirit of pioneering the integration between Mozilla services,
you now have the ability to login into our portal if you are a vouched
Mozillian (with persona) even if you are not a Rep! You can then
customize a dashboard based on the interest areas of Mozilla you want
to track, and get activities and metrics from Reps that are working on
those areas.

This new functionality raises the awareness around the countless
activities that Reps are driving across all functional areas and
delivers easy discoverability of Reps working on those areas, so that
you can communicate with them. As always we already have in the
pipeline the enhancement of functionalities around this new feature,
like email abilities, unification of dashboards between Mozillians and
Reps and other cool new dashboard functionalities.

and many more features…
..including the ability to email all participants of an event via a
mail modal in event pages, ability to extract people info and emails
if logged in the site in /people page, ability to search in events
based on date range and enhancing the email notification
functionalities.

As those lines are written our web developers together with our webdev
volunteers are working on a Voting system and new commenting system
and categories for events. You can find all about what is in the works
in our current dev sprint.

Special thanks to our devs Tasos and Nemo, our code reviewer Giorgos,
our production manager Ben and all the Reps for the countless
countinous feedback and improvement pointers.

Updates on reps.mozilla.org – Mails please!

Over the past 6 weeks reps.mozilla.org went under a new development sprint!

I would like to take this opportunity and welcome our two new webdevs Tasos Katsoulas and Yiannis “Nemo”Giannelos both django-ninjas at day and beer lovers at night! An obvious fit to our team they worked tirelessly on imporving the functionality of the portal and adding new features. In particular:

Mailing enhancements

  • Implementing a new ‘Settings’ page for opting in and out mailing features (bug 818036)
  • Send an email to the owner of a report after each comment (bug 758603)
  • Enhancements in “mail my mentees” form (bug 763490)
  • Send email to mentor when a mentee files a new report (bug 762418)
  • Monthly reminder for new reps to mentors list (bug 774247)

The new mailing features will enable Reps to communicate more efficiently among their activities and streamline the reporting procedure more. Over the past 1.5 years Mozilla Reps have filled over 3000 reports! Feel free to browse through reps and check out their reports and activities!

Other features included:

  • Custom planning pad urls for events (bug 794008)
  • iCalendar export for single event (bug 761544)
  • Show rep of the month on their profile page (bug 784281)

And also some regular Bugfixes:

  • CSV export is now working fully(bug 815766)
  • Date reset when event save fails is fixed(bug 778865)
  • Fix duplicate results in API queries on “People” page (bug 824892)
  • General housekeeping and many minor improvements.

For our next 3 week sprint we will be working on adding cool new features on our portal with a focus on discoverability and vizualization! Timeline vizualization of the events, communication to event attendees, ability to login to our portal given a vouched mozillians.org account, are just some of the
things to come.

As always you can leave feedback in our etherpad, or subscribe to our reps-webdev list to help us out!

Special thanks to our tireless web productions manager Ben Sternthal and our new QA person, Ioana Chiorean (our well known Romanian Reps Mentor) :)

Onwards we go!

More metrics on events please!

On our year-long journey to deploy the Mozilla Reps program we have always been fascinated and driven by metrics.

Mozilla Reps have already organized over 700 events around the world and the current rate is 2.1 events per day (!). We need better ways to capture the momentum analyze it and evaluate the huge impact those events have.

One of the main focuses of Mozilla Reps is to get new contributors in Mozilla. The central way to do that is to get people to signup in http://mozilla.org/contribute/ page (which is now localizable!). So we needed a way to tell how many signups happened as a direct result of an event.

Giorgos Logiotatids (our webdev) worked closely with the awesome Bedrock team to deliver a Signup Counter for each event. This is how it works:

– Once a Rep is in an event, she logs in to our portal and goes to the event page.
– By clicking on the “Get Involved” button bottom right she gets a unique URL (per event) for the “Get Involved” page.
– She uses this page (or the link to it) to get people to sign up for
contributor opportunities in Mozilla.
– Once someone signs up, the counter next to the button will increase by one!
– By the end of the event we can see how many sign ups the event had :)

Moving forward we have plans to integrate more metrics around the signups like: How many people actually ended up being contributors, signups per region or functional area, total signups per Rep, signups Frequency (per type of events) etc..

Finally, special thanks to David Boswell and all the functional owners of the “Get Involved” page, for their fantastic long time effort to engage with new contributors and get them involved daily.

ps. We are working on a way for all Mozillians to log in our portal and have access to those metrics. Stay tuned! In the meantime check all our upcoming events :)

 

ReMo Portal testing and way forward

ReMo team has been quiet recently, and this is our comeback-update :)

The story so far

Over the past two months we developed from scratch and deployed the version 0.1 of Mozilla Reps portal.

We have been planning for this since the start of the program 10 months ago, but we finally got the resources and momentum to build it starting in January, when Giorgos joined the team :)

Version 0.1 codenamed Solkar was a ground-laying version with its scope limited in implementing a profile system so we can manage the Reps profiles better. We knew we had hundreds of Reps but visualization is a game-changer:

People page in Solkar

Version 0.2 codenamed Skon is bringing cool new features :) New looks, reports, enhancements on profiling and cool discovery features.

Skon new looks

Skon new looks

Dashboard in Skon

But in order for us to build the best website for Reps, we need your help testing it and suggesting new features!

Come test with us!

Tomorrow we are doing a test day on our yet-to-be-realeased 0.2. We will be in IRC, in #remo-dev channel (irc.mozilla.org) testing various scenarios with the help of our awesome QA team!

Join us for 24 hours of testing on our new portal!

Mozilla Reps Documentation Sprint this weekend!

This weekend (in 2 days!) Mozilla Reps will be running a documentation sprint in a collaborative effort to make our Documents and SOPs even better!
We need your documentation, writing, wiki-ninja skills for 3 days starting this Friday 25th Nov till Sunday 27th Nov.

You don’t have to be a master in documentation, devote 3 full days or even be a Rep to join us.

We will be coordinating our efforts in #remo IRC channel and in this EtherPad
Finishing and polishing some SOPs will be our primary focus (more info on the EtherPad). We will make sure to have people on IRC all the time to coordinate efforts and we are expected to hold some calls and IRC chats.

If you plan on joining us, please write your name on the Etherpad and drop by IRC to discuss on what we should focus those 3 days!
We will shortly announce a kick-off 3 hours long call/meeting for Friday (afternoon for GMT)

Let’s write and shine!

OMG! Lets document!

"OMG! Let's document!"

ps. We will have gifts for all participants :)

How about some Antarctica?

If you have a question stuck in your head, you need to get an answer.

“Which is the place in the world with biggest Firefox share?”

Antarctica!

Antarctica has consistently Firefox share of 80+ % for years now! (Based on all stat/market share agencies that I could dig into). This could come as a surprise to some people, but think about it! It is totally logical. Antarctica is packed with scientists/pioneers/engineers/brilliant minds that can settle for nothing less that bleeding edge technology, and this is Firefox!

Now how about leveraging this power and recognizing this fact? How about a Mozilla Antarctica Community?

Let’s kick this off! Over the next weeks David Boswell, Robert Nyman, Anthony Ricaud and me will reach out to those people, establishing a community where no browser has gone before.

Mozilla Reps welcome packs arrived!

The usual suspect, a brown van arrived once again in my doorstep. This time the package was kinda lightweight. But I should not judge by the weight.

I quickly opened the white wrapping and I had a mysterious grey bag in front of me.

Looking a bit closer, on the tag, my heart jumped :)Mozilla ReMo PackXLarge

Finally, it was party time! I cannot remember the moments between the grey bag and having all those super-uber-cool goodies laying on my desk :)

The bag includes:

  • 10x – Firefox standard-issue buttons
  • 2x – Firefox old-time-classics lanyards
  • 2x – Mozilla Reps the-little-awesome buttons (white)
  • 2x – Mozilla Reps the-little-awesome buttons (black)
  • 5x – Mozilla the-proud-ones transparent stickers (white)
  • 5x – Mozilla the-proud-ones transparent stickers (black)
  • 2x – Mozilla Reps flagship transparent stickers (white)
  • 2x – Mozilla Reps flagship transparent stickers (black)
  • 1x – Mozilla Reps awesome-ready polo shirt
  • 1x – A6 bonus welcome note

When we kickstarted Mozilla Reps back in June, we wanted to make sure that every single Mozilla Rep will be equipped with the finest set of swag to be identified and spread the love. Now we are able to provide it!

Rep mentors will be contacting their mentorees for delivery of those cant-wait-to-have packs :)

More info can be found in the Swag wiki page and you can find more pictures on this album.