WinterMilestone 3 Team1 EU ReputationIdea: Gamified Narrative

From crowdresearch
Revision as of 17:50, 31 January 2016 by Vladomete (Talk | contribs)

Jump to: navigation, search

DARKHORSE: Gamified Narrative:




Bringing a bit of game design you could design a reputation system where you have both levels and perhaps classes. Workers' and requesters' reputation linked directly to each skill area rather than an aggregate for all the tasks incorporating various skills all bundled into one (e.g. worker may produce fantastic results on logo work but mediocre results on python coding). This way you can see a a user's worth and rated contribution on a multidimensional plane (perhaps reflected on a spider diagram). In terms of levelling, this can be determined after your first couple of tries (perhaps 10-20 range) to rule out for your inexperienced ways around the platform and tasks and whatnot. Based on that generated level (for example 52), you could go either up or down, based on an algorithm that takes into account automatised rating (probably time & other KPIs) and the one you get from requesters/workers. This rating could be used to place you within categories from which workers/requesters can choose from while filtering for jobs or adding tasks and could work towards offering different rates based on the skill required, matching workers with requesters’ needs (saving them either time or budget). In terms of classes, when working on your profile (again, either w/r), you could opt in (in exchange for some benefits) into a class that’s either going to help mediate the resolution process between workers and requesters, or help requesters design their tasks better, or the flip coin to help workers (that have been previously reported as failing on certain tasks) with whatever they may need (considering it’s not IQ and within their similar range of interests).

Further considerations: New comers could self-certify their level (novice, veteran, expert) for each skill they want to accept work on. This is however based on trust. In order to improve this system, workers would have some set tasks (determined and developed other workers within the same field) to complete in order to demonstrate their skills. In the case of creative workers, submitting a portfolio of previous work for review could work as well.

Feedback and The Mighty Purgatory

To make freeriders not freeride anymore and at the same time to allow people not to be “killed”, we should lower the consequences of being rejected with a negative debt in trust. The rejected workers have a trust restoration process. They have to complete n (let’s say 5) tasks in order to be back in the system. For free. It is like a small penalty and at the same time a way to re-build trust and quality. They do the job in parallel to other workers, so they do not “block” the HIT, they just make it even if it has been done already.

Reputation will be assessed with both automatic algorithms and with peer reviews (see Character's stats).

If there’s some issue, both of them can communicate with each other through the platform (if there’s a problem, “trade union” is reached out)

The respect/disrespect of one of the aspect of rating (both for requesters and workers) will automatically influence the reputation, it will either increase or decrease (if there’s no force-majeure or another human factor. in this case, trade union is also reached)

Every newcomer has initial rating that will vary, depending on the conditions listed above.

If the reputation of worker/requester will be below zero, he will be in a sort of “black list”, in order to get out of this list, he would need follow the instruction metioned in the contract. (do some work for free? or smth else)

As reputation plays a very important role in the system, it will influence directly the following aspects:

pricemaking: workers with better reputation will earn more money as they are, by default, more experienced/skilled/etc. Consequence-> better quality for requesters

the supply/demand: A requester with a better reputation will be more likely to work with workers with better reputation.

The Mighty Purgatory


Variation: the workers in The Purgatory should make free jobs and requesters should pay a random % more in their job posting.

Rewards & Badges

Have a meritocracy system that empowers the top x% of your professionals (micro-taskers, designers, requesters, etc) to be the “pack-leader” and govern and look after. This can be done through an algorithm that looks at the correlation of rating and activity, or most focus (reported communication in long-term projects, etc).

In my head this would be a nice way of actually employing people all over the world to act as a set of collective knowledge and wisdom. This would be a position they will have to accept of course, and during their “reign”, there will be responsibilities such as: nominate 2 users from your field to help you with administrative business (such as judging creative work or chip in whatever subjective matter may permeate); mediate 10/20/30 cases per day, depending on their field (along with their disciples) assess and try to improve/add/simplify the “code of conducts” within your field; assess and address former problems that were raised (this can be indexed and documented within FAQ perhaps) - 3 a day assess and address functions/features that other users from your group have asked for in the past

Badges system: Badges identify the mastery of a worker’s skill. Whenever a skill evolves, the worker will get a notification that it’s time to prove their skill is relevant in order to keep the badge. A skills development advisor algorithms would need to be built into the platform which will link through to appropriate, free, relevant and timely resources for upskilling.

Character Stats in the Game: Semi-automatic reputation system with KPIs



High-reputed workers could evaluate other workers contested work and receive reputation and money from the system. The evaluation should be anonymous.

Variation: workers can self-evaluate their work and their self-evaluation could be confirmed by requesters or by peers.

The Cult and the Magic Attraction

Darkhorse: Each user will express his needs as invocations, and the needs will be recorded for match-making (see "The Magic Attraction")

According to KPIs and other Character Stats the system will automatically match the best user for each other needs (worker-requester).

Before the task is posted on the platform, requester chooses the set of skills he needs, but an algorithm will also magically figure it out by itself while analyzing tasks, and the task will be sent firstly to the people who match the skills’ set needed and according to the "invocations". Examples:

The best reputed requester will see the best reputed workers firstly

If requester and worker already have an experience of working together and both parties are satisfied, they will see each other listed first.

The Jury

- If R and W have a dispute e.g. R rejects work of W because of quality THEN

R can choose a lower payment, if the R doesn't or if R's proposal is rejected THEN

4 Experts (Experts = the best 10% of a "Guild" or "Category" = "A type of job, expertise") from both Rs and Ws will look into the results of the work and decide about rejection:

The R is evaluated and gets Worker's index and Requester's index. The W is evaluated and gets Worker's index and Requester's index.

Then, if the worker gets 1 - 1 he gets paid, 0 - 1 gets a 15% cancellation fee, 0 - 0 his work is rejected. For the requester, he gets 2, 0 or -1 reputation points according to the case.

Question: WHY SHOULD THEY EVALUATE? Workers get paid by reputation or by daemo itself. Requesters gain more reputation.

Users Involved: @kamilamananova, @arichmondfuller, @purynova, @seko, @vlado, @ahmednasser, @amdp