New photos that had just been submitted to Fotopedia

Fotopedia – the rating system (2/2)

Last modification: 28-Nov-10

After all this background discussion in part 1, it’s time to get more concrete about actual problems and possible solutions…

Issue #1: Great photo – wrong article

 

Photo of Plaza_de_España (Seville) that was accidentally linked to Alcázar of Seville instead. powered by Fotopedia

A photo can accidentally be attached to an inappropriate article. Although the ranking system might ultimately fix this, it is more practical to inform the Fotopedia staff.

Nevertheless, “being” an encyclopedia requires a lot of focus on reliability. An extreme example is the Fotopedia article on Luxor Temple in Egypt: when I checked, at least 7 of the 14 Top pictures for Luxor Temple showed various other temples in the Luxor area. Luxor Temple, however, is quite large so the most convincing way to prove an image is not of Luxor Temple is to prove that it depicts another well-known temple (e.g. Karnak, etc.). Although an error rate of at 50% is unusally high, my estimate that a few percent of travel photos are incorrectly classifed, and that more are correct, but imprecise.

What might have caused the errors in this case:

  • There are several ancient temples in/near Luxor (collectively known as “Ancient Thebes with its necropolis” in the Heritage project). People usually visit multiple temples on the same day, they look similar and the photographer needs to check closely (e.g. capture times) to determine which photo was taken where.
  • Only one temple at Luxor is known as Luxor Temple, while the others may have been correctly keyworded as “Luxor” and “temple”.
  • Many photos show just a fragment of the subject (here is an example which I suspect is actually from Medinet Habu).

The incorrect photos may actually all be fine photos and thus receive high rating like the above example from Seville (that was “right city, wrong building”). Many ratings will be from people who are not very familiar with the subject and so will simply assume that the images are classified correctly. For some topics the risk of errors may be lower (baseball, Venice, Rolls Royce) and for others it is higher (animal species, buildings, mountains, saints). So some suggestions how this might be avoided..

  1. Encourage providing captions and links. A photo with a filled in caption or linked to more than one article should generally be rewarded. The photo is better documented, and thus has more value to encyclopedia users (e.g. students, enthusiasts, maybe occasional scholars). I expect that more attention to documenting pictures will raise awareness about information accuracy – and make it easier to detect errors.
    The goal of documenting images better is to be able to distinguish between “Mount Baker is the mountain on the left” and “View from Mount Baker”. And to give both voters and users of the photo more reliable information than having to guess based on the article where they found the photo.
  2. Show captions and links during voting How can you judge the suitability of a photo for an encyclopedia if you don’t know how well the image was documented? You may also miss information which is relevant to know what you are seeing. For example, take a typical National Geographic travel photo or World Press nature photo and judge it without access to the caption: chances are you will not appreciate what you are seeing.
  3. Vote per link If a photo is linked to 3 articles, vote for all contexts at one. You should be aware of them anyway, to interpret what you are seeing (e.g. photo of a neoclassic Excalibur car prominently parked in front of the Louis Vuitton shop on Union Square, San Francisco). This helps get more emphasis on the info value.
  4. Separately rate Aesthetic & Information. It is helpful to separate ratings for aesthetics and for information value. Although this means providing 2 numbers rather than one, it helps get people to vote more reliably: current voting IMO is mainly on aesthetics and the encyclopedia side is undervalued during voting. This means that the images are less useful for someone looking for more information, or for someone interested in visiting that location.
    Actually if an image is linked to 3 articles, only the Information rating needs to be repeated. The aesthetics rating can be reused across the articles.
  5. “Own photos” are safer. Photos that you made yourself could be given a small bonus compared to photos made by someone else. Essentially because captions or keywords from Flickr were not intended to have encyclopedia quality, because 3rd party photos are unlikely to be linked to all relevant articles and because the “uploader” cannot fill in the gaps in the available information.

As an example, let’s take the image above of the Plaza de España (Seville). Assume it is linked to Ibero-American Exposition of 1929 and Plaza de España (Seville). A voter would get the following 3 questions:

Visual quality: choose between 0/1/2/3/4/5/6/7
Context Plaza de España (Seville): 0/1/2/3/4/5/6/7/?
Context Ibero-American Exposition of 1929: 0/1/2/3/4/5/6/7/?

If you think it is an OK picture but it looks useful for the Plaza de España and you have no clue what “Ibero-American Exposition of 1929″ is all about (which is OK), you might rate it “4” and “5” and “?” respectively. That is more work than answering a single question. But you actually rated the image for two different articles (which is currently very awkward to do). And you provided more precise information, allowing smart software to learn more about the photo than if a single scale had been used.

Fotopedia’s Adrian Measures pointed out that captions may be in a language that the reader can’t read fluently. Links might be handled more elegantly when Photopedia becomes multi-lingual. I agree that manually translating captions into all possible languages is not worth the effort. But I still strongly prefer a caption in any language to no caption at all: for some languages I can guess what the caption means (e.g. by recognizing names and dates) – and if I really care, I can have software or a friend translate the caption. In particular, the presence of a good caption allows me the ability to check the information or find additional information (e.g. to discover that this Roman statue was found in a site called Italica in Spain). Just a link to Italica is ambiguous.

Issue #2: Duplicate images

The Eiffel Tower article has roughly 60 images. Each of them is indeed of the Eiffel Tower and I would have been proud if any one of these were mine. But many images are similar. Maybe 25 photographers submitted their best 1 or 2 images of the Eiffel Tower at night. There are multiple images of the Eiffel Tower with fireworks. The are multiple images looking straight up into the tower, etc. Almost none of the images is “unique” with the collection because the Eiffel Tower can only be photographed in so many ways. Another example: two photos show the Colosseum in Rome reflected in a puddle, multiple show the Colosseum as background to an unrelated statue, many show the Colosseum at night, many show the interior. If these photos had been taken by a single photographer, the photographer would have made a selection, and would not have presented the same image or “trick” multiple times. However, because the photos come from different photographers, the rating process should help eliminate the overlap. Image overload is not ideal for the viewer – but you can argue that the viewer can stop browsing whenever they want – especially if the images are ranked from high to low rating. But this means that the first few great pictures will get viewed a lot, that the first few pictures may earn a +1 and lower rated pictures will largely get ignored because

  • we don’t usually have patience for 50-100 Eiffel Tower pictures
  • you may award a +1 to the first Eiffel Tower picture you see with fireworks (cool!), but not give a +1 to the second or third image of Eiffel Tower with fireworks – even if the subsequent images are better than the first one.

So the current ranking system accidentally biases reviewers quite heavily towards images that were submitted early: older submissions have had more time to accumulate votes, and new images viewed later in the list will be viewed less. And if they are viewed, they will likely be rated lower because a new image is no longer new when you see it the 2nd of 5th time. Some ideas how this can be improved..

  1. 1..7 scale
    Let users rank photos on a scale of 1 to 7 (whereby 4 represents the “average”  quality level of Fotopedia photos). Photo.net uses this convention. This gives more information because you can assign an above-average photo a 5, 6 or 7. It also encourages people to use values below 4 without having to interpret this as “a really bad photo”: in fact, a rater should be encouraged to assign rates below 4 as often as ratings about 4 (again a photo.net trick). This helps calibrate the rating scale across users, encourages users to use a wider range of values and encourages people to not only rate the best photos they look at.
  2. Use averages.
    If a photo gets ratings of 3, 4, 4, 4, 6 these ratings should be averaged to 4.2. A newer photo may only have ratings 4, 5 (thus with a higher average despite having fewer ratings). This solves the problem in the current system that old photos accumulate more points than new ones, and that newer photos may not even get seen because they are at the end of the list. This is unfair to new photos, and doesn’t really encourage photographers to submit photos for “older” articles.
  3. Avoid high-to-low presentation.
    If a viewer decides to rate images within an article, they should be presented in random order. This means that any image (old or new; good or bad; top or candidate) has equal chance to get rated. The viewer can view all the available images, but can also stop midway. Rating of a single (e.g. featured) image is also OK, but rating of multiple photos with an article is better from an accuracy and efficiency standpoint.
  4. Hide ratings
    When a viewer rates an image, don’t show its current rating before the user has given an opinion. Showing current rating influences the viewer and is considered bad practice in polling: either the voter follows the opinion of others, or votes extreme to “correct” the average opinion of others.
  5. Curator can cluster photos
    Have an “expert”  (curator/editor/volunteer…) with knowledge or interest in the topic, indicate with photo’s within an article are similar. This can be used for generating smaller selections (e.g. above 4 or even 5) which don’t contain similar photos. The person doing the clustering doesn’t directly define which photo goes into a selection, but essentially says “only the best photo in this cluster will get in the selection”. T.b.d. what to do with a cluster that doesn’t contain strong enough pictures: does the best one still make it to the selection because it shows a specific aspect? Or do none of the photos in the cluster make it because they are not good enough?

As an example of the clustering, I took the 19 photos for Philae (an Egyptian temple near Aswan) and created some example clusters. Each horizontal row in the illustration is a cluster. The leftmost image in each row had the highest score (at the time). This means that an image from the left column would be used to represent the other columns.

Example of clustering (photos from Philae article)

Note that the cluster only impacts the generation of selections: all photos are still available for those who want to see all them all. In my proposal, a combination of a threshold value and cluster based filtering would generate a Selection (formerly Top) from the Collection (formerly All = Top + Candidates).

As an example of an extreme need for captions, see the following photo:

 

This photo is attached to French Campaign in Egypt and Syria and as a candidate to Graffiti powered by Fotopedia

Here is a photo I pasted under Graffiti – so it is among lots of colorful wall paintings. The photo shows graffiti made in 1799 by a team of scientists sent by Napoleon to explore Egypt (they were incidentally protected by French soldiers, leading to the famous order “Scientists and donkeys in the center!”).

The photo currently rates +3 in this context – which is not bad given that it deviates significantly from its neighbors. The photo might be very valuable to a small set of viewers (e.g. if you want to write a book on graffiti), but can be irrelevant or easily misinterpreted by others. For such images, I provide a caption explaining what the photo shows – but currently a reviewer normally doesn’t see the caption.

Issue #3: Ranking in context & article hierarchies

As explained above, image are ranked in the context of an article. The Information Quality ratings can be different per article. But in real examples they can be coupled through hierarchies such as geography (Note Dame -> Île_de_la_Cité -> Paris) or taxonomies (White-bellied_Sea_Eagle -> Sea_Eagle -> Eagle). When an image occurs in 2 or more articles, it can be smart to use rating information from one context within the other one. Some suggestions:

  1. Aesthetics independent of context It sounds safe to assume that the aesthetics of an image is identical in all contexts. This can give free and accurate rating information: store the aesthetic rating with the photo itself rather than with the linkage between the photo and an article.
  2. Inheritance It would be safe to inherit “relevance” rating across contexts if there is a hierarchy relationship defined between them (as in Fotopedia Projects). Very relevant photos of the Eiffel Tower are also relevant at the level of Paris, and may even be somewhat relevant at the level of France. Software can find the best Paris pictures by finding the best pictures of things-in-Paris.
  3. Link to the lowest levels A general guideline would be to link a photo to the most precise level that is known. Don’t link to Paris or France when you can be more specific. When you link to the Eiffel Tower, don’t also link to Paris > France > Europe. Something similar applies to Cattle Egret > Egret > Bird > Animal. Leave the propagation of good photos to higher levels to the software. Some pictures may have to be added to higher levels manually, but that is something for the Fotopedia staff.

Putting it all together

Let me try to summarize what the above ingredients would look like if you combine them. Note that numerous variations are possible, so just interpret this as an example and a general direction:

  • Ratings are selected by the reviewers on a scale of 1 to 7 (as in www.photo.net).
    • Negative values are avoided for psychological reasons
    • The value 4 should correspond to “average level of quality in Fotopedia” and a user should assign ratings that roughly average out to 4.
      • Show the user the average of his/her ratings on the profile page as feedback. This is done in photo.net as well.
  • Assign separate ratings for (A)esthetics and for (I)nformation
    • The A-rating is attached to the photo (rather than to the photo in the context of a one specific article).
    • The I-rating is attached to the photo in the context of one specific article
    • The User interface could make it easy to provide multiple I-rating when a photo that is linked to multiple articles.It is encourated to link a photo to multiple articles because this reuses the photo, links the articles and provides documentation about the photo.
      • You don’t have to provide an I-rating (use “?” as default value).
        So you can provide I-ratings for only those subjects that you feel comfortable about
      • This increases the amount of information collected per minute that the user spends on rating.
    • Photos can be ranked based on their received A and I ratings.
      • The exact function can start out with Rating=(A+I)/2 when I is available (else Rating=A). Improved functions can be introduced later.
    • Ratings from multiple people are averaged rather than summed.
      • A photo from a less popular topic can thus be directly compared to scores for a less popular topic.
    • Whenever a user votes on a photo, the photo’s overall rating should not be shown before the user votes. The photo’s rating should be shown directly after voting – including how much the rating changed due to the vote (e.g. A: 4.14 -> 4.25, I: 3.52 -> 3.41). Showing the change confirms that voting has impact. The impact of a vote will obviously decrease as more people have voted on that photo.
  • Every article has 2 sets of photos (based on a formula that uses A and I values)
    • Collection: all photos linked to an article, regardless of A and I rating.
      • Photos are only detached from an article if the photo has been incorrectly classified. This means the information photo-belongs-to-article is saved regardless of the photo’s rating history. The current system has a design bug: info is lost when the rating drops to -1 and the photographer or curator subsequently removes the photo from that article.
    • Selection: a subset containing the best photos within the Collection
      • The Selection can be determined dynamically based on Ratings (already the case) and manual filtering (new) to avoid comparable images within Selection. Article curator can manually cluster similar images within collection into clusters: only the highest rated image from the cluster is shown in Selection. Curators can adjust Selection threshold (old) or Selection size per article (new): top-25 for the Eiffel Tower; top-100 for France; top-50 for Portrait; top-5 for Harley-Davidson
      • The Selection is similar to Top, but photos in the Selection get the same treatment as photos outside the Selection. It is like asking “show me the top-5 per article” or “show me the top-20 per article”.
      • Clustering is optional: clustering data can be added at any time. The system would work without clustering. Clustering makes sense mainly for large Collections.
  • Every article has a curator (or whatever the name of the role is). Responsibilities:
    • Cluster similar images (to control the Selection somewhat)
    • Keep an eye on incorrect or inappropriate images & handle complaints
    • Manage projects in which the article occurs
  • Dealing with hierarchies
    • discourage attaching a photo at unnecessarily high hierarchy levels: don’t attach a Dove to Bird or Animal.
    • instead the rating system is used to compute what photos are pushed up
    • example: Pisa, Rome, Florence, Naples are part of Italy project. The highest ranked Selection photos from Pisa, Rome, Florence, Naples are pushed up to the Italy level.
    • The number of photo’s pushed up could use a similar criterium as Selection

Comments would be great

Feel free to comment below. Note that the comments are hierarchical (“threaded”), so please press the Reply of the comment you want to respond to. It then ends up directly below that comment and with an extra level of indentation.3

8 thoughts on “Fotopedia – the rating system (2/2)

  1. Pingback: Fotopedia – the rating system (1/2) | Peter.vdHamer.com

  2. Charles

    Very well presented thoughts and suggestions.
    I totally agree to Hide the rating of a picture until the user votes for it.
    The random presentation of pictures is also the best way to display them for voting.
    the (A+I)/2 rating needs some thought as an overall rating , since high aesthetically pictures may negate due to possible low “I”
    There should be a way to display the top ranked pictures (Highest to Lowest earned points), regardless of context , for others to get good examples of fine image creation.
    Also when a user decides to give a negative vote to an image , he/she must have the option to anonymously give a reason for doing so.

    Charles

    Reply
    1. pvdhamer Post author

      Hi Charles,

      the (A+I)/2 rating needs some thought as an overall rating, since high aesthetically pictures may negate due to possible low “I”

      It would indeed be wasteful to first ask users to rate on 2 scales, and then simply use the average of both scales for ranking. Once the information is available, the weighing function can be made fancier. I was mainly concerned about high-Info photos with average Aesthetics because these currently seem to get underrated. See the next paragraph for the case of high Aesthetics anad low Info value.

      There should be a way to display the top ranked pictures (Highest to Lowest earned points), regardless of context

      As long the data is available, different rankings can be generated for different purposes. But I wouldn’t like to stress a ranking just based on Aesthetics alone (not sure that’s what you meant) because Fotopedia wants to be an encyclopedia and not “just” a showcase for all types of photography.

      Example: a great wedding photo at a castle should rank low in the context of the Castle, but might rank high in the context of Wedding Photography. Both “copies” (instances) of the photo could and probably should simply be independent contestants in an overall ranking. If a particular high-A photo doesn’t rank well in any of the provided contexts, it might still be very suitable for Photo.net or Photosig.com or as stock photography, but is apparently less suitable for a photo encyclopedia.

      Is this what you meant?

      Also when a user decides to give a negative vote to an image , he/she must have the option to anonymously give a reason for doing so.

      I don’t have a problem with raters providing feedback on photos, but it is a challenge to design the system right. Anonymous comments can be nasty if the writer doesn’t behave. Signed comments can result in flaming and retaliation. I also would like to know why my photo got “thumbs down”. Distinguishing between Aesthetics and Informational suitability might help: you get more information than you used to. The ability to add comments to photos is probably useful as well: Photo.net (which has been doing similar things for years) also allows you to comment on photos. But Fotopedia has an extra challenge: is the comment about the photo or about a photo in a specific context…

      Peter

      Reply
  3. Grace

    Peter,

    First, I don´t have any problem that you display my photo as an example.
    About your article, I agree with most of your thoughts and suggestions.
    Personally I strongly support the idea of hiding the previous rating of a picture until voting for it.
    Also, to display the picture in a random presentation (including tops and candidates) for voting purposes.
    About to vote per link (vote for all contexts at one): I´m not sure how it would work.
    Your example:

    Visual quality: choose between 0/1/2/3/4/5/6/7
    Context Plaza de España (Seville): 0/1/2/3/4/5/6/7/?
    Context Ibero-American Exposition of 1929: 0/1/2/3/4/5/6/7/?

    If you think it is an OK picture but it looks useful for the Plaza de España and you have no clue what “Ibero-American Exposition of 1929″ is all about (which is OK), you might rate it “4″ and “5″ and “?” respectively.

    What would be the final vote of this photo in “Plaza de España” and in “Ibero-American Exposition of 1929″?

    Grace.

    Reply
    1. pvdhamer Post author

      Hi Grace,

      For Plaza de España, the vote A=4 I=5 would change the average A and I rating of the photo somewhat. So after voting, the voter would see the new averages (say A=4.17 I=4.68) plus info on the averages just before the vote (in order to show how much impact the vote had). Later, when the rating of the photo needs to be displayed, both average values are shown: A=4.17 I=4.68 rather than a single value.

      When photos need to be ranked, a single number is computed based on A=4.17 and I=4.68. But I would keep things simple by not displaying that internal number: only show the photos sorted based on that number.

      This is similar to how Fotopedia already ranks things like “Best Recent Contributors”: you might see the top-13 contributors, but you don’t see the underlying computations or values. We can discuss how “a single number is computer” could work – but it will get a bit nerdy and go into internal stuff that you normally would not see.

      So A=4 simply adjusts the average A-rating for the photo.
      And I=5 for “Plaza de España” simply adjusts the average I-rating for the photo in that context.
      And I=? for “Ibero-American Exposition of 1929″ leaves the average I-rating for the photo in that context unchanged because the user didn’t vote.

      Would this be understandable for the user? Would this look fair enough to the user? Peter

      Reply
  4. Grace

    Peter, thanks for your explanation.
    This will be understandable for the user and look fair too.
    To be honest with you, I hoped to understand how will be compute the unique number when photos need to be ranked (based on A=4.17 and I=4.68). Will it be a simple average (4.425)? I hope not
    One additional question, which will be the initial value (when the photo is nominated) for A and I?

    Reply
    1. pvdhamer Post author

      Let’s handle the 2nd question first. Note that these are only my recommendation or proposal (so more “would” than “will”).

      which will be the initial value (when the photo is nominated) for A and I?

      Actually a pretty good question. Some options:

      1. The photo doesn’t get an A|I rating until a human voter (other than the submitter) rates it. This means that the photo doesn’t show up in rankings immediately – bad idea.
      2. The photo always automatically gets a 4|4 vote
      3. The submitter can vote freely on his/her own photo. So the vote might be 4|4 3|5 or 7|7 – can trigger suspicion, so bad idea.
      4. The submitter can vote on his/her own photo, but with restrictions. Too complex.

      So I prefer the 2nd option (A=4 I=4) mainly because:

      • it allows the photo to participate in ranking immediately
      • it typically puts the photo in the middle of any existing ranking (if there are a bunch of photos already)
      • it reduces the impact of the first few votes
      • it avoids people voting on their own photo
      • it is comparable to the old system where an automatic value is assigned

      But, the 4|4 vote can be seen as the vote of “the software”, and could be used reward the photo in certain cases:

      • increase I (in all contexts) by 0.5 or 1 point for extra linked articles.
        If the photo links to 2 articles, add 0.5 point. If the photo links to 3 or more articles, add 1 point. This helps document the photo, even if the photo isn’t a great illustration of the article (“Cattle Egret on the Nile in Egypt”). I think 4 or more links to articles is seldom desirable: bird, white, cattle egret, Nile, Egypt, water.
      • increase I by say 1 point if the photo has a caption.
        This also helps document the photo – unless the caption is really crappy.
      • decrease I by say 0.5 if the photo is not nominated by the photographer. My suspicion is that this increases the chance of errors and certainly makes it less likely that the photo will be maintained if there are questions or comments.
      • increase (I) by say 2 if the photo is uploaded by a museum. Note that the museum likely also supplied a caption: 2 + 1 points!
      • There is a special case that the photo is uploaded by the photographer, but an extra link is added by someone else. For now I don’t have a special rule for this: it doesn’t occur a lot, and I guess the extra link adds value, so the I-rating may go up by 0.5 points for the 2nd or 3rd link.

      Conclusion: if the software has this type of intelligence, it would thus always rate a photo at A=4 (software doesn’t know better), but the I-value could start at 3.5 and could go up to 7 (or even beyond – probably not a problem).

      Reply
    2. pvdhamer Post author

      Grace,

      I hoped to understand how will be compute the unique number when photos need to be ranked (based on A=4.17 and I=4.68).
      Will it be a simple average (4.425)? I hope not

      Sorry. I was trying to avoid “technical” details and also to leave this open for a while.
      So… an A-value and I-value together needs to be converted into a single number. Imagine having a 7×7 table consisting of 7 rows for A=1 .. A=7 and 7 columns for I=1 .. I=7. In each of the 49 cells you find the rating number.
      These 49 numbers would determine how photos rated compared to each other – an thus what things are “rewarded”. Although this requires filling in at least 49 numbers, the good news is that a pretty rough estimate is enough. So we can afford to only worry about filling in 9 of these 49 cells (and use them to determine the other 40):

      (A=2,I=6)=? (A=4,I=6)=? (A=6,I=6)=?
      (A=2,I=4)=3 (A=4,I=4)=4 (A=6,I=4)=5
      (A=2,I=2)=? (A=4,I=2)=? (A=6,I=2)=?

      Here I arbitrarily decided that, when I=4, the rating equals (A+4)/2. This choice just sets a scale, and no real impact on the problem of ranking in two dimensions.
      Obviously increasing the value of I above 4 should increase the rating (and vice versa). So the question is how to fill in the 6 cells marked with a “?”.
      One option is to use the average of A and I, (A+I)/2, which you didn’t like:

      (A=2,I=6)=4 (A=4,I=6)=5 (A=6,I=6)=6
      (A=2,I=4)=3 (A=4,I=4)=4 (A=6,I=4)=5
      (A=2,I=2)=2 (A=4,I=2)=3 (A=6,I=2)=4

      With such a mapping, (A=2,I=6) is valued the same as (A=6,I=2). I would argue that (A=2,I=6) be value more than (A=6,I=2) for use in an encyclopedia (a calendar would be biased the other way around). This assumption gives a matrix such as:

      (A=2,I=6)=5 (A=4,I=6)=6 (A=6,I=6)=7
      (A=2,I=4)=3 (A=4,I=4)=4 (A=6,I=4)=5
      (A=2,I=2)=1 (A=4,I=2)=2 (A=6,I=2)=3

      whereby (A=2,I=6) is now valued at 5, while (A=6,I=2) is now valued at 3. Note that an obvious case like (A=6,I=6) is, for obvious reasons, valued higher than other cases. And similarly (A=2,I=2) is valued lowest.

      For the mathematically included, this last rating scales with (A+2I) instead of (A+I). And this helps informative photos that don’t look too special (example about a town in Corsica) compared to good-looking images that don’t provide much information (example, same photographer, same town).

      Any other ideas about filling in the question marks? Essentially, as long as the equations can stay linear, I am looking for the constant c in “the rating scales with (A+cI)” whereby a higher value such as c=2 increase the reward if the photo is informative, and a low value like c=0.5 mainly rewards aesthetics with only a small correction for information content. Note that for articles with few pictures, there is little to choose from anyway – so you will probably see all the pictures anyway. And pictures with both high A and high I values will always win anyway. But the ranking is intended to give for example, historical pictures a chance (e.g. “building of the Golden Gate Bridge”) or ones that provide good information (e.g. “view of bridge from airplane”) while still supporting visually great pictures (e.g. “bridge in the mist”, “bridge with fisheye lens”, “aircraft carrier sails under the bridge”).

      Note that I don’t know whether c=2 is the ideal answer, but it the best guess I can give now. But, as explained before, the function would not normally be explained and the outcome of these formulas would IMO not be directly displayed to users. Its only goal is to rank photos so that top-5 or top-15 lists can be automatically generated in a way that looks reasonable.

      Peter

      Reply

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>