Best Match 2.0 Summary

1|2|3|4 of 6
Displaying 1 to 20 of 113 matches.
Author
Message
Posted Fri Jan 9, 2009 11:39AM
Original announcement thread:

http://www.istockphoto.com/forum_messages.php?threadid=80951


On 2008-12-09 15:09:33, bitter wrote:

Photographers love to hate Best Match, snickering at its name, BM– and discussing it at length in the shadows of forums everywhere. We know. The mystery of how BM functions is being analyzed regularly by everyone.

With BM, we have one, clear goal: to put the best content in front of our clients. We have finite slots on the first page and tens-of-thousands of files vying for those spots. We understand we won't make every artist happy, but we do our best to be fair when slotting files into BM search results.

A long time ago we developed an algorithm to rank keywords on each file. Since then, we've been tracking data for every single file on iStock. Guess what? It works. Starting in mid-January we will start applying these results to BM searches. For clients it will mean more accurate, more meaningful and more relevant results. For artists it means a massive shift. The results for everyone, are going to be very, very different.

This development is part of a multi-year strategy that we all undertook, starting with the CV (Controlled Vocabulary) that we took (and improved) from Getty Images, nearly three years ago. For those who are unfamiliar with the history, this is the technology that allows us to translate keywords in multiple languages automatically. Next, we all went through a year of disambiguation. You remember if you were here in 2007, the painful steps of going through each file and clarifying and exacting the keywords for every file in your portfolio. Most recently we began our ZTS (Zero Tolerance Spam) program, which is an ongoing initiative to ensure that there are no irrelevant terms or keywords in every file. It hasn't been easy and we understand the great amount of work everyone has endured to make our search results the best they can be. The quality of results has vastly improved since 2006 when we began this endeavor.

With the launch of our new keyword ranking system the culmination of years of work by thousands of people will come to fruition, providing iStock clients with what we think will be the most impressive and most exact search results, for community created media, found anywhere on the planet. In January when the new Best Match launches, it will finally live up to its name and accurately give clients the Best Match for their search terms. We will begin pulling leavers and turning dials to slowly turn up ranking in BM starting next week!




------------------
Clarifying comments:

http://www.istockphoto.com/forum_messages.php?threadid=80951&messageid=1224474


Posted By rogermexico:

Posted By kelvinjay:

Posted By kkthompson:
On 2008-12-09 15:09:33, bitter wrote:

For artists it means a massive shift. The results for everyone, are going to be very, very different.



Given that massive changes to the BM are one of the main complaints in any BM thread, it will certainly be interesting to see how this one pans out. I guess we'll just have to wait & see...


Yeah, I know it's kind of a contradictory sounding message, but the goal is to have one last big shake so that we can move to something more stable. By blending this ranked keyword data into the algorithm, it should make it on the whole more stable. In the past we've been seeing really wild swings whenever the guys have gone into tweak the mix - this is aimed at alleviating those swings and giving us something more reliable.



------------------
Clarifying comments:

http://www.istockphoto.com/forum_messages.php?threadid=80951&messageid=1225298


Posted By kkthompson:


Posted By dhanford:
Does the BM remain as it is now until mid Jaunary?


No. There will be slow & steady modifications as we cruise along.


Posted By Box5:
Posted By M3SH:
I guess the implications are that one needs to resort the keywods on each file to make sure the most relevant come first, with decreasing relevance further down the list.

I wouldn't be so sure. I get the impression that the keyword relevance scoring and such is happening on the back end. 


Oh hell, I wanted to make you all sort every keyword for every file... [ducks] but I'd be an old man before it happened. Doing it algorithmically in the back-end was the next best thing. Can you imagine the beat-down in the forums if we'd have asked to do that? I shudder to think.

How does it work? Not really gonna give to many details, as we're pretty tired of people trying to game the system. You aren't necessarily penalized for bad keywords: they just don't return results.



------------------
Clarifying comments:

http://www.istockphoto.com/forum_messages.php?threadid=80951&messageid=1226303


Posted By bitter:

Posted By mikemcd:
I don't know better than anyone else what this new BM shift will do to our sales, but let's take a quick look back at the original message here:

"With BM, we have one, clear goal: to put the best content in front of our clients. We have finite slots on the first page and tens-of-thousands of files vying for those spots."

As always, BM changes are done with the buyers in mind, rightfully so. I think istock is making the right move here, but that often means that many of us end up disappointed with the result. BM changes have been and will remain to be done for the buyers, not for us.

I'm as hopeful as anyone that this works out positively for everyone. But as a contributor I'm not singing istock's praises for this move and giving them the standing ovation, and I'm baffled as to why anyone else is. Some of the same people complaining about slow sales since the last BM change are now here saying "Yay, BM change!" Sure it's possible that things could get better for those who suffered because of the last change. But there's an equal chance that things will take another dive for those same people after this one.

Fingers crossed, I am cautiously optimistic about this. If it works out, great. But if it doesn't, I won't be back here in the forums next month with the same group who will be scratching their heads saying "What happened to my sales?," as if no one could see that potential result coming.



I'm happy you noticed how carefully I chose my words. We are not promising everyone will like the new BM, nor promising increased royalties to anyone or group in particular. Our goal is to improve the search experience for clients. That's all. We have to assume that the theory of well keyworded files being found and purchased more often than poorly keyworded files is true in this endeavor.




------------------
Related clarifying comment about "more like this" link:

http://www.istockphoto.com/forum_messages.php?threadid=81248&messageid=1228933


Posted By kkthompson:

Posted By arlindo71:
Well, since istock seems to be keeping track of wich keywords are used to find an image, maybe they could use the three most used keywords for each image in the "more like this" search instead of simply the first three...



Yes, this will happen in the New Year, so don't do anything to your keywords.






All new Best Match related threads will be redirected here, so please refrain from starting more. Thanks.

(Edited on 2009-01-10 05:06:31 by sylvanworks)
Posted Fri Jan 9, 2009 11:42AM
Here we go. Thank you, Rob.

Now let's get back to it.
Posted Fri Jan 9, 2009 11:45AM
this all sounds niffty, but to me all this is irrelevant. really the only thing i care about is a bit more cash in my pocket to buy that new camera and so far the results are telling me that i might have to sell the one i have and downgrade to be able to buy diapers for my grandson

(Edited on 2009-01-09 11:46:31 by 2HotBrazil)
Posted Fri Jan 9, 2009 11:45AM
The sky is falling in!

Actually, I'm very excited about the prospect of better and more accurate results for our searches. I think such a fundamental change will require a good deal of time before we can assess whether it's a success or not. The current BM sort order is favouring old images with unDA'd tags but I assume this will all change. I'll reserve my judgement until I've seen my stats for March. Here's hoping that reactions are a little less hysterical in response to the affect this may have on sales in the short term

(Edited on 2009-01-09 12:02:58 by kelvinjay)
Posted Fri Jan 9, 2009 11:46AM

Rob, will be an official announcement when new BM starts to run? (complete proccess, i say) Something like "It's working since five minutes later".
Posted Fri Jan 9, 2009 11:46AM
Wait, the BM changed? Why wasn't I notified?
Posted Fri Jan 9, 2009 11:47AM
This is probably a really dumb question, but does the order in which we list keywords in a file influence the search? In other words, should the most important keywords be listed first? I haven't done that and got to wondering. Thanks!
Posted Fri Jan 9, 2009 11:49AM
Posted By WendellFranks:
This is probably a really dumb question, but does the order in which we list keywords in a file influence the search? In other words, should the most important keywords be listed first? I haven't done that and got to wondering. Thanks!

No. Order of tags has no affect on relevance.
Posted Fri Jan 9, 2009 11:51AM
You might want to add some stuff in the first post of this official pronouncements thread about how istock really doesn't mean to shaft vectors in the search, despite having been downgrading them in the BM search since October, and that something will be done about this eventually -just to reasssure the vector contributors (JRRD and Lobo have mentioned as much in various threads, but people get worried when nothing keeps on happening and in fact the latest changes shift vectors even further back )





Is it just me being obtuse at 5am in the morning or are the nested quotes that Rob has posted above a little unclear in their overall meaning?


While it's clear that Best Match 2.0 isn't fullly implemented yet, I'm not clear as to whether the keyword relevancy is included at all yet (ie whether the gradual prcess of including their effect has started). And if keyword relevancy is being included now, or this is the base search on which the keyword relevancy is going to be imposed why are undisambiguated old files appearing at the front of searches so much when this seems to fly in the face of using keyword relevancy?


And if this isn't the precursor to BM2.0 why such a big shake up in BM occurred so close to when it was going to be implemented, as it's very confusing.

(Edited on 2009-01-09 11:57:39 by Susan_Stewart)
Posted Fri Jan 9, 2009 11:55AM
I'm also excited about better results. The last thing we want is to start loosing customers due to bad search results. That won't help any of us. I have faith that iStock won't let us down. Business as usual!
Posted Fri Jan 9, 2009 12:27PM
Posted By Susan_Stewart:
While it's clear that Best Match 2.0 isn't fullly implemented yet, I'm not clear as to whether the keyword relevancy is included at all yet (ie whether the gradual prcess of including their effect has started). And if keyword relevancy is being included now, or this is the base search on which the keyword relevancy is going to be imposed why are undisambiguated old files appearing at the front of searches so much when this seems to fly in the face of using keyword relevancy?

One of the posts does say that it should kick-off in mid-January so maybe we have a week or so to wait until we see it in action. However, I do agree that it is odd to have such a big shake-up before the relevancy logic is released.
Posted Fri Jan 9, 2009 1:11PM
Don't forget the videographers in BM 2.0 We can make serious $bucks too you know. Perhaps Vector and Video should all shout together
Posted Fri Jan 9, 2009 1:45PM
After reading it all, it sounds like accurate, relevant and thorough keywording (maybe even better titles and descriptions?) will be the key to success with BM 2.0. That doesn't sound so bad . . .
Posted Fri Jan 9, 2009 1:50PM

Looks like a lot of work to compile this list of relevant info. Thanks!


The next few weeks should be very interesting...
Posted Fri Jan 9, 2009 3:42PM
Should be a very intersting time. Personally I hope it works out as intended. The begining of January seems positive enough.
Posted Fri Jan 9, 2009 10:59PM
Am I right understanding that titles and descriptions will be a factor in BM 2.0 and that I should edit them? It always seemed a bit odd to me to use the word "sailboat" in the title and in the description when the image clearly showed a sailboat and "sailboat" was a keyword anyway, so in the past I had the tendency to be a bit more creative in chosing titles and to be quite brief in my descriptions. Will that work against me now?
Posted Fri Jan 9, 2009 11:47PM
Posted By Eulenblau:
Am I right understanding that titles and descriptions will be a factor in BM 2.0 and that I should edit them? It always seemed a bit odd to me to use the word "sailboat" in the title and in the description when the image clearly showed a sailboat and "sailboat" was a keyword anyway, so in the past I had the tendency to be a bit more creative in chosing titles and to be quite brief in my descriptions. Will that work against me now?

From which piece of text did you draw that conclusion? I haven't read a statement about titles & descriptions.
Posted Sat Jan 10, 2009 12:14AM




Posted By VLIET:



Posted By Eulenblau:
Am I right understanding that titles and descriptions will be a factor in BM 2.0 and that I should edit them? It always seemed a bit odd to me to use the word "sailboat" in the title and in the description when the image clearly showed a sailboat and "sailboat" was a keyword anyway, so in the past I had the tendency to be a bit more creative in chosing titles and to be quite brief in my descriptions. Will that work against me now?




From which piece of text did you draw that conclusion? I haven't read a statement about titles & descriptions.






Read the last post of kkthompson Rob quoted above. There it says:


"Yes, this will happen in the New Year, so don't do anything to your keywords.

There are also planned changes to the Ratings and Titles. We knew they'd be requested, we just didn't have time to get them in this release. We needed to push this to get some other stuff ready to go."





P.S. Admittedly I says only "titles" here, but I seem to remember there was a discussion regarding relevancy of titles and descriptions in some other BM thread.




Edit: spelling

(Edited on 2009-01-10 00:18:24 by Eulenblau)


Edit: P.S.

(Edited on 2009-01-10 01:40:03 by Eulenblau)
Posted Sat Jan 10, 2009 4:36AM
Titles used to be searched for keywords under the old system, but now they're not. However, the popular "find similar" function used the title and some odd keywords to generate the search it performed. So it is always better to give a purely factual title. If you have a photo of a man sailing a boat on a lake then call it "man sailing a boat on a lake" and not "the smell of freedom and the majesty of nature" etc
Posted Sat Jan 10, 2009 5:07AM

Posted By Eulenblau:
Am I right understanding that titles and descriptions will be a factor in BM 2.0 and that I should edit them? It always seemed a bit odd to me to use the word "sailboat" in the title and in the description when the image clearly showed a sailboat and "sailboat" was a keyword anyway, so in the past I had the tendency to be a bit more creative in chosing titles and to be quite brief in my descriptions. Will that work against me now?


No, that is not correct.

The line in Kelly's comment was in response to something else and was not related to BM. I have removed it from the original post. Sorry for the confusion.
This thread has been locked.
1|2|3|4 of 6
Displaying 1 to 20 of 113 matches.