gfish: (Default)
gfish ([personal profile] gfish) wrote2008-06-27 09:53 am

SRVC results

We won!

1st place: UBC, 12 points
2nd place: IMRA-Europe, 8 points
University of Maryland: didn't place, no data

I'm not sure I ever posted about what exactly SRVC is. So...

This was the second year for the Semantic Robot Vision Challenge, a competition designed to force realworld use of modern vision techniques in a robotic context. Last year was at AAAI in Vancouver, now it's being hosted by CVPR in Anchorage. Looks like it will stick with CVPR, so next year will be Miami.

4 hours before the active competition starts, teams are given a text list of ~20 items. Some are specific (DVD '300', Spam) and some are general categories (frying pan, fax machine). Without human intervention, their systems then access the internet to gather training images to learn what these objects look like. (Mostly from Google Images, but some other sources as well.) Each then has 4 hours in which to process the data.

For the actual run, each team gets 30 minutes to recognize the objects in a prepared environment. So far these environments have been pretty simple, but that will change as the contest evolves. There are two leagues, software and hardware. The software leagues are given a set of images taken by the organizers, some of which are good and some of which aren't. The hardware leagues have to send in a robot to take their pictures -- still limited to 30 minutes for gathering and analysis. (This is why we had 4 laptops strapped on this year.)

Pretty hard stuff. Lots of fun. We can do a lot better next year. :)

ETA: I'll post a detailed score breakdown once I get the data. But in short, you can get 0-3 points for each object you recognize, depending on how good the bounding box is, plus 1 bonus point if you announced the classification in realtime during the competition. (This encouraged robot state displays that made this year's contest a lot more audience friendly.) We got 5 scoring objects, 1 non-scoring object, and a bunch of bonus points.

[identity profile] bakeme.livejournal.com 2008-06-27 06:20 pm (UTC)(link)
wow, that is cool. cool and kinda creepy, in a matrix/i, robot kinda way. i've read that visual recognition of objects is a huge hurdle for ai, abstracting general features and recognizing instantiations of categories without cheating, being preprogrammed with details from a specific, preplanned circumstance.

[identity profile] keystricken.livejournal.com 2008-06-27 06:26 pm (UTC)(link)
Congratulations!

[identity profile] corivax.livejournal.com 2008-06-27 06:26 pm (UTC)(link)
So twelve points means you recognize how many objects? Twelve?
ext_3294: Tux (Default)

[identity profile] technoshaman.livejournal.com 2008-06-27 06:30 pm (UTC)(link)
Yay winner!

Ever check out the LEGO robot wars they have at Pacific Science Center when you were here? Robot sumo wrestling FTW. :)

[identity profile] vixyish.livejournal.com 2008-06-27 06:41 pm (UTC)(link)
Yaaaays!

I also am curious to know what the raw score means.

[identity profile] ionan.livejournal.com 2008-06-27 06:41 pm (UTC)(link)
Whoo-hoo! Congrats!

[identity profile] tfabris.livejournal.com 2008-06-27 07:03 pm (UTC)(link)
Many congratulations. Very impressive. I'd like to see video of the robots in action.

[identity profile] k-crow.livejournal.com 2008-06-27 07:17 pm (UTC)(link)
Congratulations! Looking forward to see the detailed score breakdown later. :)

[identity profile] hsifyppah.livejournal.com 2008-06-27 07:26 pm (UTC)(link)
Image
ivy: (forest heart close)

[personal profile] ivy 2008-06-27 09:37 pm (UTC)(link)
Congratulations; that's brilliant! Go go robot rangers!

[identity profile] grinninfoole.livejournal.com 2008-06-27 09:39 pm (UTC)(link)
Congratulations to you and your teammates. You should be very proud.

and you should definitely fill the blank here: http://rollick.livejournal.com/721724.html

[identity profile] sistawendy.livejournal.com 2008-06-27 10:46 pm (UTC)(link)
Awesome! I should so point m'boy to your LJ here.

[identity profile] waysofseeing.livejournal.com 2008-06-28 04:39 am (UTC)(link)
A winner is you! All hail.

[identity profile] olafthunderfoot.livejournal.com 2008-06-30 12:24 am (UTC)(link)
sweeeeeeeeeet!!!!