Itis cool

Thank you very much for providing the information. We'll look into fixing this bug.

Not sure what the LabelMe email is so I will post the information here.

I am using the Firefox 3.0.1 browser.

To produce the point around (1,1) all you need to do is either change the name of an already annotated object or delete the name of an already annotated object.

Can you send me an e-mail describing the browser you were using and the exact actions you took to produce the bug? I cannot reproduce it on my side.

Thanks!
--Bryan

Just a little bug I've noticed.

When you edit the name of an image that has already been annotated, a point is created somewhere near (1,1) after you click OK.

Thank you, it worked this time.

Thank you for pointing out that the source code download page is down. We have fixed the problem, so please try again. Our apologies for this bug.

Have tried several times to submit the form to receive the source code for your LabelMe project and the form always fails to submit correctly.
Is this a temporary problem?
If so, when do you expect it to be fixed?

Will download another browser and try again.

Nope, still a 500 Internal Server Error.

We succeed installing the LabelMe code in Windows.
Here is a general guideline of what we did:

1) Downloaded the Labelme code package (the authors will send that).
2) Installed "Apache" for windows
3) Installed "Active Perl"
4) Installed Cygwin
5) Make sure that all of the above (except LabelMe) works OK first.
6) We change the config file of Apache (httpd.conf) by adding the following:
------------------------------------------------------------- ------
# Added by Juan from line 194
<Directory "C:/POSTDOC/LabelMe">
 Options FollowSymLinks SymLinksIfOwnerMatch Indexes +Includes +ExecCGI
        AllowOverride AuthConfig
 AllowOverride All
 Order allow,deny
 Allow from all
</Directory>



    # Added by Juan in line 325

Alias /LabelMe/ "C:/POSTDOC/LabelMe/"

# Added and changed by Juan (line 338)
    #ScriptAlias /cgi-bin/ "C:/Program Files/Apache Software Foundation/Apache2.2/cgi-bin/"
    ScriptAlias /cgi-bin/ "C:/POSTDOC/LabelMe/"

# Changed line 406
    AddHandler cgi-script .cgi .pl

# Added and changed in line 417
    AddType text/html .shtml
    AddHandler server-parsed .shtml
    AddOutputFilter INCLUDES .shtml


-----------------------------------------------------

7) We added the module "mod_rewrite" to the Active Perl version.
8) We changed and added to the file "Makefile" the following:
------------------------------------------------------------- ---------
#IMAGES_DIR=/afs/csail/group/vision/www/data/LabelMe/Test/Images
#ANNOTATIONS_DIR=/afs/csail/group/vision/www/data/LabelMe/Test/Annotations

IMAGES_DIR=/cygdrive/c/POSTDOC/LabelMe/Images/
ANNOTATIONS_DIR=/cygdrive/c/POSTDOC/LabelMe/Annotations/
 
---------------------------------------------------------- --------------
9) We run the command "make" on Cygwin, under the folder "LabelMe"
10) We changed all the "#! /usr/bin/.." by "#!c:/Perl/bin/perl.exe" in all the scripts under LabelMe
11) We add/changed the scipt "fetch_image.cgi". See below all the file after the changes
-------------------------------------------------------------- ------------

#!c:/Perl/bin/perl.exe

# Get STDIN:

read(STDIN,$collection,$ENV{'CONTENT_LENGTH'});

$fname = "DirLists/$collection.txt";

# Juan add:
if(!open(xFP,$fname)) {
    print "Status: 404\n\n";
    return;
}
$numlines = 0;
@lines = readline(xFP);
foreach $i (@lines) {
    $numlines = $numlines + 1;
};
close(xFP);
# end Juan add

if(!open(FP,$fname)) {
    print "Status: 404\n\n";
    return;
}

# Juan remove:
#open(NUMLINES,"wc -l $fname |");
#$numlines = <NUMLINES>;
#($numlines,$bar) = split(" DirLists",$numlines);
#close(NUMLINES);
# end Juan remove

$line = int(rand($numlines))+1;

for($i=1; $i < $line; $i++) {
    $garbage = readline(FP);
}

$fileinfo = readline(FP);
($im_dir,$im_file) = split(",",$fileinfo);
$im_file =~ tr/"\n"//d; # remove trailing newline

close(FP);

# Send back data:
print "Content-type: text/xml\n\n" ;
print "<out><dir>$im_dir</dir><file>$im_file</file></out>";

--------------------------------------------------------- -----------

12) Last things: Open your browser (we use Firefox) and enter the following url:
http://127.0.0.1/LabelMe/tool.html

Good luck!
Thanks Antonio and the rest for this great application!
Mathias Kolsch and Juan Wachs

You may browse all of the images on LabelMe here:

http://labelme.csail.mit.edu/browseLabelMe/index.html

and then select the one you wish to label.

How do I specify which image I want to annotate with your web-based version of the LabelMe Annotation Tool?

Please send me e-mail (brussell AT csail DOT mit DOT edu) to resolve this. Once we debug this, I'll post the solution on the installation instructions page.

Thank you for the code very much, though I cannot use it properly.

I enabled server side includes and perl scripts in Apache the following way (I use Ubuntu Linux):

Options +Includes +ExecCGI
AddType text/html .shtml
AddOutputFilter INCLUDES .shtml
AddHandler cgi-script .cgi .pl

The image appears in the annotation tool, but I am unable to draw polygons. In Firefox, at Tools->Page Info, "text/html" appears instead of "application/xhtml+xml".

I am sure that server side includes are enabled, because without them, the image does not appear at all.

Could you please help me?

My apologies for not sending you the code sooner. I just sent it to you. Please let us know if you have not received it.

Hello!

I would like to obtain the source code of your annotation tool for my project, and I have filled in the code registration form on 2008. feb. 19., but have not received a reply.

I submitted my data again. Please let me know if I will receive the code soon. Your help would be kindly appreciated.

Gyula Vörös

Thanks for your question and feedback.

We give general labeling guidelines here:

http://labelme.csail.mit.edu/guidelines.html

In general, we prefer that you label objects as if they were not occluded, whenever possible. When you do this, you can reliably infer the depth-ordering of the objects (c.f. one way of doing this is outlined in our IJCV paper: http://people.csail.mit.edu/brussell/resea...IM-2005-025-new.pdf).

Edited by author 01-31-2008 01:46 PM
Partialy visible object labeling

This question about labeling probably has been answered already, but you may want to post clear instruction how to draw the lines around the object if it is only partially visible (eg. chair only legs are seen, or plate or car when only quarter is seen, there is a person in front of the car, or only half of fridge is seen in the kitchen - creates triangular fridge). This creates weird geometric shapes and may may not really help you all that much. Garbage in garbage out, you know the old saying.... But other than that, keep up the great job.

Q: Should you label only what is visible even if it is partially occluded, or should you label the object as it should be seen.

Thanks! This is great work!

Yes, you may query using the Matlab toolbox:

HOMEANNOTATIONS = 'http://labelme.csail.mit.edu/Annotations';
D = LMquery(LMdatabase(HOMEANNOTATIONS), 'object.name', 'road');

The structure "D" will have the list of folders and images containing at least one car.

Hi! Is there any way we can obtain a list of images that contain an object of interest. For example, a query which gives me the list of all images on the database that contain at least one car.

Hi! Nice site!

Thanks for contributing labels and for your suggestions. In response to your suggestions:

(1) We are close to having Safari support but have not completed this yet. If you urgently need Safari support, then we encourage you to download the annotation tool source code: http://labelme.csail.mit.edu/Documentation/sourceCode.html

(2,3) Quality control in LabelMe is certainly an important issue. However, we have found that users generally provide good labels (c.f. our paper on the LabelMe database: http://people.csail.mit.edu/brussell/resea...IM-2005-025-new.pdf).

I just labeled one image. It's a nice interface. Suggestions: (1) support for Safari (Mac OS X), (2) you could also just show an image + existing contours (without labels) to the user (either created by previous users or computed via a segmentation algorithm) and ask them to either reject the contour or provide their own labels for it. (3) you could do the reverse too: show them just the image + a label (obtained from a previous user), and ask them to either state that no such object exists in the image, or contour that object... at the end, you can score the contour using an edge detector (or similar)... this way, you could perhaps improve/reject the badly drawn contours, and get rid of "maliciously" drawn objects which don't actually exist in the image.

Nevermind, I found the demoWordnet.m file.
This is great!

I can't seem to figure out how to use MatLab toolbox to be able to query the images using WordNet. Any help would be appreciated. Thanks!

The answers for your questions can be found via links from the main LabelMe page (http://labelme.csail.mit.edu). More specifically, check out the (1) tool source code and (2) search objects/scenes links for answers regarding source code and object queries.

Hey , i wanted to some details abt ur labelme..
Firstly, wich language are u ppl using ....
Secondly, How can i query
Thirdly do we have to label eac image for querying.... ??

Hello! great idea of color of this siyte!

Thank you for your interest in the LabelMe project. Yes, LabelMe is alive and well. You are more than welcome to contribute images, annotations, or code. If you want immediate correspondence, please contact us by e-mail directly as only messages can be posted to this discussion space.

I need to know if you guys are still working on Labelme or not. I had read about Label Me in some academic paper and we were working on more or less similar project in Nayang Tech in singapore [Called SYGY]. But I doubt if Label Me is still alive or the project is ended.
I checked the tool, and it works fine, but I really don't know if still people are welcomed to contribute?
And one more.
How can I find out if I have got response on this discussion page? there is no notifier , seems I have to get back sometime later.
Alireza Kashian @ Singapore

Alastair, thanks for you interest in the LabelMe project. Unfortunately we cannot post the PASCAL VOC 2007 images on LabelMe at this time.

How about putting up the PASCAL:VOC 2007 images. Are there any copyright issues? I intend to segment extra images for my entry and they might as well be publicly available.

Ok. Thank you very much for your quick response. By now im annotating images just for fun, but as soon as I get some time I plan to give that idea a deeper thought. It has to be possible, since the worst part of evaluating a segmentation is also getting the ground truth.
Thanks again.

Juan, thank you for your feedback and for reporting the bug. Yes, all of your annotations are being stored safely. There was just a small bug with the counter. We have since fixed this problem, so hopefully the counter will not decrease anymore.

As for using the dataset for segmentation evaluation, we agree that this could be an interesting way to use the dataset. We have not given this much thought and have not pursued this direction. Thanks for raising this issue!

I'm experiencing a strange behaviour. As I label objects the counter advances, but after I change the image, it is back to the original number.
Is that normal, and only due to some delay?
Are my labels being stored?
Thanks.
       Juan

Hello, in the first place I would like to say congratulations, this is a great idea. I'm working in image segmentation, and I'm concerned about the lack of quantitative results in this field. However there aren't many labeled databases, particularly for segmentation. I know the aim is slightly different than object recognition, but some tools like this one can be re-utilized. I was wondering if you ever thought about that, and if you have any ideas about this.
Thanks in advance.
Juan

Daniel, thanks for your feedback and suggestion. While the tool does not explicitly provide a mechanism for labeling depth orderings, one can achieve this by appending to the label field of an annotation "depthXX". During post-processing with the Matlab toolbox, you can then extract this information and develop functions to display the depth information.

Also, there is quite a bit one can do with the annotations already to determine depth ordering. We will soon release a Matlab function that suggests a depth ordering for the polygons in an image based on some simple heuristics. This function seems to work quite well in practice.

We agree that depth information is very important and may try to include explicit labeling instructions in a future version of LabelMe.

Again, thanks for your comments!

I suggest the possibility to specify occlusions. It could be done like in Illustrator or other programs where you can order objects back or forward stepwise. In the end there would be an ordered list and if two regions overlap and one appears before the other in the list then it occludes it.

Thanks for the reply - yes, that's the image I annotated, and the giraffes also now show up in a search on "giraffe".

Yes, there is a delay between labeling an object and when you are able to search for the object through the online search tool. However, the annotations should be recorded. You can verify this by revisiting the image that you annotated (the giraffe annotations should be there).

To make sure that everything is ok, did you label the following image?

http://labelme.csail.mit.edu/tool.html?col...811_144650_GM6A0142

Is there a delay between labelling an object and the database being updated? I labelled some giraffes yesterday but a search today on "giraffe" doesn't show the ones I labelled. I wanted to check that everything was working before I did more images, but now I'm not sure.

Edited by author 07-20-2006 05:09 PM
We just released the beta version of the labeling tool. Please try it out and let us know what you think about it! Things we've changed since the last version:

-Added a zoom feature so it's easier to annotate smaller objects
-Made the labeling tool compatible with Firefox, IE, and Safari
-Changed the way that the outlines are drawn
-Added capability of removing individual line segments
-Made the layout more intuitive