Another question, I was looking at the wordnet extension, does this only work with Matlab also

Paul

Um...I dont use matlab :-), or should I say I do not have matlab

Paul

Currently, the annotation tool does not allow suggesting a default set of labels. The user must type in the label.

To interact with the data, there is a Matlab toolbox with various functions for plotting, extracting a polygon mask, etc. You may find these functions helpful for parsing and extracting various properties (e.g. points interior to the annotated polygon).

The Matlab toolbox can be downloaded here:

http://labelme.csail.mit.edu/LabelMeToolbox/index.html

Guys tks for the help on the install, it seems to have been a file owner problem.

So now I have a few more questions :-)

1. When I annotate a image, and it asks me to label it, is it possible to suggest a default set of labels from somewhere

2. When the annotation is done it stores them in the Annotations folder, so I had a look at the file, but wanted to know what the fields were: I have

<annotation><filename>boo.jpg</filename><folder>folder</folder><source><sourceImage>The MIT-CSAIL database of objects and scenes</sourceImage><sourceAnnotation>LabelMe Webtool</sourceAnn
otation></source><object><name>laptop</name><deleted>0</deleted><verified>0</verified><date>13-Nov-2009 16:11:14</date><id>0</id><polygon><username>anonymous</username><pt><x>37</x><y>348</y></pt><pt>
<x>47</x><y>451</y></pt><pt><x>108</x><y>611</y></pt><pt><x>190</x><y>776</y></pt><pt><x>382</x><y>858</y></pt><pt><x>1153</x><y>677</y></pt><pt><x>1072</x><y>424</y></pt><pt><x>933</x><y>279</y></
pt><pt><x>532</x><y>296</y></pt></polygon></object><imagesize><nrows>960
</nrows><ncols>1280
</ncols></imagesize></annotation>

Is the x/y where I clicked as I went around the picture, or some other points. Also if I know the x,y points of the picture as given by the data above, does anyone know of a simple way of storing the pixels contained within

e.g I have a square shape x1=10, y1=10, x2=20, y2=10, x3=20, y3=20, x4=10, y4=20. Now this is what it stored in the annotation file from what I can see. However if I knew a point say 15,15, how can I work out that that is within the square, I know there must be a formula for this somewhere, just cant seet it :-)

tks

Paul

Done, and tks

Please e-mail me directly (russell AT di DOT ens DOT fr) the URL. I'll have a look. Thanks.

Is there a way of posting the url offline ?

Also apache contained the perl/CGI things you mentioned. Also in the apache logfiles I am seeing

Premature end of script headers: write_logfile.cgi, referer: http://www.mydomain.com/annotate/LabelMe-1...der=null&image=null

and alot of the other scripts like get_anno_file.cgi also showing the same "null" error

I also get

File does not exist: /usr/local/mydomain/annotate/LabelMe-1-99/Images/null, referer: http://www.mydomain.com/annotate/LabelMe-1...der=null&image=null

BUt still getting the same objXml.status error, and no image loading

Hi Paul,

Can you please send me the URL of your copy of the annotation tool? I can have a quick look.

Make sure that you are enabling perl/CGI in your httpd.conf file:

Options +Includes +ExecCGI
AddType text/html .shtml
AddOutputFilter INCLUDES .shtml
AddHandler cgi-script .cgi .pl

Hi

I downloaded the latest version and went through the install instructions (ubuntu), created the 3 directories, and ran make, which all went well. Then I went to the URL

www.myname.com/tool.html, and the error unknown objXml.status pops up a couple of times, and then the icons appear, BUT no image loaded.

I am seeing alot of "premature end of script headers" in my apache error_log also.

I am running Firefox on a mac, and have checked the Page info for xhtml +xml, and it shows the correct info.

Any pointers...

Paul

thanks for pointing out this bug. Please, download the toolbox again from the labelme website. That bug should be fixed now. Let us know if you still encounter any problem.


On Nov 3, 2009, at 6:24 AM, QT - Gibbs wrote:

< replied-to message removed by QT >

Hi guys,
I think you may have a tiny bug.
I've just download the last LabelMe toolbox, when I tried to run the following lines I got an error

>> HOMEANNOTATIONS = 'http://labelme.csail.mit.edu/Annotations';
>> HOMEIMAGES = 'http://labelme.csail.mit.edu/Images';
>> D = LMdatabase(HOMEANNOTATIONS, {'static_street_statacenter_cambridge_outdoor_2005'});
??? Undefined function or variable "Nfolders".

Error in ==> LMdatabase at 109
for f = 1:Nfolders

------------
It was easily solved when I added in line 70 of LMdatabase.m:
    if Narg == 2
        Folder = varargin{2}
        Nfolders = length(Folder)
    end

I don't know if it's the right solution but it worked for me.

Hi, I used the scene search function from the web interface to retrieve the "cross street", and get 325 images returned. However, when I use the matlab code to do the retrieval, I get nothing. The code I used is like this:
HOMEIMAGES = 'http://people.csail.mit.edu/brussell/research/LabelMe/Images';
HOMEANNOTATIONS = 'http://people.csail.mit.edu/brussell/research/LabelMe/Annotations';
D = LMdatabase(HOMEANNOTATIONS);
[Q,j] = LMquery(D, 'scenedescription', 'cross street');

My question is: how can I get the same search result as the web interface?

I have downloaded both Label Me and Annotation Tool box for scene perception experiment. Based on the instruction, all data files are saved in Annotation folder in XML format. If we are running the same experiment for many subjects and we would like to see each participant's capability in labelling the object on the scene. How can I modify the matlab program (maybe Label Me or AnnotationTool) to achieve the following purposes:
1) Save the annotation data for each subject in separate folders for analysis purpose
2) Read the result from the XML as an image to scoring purpose (e.g. whether they label the right object at the right location)?
Many thanks for your help!

Edited by author 07-01-2009 10:52 PM
Thank you all. It was a very silly problem - my image files didn't have access permissions set for others. It's working perfectly now. Sorry to bother the group with this.

As I noticed, a missing annotation directory do not stop the site from loading the image, but corresponding annotation directory is a must to save the annotations done on the image.

Thanks again to the authors.

--Mozaher

For your images, make sure that you have corresponding directories in
the "Annotations/" folder. For example, you should have:

Images/folder1
Annotations/folder1

If this does not work, please send me an e-mail directly.
--Bryan

If you are installing the newest version of the tool (LabelMe-1-91),
be sure that you have a new directory called "TmpAnnotations/" (see
discussion board note below).

Unfortunately, this is as much advice as we can give since we have not
installed the annotation tool on a Windows Server. If you manage to
find the solution, it would be greatly appreciated if you can let us
know (we will update the installation page).

Hi,
I have a working installation of LabelMe-1-14. It is working perfectly fine with the dataset available from labelme website. But unfortunately it is not working with my own dataset. The site gets hanged at "Loading Image".

All the images in my dataset are 256 x 256 jpg images. I have updated the labelme.txt in DirList folder to list the new images, but still can't get through.

Any help is highly appreciated. Thanks.

Hi,

I am trying to install the LabelMe source code on a Windows Server. However, I am getting various kinds of errors in fetch_image.cgi. The changes suggested in Step 10 on the Source Code Installation page are riddled with syntax errors. I have fixed a bunch of them (looking at the Apache logs), but the end result is still the same.

The tool.html page gets stuck trying to load the next image. The perl script returns null for both image and annotation file. It seems like the $collection variable in fetch_image.cgi is not loaded correctly.

Has anyone else had this problem? Any recommendations? Thanks.

For the LabelMe-1-91 update, we require a new directory (with write permissions) called "TmpAnnotations". In all, you should have the following directories:

Images/
Annotations/
TmpAnnotations/

Rob, Did you get any leads on "There was a problem retrieving the XML data: Internal Server Error" message? I had an older version working but I am getting the same message with the 1-91 update.

I am now trying to extract the gist descriptor. I would like to know how to process image that are not in square size?

Hi- I'm wondering if there is something different about version 1-91 that is tripping me up. I had 1-14 working fine. When I try to submit the label for a drawn polygon I get the following message "There was a problem retrieving the XML data: Internal Server Error". I've checked permissions on everything (I think) including the Annotations directory. It looks like the message comes from canvas.js, indicating that the HTTP request for XML data to submit.cgi has returned a 200 error. But I'm blanking on why that should be the case. Can you suggest anything that would help me track down what I have done wrong? Thanks.

We have recently posted the latest version of the source code for the annotation tool:

http://labelme.csail.mit.edu/Documentation/LabelMe-1-91.tar.gz

For installation instructions, please refer to the following web page:

http://labelme.csail.mit.edu/Documentation/sourceCode.html

Hi- I notice that the annotation tool at the MIT site (http://labelme.csail.mit.edu/tool.html) has the great new feature that allows editing of the individual polygon vertices, but the version I just downloaded (1-14) does not. Will that feature be available for general release soon? Thanks in advance for the info, and thanks for sharing the tool.

Edit: after doing all this playing around, I somehow noticed that the labelme.txt file was blank. After seeing this I reinstalled the tool, and all now works! Thanks again for the assistance.

I did some testing, and it turns out this is set up so that the tool can see the .htaccess file - I tested by putting junk in the .htaccess file and restarting the server, and lo and behold when I did I got server errors when I browsed back to the tool. So I'm running out of ideas... To confirm, there are no error messages either when running the tool, or in the apache logs. It just fails to display pictures.

I can understand your situation but it is quite compulsory that you should allow "htaccess" for this application to run because we are provided a file ".htaccess" in our source code which means that this tool uses its own apache settings and these will work only when u add those lines and this requires ROOT permission . I did all of this on my own laptop and this worked .

You may get error mesgs if you dont include the module mod_rewrite.so and allow htaccess . Try contacting ur college sysadmin . He may help you !!

Edited by author 05-17-2009 02:08 PM
Hmm... I think my situation may be slightly complicated by the fact that I'm running on a machine where I don't have root access (University machine), so playing with default Apache settings isn't really an option. Assuming, however, you mean editing the httpd.conf file for my server, adding the lines of what you suggested doesn't seem to have any effect whatsoever (there are also no error messages in the logs). Furthermore, I'm confused - why enable access to the labelme site if all images, annotations and the tool are stored and running locally? It may be I just don't understand this properly!

Thanks for the help in any case.

Even I got the same problem while using LableMe as a part of my project . I solved the problem by editing apache configuration . You should allow htaccess to that site (lable Me) . Edit your apache2.conf (for ubuntu) by adding a line

"LoadModule rewrite_module /usr/lib/apache2/modules/mod_rewrite.so" and add

"<Directory [PATH OF UR LABLEME DIRECTORY] >
        Options Indexes FollowSymLinks MultiViews +Includes
        AllowOverride all
        Order allow,deny
        allow from all
        AddType text/html .shtml
        AddOutputFilter INCLUDES .shtml
        DirectoryIndex index.shtml
    </Directory>
"
to the file "/var/www/apache2/sites-available/default" file.


I think this should work for you (it worked for me!!) on Ubuntu . Try doing it and let me know the error in the log file , if you don't get the desired outpu!!

On Sun, May 17, 2009 at 10:30 PM, QT - Ben Allison <
qtopic-37-E4xRZ7fZZhh@quicktopic.com> wrote:

>
< replied-to message removed by QT >

LabelMe Authors,

After filling out the form to do so, I have set about trying to run a copy of the tool locally to annotate some images as part of a project we're doing. I've spent a fair while fiddling around with the tool and setting up the web server, but when I point my browser at myserver/tool.html I only ever get the "Loading Image" message and the image itself never displays. The same thing happens if I point my browser at the local copy of the webpage. My first suspicion was a permissions issue, but I'm now fairly confident it's not that. Any suggestions as to what's causing this would be greatly appreciated.

Dear Professors,

   I downloaded the training data set "training.tar" from LabelMe download-webpage. But I can not unzip the files. Maybe there are some problems when zipping the files. I also downloaded the test files. There are no problems when unzipping them.

Dear LabelMe Hackers:

Inside tags.txt there are a couple of duplicate tags:
"TAG: plant" and "TAG: balcony" appear twice.
>>[Tag,Descriptions]=loadtags('tags.txt');
The problem is that now:
length(Tag) ~= length(unique(Tag))

I think these two TAGs should be merged inside tags.txt. I am not sure if the problem persists inside LMaddtags since I use loadtags directly.
-Tomasz

P.S. I still think putting the LabelMeToolbox in SVN is a good idea.

LMGist now works. Thanks a lot!

Thank you for pointing us to the duplicate label.

Currently the tool does not have a way to hide polygons. One way to get around this is via the zoom button. We know that this is not elegant, but hopefully we can address this problem in the future.

The annotations are getting quite dense for some images and it is hard to see what is labeled.

As a result, certain objects are labeled multiple times.

For example, same physical region has two "sky" labeled regions in the following image:

http://labelme.csail.mit.edu/tool.html?col...&image=p9160555.jpg

Thanks for pointing out the missing function. I have included the function with LMgist.m now. You will have to download the toolbox again. Make sure to clear your cache first. Let us know if it is still not working for you.

QT - Alon Catz wrote:
< replied-to message removed by QT >

Hello all,

I am trying to use the matlab toolkit to calculate gist descriptor on my images and I am getting the following error in LMgist function

?? Undefined function or method 'prefilt' for input arguments of type 'single'.

Error in ==> LMgist at 115
        output = prefilt(img, param.fc_prefilt);

Error in ==> demoGist at 12
[gist, param] = LMgist(img, '', param);

Any help will be appreciated.

Just wanted to let you know about a bug.

When editing or deleting an annotation a point is automatically created somewhere around the top left corner.

I have been experiencing this from the 2.0-3.0.6 Firefox browsers.

Please help me asap.. its kinda urgent!!!

thanx in anticipation

Sir

Now i have enabled SSI in my system. It is working fine as i have tested it by running a test file in the browser.Even then tool.html is hanging @ Loading image.... and the pageinfo is not showing xhtml and stuff. What might be the reason??

Thanks in advance

Sir,

After editing "all" line as you said,Makefile is working properly without giving any errors
but when I am trying to open tool.html ..the screen is once again hanging @ Loading image
labelme.txt is showing all the images correctly.But in the page properties it is showing text/html.Please help me out!!

Thanks in advance

On Fri, Nov 14, 2008 at 11:00 PM, QT - LabelMe <
qtopic-37-E4xRZ7fZZhh@quicktopic.com> wrote:

>
< replied-to message removed by QT >

Hi,

Since it looks like the Images/ and Annotations/ folders are in the same directory as the annotation tool code, you can change the "all" line in the Makefile to read:

all: dirlists counter logs

Then, try running "make" again. If the rest of the commands do not work, then it looks like your system is not set up to properly execute the bash commands in the Makefile. My suggestion here is to do a Google search to resolve this.

Regarding SSI, I would suggest a web search since this depends on how your system is configured.

Best,
Bryan

Sir,

In the page properties it is showing text/html ..not any xhtml or so!!

Sir ,
Thanq for replying so fast.
Iam getting an error as follows:

------------------------------------------------------------- ------------------------------------------------------------- if [ -a "Images" ]; then echo "IMAGES_DIR all set."; else ln -s
/var/www/labcopy/lab/LabelMe1/Images Images; fi

[ : 1:Images: unexpected operator


if [ -a "Annotations" ]; then echo "ANNOTATIONS_DIR all set."; else ln -s /var/www/labcopy/lab/LabelMe1/Annotations Annotations; fi

[ : 1:Images: unexpected operator
--------------------------------------------------------------- --------------------------------------------------------
/var/www/labcopy/lab/LabelMe1 is my path ..iV created Images and Annotaions directories mannually . I also created directory figs in both images and annoations folders .I placed my images in he figs folder in Images directory.

I also dunno exactly about SSI .Can you please send me a link or something regarding it.

Thanks in advance


On Fri, Nov 14, 2008 at 10:27 PM, QT - LabelMe <
qtopic-37-E4xRZ7fZZhh@quicktopic.com> wrote:

>
< replied-to message removed by QT >

Hi,

Can you e-mail us directly what the Makefile error is? Also, make sure to check that your site is generating XHTML pages. If not, then you need to configure Server Side Includes (SSI) properly.

Bryan

Sir
Ive gone through your annotation tool.It is an excellent project and i downloaded(received thru mail) your source code.When i am trying to
configure it on my ubuntu system ,After running the make file it is showing some error in the 1st two lines (i.e, near Images and Annotations).Now if i run tool.html my screen is hanging up @ loading image......No image is being displayed .Please assist me in solving the problem asap!! its a kinda urgent!!!

Thanq!!

Thanks for the suggestion. CVS will be the best thing to do. We will try to set this up (maybe after the CVPR deadline...)

The toolbox is being updated very often but we always try to make sure that it is backwards compatible.

Antonio


QT - Tomasz wrote:
< replied-to message removed by QT >

Hey LabelMe gurus,

I've been using LabelMe for quite some time for my research and I like to make sure I'm using the most recent version of the Labelme Toolbox at all times. Periodically re-downloading it seems kind of silly. CVS/svn would be awesome, but just putting the timestamp of the most recent version next to the link would work too.

Thanks,
Tomasz

It is said that there are 5.8 Gbytes for training.tar.gz in train in Spain and test in the rest of the world (http://people.csail.mit.edu/torralba/benchmarks/). But when I download them, this package is only 1.8 Gbytes. When I unzipt it, it fails and pops up the information "it is not complete". Could you please have a check and upload the full 5.8 Gbytes images. Thanks

Which version of MATLAB do I need to run LabelMe? I have a 6.0 and in the office a 7b. With 6.0 you cannot initialize the database:

Dlabelme=LMdatabase(HOMEANNOTATIONS);

Nfolders =

   151

1/151,
 Total images:0, annotation files:0 (with 0 empty xml files)
2/151, 05june05_static_indoor
??? Error using ==> subplot
Too many input arguments.

Error in ==> C:\MATLAB6p5\toolbox\LabelMeToolbox\LMdatabase.m (plotbar)
On line 226 ==> ha = subplot(2,1,1, 'parent', fig); cla(ha)

Error in ==> C:\MATLAB6p5\toolbox\LabelMeToolbox\LMdatabase.m
On line 194 ==> plotbar(Hfig,f,Nfolders,i,N);

these errors occur both using the data online and after having downloaded the entire database. Does someone know why is this happening?

Cheers

Just wanted to say couple of bugs happen when running LabelMe on Firefox 3.0.3.

First, when editing or deleting an annotation a point is automatically created somewhere around the top left corner.

Also, after about 10-15 minutes of use the browser seems to crash because of what appears to be a memory overload.

The number o unique labels increases every week. So, in order to know hoe many unique labels you have in your copy, you can run the next commands:
[names, counts] = LMobjectnames(D);
% where D is the index struct generated with LMdatabase.

length(names)
% this will give you the number of unique labels.



QT - James wrote:
< replied-to message removed by QT >

In order to download the annotations you should visit this page:

http://labelme.csail.mit.edu/instructions.html

The page you were using is old and we do not support that method of download anymore.

Antonio


QT - James wrote:
< replied-to message removed by QT >

Umm... also, the link to download annotations is not working!

This link...
http://people.csail.mit.edu/torralba/resea...rap_annotations.cgi
referenced on
http://people.csail.mit.edu/torralba/resea...s/instructions.html

Gives a 404 error.

Thanks

Hi,
 Are there any statistics as to how many *unique* labels are there in the labelme dataset?

The 242,xxx labels statistic counts how many objects are labeled but we are looking into how many unique labels are there.

Thanks

Thanks. I understand the problem now. The image in the boosting demo website has been scaled so that the car has a canonical scale.
Therefore, the image size has changed and you can not use the annotation file from the LabelMe website.

The original image in LabelMe, has a size of 640*480

http://labelme.csail.mit.edu/Images/boston_static_street/0021.jpg
Antonio


QT - joe wrote:
< replied-to message removed by QT >

Yes. Did you take a look at the ''boston_static_street\0021.xml' from boosting demo website?

Here are first few lines of the first object 'CarSide' from boosting demo website.
- <pt>
  <x>98</x>
  <y>108</y>
  </pt>
- <pt>
  <x>100</x>
  <y>108</y>
  </pt>
- <pt>
  <x>101</x>
  <y>101</y>

Here are first few lines of the first object 'CarSide' from urlwrite .

- <pt>
  <x>3</x>
  <y>2</y>
  </pt>
- <pt>
  <x>1</x>
  <y>281</y>
  </pt>
- <pt>
  <x>324</x>
  <y>265</y>


The points' coordinates from urlwrite exceed the image size, which is 179x239x3.

Is this the matlab command that you tried?

urlwrite('http://labelme.csail.mit.edu/Annotations/b...0021.xml','test.xml')
This seems to work for me.


Also the xml file seems to be correct:

http://labelme.csail.mit.edu/Annotations/b...tic_street/0021.xml
Can you give more information about the error you are getting?


QT - joe wrote:
< replied-to message removed by QT >

Some image annotations seem to be corrupted in the database.
For e.g., 'boston_static_street\0021.xml' downloaded from LabelMe website is different from what's downloaded from the boosting demo webpage 'http://people.csail.mit.edu/torralba/short...sting/boosting.html'.
Simple check revealed that the 'boston_static_street\0021.xml' from demo webpage is correct, while 'boston_static_street\0021.xml' from LabelMe website using urlwrite commmand is not correct.
Could anybody helo taking a look?
Thanks!

Edited by author 09-04-2008 06:58 AM
I have developed a new game for my Master's thesis called "Name It Game". It's a combination of LabelMe and Peekaboom, where you choose an object from a list of objects and you'll have to select that objects in the image. The other player has to guess what object you are revealing.

I have used a limited set of images from LabelMe as a base to test the game on quality of the selections. I use LabelMe because you have a very large set of high quality selections.

At the moment I'm looking for players for the game in order to get results for my thesis. Who can help me out?

The game is located at http://www.name-it-game.com

There are more than 11,000 persons annotated in LabelMe.
How did you created the structure Dlabelme?

Did LMinstall produced empty folders?

--Antonio

QT - emily wrote:
< replied-to message removed by QT >

Oh, I also found many folders after run LMprogressiveinstall are empty..
How to fix this?


Thanks.

I downloaded all 254 folders using LMinstall. and query about 'person'
 [Dj,j] = LMquery(Dlabelme, 'object.name', 'person');

However, it shows only 37 matches out of 815. I'm expecting much more examples of persons in the dataset. am I missing any part of the dataset, or making any mistakes?


Thanks for help.

Itis cool

Thank you very much for providing the information. We'll look into fixing this bug.

Not sure what the LabelMe email is so I will post the information here.

I am using the Firefox 3.0.1 browser.

To produce the point around (1,1) all you need to do is either change the name of an already annotated object or delete the name of an already annotated object.

Can you send me an e-mail describing the browser you were using and the exact actions you took to produce the bug? I cannot reproduce it on my side.

Thanks!
--Bryan

Just a little bug I've noticed.

When you edit the name of an image that has already been annotated, a point is created somewhere near (1,1) after you click OK.

Thank you, it worked this time.

Thank you for pointing out that the source code download page is down. We have fixed the problem, so please try again. Our apologies for this bug.

Have tried several times to submit the form to receive the source code for your LabelMe project and the form always fails to submit correctly.
Is this a temporary problem?
If so, when do you expect it to be fixed?

Will download another browser and try again.

Nope, still a 500 Internal Server Error.

We succeed installing the LabelMe code in Windows.
Here is a general guideline of what we did:

1) Downloaded the Labelme code package (the authors will send that).
2) Installed "Apache" for windows
3) Installed "Active Perl"
4) Installed Cygwin
5) Make sure that all of the above (except LabelMe) works OK first.
6) We change the config file of Apache (httpd.conf) by adding the following:
------------------------------------------------------------- ------
# Added by Juan from line 194
<Directory "C:/POSTDOC/LabelMe">
 Options FollowSymLinks SymLinksIfOwnerMatch Indexes +Includes +ExecCGI
        AllowOverride AuthConfig
 AllowOverride All
 Order allow,deny
 Allow from all
</Directory>



    # Added by Juan in line 325

Alias /LabelMe/ "C:/POSTDOC/LabelMe/"

# Added and changed by Juan (line 338)
    #ScriptAlias /cgi-bin/ "C:/Program Files/Apache Software Foundation/Apache2.2/cgi-bin/"
    ScriptAlias /cgi-bin/ "C:/POSTDOC/LabelMe/"

# Changed line 406
    AddHandler cgi-script .cgi .pl

# Added and changed in line 417
    AddType text/html .shtml
    AddHandler server-parsed .shtml
    AddOutputFilter INCLUDES .shtml


-----------------------------------------------------

7) We added the module "mod_rewrite" to the Active Perl version.
8) We changed and added to the file "Makefile" the following:
------------------------------------------------------------- ---------
#IMAGES_DIR=/afs/csail/group/vision/www/data/LabelMe/Test/Images
#ANNOTATIONS_DIR=/afs/csail/group/vision/www/data/LabelMe/Test/Annotations

IMAGES_DIR=/cygdrive/c/POSTDOC/LabelMe/Images/
ANNOTATIONS_DIR=/cygdrive/c/POSTDOC/LabelMe/Annotations/
 
---------------------------------------------------------- --------------
9) We run the command "make" on Cygwin, under the folder "LabelMe"
10) We changed all the "#! /usr/bin/.." by "#!c:/Perl/bin/perl.exe" in all the scripts under LabelMe
11) We add/changed the scipt "fetch_image.cgi". See below all the file after the changes
-------------------------------------------------------------- ------------

#!c:/Perl/bin/perl.exe

# Get STDIN:

read(STDIN,$collection,$ENV{'CONTENT_LENGTH'});

$fname = "DirLists/$collection.txt";

# Juan add:
if(!open(xFP,$fname)) {
    print "Status: 404\n\n";
    return;
}
$numlines = 0;
@lines = readline(xFP);
foreach $i (@lines) {
    $numlines = $numlines + 1;
};
close(xFP);
# end Juan add

if(!open(FP,$fname)) {
    print "Status: 404\n\n";
    return;
}

# Juan remove:
#open(NUMLINES,"wc -l $fname |");
#$numlines = <NUMLINES>;
#($numlines,$bar) = split(" DirLists",$numlines);
#close(NUMLINES);
# end Juan remove

$line = int(rand($numlines))+1;

for($i=1; $i < $line; $i++) {
    $garbage = readline(FP);
}

$fileinfo = readline(FP);
($im_dir,$im_file) = split(",",$fileinfo);
$im_file =~ tr/"\n"//d; # remove trailing newline

close(FP);

# Send back data:
print "Content-type: text/xml\n\n" ;
print "<out><dir>$im_dir</dir><file>$im_file</file></out>";

--------------------------------------------------------- -----------

12) Last things: Open your browser (we use Firefox) and enter the following url:
http://127.0.0.1/LabelMe/tool.html

Good luck!
Thanks Antonio and the rest for this great application!
Mathias Kolsch and Juan Wachs

You may browse all of the images on LabelMe here:

http://labelme.csail.mit.edu/browseLabelMe/index.html

and then select the one you wish to label.

How do I specify which image I want to annotate with your web-based version of the LabelMe Annotation Tool?

Please send me e-mail (brussell AT csail DOT mit DOT edu) to resolve this. Once we debug this, I'll post the solution on the installation instructions page.

Thank you for the code very much, though I cannot use it properly.

I enabled server side includes and perl scripts in Apache the following way (I use Ubuntu Linux):

Options +Includes +ExecCGI
AddType text/html .shtml
AddOutputFilter INCLUDES .shtml
AddHandler cgi-script .cgi .pl

The image appears in the annotation tool, but I am unable to draw polygons. In Firefox, at Tools->Page Info, "text/html" appears instead of "application/xhtml+xml".

I am sure that server side includes are enabled, because without them, the image does not appear at all.

Could you please help me?

My apologies for not sending you the code sooner. I just sent it to you. Please let us know if you have not received it.

Hello!

I would like to obtain the source code of your annotation tool for my project, and I have filled in the code registration form on 2008. feb. 19., but have not received a reply.

I submitted my data again. Please let me know if I will receive the code soon. Your help would be kindly appreciated.

Gyula Vörös

Thanks for your question and feedback.

We give general labeling guidelines here:

http://labelme.csail.mit.edu/guidelines.html

In general, we prefer that you label objects as if they were not occluded, whenever possible. When you do this, you can reliably infer the depth-ordering of the objects (c.f. one way of doing this is outlined in our IJCV paper: http://people.csail.mit.edu/brussell/resea...IM-2005-025-new.pdf).

Edited by author 01-31-2008 01:46 PM
Partialy visible object labeling

This question about labeling probably has been answered already, but you may want to post clear instruction how to draw the lines around the object if it is only partially visible (eg. chair only legs are seen, or plate or car when only quarter is seen, there is a person in front of the car, or only half of fridge is seen in the kitchen - creates triangular fridge). This creates weird geometric shapes and may may not really help you all that much. Garbage in garbage out, you know the old saying.... But other than that, keep up the great job.

Q: Should you label only what is visible even if it is partially occluded, or should you label the object as it should be seen.

Thanks! This is great work!

Yes, you may query using the Matlab toolbox:

HOMEANNOTATIONS = 'http://labelme.csail.mit.edu/Annotations';
D = LMquery(LMdatabase(HOMEANNOTATIONS), 'object.name', 'road');

The structure "D" will have the list of folders and images containing at least one car.

Hi! Is there any way we can obtain a list of images that contain an object of interest. For example, a query which gives me the list of all images on the database that contain at least one car.

Hi! Nice site!

Thanks for contributing labels and for your suggestions. In response to your suggestions:

(1) We are close to having Safari support but have not completed this yet. If you urgently need Safari support, then we encourage you to download the annotation tool source code: http://labelme.csail.mit.edu/Documentation/sourceCode.html

(2,3) Quality control in LabelMe is certainly an important issue. However, we have found that users generally provide good labels (c.f. our paper on the LabelMe database: http://people.csail.mit.edu/brussell/resea...IM-2005-025-new.pdf).

I just labeled one image. It's a nice interface. Suggestions: (1) support for Safari (Mac OS X), (2) you could also just show an image + existing contours (without labels) to the user (either created by previous users or computed via a segmentation algorithm) and ask them to either reject the contour or provide their own labels for it. (3) you could do the reverse too: show them just the image + a label (obtained from a previous user), and ask them to either state that no such object exists in the image, or contour that object... at the end, you can score the contour using an edge detector (or similar)... this way, you could perhaps improve/reject the badly drawn contours, and get rid of "maliciously" drawn objects which don't actually exist in the image.

Nevermind, I found the demoWordnet.m file.
This is great!

I can't seem to figure out how to use MatLab toolbox to be able to query the images using WordNet. Any help would be appreciated. Thanks!

The answers for your questions can be found via links from the main LabelMe page (http://labelme.csail.mit.edu). More specifically, check out the (1) tool source code and (2) search objects/scenes links for answers regarding source code and object queries.

Hey , i wanted to some details abt ur labelme..
Firstly, wich language are u ppl using ....
Secondly, How can i query
Thirdly do we have to label eac image for querying.... ??

Hello! great idea of color of this siyte!

Thank you for your interest in the LabelMe project. Yes, LabelMe is alive and well. You are more than welcome to contribute images, annotations, or code. If you want immediate correspondence, please contact us by e-mail directly as only messages can be posted to this discussion space.

I need to know if you guys are still working on Labelme or not. I had read about Label Me in some academic paper and we were working on more or less similar project in Nayang Tech in singapore [Called SYGY]. But I doubt if Label Me is still alive or the project is ended.
I checked the tool, and it works fine, but I really don't know if still people are welcomed to contribute?
And one more.
How can I find out if I have got response on this discussion page? there is no notifier , seems I have to get back sometime later.
Alireza Kashian @ Singapore

Alastair, thanks for you interest in the LabelMe project. Unfortunately we cannot post the PASCAL VOC 2007 images on LabelMe at this time.

How about putting up the PASCAL:VOC 2007 images. Are there any copyright issues? I intend to segment extra images for my entry and they might as well be publicly available.

Ok. Thank you very much for your quick response. By now im annotating images just for fun, but as soon as I get some time I plan to give that idea a deeper thought. It has to be possible, since the worst part of evaluating a segmentation is also getting the ground truth.
Thanks again.

Juan, thank you for your feedback and for reporting the bug. Yes, all of your annotations are being stored safely. There was just a small bug with the counter. We have since fixed this problem, so hopefully the counter will not decrease anymore.

As for using the dataset for segmentation evaluation, we agree that this could be an interesting way to use the dataset. We have not given this much thought and have not pursued this direction. Thanks for raising this issue!

I'm experiencing a strange behaviour. As I label objects the counter advances, but after I change the image, it is back to the original number.
Is that normal, and only due to some delay?
Are my labels being stored?
Thanks.
       Juan

Hello, in the first place I would like to say congratulations, this is a great idea. I'm working in image segmentation, and I'm concerned about the lack of quantitative results in this field. However there aren't many labeled databases, particularly for segmentation. I know the aim is slightly different than object recognition, but some tools like this one can be re-utilized. I was wondering if you ever thought about that, and if you have any ideas about this.
Thanks in advance.
Juan

Daniel, thanks for your feedback and suggestion. While the tool does not explicitly provide a mechanism for labeling depth orderings, one can achieve this by appending to the label field of an annotation "depthXX". During post-processing with the Matlab toolbox, you can then extract this information and develop functions to display the depth information.

Also, there is quite a bit one can do with the annotations already to determine depth ordering. We will soon release a Matlab function that suggests a depth ordering for the polygons in an image based on some simple heuristics. This function seems to work quite well in practice.

We agree that depth information is very important and may try to include explicit labeling instructions in a future version of LabelMe.

Again, thanks for your comments!

I suggest the possibility to specify occlusions. It could be done like in Illustrator or other programs where you can order objects back or forward stepwise. In the end there would be an ordered list and if two regions overlap and one appears before the other in the list then it occludes it.

Thanks for the reply - yes, that's the image I annotated, and the giraffes also now show up in a search on "giraffe".

Yes, there is a delay between labeling an object and when you are able to search for the object through the online search tool. However, the annotations should be recorded. You can verify this by revisiting the image that you annotated (the giraffe annotations should be there).

To make sure that everything is ok, did you label the following image?

http://labelme.csail.mit.edu/tool.html?col...811_144650_GM6A0142

Is there a delay between labelling an object and the database being updated? I labelled some giraffes yesterday but a search today on "giraffe" doesn't show the ones I labelled. I wanted to check that everything was working before I did more images, but now I'm not sure.

Edited by author 07-20-2006 05:09 PM
We just released the beta version of the labeling tool. Please try it out and let us know what you think about it! Things we've changed since the last version:

-Added a zoom feature so it's easier to annotate smaller objects
-Made the labeling tool compatible with Firefox, IE, and Safari
-Changed the way that the outlines are drawn
-Added capability of removing individual line segments
-Made the layout more intuitive