QuickTopic (SM) free message boards QuickTopic (SM) free message boards
Skip to Messages
  Sign In to access your topic list  |New Topic |My Topics|Profile
Upgrade to Pro   Customize, show pictures, add an intro, and more:   QuickTopic Pro...and check out QuickThreadSM
Topic: Friendster spider
Views: 6825, Unique: 3003 
Subscribers: 4
What's
this?
Printer-Friendly Page
Subscribe to get & post, or stop messages by email Subscribe
About these ads
Who | When
Messagessort recent-bottom   
Post a new message
 
   51
07-22-2008 11:47 AM ET (US)
Deleted by topic administrator 07-23-2008 02:09 AM
travestiaPerson was signed in when posted  50
07-21-2008 01:01 AM ET (US)
thnks my friend travesti and jigolo
   49
07-19-2008 01:44 AM ET (US)
Deleted by topic administrator 07-20-2008 02:19 AM
babysmilingPerson was signed in when posted  48
07-17-2008 09:40 PM ET (US)
Need to know before buying Lace wigs
Jully  47
07-05-2008 06:49 AM ET (US)
Planning, Deploying, and Managing Microsoft Systems Management Server 2003, also known as 70-089 exam, is an essential part of Microsoft certifications. In order to have better opportunities in IT industry, an IT Professional must take 70-089 exam. When you enter Microsoft Certifications field of study, you will be skilled at using the Microsoft Technology. Studying and taking the Microsoft 70-089 exam can be for anyone in the IT field who wants to excel in the IT Industry.
jhon  46
07-05-2008 06:48 AM ET (US)
CCNA stands over Cisco Certified Network Associate. CCNA professionals power install, configure also direct Local Area Networks or LAN, Wide Area Networks or WAN and dial approach services in that small networks. CCNA certification is the foundation and the novice level in networking. It is the only exam required to get a Cisco routing and Switching Certfication at an associate level. CCNA certification is awarded by Cisco Systems. It is for individuals who are interested in building a future in the networking domain. This certification is the prerequisite for any further Cisco certification. This certification increases the professional credibility of the candidate. It does so by the high standards of technical expertise gained by the professional. This professional is equipped to improve network performance and security.
Jennifer  45
07-03-2008 09:39 AM ET (US)
These row Paper Shredding applications are well-formed mere to use. They usually ring in with interfaces that are exorbitantly routine to navigate, along with a subscribe of instructions and how-to's for certain steps you have to take in Business Shredding files. All you virtually have to do is select the file you want to delete, choose the options for the deletion of the file, and you're all set to go. The more advanced file Mobile Shredder software applications come with different algorithms for Document Shredding.
 
Messages 44-43 deleted by topic administrator between 09-17-2008 09:11 AM and 07-07-2008 02:24 AM
kamiu  42
06-29-2008 11:27 PM ET (US)
   41
06-27-2008 12:19 PM ET (US)
Deleted by topic administrator 06-29-2008 06:34 PM
jgk  40
06-27-2008 03:02 AM ET (US)
Martin  39
06-20-2008 07:45 AM ET (US)
Now get information about Digital Camera Magazine and your Favorit Cell Phones from hyper sites. Now New Trend is to use latest Digital Cameras.
   38
06-20-2008 05:34 AM ET (US)
Deleted by topic administrator 06-25-2008 02:25 AM
Jennifer  37
06-19-2008 08:15 AM ET (US)
Gary Winnick's Dizzying Rise to Become the Richest Person in Los Angeles Started Just Three Years Ago With a Big Idea and a Relatively Small Investment. He's the $6.2 billion man - perhaps soon to be the $9 billion man. And he isn't a movie star, studio mogul or computer guru. To the average Angeleno, in fact, the name barely registers - if at all.
   36
06-13-2008 03:13 AM ET (US)
Deleted by topic administrator 06-16-2008 08:26 PM
John Doe  35
06-12-2008 09:16 AM ET (US)
244638218b27424cba6cb39352073aa8
drgf  34
06-12-2008 04:32 AM ET (US)
xiaojing  33
05-27-2008 04:52 AM ET (US)


cheapest, best service have it on
wow gold .
so many wonderful things you can enjon it not only cheapest price,best distrubition,all from
wow leveling,
warcraft power leveling
warcraft gold promptly,best service only get it from
wow power leveling
FFXI Gil
Buy FFXI Gil
FFXI Gil Sale
Cheapest FFXI Gil
Buy Cheap FFXI Gil
final Fantasy XI Gil
Cheap FFXI Gil



cheapestwow gold
best distrubition,all fromus wow gold
euro wow gold
world of warcraft gold
 Person was signed in when posted  32
05-16-2008 02:59 AM ET (US)
Deleted by topic administrator 05-16-2008 08:07 AM
CHRIS  31
04-21-2008 07:11 AM ET (US)
HEY GUYS CAN YOU KICK ME IN THE BALLS VERY HARD AND STRONG????PLEASE..........THE STRONG ONE OR GRAB IT IR PUNCH IT OR BITE IT EVRYTHING YOU WANT TO DO IN MY BALLS AND PENIS...
marilou  30
02-14-2008 10:49 PM ET (US)
hi there single.
 
Messages 29-28 deleted by topic administrator 07-23-2006 02:03 AM
add me up in friendster!!  27
06-22-2006 01:18 AM ET (US)
mrsagaycity2006@yahoo.com or vote for me in the online mr.photogenic competition in this link

www.friendster.com/haringnegros

and vote for SAGAY CITY thnx in advance
NeedtoKnow  26
04-17-2006 03:46 AM ET (US)
Hello everybody, I'm new to friendster but noticed that I'm not able to access the Who's Viewed Me link. I have my settings set so that I am not anonymous. Did they disable it in the U.S.? If so, how long ago? Thanks!
SBloom  25
06-15-2004 03:07 PM ET (US)
I found a site that I like so much that I'm helping them spread the word. Karmaloop.com is an online urban boutique with tons of different labels: triple5soul, kangol, puma, paul frank, & tons of boutique stuff you can't find outside of Broadway in NYC. You can get 10% off when using my rep code- BLOOM
fabfabulous5  24
12-29-2003 02:23 AM ET (US)
Are you a single male and not sure what to do on New Year's Eve. My friends and I always go out and have a great time and lot's of fun. On New Year's Eve we will be attending the New Year's Eve party at the San Ramon Marriott and would love to meet 5 single men. We are all professional independent women between the ages of 35 and 45.
If you are between the same ages and attending the party let me know so we can meet. The party will only be that much more exciting if we are expecting you. Whether you come by yourself or with a group of friends, we look forward to meeting you.
Please respond and tell us more about yourself and I'll tell you how to identify us at the party.
See you there.
Fabfabulous5@hotmail.com
sam2003Person was signed in when posted  23
09-25-2003 12:26 PM ET (US)
Edited by author 09-25-2003 12:26 PM
another site that is similar to friendster but is better, it comes with instant messaging feature, which is very cool. http://www.spinheart.com
B. MindfulPerson was signed in when posted  22
08-14-2003 10:55 PM ET (US)
In response to Ben Discoe (m14); I am *not* saying that anyone's sensitive personal data could be culled by a spider. The friendster folks did a nice job for the most part of drawing a solid line between presenting public and private data.

However, what they do leave sitting right out there is, in fact, a marketeers treasure tove. How much would any number of companies pay to know what is 'cool' at any given moment using near real-time metrics. If you scrape enough users favorites books, music, movies, etc. take along their sex, dating status, etc. dump all of that into a database and then query the heck out of that database, there you will find cultural metrics that companies would pay top dollar for. These metrics will be unlike any test marketing or product research analyst could determine.

The information that everyone is putting in their profiles is the same information we all hate divulging in questionaires, warranty cards, online surveys, because we know they are used to market products we don't want in a more sophisiticated manner. We know they are getting free data from us that they should be paying for. But with Friendster not being concerned about bots, one spider can gather perhaps the gratest single current data set about people's interests.

So I repeat my concern that by leaving the site open to sipder/robots the Friendster folks are compromising our uniqueness and assiting in the greater commodification of those things that are so special to us they make us feel cool and unlike any other.

B Concerned.
Eli the BeardedPerson was signed in when posted  21
08-14-2003 07:16 PM ET (US)
Peganthyrus wrote (/m20):
Unless you're a completely pathological hermit, you care about the shape of your social networks.

I guess I'm a completely pathological hermit, then.
PeganthyrusPerson was signed in when posted  20
08-14-2003 05:57 PM ET (US)
Dav replying to Ben:
2. the number of people that are really into graphing their network is smaller than you might think.

Yes I disagree. There are many more reasons to get a copy of a friendster network other than making pretty pictures.


And more people want to see those pretty pictures than you might think. I've seen an assortment of things that graph, record, and otherwise give you information on your friends network on Livejournal; almost all of these things are very immediately DoS'd into a fine paste by teeming hordes of LJers who want to see where they stand in their social network. Take a look at the 'lj_nifty' community there, where most of these tools end up being promoted. Hell, I have convenient links to several of them in my LJ userinfo page. So do a lot of people.

Unless you're a completely pathological hermit, you care about the shape of your social networks. And tools like this provide ways to see it in a more concrete form than 'I like Phil, and I like Sue, and I like John, but John really hates Sue...'
banksean  19
08-14-2003 04:40 PM ET (US)
re: fakesters: Fakester Manifesto

Dav: a combo applet of your blogosphere + my touchgraph would be neat.

I've also experimented with some derived measures of my friendster network like ranking users by the number of single people of the opposite sex in their immediate network, if they are single ("mackness").

Friendster really needs to come up with reasons to keep people around (besides dating) after they've collected all their real life friends. Something like the contact list your describe is probably the way to go. I know they've pulled a few fake accounts like "Austin Parties" that are being used for this purpose. I bet they want to add support for it formally and charge for the service in some way.
Ben Discoe  18
08-14-2003 03:43 PM ET (US)
On another (related) subject: Fakesters

I feel strongly that both the pro-fakester people and the anti-fakester people (esp. Jonathan of Friendster) are both making a big deal out of nothing. The obvious solution is to simply add a flag for fakesters. This could be either voluntary, or a review process the way it currently is, except that fakesters are flagged rather than removed. Then, each person can choose whether they want to see their Friendster network with or without fakesters in it, and everyone is happy.

Personally, i have a "fake" flag in my spider output format, though of couse it can't be gathered, but manually filled in, so that visualization can toggle those nodes on or off depending on whether you want to see the "Real" social network or not.
Ben Discoe  17
08-14-2003 03:31 PM ET (US)
> send a friendster email to every person who lists a
> bay area city as their location.

Ah. The Friendster 'Bulletin Board' feature is supposed to already provide this capability: announcements to your personal network,
although clumsy. I can see your use of the spider in this way as somewhat valid, since it works around the following failings of
Friendster:

1. They need to make the 'Bulletin Board' more powerful, so that you can specify how many hops you want to sent do, and geographically filter.
2. They need to give users control of who they want to hear from, ie. how close a user has to be, either geographically or # of hops, to be allowed to send a Friendster message. This is necessary to balance out the power of the other features, and limit the appeal of spam-like uses. The current default of "any # of hops" is clearly wide open to mis-use.
To summarize, i think that when Friendster adds the safeguards that it clearly needs, the potential misuses and the appeal of large spidering will decrease.

-Ben
Dav ColemanPerson was signed in when posted  16
08-14-2003 03:16 PM ET (US)
/m15: i feel this is not a big issue because of the anonymous nature of friendster. No real names or email addresses are exposed, so the marketing uses of the data are forced to be rather benign

OK, I didn't want to let this out but I feel like I need to make a point. My cousin is going to be producing an event this fall and I want to help her publicize it. I'm going to write a spider that will traverse my friendster network (it will actually start from a fakester account) and send a friendster email to every person who lists a bay area city as their location. I'm going to spam friendster.

This isn't a terribly clever idea, and I'm sure I'm not the only person who's thought of it.
Dav ColemanPerson was signed in when posted  15
08-14-2003 03:10 PM ET (US)
Edited by author 08-14-2003 03:19 PM
(corrected spelling mistake)

1. adding an additional pause, when it already takes 3-20 seconds to retrieve a page, seems ineffective.

Yes indeed. I put the pause in before I ever ran the spider just in case. But my point was exactly that it didn't matter, jsut as being single threaded didn't matter.

2. the number of people that are really into graphing their network is smaller than you might think.

Yes I disagree. There are many more reasons to get a copy of a friendster network other than making pretty pictures.

3. the number of friendsters that it is worthwhile to graph is not that large - after a few hundred people, people are too unrelated to be interesting, so spider won't run that long.

Again, you're thinking only of how you intended to use it for your own purposes.

4. it's not clicking on every link it sees, but moves gradually outward into the network, gently

What do you mean? I didn't say every link, I said "every linked friendster." And certainly your spider is doing that? I can see how that could be misunderstood though, so to be clear the behavior I'm talking about is traversing the friend links.

5. yes, 'encouraging' Friendster to open a net interface would be a nice side-effect of this stuff

Crossing my fingers, but not holding my breath :)
Ben Discoe  14
08-14-2003 03:06 PM ET (US)

Regarding B.Mindful's warning of "extensive data grabs can be done by any markting department", i feel this is not a big issue because of the anonymous nature of friendster. No real names or email addresses are exposed, so the marketing uses of the data are forced to be rather benign. I also fail to see what "treasure trove of personal data that most users would never make public" is on Friendster. I mean, favorite books and movies? Posting such things anonymously hardly seems like a sensitive disclosure.
Eli the BeardedPerson was signed in when posted  13
08-14-2003 03:02 PM ET (US)
Dav has a point. Does this follow the robots exclusion protocol?
(Not that www.friendster.com has a robots.txt now, but they
might someday.) How long does it wait between page hits? If
it takes 90 seconds to get a page, the site is clearly
overloaded, and a spider should wait an hour or more before
getting the next page. If the response time is speedy, one
page every minute to five minutes is my rule of thumb.
Ben Discoe  12
08-14-2003 02:59 PM ET (US)

Dav, i think we simply disagree. I believe:
1. adding an additional pause, when it already takes 3-20 seconds to retrieve a page, seems ineffective.
2. the number of people that are really into graphing their network is smaller than you might think.
3. the number of friendsters that it is worthwhile to graph is not that large - after a few hundred people, people are too unrelated to be interesting, so spider won't run that long.
4. it's not clicking on every link it sees, but moves gradually outward into the network, gently
5. yes, 'encouraging' Friendster to open a net interface would be a nice side-effect of this stuff
Dav ColemanPerson was signed in when posted  11
08-14-2003 02:48 PM ET (US)
You guys don't get it. It doesn't matter if the spider is single threaded. Mine was single threaded and it was even nice enough to pause between each request. The problem is that by releasing a spider so that anybody can just download it there could potentially be a huge net increase in traffic to the site. Especially, for that matter, something as easy to use as a windows EXE, where even a non-geek can just kick off a spider process (...well, at least they aren't coming with installers yet). Imagine if thousands of people are running these spiders to map their own networks. Sure the spider isn't doing anything other than clicking on links. But it's clicking on every linked friendster it sees, incessantly which is not normal human behavior. Seriously, how do you not see that this is going to be a giant increase in traffic (on an already overloaded set of servers)? It took me days to scrape just a small fraction of my network, by the way.

And FOAF is fine, however it doesn't address the only important issue with caching the data somewhere off of friendsters databases, which is the legal issue of using the company's data for non-approved purposes.

Maybe this is the right approach though. If all the scraping causes problems it may force Friendster to open a net interface to their data so people can build apps on top of it.
banksean  10
08-14-2003 02:16 PM ET (US)
Edited by author 08-14-2003 02:19 PM
I just posted the source to a friendster scraper if anyone's interested. It's single threaded, so it doesn't totally whack their servers. I used it to gather the data for my touchgraph-based browser. And to the p2p/friendster caching idea: why not export it to FOAF?
Ben Discoe  9
08-14-2003 05:47 AM ET (US)
I don't think that overloading Friendster's server is an issue currently, because of the slow response. 30 sec timeout wasn't long enough, i had to push it to 90! That means that the spider spends a long time waiting for each page - no worse than a real person trying to click around their network.

Now, if the spider tried to put in multiple simultaneous requests to try to go faster, then THAT would be obnoxious and inadvisable to distribute..
B. MindfulPerson was signed in when posted  8
08-13-2003 08:45 PM ET (US)
A couple months ago I started working on my own spider, but the purpose was to point out to Freindster and their users that their sandbox was still in the middle of a dangerous world. A quick series of extensive data grabs can be done by any markting department, cultural aggregator, trend research group, nefarious advertising agency to cull and sell a huge treasure trove of personal data that most users would never make public. I ran out of time to finish it up, but now almost anyone could build their own cultural aggregator and better target products to you you don't want.
Eli the BeardedPerson was signed in when posted  7
08-13-2003 06:23 PM ET (US)
The coolest thing about this was the link to the graphviz
site. I like graphing tools.
PeganthyrusPerson was signed in when posted  6
08-13-2003 04:58 PM ET (US)
Edited by author 08-13-2003 04:59 PM
This sort of thing is always fascinating! I've fooled around with similar stuff based on Livejournal's "friends" network; see here for a graph I made of my own friends network near the beginning of the year. (requires SVG)

Also, this is a pretty cool Java program for interactively graphing LJ friend networks.
Dav ColemanPerson was signed in when posted  5
08-13-2003 04:22 PM ET (US)
Whoa, I'm not so sure that was a good idea. When I wrote my friendster spider so I could graph my network I purposely didn't post the code in public (a few people got copies, including Ben iirc) because I was worried about the amount of traffic it would generate if everyone decided to crawl their network with it.

It seemed the only way to let everyone have at their own network without overloading the already beleaguered Friendster servers is to do some sort of shared p2p database away from the official site so that data already scraped by someone doesn't have to get scraped again. Of course, that gets into legal issues of using their data for a different 'service' (plus up-to-date issues for the data) so I never went forward with it.

I hope the servers hold up....
nonym  4
08-13-2003 04:18 PM ET (US)
He might have gotten away doing some casual scraping himself, but publishing the tool is asking for trouble... Friendster certainly doesn't have bandwidth to spare for this guy, so I'm pretty sure they'll take steps to block his robot.

If friendster was cool and wanted to encourage this sort of thing, they might just open their MySQL port to the public (I think K5 may do this? someone does...)
luserspaz  3
08-13-2003 04:07 PM ET (US)
Now output it in RDF using FOAF. Just think of all the fun stuff you could do with it then!
mstyne  2
08-13-2003 03:18 PM ET (US)
So this clown is why it's always so slow.
Stefan JonesPerson was signed in when posted  1
08-13-2003 03:10 PM ET (US)
Borg Collective Connectivity Diagram.
RSS link What's this?
QuickTopicSM message boards
Over 200,000 topics served
Learn more Frequently asked questions  Acknowledgements
What they're saying about QuickTopic
 Questions, comments, or suggestions? Contact Us
Read our use policy before beginning. We value your privacy; please read our privacy statement.
Copyright ©1999-2008 Internicity Inc. All rights reserved.