Home | Resume | All Posts | Last updated: 12 August 2003 08:42:32 PM CDT

FOAF
Search this site:
banksean
"My modesty is unparalleled."
-Kris
August 2003
SM TW TF S
          1 2
3 4 5 6 7 8 9
10 11 12 13 14 15 16
17 18 19 20 21 22 23
24 25 26 27 28 29 30
31            
July  





Weblog Commenting by HaloScan.com
Tuesday, August 12, 2003
Friendster Scraper Source Code
A big ol' can o' worms for ya.

Requirements: Visual Stuido .NET, SQL server 2000 and knowledge of how to get your friendster user id (which is different from your email address). .NET development skillz are a must, as this is not intended to be user-friendly.

After you've run the create_database.sql script, edit app.config to have the sqlConnection1 point at it. Run the app, enter your email, id, and password. Hit the 'Scrape' button and let her rip. Well maybe that's an overstatement. It's single-threaded, so you should probably just start it before you go to bed or something else time-consuming that doesn't require the use of your computer.

After it stops running, you should have a populated database. You can then hit the "Generate XML" button and the textbox should fill up with touchgraph-ready xml (minus the dtd info and the footer). You can also run the "Mackness Report" which generates an html table ranking users by 'mackness'. If you really want to know what that means, look at the sql query that generates it.

No implied or expressed warranties, use at your own risk, all rights reversed blah blah blah. I am not repsonsible for what you do with it. Please let me know if try it out though. I'm in the process of moving it all over to java, and I don't plan to maintain the .NET version. Dan Brickley (of FOAF, RDF, Semantic Web fame) suggested I post it anyways in case others would make use of it. Enjoy.