Comments for Matt Croydon::Postneo

Comment on Parsing CSV data in Scala with opencsv by Matt Croydon

Matt Croydon — Thu, 28 Jul 2011 15:59:37 +0000

Mark, Yeah that would definitely work in this case, but I'm used to working with much dirtier CSV data than the example above. Once you get in to different quote characters and/or different delimiters a simple split and readlines tends to fall down. My baseline for a good experience dealing with CSV data is the Python csv module, which gets a lot of this (and some harder stuff) right.

Comment on Parsing CSV data in Scala with opencsv by Mark

Mark — Thu, 28 Jul 2011 13:55:35 +0000

Why not just use the split function with readlines?

Comment on Social Graph Analysis using Elastic MapReduce and PyPy by Matt Croydon

Matt Croydon — Thu, 05 May 2011 18:07:14 +0000

Daniel,

The tweets themselves aren’t available, but the social graph itself in the Data section is. Here’s the link: http://an.kaist.ac.kr/traces/WWW2010.html

Most researchers seem to collect their own data with the Twitter Streaming API (http://dev.twitter.com/pages/streaming_api). There are some commercial sources as well such as Gnip (http://gnip.com/) and DataSift (http://datasift.net/).

Comment on Social Graph Analysis using Elastic MapReduce and PyPy by Carl Friedrich Bolz

Carl Friedrich Bolz — Thu, 05 May 2011 14:07:16 +0000

Very nice. However, aren’t these tasks mostly IO-bound anyway? I guess that’s why PyPy only gives this small speedup

Comment on Social Graph Analysis using Elastic MapReduce and PyPy by Daniel

Daniel — Thu, 05 May 2011 05:54:39 +0000

Interesting article, I went to grab the dataset out of curiosity but it would seem Twitter have changed their Terms of Service and such data is no longer allowed to be distributed

Comment on Social Graph Analysis using Elastic MapReduce and PyPy by Matt Croydon::Postneo » Blog Archive » Social Graph Analysis using Elastic MapReduce and PyPy | yahoo

Thu, 05 May 2011 00:20:37 +0000

[...] Delicious popular This entry was posted in yahoo rss and tagged yahoo. Bookmark the permalink. ← 10 [...]

Comment on Social Graph Analysis using Elastic MapReduce and PyPy by Micah Silverman

Micah Silverman — Wed, 04 May 2011 15:48:57 +0000

To be clear, The S3 transfer charges are to get your data initially onto S3. There are no transfer charges between nodes on the cluster.

Comment on Social Graph Analysis using Elastic MapReduce and PyPy by Adam

Adam — Wed, 04 May 2011 14:26:56 +0000

I would love to see a cost comparison for this approach vs. using your own Hadoop and HDFS on Cluster Compute instances as the size of the job grows. Is there a point at which Elastic Map Reduce is less cost effective?

Comment on Literate Diffing by Me

Me — Tue, 03 May 2011 10:15:00 +0000

/\#/ this means “have #” not “starts with #” so it’ll break diff of bash comments etc…

Comment on Literate Diffing by Eric Moritz

Eric Moritz — Sun, 01 May 2011 22:30:39 +0000

Can’t you just add a comment in your code so it’ll show up as a new line in the diff?

Comment on Getting to know Scala by Manish L

Manish L — Wed, 02 Mar 2011 07:14:25 +0000

Good journey towards the Scala summit! There is this excellent framework named “Lift” built ground-up by David Pollack based completely on Scala! I am exploring it currently!

Comment on Getting to know Scala by Matt Croydon

Matt Croydon — Tue, 01 Mar 2011 06:23:39 +0000

Byron,

Nice catch! I managed to miss a double quote on an a tag. Fixed.

Comment on Getting to know Scala by Byron

Byron — Tue, 01 Mar 2011 05:57:47 +0000

Good writeup, but did you lose a line of text in your fourth to last paragraph, between ‘I quickly installed it…’ and ‘…and Scala syntax primer quite often)’?

Comment on Getting to know Scala by Matt Croydon

Matt Croydon — Mon, 28 Feb 2011 15:54:32 +0000

Gustavo: Definitely. I’ve read a little about Akka and it’s on my list of things to check out in depth.

Comment on Getting to know Scala by Gustavo Hexsel

Gustavo Hexsel — Mon, 28 Feb 2011 15:30:41 +0000

Try out Akka, it’s an Actor library that is very scala-idiomatic, high performance (much more than Scala actors), and scalable.

Comment on WordPress Trackback Validator Plugin by sathouse

sathouse — Tue, 22 Feb 2011 22:59:48 +0000

???????????!

Comment on Clickable Bylines by Mary Miller

Mary Miller — Tue, 22 Feb 2011 22:33:22 +0000

The moment I saw your site was like wow. We appreciate you putting your energy in publishing this web site.

Comment on Net10: Tracfone\’s New Pseudo-MVNO by boilingCharles-313

boilingCharles-313 — Tue, 22 Feb 2011 22:11:36 +0000

Enter comment here.

Comment on Bochs on the PSP by Ruth Stivers

Ruth Stivers — Tue, 22 Feb 2011 21:55:03 +0000

I am Im investing much more of my time online then everything else, oh well just thought I’d pop in and say hi.

Comment on Nokia 770 Gains FCC Approval by Anthony Ingram

Anthony Ingram — Tue, 22 Feb 2011 21:41:30 +0000

Hello there, Im following blog from the long time now and read all the posts continual when I discovered it first timevery nice read!! Thank you!Cu