Geolocation Information Gaps


Posted

in

,

I’ve been seeking out interesting data sources to plot in Google Earth after learning the basics of KML. I’ve been wanting to do something cool with NOAA’s XML weather feeds since I heard about them, so I thought I would download the 700kb list of stations serving up XML and spit out some KML from that data as a “neat” first step.

I’ll probably still do that, but after parsing the data, I’m a bit dissapointed. As always there are huge gaps in geolocation information. In order to get my hands on the data I turned to xmltramp which is an awesome library for accessing simple XML documents in a pythonic way. I then whipped up a few lines of Python to walk through the data:

import xmltramp # http://www.aaronsw.com/2002/xmltramp/

f=open('stations.xml', 'r')
doc=xmltramp.parse(f.read())
count = 0
total = 0
for station in doc['station':]:
  total = total + 1
  sid = str(station['station_id'])
  lat = str(station['latitude'])
  lon = str(station['longitude'])
  if (lat != 'NA') and (lon != 'NA'):
    print "Station ID: " + sid + \
    " (" + lat + "," + lon + ")"
    count = count + 1
print str(count) + " out of " + str(total) + \
" stations are geolocated."

Here’s the output of the above code:

mcroydon@mobilematt:~/py/kmlist$ python kmlist.py
Station ID: PAGM (63.46N,171.44W)
[... snip ...]
Station ID: KSHR (44.46.10N,106.58.08W)
422 out of 1775 stations are geolocated.

Well that’s a bummer. 422 out of 1775, or less than 25% of all stations are geolocated. While that’s still 422 more stations than I knew about previously, it’s a far cry from a majority of weather stations across the United States.

Another thing you will notice is that some stations appear to be expressed in degrees in decimal form (63.46N) while others appear to use Degrees/Minutes/Seconds (44.46.10N).

It’s gaps like these that can make working with “found” geolocation data frustrating.

Comments

96 responses to “Geolocation Information Gaps”

  1. Sean Gillies Avatar

    Matt,

    Try http://weather.noaa.gov/tg/site.shtml. I’m not sure it has everything you need, but has a couple big text files of site locations.

  2. Matt Croydon Avatar

    Thanks Sean. I think something like this http://www.rap.ucar.edu/weather/surface/stations.txt should allow me to fill in the gaps. wc -l counts 8509 anyway, so here’s hoping.

  3. Sean Gillies Avatar

    Daryl Herzmann, a WX/GIS/MapServer guy at Iowa State, has a bunch of weather-related OGC web services: http://mesonet.agron.iastate.edu/ogc/. The CONUS NEXRAD WMS you should be able to hack directly into your Google maps.

  4. Simon Chan Avatar
    Simon Chan

    The value 63.46N is not in decimal form; it is Degrees/Minutes and without Seconds reading.

  5. Matt Croydon Avatar

    Thanks for the heads up Simon.

  6. Term Insurance…

    contumacy ventricle caters.Life Covarage [url=http://www.tucsonwildlife.org/#]Life Covarage[/url] http://www.tucsonwildlife.org/#

  7. Black Jack…

    trudged.dirtiness canvassed maximums!cauldron.frieze Black Jack [url=http://www.anblackjack.com/#]Black Jack[/url] http://www.anblackjack.com/#

  8. Home Insurance…

    Callan how Zaire tanker Home Insurance [url=http://www.homeformule1.com/#]Home Insurance[/url] http://www.homeformule1.com/#

  9. 91d75aead549…

    91d75aead549c7b8d134…

  10. Yoppi Do Avatar
    Yoppi Do

    It’s gaps like these that can make working with
    http://westblog.ru/?p=140
    “found” geolocation data frustrating.

  11. Switch Home Insurance…

    Home Insurance The easiest way to make sure it has never been in a situation where you try to switch insurance companies to discover the new company does not know what it is to ensure the houses most common reasons are insurable. Dog Breeds Home insura…

  12. Alfredo Polter Avatar

    oversize diary you’ve include

  13. Melynda Capestro Avatar

    It report details how to take care of.

  14. Salvatore Nido Avatar

    You do not want to risk your credibility in order that this has been a riches to rags story.

  15. Long Desrochers Avatar

    Like your website, I have been reading quite a lot about this recently and it is helpful to get lots of unique bits of info and points of view. Look forward to finding out more.

  16. inflatable rafts Avatar

    E. M. Forster~ We must be willing to let go of the life we have planned so as to have the life that is waiting for us.

  17. stearns inflatable canoes Avatar

    Brother: Did you put the cat out? Sister: Why, is it on fire?

  18. tekne kiralama Avatar

    very good \o/

  19. Stephane Aubin Avatar

    I really like your blog and i respect your work. I’ll be a frequent visitor. Some of my younger friends lean more towards such singers as George Strait and Garth Brooks.

  20. weight loss pills Avatar

    Unusual this publish is totaly unrelated to what I used to be looking google for, but it was once indexed on the first page. I guess your doing one thing proper if Google likes you enough to position you on the first web page of a non comparable search.

  21. Small Bathroom Renovations Avatar

    Please, keep up the awesome work and continue to post topics like this. I am really fan of your site.

  22. Andrew Warnix Avatar

    I dugg some of you post as I cogitated they were very helpful invaluable

  23. Healthmaster Avatar

    Extraordinary this publish is totaly unrelated to what I used to be looking out google for, but it was once indexed at the first page. I suppose your doing one thing right if Google likes you sufficient to put you at the first page of a non comparable search.

  24. Hip Hop Blog Avatar

    Bizarre this submit is totaly unrelated to what I was searching google for, but it used to be listed at the first page. I assume your doing one thing right if Google likes you enough to place you on the first web page of a non related search.

  25. New York Bankruptcy Lawyer Avatar

    Thank you for making the honest effort to discuss this. I feel very robust approximately it and wish to learn more. If it’s OK, as you gain more extensive knowledge, could you mind adding more articles similar to this one with more information? It might be extremely helpful and useful for me and my friends.

  26. hosting discount Avatar

    Exactly what I was looking for, regards for putting up.

  27. generic propecia Avatar

    Quite good question

  28. halo reach ranks Avatar

    I’m speechless. It is a very good weblog and very enticing too. Nice work! That’s not in reality so much coming from an newbie publisher like me, but it surely’s all I may just say after diving into your posts. Great grammar and vocabulary. Not like different blogs. You really recognise what you?re speaking about too. So much that you made me wish to discover more. Your weblog has change into a stepping stone for me, my friend.

  29. lanyards Avatar

    I think that is an interesting point, it made me assume a bit. Thanks for sparking my pondering cap. Every so often I get such a lot in a rut that I just really feel like a record.

  30. 4 aces tobacco Avatar

    Excellent issues?I might observe that as someone who truly doesn’t write on blogs a lot (in reality, this can be my first post), I don’t suppose the time period ‘lurker’ may be very becoming to a non-posting reader. It’s now not your fault in the least , but perhaps the blogosphere could get a hold of a better, non-creepy title for the 90% people that revel in reading the content .

  31. home education Avatar

    Have you noticed the news has changed its approach recently? What once seemed like a never discussed issue has become more prevelant. Its that time to chagnge our stance on this though.

  32. baseball trading pins Avatar

    I like the valuable information you be offering to your articles. I can bookmark your weblog and have my youngsters check up here generally. I am relatively sure they’re going to be informed a number of new stuff here than anybody else!

  33. english tutor Avatar

    i bookmarked this! looking for updates

  34. electronic cigarette menthol Avatar

    I think that may be a fascinating element, it made me think a bit. Thanks for sparking my considering cap. Occasionally I am getting such a lot in a rut that I simply really feel like a record.

  35. english tuition Avatar

    The one variation concerning him and Hitler is his frizzy incharge.

  36. customized dog tag Avatar

    I am speechless. This is a very good blog and really attractive too. Nice work! That’s no longer in point of fact much coming from an beginner publisher like me, but it surely’s all I may say after diving into your posts. Great grammar and vocabulary. Now not like different blogs. You in point of fact understand what you?re talking about too. So much that you simply made me want to explore more. Your blog has turn out to be a stepping stone for me, my friend.

  37. xenical Avatar

    All you need is love

  38. health benefits of acai berry Avatar

    Great concept. Another informative post. This is a very nice blog that I will definitively come back to several more times this year!

  39. webblog Avatar

    This is such a great useful resource that you will be giving and you provide it away for absolutely free. I like finding sites which comprehend the value of supplying a high quality resource for free.

  40. kitchen remodel ideas Avatar

    I definitely enjoying every little bit of it and I have you bookmarked to check out new stuff you post.

  41. NYC Movers Avatar

    City move can be and should be an easy process. With Manhattan Movers NYC it start with call to our office! No hidden costs, no surprices! Call us. We serve Manhattan, Brooklyn, Queens – all NYC. Manhattan Movers NYC, 553 Broome St, New York, NY 10013, (212)300-6628

  42. Consumer Wealth System Avatar

    This is a very intriguing post, I was looking for this knowledge. Just so you know I found your web site when I was searching for blogs like mine, so please check out my site sometime and leave me a comment to let me know what you think.

  43. mrscabies302 Avatar

    word available to be able to individuals in relation to your products or services,

  44. New Zealand QROPS Avatar

    Thanks for making the sincere effort to discuss this. I feel very robust approximately it and want to read more. If it’s OK, as you achieve more extensive wisdom, could you thoughts adding more articles very similar to this one with more information? It will be extraordinarily useful and helpful for me and my friends.

  45. lifecell skin care Avatar

    You completed certain fine points there. I did a search on the theme and found most persons will have the same opinion with your blog.

  46. wash lights Avatar

    I’m speechless. This is a superb weblog and really engaging too. Great paintings! That’s no longer actually much coming from an newbie publisher like me, but it surely’s all I may just say after diving into your posts. Great grammar and vocabulary. No longer like different blogs. You really realize what you?re talking approximately too. Such a lot that you made me want to discover more. Your weblog has turn into a stepping stone for me, my friend.

  47. lincoln radio Avatar

    I picture this could be various upon the written content material? even so I nonetheless consider that it usually is appropriate for virtually any type of matter subject matter, as a result of it could frequently be gratifying to resolve a heat and pleasant face or maybe pay attention a voice while initial landing.

  48. Natural weight loss pills Avatar

    Why there are so many comments in this blog?

  49. ladies watches Avatar

    Once you have a home theater system to see films, you must fully bundle this out by having a good surround device that offers you the greatest audio possible

  50. Frauen kennenlernen Avatar

    Looking forward to another great article. Good luck to the author! all the best!