I haven’t had enough time to work up a proper hack for this, but I though I would pass along an interesting discovery that I made the other day before heading out to PyCon. After hearing about how great BeautifulSoup is at scraping HTML and making it easy to get little bits from it that you need, I thought I’d have a go at running it on my taco. You know what? It worked. I was expecting it to barf on import, but no, it chugged along just fine.
Now unfortunately BeautifulSoup won’t work out of the box with the standard .SIS install of Python for Series 60. It relies only on SGMLParser, string, and types, but those three libraries have some dependencies themselves. Here is what BeautifulSoup requires according to modulefinder.py running on my Debian box:
- array
- copy_reg
- markupbase
- re
- sgmllib
- sre
- sre_compile
- sre_constraints
- sre_parse
- string
- strop
- sys
- types
These dependencies can be easily taken care of by dropping the python modules from the source distro in the appropriate libs directory on the drive you installed Python on.
One reason that BeautfulSoup “just works” on Series 60 is that the author strives to keep imports to a minimum and that the author srives to keep BeautifulSoup backwards compatible all the way back to Python 1.5.2. There are probably many modules out there like BeautifulSoup that are designed to be backwards compatible and platform independent that should work just fine on Series 60. As I find them, I will definitely point them out. I also hope to do some hacking on a few screen scraping apps that use BeautifulSoup and appuifw to present web data using native widgets.
Comments
65 responses to “Mobile Screen Scraping with BeautifulSoup and Python for Series 60”
Yeah, BeautifulSoup is… well, beautiful.
I tried it awhile back – check out my blog post and wrote an app that does up-to-the-minute currency conversion (or at least as frequently as x-rates.com updates it).
Damn, if I had timed it, I could’ve posted about that as well. As far as I recall, I spent a little less than three hours (that includes setting up BeautifulSoup to work on S60 and googling for how to parse HTML tables with it).
I’m thinking of doing some series 60 hacking; Will any Nokia series 60 do the trick? Can Series 90 phones run Python?
cfdghsdfhsdhgsdh
I have started using Python in my S60 phones few days ago. I have written a mobile screen scraping app using urllib and regular expressions.
aaa hotel discounts
…
aaa hotel discounts
…
I’ve meant to write something like this on one of my blogs and you gave me an idea. TY.
Took me time to read all the comments, but I truly enjoyed the article. It proved to be Very helpful to me and I am certain to all the commenters here It’s always great when you can not only be informed, but also entertained I’m sure you had fun writing this write-up.
Youre so right. Im there with you. Your blog is definitely worth a read if anyone comes throughout it. Im lucky I did because now Ive got a whole new view of this. I didnt realise that this issue was so important and so universal. You undoubtedly put it in perspective for me.
Dude, please tell me that youre heading to write more. I notice you havent written another blog for a while (Im just catching up myself). Your blog is just as well important to be missed. Youve acquired so very much to say, such knowledge about this topic it would be a shame to see this blog disappear. The internet needs you, man!
I believed it was going to be some dull aged post, however it definitely compensated for my time. I will submit a hyperlink to this page on my weblog. I’m positive my website visitors will come across that pretty useful.
Thanks a ton for this post. I totally loved going through it and will share it with people I know.
For card not present transactions exactly where the card is not shown (e.g., e-commerce, mail order, and phone sales), retailers in addition confirm that the customer is in bodily possession of the card and is the authorised consumer by asking for additional info these kinds of as the security code printed on the back again of the card, date of expiry, and billing tackle.Amex credit cards
Nice post. I study something more challenging on completely different blogs everyday. It will at all times be stimulating to read content from different writers and apply somewhat something from their store. I?d choose to make use of some with the content on my weblog whether you don?t mind. Natually I?ll provide you with a hyperlink in your internet blog. Thanks for sharing.
Let’s talk, to me is what to tell.
Some truly excellent blog posts on this internet site,thankyou for contribution.
XPNekH
🙂
It had been a while since I visited website with such high quality information. Thansk so much for the useful data
Great blog you have here, hope you won’t mind if I retweet your blog posts to my twitter’s account.
My husband and I started doing this a few years ago. It was a leap of faith for me because I found it to be humbling to admit on paper (or in our case a bulletin board) my big dreams..what if they dont come true? (Weve had friends and family happen to see it when they are in our bedroom.) I continue to believe in this as a powerful exercise in faith. We have seen so many of our dreams accomplished and have traded many pictures and words that have happened for new dreams and visions. Our dream board is one of the first things I see before I fall asleep and the first thing I see in the morning. In the center of the board we have a picture of Jesus. Weve also found that creating custom desktop wallpaper with words and images is also a good tool.Have fun with it!
Hey I was just looking at your site in IE 8 and the graphic at the top of the link doesnt show up right. Just thought I would let you know.
Please message me with any tips about how you made this site look like this, I would appreciate it!
Dzieki za info.
Hello! Bookmarked it to my PC^^ Sweet post.
Greetings from Idaho! I’m bored to tears at work so I decided to browse your website on my iphone during lunch break. I really like the knowledge you present here and can’t wait to take a look when I get home. I’m shocked at how fast your blog loaded on my cell phone .. I’m not even using WIFI, just 3G .. Anyhow, good blog!
very interesting information! .
actually liked the article you published actually. it just is not that easy to find great text toactually read (you know.. really READ and not just browsing through it like some zombie before going to yet another post to just ignore), so cheers man for really not wasting any of my time! 🙂
I like the way you present the post. Very clear and useful for a newbie like me. Absolutely great post with valuable tips. I enjoyed reading your blogs. Thanks for sharing such points. I am impressed!! 😉
Thanks for each of your hard work on this blog. My mother takes pleasure in managing internet research and it’s obvious why. My partner and i learn all of the powerful manner you create rewarding tactics on this website and therefore cause participation from website visitors on the situation then our favorite daughter has always been being taught so much. Enjoy the rest of the year. You’re the one conducting a tremendous job.
Thank you for all of the effort on this web site. My mom take interest in working on investigations and it is simple to grasp why. Many of us notice all relating to the compelling means you render simple steps via this blog and in addition invigorate contribution from other ones on the concept then our own simple princess is always starting to learn a great deal. Have fun with the remaining portion of the new year. You are always doing a very good job.
I like the way you present the post. Very clear and useful for a newbie like me. Absolutely great post with valuable tips. I enjoyed reading your blogs. Thanks for sharing such points. I am impressed!! 😉
There are some attention-grabbing time limits on this article however I don’t know if I see all of them heart to heart. There’s some validity but I’ll take hold opinion till I look into it further. Good article , thanks and we want extra! Added to FeedBurner as properly.
hdeiduhqpke qeihi zvef.
Thank you for the auspicious writeup. It in fact was a amusement account it. Look advanced to more added agreeable from you! However, how can we communicate?
Took me time to read all the comments, but I really enjoyed the article. It proved to be Very helpful to me and I am sure to all the commenters here! It’s always nice when you can not only be informed, but also entertained!
Thanks nice post..
I enjoy you because of all of the effort on this web site. Ellie enjoys working on research and it’s really obvious why. My spouse and i know all relating to the compelling method you provide very helpful guides on your web blog and therefore improve response from some others on that subject plus our favorite simple princess is undoubtedly discovering so much. Take advantage of the remaining portion of the new year. You’re performing a really good job.
continue with the the good work on the site. I appreciate it. Could use some more frequent updates, but i’m quite sure that you have got more or better things to do like we all do. =p
Can I quote you on my website if I link back to your blog?
Hey, I searched for this blog on Bing and just wanted to say thanks for the excellent read. I would have to agree with it, thank you again!
continue with the the good work on the blog. I like it. Could use some more frequent updates, but i am sure you got some more or better things to do , hehe. =)
Hello there, You have done a great job. I will certainly digg it and personally suggest to my friends. I am confident they’ll be benefited from this web site.
I do not even know how I ended up here, but I thought this post was great. I don’t know who you are but definitely you are going to a famous blogger if you aren’t already 😉 Cheers!
I received 1 st business loans when I was very young and that aided me a lot. However, I require the sba loan as well.
I happen to be commenting to make you understand of the outstanding discovery my friend’s princess encountered using your web page. She picked up plenty of things, which include what it’s like to have a very effective giving nature to make most people completely gain knowledge of several grueling topics. You truly surpassed my expectations. Thank you for giving the helpful, trustworthy, explanatory and cool tips on that topic to Gloria.
tory burch shoe sale …
Tory Burch flip flop online sale.For the younger working expat women,look at these tory burch Shoes.these tory burch flip flops are definitely fun,yet the glossy design and round-toe stay these lovely.These tory burch shoes with multiple.New arrivel To…
I enjoy you because of all of the work on this web page. My daughter take interest in doing investigations and it is simple to grasp why. We all learn all about the powerful mode you create good secrets via the web blog and even boost response from the others on this situation so my simple princess is really being taught so much. Take advantage of the rest of the year. You are doing a wonderful job.
I found your weblog site on google and verify just a few of your early posts. Continue to keep up the very good operate. I just further up your RSS feed to my MSN News Reader. Seeking ahead to reading extra from you in a while!…
Good post admin. 🙂 Thanks 🙂
I am pleased that I discovered this web site, exactly the right info that I was looking for! .