html - How to parse code after it has been stripped of styles and elements in python -

-

this basic question regarding html parsing:

i new python(coding,computer science, etc), teaching myself parse html , have imported both pattern , beautiful soup modules parse with. found code on internet cut out formatting. 

import requests import json import urllib lxml import etree pattern import web bs4 import beautifulsoup   url = "http://webrates.truefx.com/rates/connect.html?f=html" html = urllib.urlopen(url).read() soup = beautifulsoup(html)  # kill script , style elements script in soup(["script", "style"]):     script.extract()    # rip out  # text text = soup.get_text()  # break lines , remove leading , trailing space on each lines = (line.strip() line in text.splitlines()) # break multi-headlines line each chunks = (phrase.strip() line in lines phrase in line.split("  ")) # drop blank lines text = '\n'.join(chunk chunk in chunks if chunk)   print(text)

this produces following output:

eur/usd14265522866931.056661.056751.056081.057911.05686usd/jpy1426552286419121.405121.409121.313121.448121.382gbp/usd14265522866821.482291.482361.481941.483471.48281eur/gbp14265522865290.712790.712900.712300.713460.71273usd/chf14265522866361.008041.008291.006551.008791.00682eur/jpy1426552286635128.284128.296128.203128.401128.280eur/chf14265522866551.065121.065441.063491.066281.06418usd/cad14265522864891.278211.278321.276831.278531.27746aud/usd14265522864960.762610.762690.761150.764690.76412gbp/jpy1426552286682179.957179.976179.854180.077179.988

now point how can parse further if want string 'usd/chf' or particular point of data?

is there easier method webscrape , parse with? suggestions great!

system specs: windows 7 64bit ide: idle python: 2.7.5

thank in advance, rusty

keep simple. find cell by text (usd/chf, example) , following siblings:

text = 'usd/chf' cell = soup.find('td', text=text) td in cell.next_siblings:     print td.text

prints:

1426561775912 1.00 768 1.00 782 1.00655 1.00879 1.00682

Comments

Post a Comment

Popular posts from this blog

node.js - Mongoose: Cast to ObjectId failed for value on newly created object after setting the value -

-
this question has answer here: what's mongoose error cast objectid failed value xxx @ path “_id”? 7 answers even though has been asked many times because entity has no valid objectid field. i came across situation objectid set value can casted objectid still error. the schema: var serviceschema = parammongoose.schema({ servicename:{ type: parammongoose.schema.types.objectid , ref: 'servicenames',required:true } }); pseudo code: servicefromdb=new service({servicename:'some name'}); servicefromdb.servicename='000000000000000000000001'; servicefromdb.save(function(paramerror,paramdata){ if(paramerror){ console.log('but but...',servicefromdb,paramerror) } }); the output of code is: but but... { servicename: 000000000000000000000001, _id: 55079a90286f49280364f78b } { [casterror: cast objectid faile...
Read more

[C++][SFML 2.2] Strange Performance Issues - Moving Mouse Lowers CPU Usage -

-
i've been working on making 2d map editor past 2 weeks or so, , i've run strange problem. trying optimize code, example, making functions should've been functions begin with, did made cpu usage go through roof. i've tried commenting out different sections of code thought culprits (scrolling, rendering, other calculations) no avail. think issue might trying call things within different functions, sake of making modular possible, i'd functionality. the other major change i've made since file i'm comparing i've ported variables external cpp file, since having variables global makes lot easier use within different functions. simple issue, can't life of me understand why happens. with original code, around 2-3% cpu usage. new code, around 20-35%, but, if move mouse around, it'll drop around 6-8%. tl;dr: after trying optimize code using functions, i've somehow killed performance, , found strange quirk moving mouse reduces cpu usage.. /...
Read more

ios - Possible to get UIButton sizeThatFits to work? -

-
i have been using method of resizing uibuttons depreciated, , not robust. , other reasons, want sizethatfits work uibuttons. i've read online, i'm not sure if should work (seems working some, not others, difference maybe between style, i'm using custom). here simple test code recreate issue (i put in viewdidload test, shouldn't matter, , real code part of large project): uibutton *btn = [uibutton buttonwithtype:uibuttontypecustom]; [btn settitle:@"this test long title need word wrap more single line when displayed on tiny ipod in portrait view." forstate:uicontrolstatenormal]; btn.titlelabel.linebreakmode = uilinebreakmodewordwrap; // depreciated - nothing replace it? cgrect r = btn.frame; r.origin.x = 0; r.origin.y = 0; r.size.width = 320; r.size.height = [btn.titlelabel.text sizewithfont:btn.titlelabel.font constrainedtosize:cgsizemake(r.size.width,100000) linebreakmode:btn.titlelabel.linebreakmode].height; // returns approx 86 , changes correctly ...
Read more