r - Why 'Error: length(url) == 1 is not TRUE' with rvest web scraping -

-

i'm trying scrap web data first step requires login. i've been able log other websites weird error website.

library("rvest") library("magrittr")      research <- html_session("https://www.fitchratings.com/")  signin <- research %>%   html_nodes("form") %>%   extract2(1) %>%   html_form() %>%   set_values (     'username' = "abc",     'password' = "1234"      )  research <- research %>%   submit_form(signin)

when run 'submit_form' line following error:

> research <- research %>% + submit_form(signin) submitting '<unnamed>' error: length(url) == 1 not true

submitting unnamed correct b/c there no name assigned sign in button. appreciated!

i having same issue. jumped through few hoops dev version of rvest running, , it's working smoothly now. here's how went it:

first thing first. need install rtools. make sure r closed out. can found here: https://cran.r-project.org/bin/windows/rtools/. , information installation of rtools can found here (if you're using windows): github.com/stan-dev/rstan/wiki/install-rtools-for-windows

boot r, install libraries "httr" , "rcpp" if don't have them already.

install "devtools" , correlated github installer. information can found here, i'll give quick summary linked repo.

windows:

install.packages("devtools") library(devtools) build_github_devtools()  #### restart r before continuing #### install.packages("devtools.zip", repos = null, type = "source")  # remove package after installation unlink("devtools.zip")

mac/linux:

devtools::install_github("hadley/devtools")

now, run final steps.

library(httr) library(rcpp) library(devtools) install_github("hadley/rvest")

you should able run submit_form(session, form) , not experience error 

submitting 'xxxx' error: length(url) == 1 not true

Comments

Post a Comment

Popular posts from this blog

node.js - Mongoose: Cast to ObjectId failed for value on newly created object after setting the value -

-
this question has answer here: what's mongoose error cast objectid failed value xxx @ path “_id”? 7 answers even though has been asked many times because entity has no valid objectid field. i came across situation objectid set value can casted objectid still error. the schema: var serviceschema = parammongoose.schema({ servicename:{ type: parammongoose.schema.types.objectid , ref: 'servicenames',required:true } }); pseudo code: servicefromdb=new service({servicename:'some name'}); servicefromdb.servicename='000000000000000000000001'; servicefromdb.save(function(paramerror,paramdata){ if(paramerror){ console.log('but but...',servicefromdb,paramerror) } }); the output of code is: but but... { servicename: 000000000000000000000001, _id: 55079a90286f49280364f78b } { [casterror: cast objectid faile...
Read more

gradle error "Cannot convert the provided notation to a File or URI" -

-
i have defined 2 system properties in gradle.properties: systemprop.builddir=build systemprop.cfgdir=build\\cfg and have following task defined in build.gradle: task clean(group:'clean',description:'clean project') << { ant.sequential { delete(dir: system.properties.builddir) mkdir(dir: system.properties.builddir) delete(dir: system.properties.cfgdir) mkdir(dir: system.properties.cfgdir) } } this generates following error: execution failed task ':clean'. > cannot convert provided notation file or uri: {dir=build}. following types/formats supported: - string or charsequence path, e.g 'src/main/java' or '/usr/include' - string or charsequence uri, e.g 'file:/usr/include' - file instance. - uri or url instance. but equivalent block of code not generate error , works expected: task clean(group:'clean',description:'clean project') << { ...
Read more

python - NameError: name 'subprocess' is not defined -

-
i'm trying make rng website: http://jamesdotcom.com/?p=417 . when run following code: captureimage = subprocess.popen( [ "fswebcam", "-r", "356x292", "-d", "/dev/video0", "static.jpg", "--skip", "10" ], stdout=devnull, stderr=devnull) captureimage.communicate() i following error message: nameerror: name 'subprocess' not defined what should do? thanks have imported first? import subprocess captureimage = subprocess.popen(["fswebcam", ...) subprocess included in python standard library since python 2.4. should not necessary install it.
Read more