I want to scrape text from webpages and put it in to pandas dataframe. If I can scrape a table I get no problem but this here is no table and make me much trouble.
driver = webdriver.Firefox()
driver.get('https://example.com/')
time.sleep(3)
number = driver.find_elements_by_xpath("//span[@class='blaaal']")
name = driver.find_elements_by_xpath("//span[@class='blaaal2']")
for count in number:
print(count.text)
for names in name:
print(names.text)
df = pd.DataFrame(columns=['name','number'])
In that way I can print the data but if I use the count names definition without for in loop in dataframe I get error list object got no text or something like that.
I don't know how to put it to dataframe I think I have to append to define the for in loop as a column right? I don't find any post here on stack or any other learn tutorials on google.
Read more here: https://stackoverflow.com/questions/66266170/save-scraped-list-object-text-as-column-to-pandas-dataframe
Content Attribution
This content was originally published by paterson not_Gates at Recent Questions - Stack Overflow, and is syndicated here via their RSS feed. You can read the original post over there.