提取跨度标签内的信息

时间:2019-04-10 20:22:55

标签: python python-3.x selenium-webdriver web-scraping beautifulsoup

我正在尝试在“ span”标签之间提取PMC ID。

为此,我使用了xpath的find元素,但遇到了以下错误:

selenium.common.exceptions.NoSuchElementException:Message: Unable to locate element: /div/main/div/details/div/div[2]/details/summary/span[5]

以下是链接:

https://www.ncbi.nlm.nih.gov/pmc/utils/idconv/v1.0/?tool=my_tool&email=my_email@example.com&ids=9811893

以下是我的代码:

driver = webdriver.Firefox(executable_path='geckodriver.exe')
driver.implicitly_wait(10)  # this lets webdriver wait 10 seconds for the website to load
driver.get("https://www.ncbi.nlm.nih.gov/pmc/utils/idconv/v1.0/?tool=my_tool&email=my_email@example.com&ids=9811893")
pmc= driver.find_element_by_xpath('/div/main/div/details/div/div[2]/details/summary/span[5]')
pmc.get_text()

输出应为:

PMC24938

1 个答案:

答案 0 :(得分:1)

您可以使用css属性选择器,然后使用get_attribute获取属性值

from selenium import webdriver
driver = webdriver.Firefox(executable_path='geckodriver.exe')
driver.get("https://www.ncbi.nlm.nih.gov/pmc/utils/idconv/v1.0/?tool=my_tool&email=my_email@example.com&ids=9811893")
pmc = driver.find_element_by_css_selector('[pmcid]')
print(pmc.get_attribute('pmcid'))

结果:

enter image description here


尽管您不需要selenium来访问此站点。使用更快的requestsbs4

import requests
from bs4 import BeautifulSoup as bs
r = requests.get('https://www.ncbi.nlm.nih.gov/pmc/utils/idconv/v1.0/?tool=my_tool&email=my_email@example.com&ids=9811893')
soup = bs(r.content, 'lxml')
pmc = soup.select_one('[pmcid]')['pmcid']
print(pmc)