如何使用BeautifulSoup使用机械化对象的当前URL进行解析?

时间:2019-02-08 07:00:40

标签: python beautifulsoup mechanize

我想使用机械化库登录网站,然后单击几个按钮以访问要使用BeautifulSoup解析的某个网页。

我已经在Stack Overflow上找到了几个答案,我可以使用机械化库登录并单击按钮以到达所需的页面,但是我无法使用BeautifulSoup解析该链接。这是我的代码:

import mechanize
from bs4 import BeautifulSoup
import requests

br = mechanize.Browser()
br.set_handle_robots(False)
br.open(login page link)  # Url that contains signin form
br.select_form(nr=0)
br['username'] = "username" 
br['password'] = 'password'
result = br.submit().read()
for link in br.links():
    if "link1" in link.url:  
        to_follow = link
        break

br.follow_link(to_follow)
for link in br.links():
     if 'link2' in link.url: 
        to_follow = link
        break

br.follow_link(to_follow)
str = str(br.geturl())
page = requests.get(str)
soup = BeautifulSoup(page.text, 'html.parser')
elements_list = soup.find(id_='content')
elements_list_items = elements_list.find_all('a')
for i in elements_list_items:
    print(i)

我收到以下错误代码

  

回溯(最近通话最近):     文件“ C:/Users/user/PycharmProjects/test1/login.py”,第37行,在       对于我在elements_list_items中:   TypeError:“ NoneType”对象不可迭代

0 个答案:

没有答案
相关问题