Skip to content

Instantly share code, notes, and snippets.

@anri-c

anri-c/file0.html

Created August 31, 2016 11:07
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save anri-c/7d23489a9400fb02270f21d1488baa07 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save anri-c/7d23489a9400fb02270f21d1488baa07 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
file0.html
# list.html
<html>
<head><title></title></head>
<body>
<a href="http://www.example.com/index.html" title="link title a">Example A</a>
<a href="http://wwww.example.org/" title="link title b" target="_blank">Example B</a>
<a href="http://www.example.net/" title="link title c">Example C</a>
</body>
</html>
Raw
file1.txt
from bs4 import BeautifulSoup
soup = BeautifulSoup(open("list.html"))
link = soup.find("a")
print(link["title"])
# link title a
print(link["href"])
# http://www.example.com/index.html
print(link.string)
# Example A
link = soup.find("a", target="_blank")
print(link.string)
# Example B
print(link["title"])
# link title b
print(link["href"])
# http://wwww.example.org/
i = [ {"title": x["title"], "url": x["href"], "content": x.string } for x in soup.find_all("a")]
print(i)
# [{'content': 'Example A', 'url': 'http://www.example.com/index.html', 'title': 'link title a'}, {'content': 'Example B', 'url': 'http://wwww.example.org/', 'title': 'link title b'}, {'content': 'Example C', 'url': 'http://www.example.net/', 'title': 'link title c'}]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment