> For the complete documentation index, see [llms.txt](https://daijro.gitbook.io/hrequests/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://daijro.gitbook.io/hrequests/html-parsing.md). # HTML Parsing HTML scraping is based off [selectolax](https://github.com/rushter/selectolax), which is **over 25x faster** than bs4. This functionality is inspired by [requests-html](https://github.com/psf/requests-html). | Library | Time (1e5 trials) | | -------------- | ----------------- | | BeautifulSoup4 | 52.6 | | PyQuery | 7.5 | | selectolax | 1.9 | The HTML parser can be accessed through the `html` attribute of the response object: ```py >>> resp = session.get('https://python.org/') >>> resp.html ``` ## Parsing page Grab a list of all links on the page, as-is (anchors excluded): ```py >>> resp.html.links {'//docs.python.org/3/tutorial/', '/about/apps/', 'https://github.com/python/pythondotorg/issues', '/accounts/login/', '/dev/peps/', '/about/legal/',... ``` Grab a list of all links on the page, in absolute form (anchors excluded): ```py >>> resp.html.absolute_links {'https://github.com/python/pythondotorg/issues', 'https://docs.python.org/3/tutorial/', 'https://www.python.org/about/success/', 'http://feedproxy.g... ``` Search for text on the page: ```py >>> resp.html.search('Python is a {} language')[0] programming ``` ## Selecting elements Select an element using a CSS Selector: ```py >>> about = resp.html.find('#about') ```
Parameters ``` Given a CSS Selector, returns a list of :class:`Element ` objects or a single one. Parameters: selector: CSS Selector to use. clean: Whether or not to sanitize the found HTML of ``