How to get the HTML source code? Thanks about pychromedevtools HOT 4 OPEN

TimeAshore commented on July 22, 2024

How to get the HTML source code? Thanks

from pychromedevtools.

Comments (4)

TimeAshore commented on July 22, 2024 2

Example:

import PyChromeDevTools

chrome = PyChromeDevTools.ChromeInterface()
chrome.Network.enable()
chrome.Page.enable()

chrome.Page.navigate(url="http://www.jianshu.com")
event, messages = chrome.wait_event("Page.frameStoppedLoading", timeout=60)
value = chrome.wait_event("Network.responseReceived", timeout=60)
print(value)

reqid = value[0]['params']['requestId']
print("reqid: ", reqid)
print(chrome.Network.getResponseBody(reqid))

But tip no parameters：

({'method': 'Network.responseReceived', 'params': {'requestId': '1000029019.143', 'loaderId': ......
reqid: 1000029019.143
Traceback (most recent call last):
  File "/home/ldy/workspace/chromedevtols/demo.py", line 14, in <module>
    print(chrome.Network.getResponseBody(reqid))
TypeError: generic_function() takes 0 positional arguments but 1 was given

And when I use chrome. DOM. GetDocument (the depth = 1), HTML is divided, and how to get the original HTML? like this:

<html>
  <head>
  ...
  </head>
  <body>
  ...
  </body>
</html>

Thanks!

from pychromedevtools.

marty90 commented on July 22, 2024 2

Network.getResponseBody(reqid) is wrong. reqid must not be passed as positional argument but as requestId.
E.g.

Network.getResponseBody(requestId=reqid)

from pychromedevtools.

marty90 commented on July 22, 2024 1

This is not related to this tool. You should see the documentation of the Chrome DevTools Protocol.
However, you could get the body of a HTTP response using: Network.getResponseBody. You must specify the RequestId to this function. To get a RequestId, use: Network.responseReceived.

Another way is to get the DOM of the page, which is the HTML loaded by the browser, eventually modified by scripts: see the DOM page. Use for example: