当前位置: 首页 > news >正文

Selenium原理

我们使用Selenium实现自动化测试,主要需要3个东西

1.测试脚本,可以是python,java编写的脚本程序(也可以叫做client端)

2.浏览器驱动, 这个驱动是根据不同的浏览器开发的,不同的浏览器使用不同的webdriver驱动程序且需要对应相应的浏览器版本,比如:geckodriver.exe(chrome)

3.浏览器,目前selenium支持市面上大多数浏览器,如:火狐,谷歌,IE等

selenium脚本

先看一个简单的代码

from selenium import webdriver

dr = webdriver.Chrome() # 打开浏览器

执行上述代码,我们会发现程序打开了Chrome浏览器(前提:你已经正确配置了chrome的驱动和对应版本)

那么selenium是如何实现这个过程的呢?ok,我们今天就通过分析源码的方式来理解selenium的工作原理

源码分析

查看webdriver源码(按住Ctrl键,鼠标点击Chrome)

C:\Python36\Lib\site-packages\selenium\webdriver\chrome\webdriver.py

1 class WebDriver(RemoteWebDriver):

2 """

3 Controls the ChromeDriver and allows you to drive the browser.

4

5 You will need to download the ChromeDriver executable from

6 http://chromedriver.storage.googleapis.com/index.html

7 """

8

9 def __init__(self, executable_path="chromedriver", port=0,

10 options=None, service_args=None,

11 desired_capabilities=None, service_log_path=None,

12 chrome_options=None, keep_alive=True):

13 """

14 Creates a new instance of the chrome driver.

15

16 Starts the service and then creates new instance of chrome driver.

17

18 :Args:

19 - executable_path - path to the executable. If the default is used it assumes the executable is in the $PATH

20 - port - port you would like the service to run, if left as 0, a free port will be found.

21 - options - this takes an instance of ChromeOptions

22 - service_args - List of args to pass to the driver service

23 - desired_capabilities - Dictionary object with non-browser specific

24 capabilities only, such as "proxy" or "loggingPref".

25 - service_log_path - Where to log information from the driver.

26 - chrome_options - Deprecated argument for options

27 - keep_alive - Whether to configure ChromeRemoteConnection to use HTTP keep-alive.

28 """

29 if chrome_options:

30 warnings.warn('use options instead of chrome_options',

31 DeprecationWarning, stacklevel=2)

32 options = chrome_options

33

34 if options is None:

35 # desired_capabilities stays as passed in

36 if desired_capabilities is None:

37 desired_capabilities = self.create_options().to_capabilities()

38 else:

39 if desired_capabilities is None:

40 desired_capabilities = options.to_capabilities()

41 else:

42 desired_capabilities.update(options.to_capabilities())

43

44 self.service = Service(

45 executable_path,

46 port=port,

47 service_args=service_args,

48 log_path=service_log_path)

49 self.service.start()

50

51 try:

52 RemoteWebDriver.__init__(

53 self,

54 command_executor=ChromeRemoteConnection(

55 remote_server_addr=self.service.service_url,

56 keep_alive=keep_alive),

57 desired_capabilities=desired_capabilities)

58 except Exception:

59 self.quit()

60 raise

61 self._is_remote = False

通过源码中的44-49行发现,初始化了一个service对象,然后调用了start()方法,那么我们继续看下一49行的start()方法到底实现了什么功能?

C:\Python36\Lib\site-packages\selenium\webdriver\common\service.py

1 def start(self):

2 """

3 Starts the Service.

4

5 :Exceptions:

6 - WebDriverException : Raised either when it can't start the service

7 or when it can't connect to the service

8 """

9 try:

10 cmd = [self.path]

11 cmd.extend(self.command_line_args())

12 self.process = subprocess.Popen(cmd, env=self.env,

13 close_fds=platform.system() != 'Windows',

14 stdout=self.log_file,

15 stderr=self.log_file,

16 stdin=PIPE)

17 except TypeError:

18 raise

19 except OSError as err:

20 if err.errno == errno.ENOENT:

21 raise WebDriverException(

22 "'%s' executable needs to be in PATH. %s" % (

23 os.path.basename(self.path), self.start_error_message)

24 )

25 elif err.errno == errno.EACCES:

26 raise WebDriverException(

27 "'%s' executable may have wrong permissions. %s" % (

28 os.path.basename(self.path), self.start_error_message)

29 )

30 else:

31 raise

32 except Exception as e:

33 raise WebDriverException(

34 "The executable %s needs to be available in the path. %s\n%s" %

35 (os.path.basename(self.path), self.start_error_message, str(e)))

36 count = 0

37 while True:

38 self.assert_process_still_running()

39 if self.is_connectable():

40 break

41 count += 1

42 time.sleep(1)

43 if count == 30:

44 raise WebDriverException("Can not connect to the Service %s" % self.path)

我们发现9-16行其实就是执行了一个cmd命令,命令的作用就是启动了chromedriver.exeChrome浏览器的驱动程序

这里我们需要注意一点: 下载的浏览器驱动一定要配置到环境变量中,或者放到python的根目录下,便于程序在执行驱动的时候查找

这个过程和我们手动启动浏览器驱动是一样的效果,类似下面的结果

启动驱动程序后,绑定端口号9515,且只允许本地访问这个服务,其实我们可以查看一下我们本地电脑任务管理器,确实开启了一个服务进程程序

第一步工作我们已经知道了执行测试脚本webdriver.Chrome()会自动执行chromedriver.exe驱动程序,然后开启一个进程

如何打开浏览器

我们继续看源码 C:\Python36\Lib\site-packages\selenium\webdriver\chrome\webdriver.py 的51-57行代码,调用了父类RemoteWebDriver 的初始化方法,我们看这个方法做了什么事?

C:\Python36\Lib\site-packages\selenium\webdriver\remote\webdriver.py

1 class WebDriver(object):

2 """

3 Controls a browser by sending commands to a remote server.

4 This server is expected to be running the WebDriver wire protocol

5 as defined at

6 https://github.com/SeleniumHQ/selenium/wiki/JsonWireProtocol

7

8 :Attributes:

9 - session_id - String ID of the browser session started and controlled by this WebDriver.

10 - capabilities - Dictionaty of effective capabilities of this browser session as returned

11 by the remote server. See https://github.com/SeleniumHQ/selenium/wiki/DesiredCapabilities

12 - command_executor - remote_connection.RemoteConnection object used to execute commands.

13 - error_handler - errorhandler.ErrorHandler object used to handle errors.

14 """

15

16 _web_element_cls = WebElement

17

18 def __init__(self, command_executor='http://127.0.0.1:4444/wd/hub',

19 desired_capabilities=None, browser_profile=None, proxy=None,

20 keep_alive=False, file_detector=None, options=None):

21 """

22 Create a new driver that will issue commands using the wire protocol.

23

24 :Args:

25 - command_executor - Either a string representing URL of the remote server or a custom

26 remote_connection.RemoteConnection object. Defaults to 'http://127.0.0.1:4444/wd/hub'.

27 - desired_capabilities - A dictionary of capabilities to request when

28 starting the browser session. Required parameter.

29 - browser_profile - A selenium.webdriver.firefox.firefox_profile.FirefoxProfile object.

30 Only used if Firefox is requested. Optional.

31 - proxy - A selenium.webdriver.common.proxy.Proxy object. The browser session will

32 be started with given proxy settings, if possible. Optional.

33 - keep_alive - Whether to configure remote_connection.RemoteConnection to use

34 HTTP keep-alive. Defaults to False.

35 - file_detector - Pass custom file detector object during instantiation. If None,

36 then default LocalFileDetector() will be used.

37 - options - instance of a driver options.Options class

38 """

39 capabilities = {}

40 if options is not None:

41 capabilities = options.to_capabilities()

42 if desired_capabilities is not None:

43 if not isinstance(desired_capabilities, dict):

44 raise WebDriverException("Desired Capabilities must be a dictionary")

45 else:

46 capabilities.update(desired_capabilities)

47 if proxy is not None:

48 warnings.warn("Please use FirefoxOptions to set proxy",

49 DeprecationWarning, stacklevel=2)

50 proxy.add_to_capabilities(capabilities)

51 self.command_executor = command_executor

52 if type(self.command_executor) is bytes or isinstance(self.command_executor, str):

53 self.command_executor = RemoteConnection(command_executor, keep_alive=keep_alive)

54 self._is_remote = True

55 self.session_id = None

56 self.capabilities = {}

57 self.error_handler = ErrorHandler()

58 self.start_client()

59 if browser_profile is not None:

60 warnings.warn("Please use FirefoxOptions to set browser profile",

61 DeprecationWarning, stacklevel=2)

62 self.start_session(capabilities, browser_profile)

63 self._switch_to = SwitchTo(self)

64 self._mobile = Mobile(self)

65 self.file_detector = file_detector or LocalFileDetector()

这里有一行最重要的代码,62行self.start_session(capabilities, browser_profile) 这个方法,继续看一下这个方法的源码做了什么工作

1 def start_session(self, capabilities, browser_profile=None):

2 """

3 Creates a new session with the desired capabilities.

4

5 :Args:

6 - browser_name - The name of the browser to request.

7 - version - Which browser version to request.

8 - platform - Which platform to request the browser on.

9 - javascript_enabled - Whether the new session should support JavaScript.

10 - browser_profile - A selenium.webdriver.firefox.firefox_profile.FirefoxProfile object. Only used if Firefox is requested.

11 """

12 if not isinstance(capabilities, dict):

13 raise InvalidArgumentException("Capabilities must be a dictionary")

14 if browser_profile:

15 if "moz:firefoxOptions" in capabilities:

16 capabilities["moz:firefoxOptions"]["profile"] = browser_profile.encoded

17 else:

18 capabilities.update({'firefox_profile': browser_profile.encoded})

19 w3c_caps = _make_w3c_caps(capabilities)

20 parameters = {"capabilities": w3c_caps,

21 "desiredCapabilities": capabilities}

22 response = self.execute(Command.NEW_SESSION, parameters)

23 if 'sessionId' not in response:

24 response = response['value']

25 self.session_id = response['sessionId']

26 self.capabilities = response.get('value')

27

28 # if capabilities is none we are probably speaking to

29 # a W3C endpoint

30 if self.capabilities is None:

31 self.capabilities = response.get('capabilities')

32

33 # Double check to see if we have a W3C Compliant browser

34 self.w3c = response.get('status') is None

35 self.command_executor.w3c = self.w3c

分析这部分源码可以发现22行是向地址localhost:9515/session发送了一个post请求,参数是json格式的,然后返回特定的响应信息给程序(这里主要就是新建了一个sessionid),最终打开了浏览器

ok,打开浏览器的操作完成了

如何执行对应操作

查看C:\Python36\Lib\site-packages\selenium\webdriver\chrome\webdriver.py源码(第一个源码中的51-57行)

51 try:

52 RemoteWebDriver.__init__(

53 self,

54 command_executor=ChromeRemoteConnection(

55 remote_server_addr=self.service.service_url,

56 keep_alive=keep_alive),

57 desired_capabilities=desired_capabilities)

点击ChromeRemoteConnection查看一下源码

1 from selenium.webdriver.remote.remote_connection import RemoteConnection

2

3

4 class ChromeRemoteConnection(RemoteConnection):

5

6 def __init__(self, remote_server_addr, keep_alive=True):

7 RemoteConnection.__init__(self, remote_server_addr, keep_alive)

8 self._commands["launchApp"] = ('POST', '/session/$sessionId/chromium/launch_app')

9 self._commands["setNetworkConditions"] = ('POST', '/session/$sessionId/chromium/network_conditions')

10 self._commands["getNetworkConditions"] = ('GET', '/session/$sessionId/chromium/network_conditions')

11 self._commands['executeCdpCommand'] = ('POST', '/session/$sessionId/goog/cdp/execute')

第7行访问的是localhost:9515/session地址,第8-11行,定义了一些和我们使用的浏览器(chrome)特有的接口地址,我们再看一下父类RemoteConnection里面源码

C:\Python36\Lib\site-packages\selenium\webdriver\remote\remote_connection.py:RemoteConnection

1 self._commands = {

2 Command.STATUS: ('GET', '/status'),

3 Command.NEW_SESSION: ('POST', '/session'),

4 Command.GET_ALL_SESSIONS: ('GET', '/sessions'),

5 Command.QUIT: ('DELETE', '/session/$sessionId'),

6 Command.GET_CURRENT_WINDOW_HANDLE:

7 ('GET', '/session/$sessionId/window_handle'),

8 Command.W3C_GET_CURRENT_WINDOW_HANDLE:

9 ('GET', '/session/$sessionId/window'),

10 Command.GET_WINDOW_HANDLES:

11 ('GET', '/session/$sessionId/window_handles'),

12 Command.W3C_GET_WINDOW_HANDLES:

13 ('GET', '/session/$sessionId/window/handles'),

14 Command.GET: ('POST', '/session/$sessionId/url'),

15 Command.GO_FORWARD: ('POST', '/session/$sessionId/forward'),

16 Command.GO_BACK: ('POST', '/session/$sessionId/back'),

17 Command.REFRESH: ('POST', '/session/$sessionId/refresh'),

18 Command.EXECUTE_SCRIPT: ('POST', '/session/$sessionId/execute'),

19 Command.W3C_EXECUTE_SCRIPT:

20 ('POST', '/session/$sessionId/execute/sync'),

21 Command.W3C_EXECUTE_SCRIPT_ASYNC:

22 ('POST', '/session/$sessionId/execute/async'),

23 Command.GET_CURRENT_URL: ('GET', '/session/$sessionId/url'),

24 Command.GET_TITLE: ('GET', '/session/$sessionId/title'),

25 Command.GET_PAGE_SOURCE: ('GET', '/session/$sessionId/source'),

26 Command.SCREENSHOT: ('GET', '/session/$sessionId/screenshot'),

27 Command.ELEMENT_SCREENSHOT: ('GET', '/session/$sessionId/element/$id/screenshot'),

28 Command.FIND_ELEMENT: ('POST', '/session/$sessionId/element'),

29 Command.FIND_ELEMENTS: ('POST', '/session/$sessionId/elements'),

30 Command.W3C_GET_ACTIVE_ELEMENT: ('GET', '/session/$sessionId/element/active'),

31 Command.GET_ACTIVE_ELEMENT:

32 ('POST', '/session/$sessionId/element/active'),

33 Command.FIND_CHILD_ELEMENT:

34 ('POST', '/session/$sessionId/element/$id/element'),

35 Command.FIND_CHILD_ELEMENTS:

36 ('POST', '/session/$sessionId/element/$id/elements'),

37 Command.CLICK_ELEMENT: ('POST', '/session/$sessionId/element/$id/click'),

38 Command.CLEAR_ELEMENT: ('POST', '/session/$sessionId/element/$id/clear'),

39 Command.SUBMIT_ELEMENT: ('POST', '/session/$sessionId/element/$id/submit'),

40 Command.GET_ELEMENT_TEXT: ('GET', '/session/$sessionId/element/$id/text'),

41 Command.SEND_KEYS_TO_ELEMENT:

42 ('POST', '/session/$sessionId/element/$id/value'),

43 Command.SEND_KEYS_TO_ACTIVE_ELEMENT:

44 ('POST', '/session/$sessionId/keys'),

45 Command.UPLOAD_FILE: ('POST', "/session/$sessionId/file"),

46 Command.GET_ELEMENT_VALUE:

47 ('GET', '/session/$sessionId/element/$id/value'),

48 Command.GET_ELEMENT_TAG_NAME:

49 ('GET', '/session/$sessionId/element/$id/name'),

50 Command.IS_ELEMENT_SELECTED:

51 ('GET', '/session/$sessionId/element/$id/selected'),

52 Command.SET_ELEMENT_SELECTED:

53 ('POST', '/session/$sessionId/element/$id/selected'),

54 Command.IS_ELEMENT_ENABLED:

55 ('GET', '/session/$sessionId/element/$id/enabled'),

56 Command.IS_ELEMENT_DISPLAYED:

57 ('GET', '/session/$sessionId/element/$id/displayed'),

58 Command.GET_ELEMENT_LOCATION:

59 ('GET', '/session/$sessionId/element/$id/location'),

60 Command.GET_ELEMENT_LOCATION_ONCE_SCROLLED_INTO_VIEW:

61 ('GET', '/session/$sessionId/element/$id/location_in_view'),

62 Command.GET_ELEMENT_SIZE:

63 ('GET', '/session/$sessionId/element/$id/size'),

64 Command.GET_ELEMENT_RECT:

65 ('GET', '/session/$sessionId/element/$id/rect'),

66 Command.GET_ELEMENT_ATTRIBUTE:

67 ('GET', '/session/$sessionId/element/$id/attribute/$name'),

68 Command.GET_ELEMENT_PROPERTY:

69 ('GET', '/session/$sessionId/element/$id/property/$name'),

70 Command.GET_ALL_COOKIES: ('GET', '/session/$sessionId/cookie'),

71 Command.ADD_COOKIE: ('POST', '/session/$sessionId/cookie'),

72 Command.GET_COOKIE: ('GET', '/session/$sessionId/cookie/$name'),

73 Command.DELETE_ALL_COOKIES:

74 ('DELETE', '/session/$sessionId/cookie'),

75 Command.DELETE_COOKIE:

76 ('DELETE', '/session/$sessionId/cookie/$name'),

77 Command.SWITCH_TO_FRAME: ('POST', '/session/$sessionId/frame'),

78 Command.SWITCH_TO_PARENT_FRAME: ('POST', '/session/$sessionId/frame/parent'),

79 Command.SWITCH_TO_WINDOW: ('POST', '/session/$sessionId/window'),

80 Command.CLOSE: ('DELETE', '/session/$sessionId/window'),

81 Command.GET_ELEMENT_VALUE_OF_CSS_PROPERTY:

82 ('GET', '/session/$sessionId/element/$id/css/$propertyName'),

83 Command.IMPLICIT_WAIT:

84 ('POST', '/session/$sessionId/timeouts/implicit_wait'),

85 Command.EXECUTE_ASYNC_SCRIPT: ('POST', '/session/$sessionId/execute_async'),

86 Command.SET_SCRIPT_TIMEOUT:

87 ('POST', '/session/$sessionId/timeouts/async_script'),

88 Command.SET_TIMEOUTS:

89 ('POST', '/session/$sessionId/timeouts'),

90 Command.DISMISS_ALERT:

91 ('POST', '/session/$sessionId/dismiss_alert'),

92 Command.W3C_DISMISS_ALERT:

93 ('POST', '/session/$sessionId/alert/dismiss'),

94 Command.ACCEPT_ALERT:

95 ('POST', '/session/$sessionId/accept_alert'),

96 Command.W3C_ACCEPT_ALERT:

97 ('POST', '/session/$sessionId/alert/accept'),

98 Command.SET_ALERT_VALUE:

99 ('POST', '/session/$sessionId/alert_text'),

100 Command.W3C_SET_ALERT_VALUE:

101 ('POST', '/session/$sessionId/alert/text'),

102 Command.GET_ALERT_TEXT:

103 ('GET', '/session/$sessionId/alert_text'),

104 Command.W3C_GET_ALERT_TEXT:

105 ('GET', '/session/$sessionId/alert/text'),

106 Command.SET_ALERT_CREDENTIALS:

107 ('POST', '/session/$sessionId/alert/credentials'),

108 Command.CLICK:

109 ('POST', '/session/$sessionId/click'),

110 Command.W3C_ACTIONS:

111 ('POST', '/session/$sessionId/actions'),

112 Command.W3C_CLEAR_ACTIONS:

113 ('DELETE', '/session/$sessionId/actions'),

114 Command.DOUBLE_CLICK:

115 ('POST', '/session/$sessionId/doubleclick'),

116 Command.MOUSE_DOWN:

117 ('POST', '/session/$sessionId/buttondown'),

118 Command.MOUSE_UP:

119 ('POST', '/session/$sessionId/buttonup'),

120 Command.MOVE_TO:

121 ('POST', '/session/$sessionId/moveto'),

122 Command.GET_WINDOW_SIZE:

123 ('GET', '/session/$sessionId/window/$windowHandle/size'),

124 Command.SET_WINDOW_SIZE:

125 ('POST', '/session/$sessionId/window/$windowHandle/size'),

126 Command.GET_WINDOW_POSITION:

127 ('GET', '/session/$sessionId/window/$windowHandle/position'),

128 Command.SET_WINDOW_POSITION:

129 ('POST', '/session/$sessionId/window/$windowHandle/position'),

130 Command.SET_WINDOW_RECT:

131 ('POST', '/session/$sessionId/window/rect'),

132 Command.GET_WINDOW_RECT:

133 ('GET', '/session/$sessionId/window/rect'),

134 Command.MAXIMIZE_WINDOW:

135 ('POST', '/session/$sessionId/window/$windowHandle/maximize'),

136 Command.W3C_MAXIMIZE_WINDOW:

137 ('POST', '/session/$sessionId/window/maximize'),

138 Command.SET_SCREEN_ORIENTATION:

139 ('POST', '/session/$sessionId/orientation'),

140 Command.GET_SCREEN_ORIENTATION:

141 ('GET', '/session/$sessionId/orientation'),

142 Command.SINGLE_TAP:

143 ('POST', '/session/$sessionId/touch/click'),

144 Command.TOUCH_DOWN:

145 ('POST', '/session/$sessionId/touch/down'),

146 Command.TOUCH_UP:

147 ('POST', '/session/$sessionId/touch/up'),

148 Command.TOUCH_MOVE:

149 ('POST', '/session/$sessionId/touch/move'),

150 Command.TOUCH_SCROLL:

151 ('POST', '/session/$sessionId/touch/scroll'),

152 Command.DOUBLE_TAP:

153 ('POST', '/session/$sessionId/touch/doubleclick'),

154 Command.LONG_PRESS:

155 ('POST', '/session/$sessionId/touch/longclick'),

156 Command.FLICK:

157 ('POST', '/session/$sessionId/touch/flick'),

158 Command.EXECUTE_SQL:

159 ('POST', '/session/$sessionId/execute_sql'),

160 Command.GET_LOCATION:

161 ('GET', '/session/$sessionId/location'),

162 Command.SET_LOCATION:

163 ('POST', '/session/$sessionId/location'),

164 Command.GET_APP_CACHE:

165 ('GET', '/session/$sessionId/application_cache'),

166 Command.GET_APP_CACHE_STATUS:

167 ('GET', '/session/$sessionId/application_cache/status'),

168 Command.CLEAR_APP_CACHE:

169 ('DELETE', '/session/$sessionId/application_cache/clear'),

170 Command.GET_NETWORK_CONNECTION:

171 ('GET', '/session/$sessionId/network_connection'),

172 Command.SET_NETWORK_CONNECTION:

173 ('POST', '/session/$sessionId/network_connection'),

174 Command.GET_LOCAL_STORAGE_ITEM:

175 ('GET', '/session/$sessionId/local_storage/key/$key'),

176 Command.REMOVE_LOCAL_STORAGE_ITEM:

177 ('DELETE', '/session/$sessionId/local_storage/key/$key'),

178 Command.GET_LOCAL_STORAGE_KEYS:

179 ('GET', '/session/$sessionId/local_storage'),

180 Command.SET_LOCAL_STORAGE_ITEM:

181 ('POST', '/session/$sessionId/local_storage'),

182 Command.CLEAR_LOCAL_STORAGE:

183 ('DELETE', '/session/$sessionId/local_storage'),

184 Command.GET_LOCAL_STORAGE_SIZE:

185 ('GET', '/session/$sessionId/local_storage/size'),

186 Command.GET_SESSION_STORAGE_ITEM:

187 ('GET', '/session/$sessionId/session_storage/key/$key'),

188 Command.REMOVE_SESSION_STORAGE_ITEM:

189 ('DELETE', '/session/$sessionId/session_storage/key/$key'),

190 Command.GET_SESSION_STORAGE_KEYS:

191 ('GET', '/session/$sessionId/session_storage'),

192 Command.SET_SESSION_STORAGE_ITEM:

193 ('POST', '/session/$sessionId/session_storage'),

194 Command.CLEAR_SESSION_STORAGE:

195 ('DELETE', '/session/$sessionId/session_storage'),

196 Command.GET_SESSION_STORAGE_SIZE:

197 ('GET', '/session/$sessionId/session_storage/size'),

198 Command.GET_LOG:

199 ('POST', '/session/$sessionId/log'),

200 Command.GET_AVAILABLE_LOG_TYPES:

201 ('GET', '/session/$sessionId/log/types'),

202 Command.CURRENT_CONTEXT_HANDLE:

203 ('GET', '/session/$sessionId/context'),

204 Command.CONTEXT_HANDLES:

205 ('GET', '/session/$sessionId/contexts'),

206 Command.SWITCH_TO_CONTEXT:

207 ('POST', '/session/$sessionId/context'),

208 Command.FULLSCREEN_WINDOW:

209 ('POST', '/session/$sessionId/window/fullscreen'),

210 Command.MINIMIZE_WINDOW:

211 ('POST', '/session/$sessionId/window/minimize')

212 }

这个类里面定义了所有的selenium操作需要的接口地址(这些接口地址全部封装在浏览器驱动程序中),那么所有的浏览器操作就是通过访问这些接口来实现的

其中 Command.GET: ('POST', '/session/$sessionId/url') 这个地址就是实现访问一个网址的url ,我们先记录一下后面有用

ok,所有的操作对应接口地址我们知道了,那么又怎样执行这些接口来达到在浏览器上实现各种操作呢?继续看紧接着接口地址定义下面的源码

1 def execute(self, command, params):

2 """

3 Send a command to the remote server.

4

5 Any path subtitutions required for the URL mapped to the command should be

6 included in the command parameters.

7

8 :Args:

9 - command - A string specifying the command to execute.

10 - params - A dictionary of named parameters to send with the command as

11 its JSON payload.

12 """

13 command_info = self._commands[command]

14 assert command_info is not None, 'Unrecognised command %s' % command

15 path = string.Template(command_info[1]).substitute(params)

16 if hasattr(self, 'w3c') and self.w3c and isinstance(params, dict) and 'sessionId' in params:

17 del params['sessionId']

18 data = utils.dump_json(params)

19 url = '%s%s' % (self._url, path)

20 return self._request(command_info[0], url, body=data)

21

22 def _request(self, method, url, body=None):

23 """

24 Send an HTTP request to the remote server.

25

26 :Args:

27 - method - A string for the HTTP method to send the request with.

28 - url - A string for the URL to send the request to.

29 - body - A string for request body. Ignored unless method is POST or PUT.

30

31 :Returns:

32 A dictionary with the server's parsed JSON response.

33 """

34 LOGGER.debug('%s %s %s' % (method, url, body))

35

36 parsed_url = parse.urlparse(url)

37 headers = self.get_remote_connection_headers(parsed_url, self.keep_alive)

38 resp = None

39 if body and method != 'POST' and method != 'PUT':

40 body = None

41

42 if self.keep_alive:

43 resp = self._conn.request(method, url, body=body, headers=headers)

44

45 statuscode = resp.status

46 else:

47 http = urllib3.PoolManager(timeout=self._timeout)

48 resp = http.request(method, url, body=body, headers=headers)

49

50 statuscode = resp.status

51 if not hasattr(resp, 'getheader'):

52 if hasattr(resp.headers, 'getheader'):

53 resp.getheader = lambda x: resp.headers.getheader(x)

54 elif hasattr(resp.headers, 'get'):

55 resp.getheader = lambda x: resp.headers.get(x)

56

57 data = resp.data.decode('UTF-8')

58 try:

59 if 300 <= statuscode < 304:

60 return self._request('GET', resp.getheader('location'))

61 if 399 < statuscode <= 500:

62 return {'status': statuscode, 'value': data}

63 content_type = []

64 if resp.getheader('Content-Type') is not None:

65 content_type = resp.getheader('Content-Type').split(';')

66 if not any([x.startswith('image/png') for x in content_type]):

67

68 try:

69 data = utils.load_json(data.strip())

70 except ValueError:

71 if 199 < statuscode < 300:

72 status = ErrorCode.SUCCESS

73 else:

74 status = ErrorCode.UNKNOWN_ERROR

75 return {'status': status, 'value': data.strip()}

76

77 # Some of the drivers incorrectly return a response

78 # with no 'value' field when they should return null.

79 if 'value' not in data:

80 data['value'] = None

81 return data

82 else:

83 data = {'status': 0, 'value': data}

84 return data

85 finally:

86 LOGGER.debug("Finished Request")

87 resp.close()

可以看到主要是通过execute方法调用_request方法通过urilib3标准库向服务器发送对应操作请求地址,进而实现了浏览器各种操作

有人会问打开浏览器和操作浏览器实现各种动作是怎么关联的呢?

其实,打开浏览器也是发送请求,请求会返回一个sessionid,后面操作的各种接口地址,你也会发现接口地址中存在一个变量$sessionid,那么不难猜测打开浏览器和操作浏览器就是用过sessionid关联到一起,达到在同一个浏览器中做操作

第二步在浏览其上实现各种操作原理也完成了

模拟selenium

现在我们可以通过下面的一段代码查看一下打开浏览器和访问我的博客首页的请求参数是什么样子的

from selenium import webdriver

import logging

logging.basicConfig(level=logging.DEBUG) # 打印源码中的日志

dr = webdriver.Chrome() # 打开浏览器

driver.get("https://www.cnblogs.com/linuxchao/") # 访问我的博客首页

输出日志信息

DEBUG:selenium.webdriver.remote.remote_connection:POST http://127.0.0.1:55695/session

{"capabilities": {"firstMatch": [{}], "alwaysMatch": {"browserName": "chrome", "platformName": "any", "goog:chromeOptions":

{"extensions": [], "args": []}}}, "desiredCapabilities": {"browserName": "chrome", "version": "", "platform": "ANY",

"goog:chromeOptions": {"extensions": [], "args": []}}}

DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 127.0.0.1

DEBUG:urllib3.connectionpool:http://127.0.0.1:55695 "POST /session HTTP/1.1" 200 830

DEBUG:selenium.webdriver.remote.remote_connection:Finished Request

DEBUG:selenium.webdriver.remote.remote_connection:POST http://127.0.0.1:51006/session/09d52393b7dfcb45b8bb9101885ce206/url

{"url": "https://www.cnblogs.com/linuxchao/", "sessionId": "09d52393b7dfcb45b8bb9101885ce206"}

DEBUG:urllib3.connectionpool:http://127.0.0.1:51006 "POST /session/09d52393b7dfcb45b8bb9101885ce206/url HTTP/1.1" 200 72

DEBUG:selenium.webdriver.remote.remote_connection:Finished Request

Process finished with exit code 0

通过执行结果就很明显明白selenium执行的过程了,程序告诉RemoteWebDriver打开一个浏览器(发送post请求,带上请求参数),然后再向remote server发送执行浏览器动作的请求

那么为了更加深入理解selenium实现自动化测试的过程,我们可以自己编写程序模拟一下打开浏览器然后控制浏览器访问我的博客地址的操作过程

首先我们需要保持浏览器的驱动程序打开状态,然后编写如下代码并执行

import requests

# 请求地址(打开浏览器)

driver_url = 'http://localhost:9515/session'

# 打开浏览器的请求参数

driver_value = {"capabilities":

{"firstMatch": [{}],

"alwaysMatch":

{"browserName":

"chrome",

"platformName": "any",

"goog:chromeOptions":

{"extensions": [], "args": []}}},

"desiredCapabilities":

{"browserName":

"chrome",

"version": "",

"platform": "ANY",

"goog:chromeOptions": {"extensions": [],

"args": []}}}

# 发送求清

response_session = requests.post(driver_url, json = driver_value)

print(response_session.json())

# 访问我的博客的请求地址 (这个地址是我们上面记录的地址)

url = 'http://localhost:9515/session/'+response_session.json()['sessionId']+'/url'

# 访问我的博客的请求参数

value = {"url": "https://www.cnblogs.com/linuxchao/", "sessionId": response_session.json()['sessionId']}

response_blog = requests.post(url = url,json = value)

print(response_blog.json())

执行结果

{'sessionId': '25144efef880dcce53e4e6f60c342e9d', 'status': 0, 'value':

{'acceptInsecureCerts': False, 'acceptSslCerts': False, 'applicationCacheEnabled': False,

'browserConnectionEnabled': False, 'browserName': 'chrome', 'chrome':

{'chromedriverVersion': '2.39.562718 (9a2698cba08cf5a471a29d30c8b3e12becabb0e9)',

'userDataDir': 'C:\\Users\\v-xug\\AppData\\Local\\Temp\\scoped_dir9944_25238'},

'cssSelectorsEnabled': True, 'databaseEnabled': False, 'handlesAlerts': True,

'hasTouchScreen': False, 'javascriptEnabled': True, 'locationContextEnabled': True,

'mobileEmulationEnabled': False, 'nativeEvents': True, 'networkConnectionEnabled': False,

'pageLoadStrategy': 'normal', 'platform': 'Windows NT', 'rotatable': False, 'setWindowRect': True,

'takesHeapSnapshot': True, 'takesScreenshot': True, 'unexpectedAlertBehaviour': '', 'version': '75.0.3770.100', 'webStorageEnabled': True}}

{'sessionId': '25144efef880dcce53e4e6f60c342e9d', 'status': 0, 'value': None}

Process finished with exit code 0

上面的返回信息中最重要的信息是'sessionId': '25144efef880dcce53e4e6f60c342e9d',从代码中你也可以看到访问我的博客地址的url是使用这个参数拼接的,因为打开浏览器后,后面所有的操作都是基于这个sessionid的

selenium工作的过程

1.selenium client(python等语言编写的自动化测试脚本)初始化一个service服务,通过Webdriver启动浏览器驱动程序chromedriver.exe

2.通过RemoteWebDriver向浏览器驱动程序发送HTTP请求,浏览器驱动程序解析请求,打开浏览器,并获得sessionid,如果再次对浏览器操作需携带此id

3.打开浏览器,绑定特定的端口,把启动后的浏览器作为webdriver的remote server

3.打开浏览器后,所有的selenium的操作(访问地址,查找元素等)均通过RemoteConnection链接到remote server,然后使用execute方法调用_request方法通过urlib3向remote server发送请求

4.浏览器通过请求的内容执行对应动作

5.浏览器再把执行的动作结果通过浏览器驱动程序返回给测试脚本

相关文章:

Selenium原理

我们使用Selenium实现自动化测试&#xff0c;主要需要3个东西1.测试脚本&#xff0c;可以是python&#xff0c;java编写的脚本程序&#xff08;也可以叫做client端&#xff09;2.浏览器驱动, 这个驱动是根据不同的浏览器开发的&#xff0c;不同的浏览器使用不同的webdriver驱动…...

Disconf、Apollo和Nacos分布式配置框架差异对比

差异对比表格&#xff1a; 功能点DisconfApolloNacos依赖高可用框架完全依赖于Zookeeper来实现监听拉取&#xff0c;向外提供了HTTP拉取数据接口依赖于Eureka实现内部服务发现注册&#xff0c;提供HTTP接口给Client SDK拉取监听数据内部自研实现框架高可用CAP理论偏重点Zookee…...

高新技术企业认定条件条件 高企认定要求

高新技术企业认定条件 一、成立年限&#xff1a;申报企业须注册成立365个日历天数&#xff0c;而非一个会计年度。 二、知识产权 &#xff08;1&#xff09;申报企业必须拥有在中国境内授权或审批审定的知识产权&#xff0c;且知识产权在有效保护期内。知识产权权属人应为申请企…...

华为OD机试 - 新学校选址(JavaScript) | 机试题+算法思路+考点+代码解析 【2023】

新学校选址 题目 为了解新学期学生暴涨的问题,小乐村要建立所新学校 考虑到学生上学安全问题,需要所有学生家到学校的距离最短. 假设学校和所有学生家都走在一条直线之上,请问学校建立在什么位置, 能使得到学校到各个学生家的距离和最短 输入 第一行: 整数 n 取值范围 [1,1…...

二进制部署K8S

目录 一、环境准备 1、常见的k8s部署方式 2、关闭防火墙 3、关闭selinux 4、关闭swap 5、根据规划设置主机名 6、在master添加hosts 7、将桥接的IPv4流量传递到iptables的链 8、时间同步 二、部署etcd集群 1、master节点部署 2、查看证书的信息 2.1 创建k8s工作目…...

高效获知Activity的生命周期

Activity生命周期监听 使用 Instrumentation 对 Activity 生命周期进行监听。 优点&#xff1a; 全局仅一次反射&#xff0c;性能影响极小所有Activity的生命周期都能够被监听到由于Java的单继承&#xff0c;为了拓展性&#xff0c;可以使用装饰器模式对Instrumentation进行功…...

分析现货黄金价格一般有什么方法

分析现货黄金价格一般有什么方法呢&#xff1f;我相信很多投资者都会说&#xff0c;是技术分析。很多人并不知道技术分析是什么&#xff0c;并且技术分析是如何去分析现货黄金价格的&#xff0c;那么本文就介绍一下技术分析的主要分类。可以说&#xff0c;小编的其他文章都是以…...

Spring中的拦截器

这里写目录标题基本概念HandlerInterceptor拦截器HandlerInterceptor讲解MethodInterceptor拦截器二者的区别基本概念 在web开发中&#xff0c;拦截器是经常用到的功能。它可以帮我们预先设置数据以及统计方法的执行效率等等。 Spring中拦截器主要分两种&#xff0c;一个是Han…...

【Linux操作系统】【综合实验四 Linux的编译环境及线程编程】

文章目录一、实验目的二、实验要求三、实验内容四、实验报告要求一、实验目的 要求熟悉Linux环境中的程序编译、调试与项目管理过程并能实现具体操作&#xff1b;熟练使用基础函数库中与线程库中的管理函数&#xff0c;实现用户线程编程过程&#xff0c;并深入了解Linux的线程…...

Switch 如何使用NSCB 转换XCI NSP NSZ教程

很多小白经常碰到Switch游戏文件格式和预期不符的情况&#xff0c;比如碰到nsz自己不会安装&#xff08;安装NSZ格式文件教程&#xff09;&#xff1b;或者是碰到xci格式的&#xff0c;想转换为nsp&#xff1b;抑或想将nsz格式文件还原回nsp格式。本文对此提供了解决方案。 文中…...

JVM12 字节码指令集

1. 概述 2. 加载与存储指令 2.1. 局部变量压栈指令 iload 从局部变量中装载int类型值 lload 从局部变量中装载long类型值 fload 从局部变量中装载float类型值 dload 从局部变量中装载double类型值 aload 从局部变量中装载引用类型值&#xff08;refernce&#xff09; iload_0 从…...

centos之python安装与多版本python之间的共存

一、背景 随着python版本迭代加快&#xff0c;有写python模块再低版本无法运行&#xff0c;此时需要我们在进行安装一个python版本 例如&#xff1a;uvloop 在python3.7上运行&#xff1b;python 3.6官方不再维护与更新 有些模块或不支持较低版本、有些模块支持较高版本python…...

SpringBoot学习笔记(一)

Idea中隐藏指定文件或指定类型文件 setting->File Types->Ignored Files and Folders输入要隐藏的文件名&#xff0c;支持*号通配符回车确认添加 SpringBoot概述 parent 小结&#xff1a; 开发SpringBoot程序要继承spring-boot-starter-parentspring-boot-starter-pa…...

美国原装KEYSIGHT E4981A(安捷伦) E4981A电容计

KEYSIGHT E4981A&#xff08;安捷伦&#xff09; Keysight E4981A&#xff08;安捷伦&#xff09;电容计为生产线中的陶瓷电容器测试提供了高速、可靠的测量。E4981A 实现了电容从小到大的测量能力&#xff0c;测量准确。Agilent E4981A 电容计有助于提高测试吞吐量&#xff0…...

K8S的基础概念

目录 一、k8s概述 1、k8s简介 1.1 k8s的作用 1.2 k8s的由来 1.3 k8s的含义 1.4 k8s的官网 1.5 GitHub 2、为什么要用 K8S? 2.1 K8s的目标 2.2 K8s解决了裸跑Docker 的若干痛点: 2.3 K8s的主要功能 3、K8s的特性 二、Kubernetes 集群架构与组件 1、工作流程 2、…...

【数据结构】——环形队列

文章目录一.环形队列的定义及其特点二.使用数组来实现环形队列1.创建一个队列2.初始化队列3. 判断环形队列是否为空4.判断环形队列是否已满5. 向循环队列插入元素&#xff0c;插入成功返回真6.删除环形链表的数据7. 取队头元素8.取队尾元素8.释放空间总结一.环形队列的定义及其…...

windows 安装Qt

下载 下载地址https://download.qt.io/&#xff0c;此文已5.7.0为例子。 根据图片依次选择即可。 安装 安装过程参考另一篇文章Ubuntu 安装 Qt5.7.0即可 配置环境变量 ps&#xff1a;我就是之前没配置环境变量&#xff0c;直接使用创建项目&#xff0c;项目源码直接运行是…...

spring cloud gateway集成sentinel并扩展支持restful api进行url粒度的流量治理

sentinel集成网关支持restful接口进行url粒度的流量治理前言使用网关进行总体流量治理&#xff08;sentinel版本&#xff1a;1.8.6&#xff09;1、cloud gateway添加依赖:2、sentinel配置3、网关类型项目配置4、通过zk事件监听刷新上报api分组信息1、非网关项目上报api分组信息…...

wafw00f工具

wafw00f Web应用程序防火墙指纹识别工具 github地址&#xff1a;https://github.com/EnableSecurity/wafw00f 安装环境&#xff1a;python3环境 —>使用 pip install wafw00f 进行安装 安装成功后目录&#xff1a;python安装目录中的Lib\site-packages\wafw00f 本机为&a…...

论文阅读笔记-DiffusionInst: Diffusion Model for Instance Segmentation

文章目录DiffusionInst: Diffusion Model for Instance Segmentation摘要介绍任务介绍实例分割的几种方法想法来源贡献方法整体结构Mask RepresentationDiffusionInst组成TrainingInference不足之处感悟DiffusionInst: Diffusion Model for Instance Segmentation 代码&#x…...

椭圆曲线密码学(ECC)

一、ECC算法概述 椭圆曲线密码学&#xff08;Elliptic Curve Cryptography&#xff09;是基于椭圆曲线数学理论的公钥密码系统&#xff0c;由Neal Koblitz和Victor Miller在1985年独立提出。相比RSA&#xff0c;ECC在相同安全强度下密钥更短&#xff08;256位ECC ≈ 3072位RSA…...

Zustand 状态管理库:极简而强大的解决方案

Zustand 是一个轻量级、快速和可扩展的状态管理库&#xff0c;特别适合 React 应用。它以简洁的 API 和高效的性能解决了 Redux 等状态管理方案中的繁琐问题。 核心优势对比 基本使用指南 1. 创建 Store // store.js import create from zustandconst useStore create((set)…...

day52 ResNet18 CBAM

在深度学习的旅程中&#xff0c;我们不断探索如何提升模型的性能。今天&#xff0c;我将分享我在 ResNet18 模型中插入 CBAM&#xff08;Convolutional Block Attention Module&#xff09;模块&#xff0c;并采用分阶段微调策略的实践过程。通过这个过程&#xff0c;我不仅提升…...

聊聊 Pulsar:Producer 源码解析

一、前言 Apache Pulsar 是一个企业级的开源分布式消息传递平台&#xff0c;以其高性能、可扩展性和存储计算分离架构在消息队列和流处理领域独树一帜。在 Pulsar 的核心架构中&#xff0c;Producer&#xff08;生产者&#xff09; 是连接客户端应用与消息队列的第一步。生产者…...

什么是库存周转?如何用进销存系统提高库存周转率?

你可能听说过这样一句话&#xff1a; “利润不是赚出来的&#xff0c;是管出来的。” 尤其是在制造业、批发零售、电商这类“货堆成山”的行业&#xff0c;很多企业看着销售不错&#xff0c;账上却没钱、利润也不见了&#xff0c;一翻库存才发现&#xff1a; 一堆卖不动的旧货…...

高危文件识别的常用算法:原理、应用与企业场景

高危文件识别的常用算法&#xff1a;原理、应用与企业场景 高危文件识别旨在检测可能导致安全威胁的文件&#xff0c;如包含恶意代码、敏感数据或欺诈内容的文档&#xff0c;在企业协同办公环境中&#xff08;如Teams、Google Workspace&#xff09;尤为重要。结合大模型技术&…...

省略号和可变参数模板

本文主要介绍如何展开可变参数的参数包 1.C语言的va_list展开可变参数 #include <iostream> #include <cstdarg>void printNumbers(int count, ...) {// 声明va_list类型的变量va_list args;// 使用va_start将可变参数写入变量argsva_start(args, count);for (in…...

tomcat入门

1 tomcat 是什么 apache开发的web服务器可以为java web程序提供运行环境tomcat是一款高效&#xff0c;稳定&#xff0c;易于使用的web服务器tomcathttp服务器Servlet服务器 2 tomcat 目录介绍 -bin #存放tomcat的脚本 -conf #存放tomcat的配置文件 ---catalina.policy #to…...

离线语音识别方案分析

随着人工智能技术的不断发展&#xff0c;语音识别技术也得到了广泛的应用&#xff0c;从智能家居到车载系统&#xff0c;语音识别正在改变我们与设备的交互方式。尤其是离线语音识别&#xff0c;由于其在没有网络连接的情况下仍然能提供稳定、准确的语音处理能力&#xff0c;广…...

MFE(微前端) Module Federation:Webpack.config.js文件中每个属性的含义解释

以Module Federation 插件详为例&#xff0c;Webpack.config.js它可能的配置和含义如下&#xff1a; 前言 Module Federation 的Webpack.config.js核心配置包括&#xff1a; name filename&#xff08;定义应用标识&#xff09; remotes&#xff08;引用远程模块&#xff0…...