a 7j-@s*ddlmZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl m Z ddlmZddlmZddlmZddlmZddlmZdd lmZdd lmZmZmZmZmZd d lmZ d d lm!Z!d dlm"Z#d dlm$Z$d dl%m&Z&m'Z'ddl(Z)e*e+Z,Gddde&Z-dS)) annotationsN)suppress) AsyncFileLock)config) constants)js_utils) page_utils) shared_utils)DictListUnionOptionalTuple)browser)element)cdp_util)PathLike) ConnectionProtocolExceptioncseZdZUdZded<dZded<dddd d fd d Zd dZddZe ddZ ddZ ddZ ddddddddZ ddddd d!d"Zdddd#d$d%d&Zdddd#d d'd(Zdddd*d+d,Zdd-d.Zddd/d0d1d2Zddd3d0d4d5Zdd#d6d7d8Zddd9d9d:d;dd?Zd@dAZdBdCZdDdEZdFdGZdHdIZdJdKZdd9dLdMdNdOZdddPdQdRZddd9dSdTdUdVZ dWdXZ!dYdZd[d\Z"d]d^Z#d_d`Z$dadbZ%dcddZ&dedfZ'ddjdkZ(ddldmZ)dndoZ*dpdqZ+ddtduZ,ddwdxZ-ddydzZ.ddLdLd|dd}d~dZ/ddZ0ddZ1ddddddZ2dddLd9ddddZ3ddddddZ4ddddZ5ddZddZ6dddZddZ7ddZ8ddZ9ddZ:ddZ;dddZddZ?ddZ@ddZAddZBdddZCddZDdddZEddZFddZGddZHdddZIdddZJdddZKdddÄZLdddńZMddDŽZNddɄZOdd˄ZPdd̈́ZQddτZRddќddӄZSddLdLd|dԜddքZTddלddلZUddۄZVdd݄ZWZXS)Taba :ref:`tab` is the controlling mechanism/connection to a 'target', for most of us 'target' can be read as 'tab'. However it could also be an iframe, serviceworker or background script for example, although there isn't much to control for those. If you open a new window by using :py:meth:`browser.get(..., new_window=True)` Your url will open a new window. This window is a 'tab'. When you browse to another page, the tab will be the same (browser view). It's important to keep some reference to tab objects, in case you're done interacting with elements and want to operate on the page level again. Custom CDP commands --------------------------- Tab object provide many useful and often-used methods. It is also possible to utilize the included cdp classes to to something totally custom. The cdp package is a set of so-called "domains" with each having methods, events and types. To send a cdp method, for example :py:obj:`cdp.page.navigate`, you'll have to check whether the method accepts any parameters and whether they are required or not. You can use: ```python await tab.send(cdp.page.navigate(url='https://Your-URL-Here')) ``` So tab.send() accepts a generator object, which is created by calling a cdp method. This way you can build very detailed and customized commands. (Note: Finding correct command combos can be a time-consuming task. A whole bunch of useful methods have been added, preferably having the same apis or lookalikes, as in selenium.) Some useful, often needed and simply required methods =================================================================== :py:meth:`~find` | find(text) ---------------------------------------- Finds and returns a single element by text match. By default, returns the first element found. Much more powerful is the best_match flag, although also much more expensive. When no match is found, it will retry for seconds (default: 10), so this is also suitable to use as wait condition. :py:meth:`~find` | find(text, best_match=True) or find(text, True) ----------------------------------------------------------------------- Much more powerful (and expensive) than the above is the use of the `find(text, best_match=True)` flag. It will still return 1 element, but when multiple matches are found, it picks the one having the most similar text length. How would that help? For example, you search for "login", you'd probably want the "login" button element, and not thousands of scripts/meta/headings, which happens to contain a string of "login". When no match is found, it will retry for seconds (default: 10), so this is also suitable to use as wait condition. :py:meth:`~select` | select(selector) ---------------------------------------- Finds and returns a single element by css selector match. When no match is found, it will retry for seconds (default: 10), so this is also suitable to use as wait condition. :py:meth:`~select_all` | select_all(selector) ------------------------------------------------ Finds and returns all elements by css selector match. When no match is found, it will retry for seconds (default: 10), so this is also suitable to use as wait condition. await :py:obj:`Tab` --------------------------- Calling `await tab` will do a lot of stuff under the hood, and ensures all references are up to date. Also it allows for the script to "breathe", as it is oftentime faster than your browser or webpage. So whenever you get stuck and things crashes or element could not be found, you should probably let it "breathe" by calling `await page` and/or `await page.sleep()`. It ensures :py:obj:`~url` will be updated to the most recent one, which is quite important in some other methods. Using other and custom CDP commands ====================================================== Using the included cdp module, you can easily craft commands, which will always return an generator object. This generator object can be easily sent to the :py:meth:`~send` method. :py:meth:`~send` --------------------------- This is probably the most important method, although you won't ever call it, unless you want to go really custom. The send method accepts a :py:obj:`cdp` command. Each of which can be found in the cdp section. When you import * from this package, cdp will be in your namespace, and contains all domains/actions/events you can act upon. zcdp_browser.BrowserrNz List[str]_download_behaviorstrzcdp.target.TargetInfozOptional['cdp_browser.Browser']) websocket_urltargetrc s.tj|||fi|||_d|_d|_dSN)super__init__rZ_domZ _window_id)selfrrrkwargs __class__LE:\soccer\ml_env\Lib\site-packages\seleniumbase/undetected/cdp_driver/tab.pyrsz Tab.__init__cs|Srr"rr"r"r# __aenter__szTab.__aenter__cs"|IdH|r|r||dSr)aclose)rexc_typeexc_valexc_tbr"r"r# __aexit__sz Tab.__aexit__cCs,d|jjjd|jjjd|jddS)z Get the inspector url. This url can be used in another browser to show you the devtools interface for current tab. Useful for debugging and headless mode. zhttp://:z/devtools/inspector.html?ws=N)rrhostportrr$r"r"r# inspector_urlszTab.inspector_urlcCsddl}|j|jdddS)Nr)new webbrowseropenr/rr3r"r"r#inspector_openszTab.inspector_opencsddl}||jdS)z Opens the system's browser containing the devtools inspector page for this tab. Could be handy, especially to debug in headless mode. rNr2r5r"r"r#open_external_inspectorszTab.open_external_inspectorFT boolzUnion[int, float])text best_matchreturn_enclosing_elementtimeoutc st}|}|}d}z||||IdH}WnttfyJYn0|s||||IdH}|||krtd||dIdHqL|S)a Find single element by text. Can also be used to wait for such element to appear. :param text: Text to search for. Note: Script contents are also considered text. :type text: str :param best_match: :param best_match: When True (default), it will return the element which has the most comparable string length. This could help a lot. Eg: If you search for "login", you probably want the login button element, and not thousands of tags/scripts containing a "login" string. When False, it returns just the first match (but is way faster). :type best_match: bool :param return_enclosing_element: Since we deal with nodes instead of elements, the find function most often returns so called text nodes, which is actually a element of plain text, which is the somehow imaginary "child" of a "span", "p", "script" or any other elements which have text between their opening and closing tags. Most often when we search by text, we actually aim for the element containing the text instead of a lousy plain text node, so by default the containing element is returned. There are exceptions. Eg: Elements that use the "placeholder=" property. :type return_enclosing_element: bool :param timeout: Raise timeout exception when after this many seconds nothing is found. :type timeout: float,int N$Time ran out while waiting for: {%s}?) asyncioget_running_looptimestripfind_element_by_text Exception TypeError TimeoutErrorsleep)rr:r;r<r=loop start_timeitemr"r"r#finds(% zTab.findzelement.Element)selectorr=returncs|j||dIdHS)a| Find a single element by css selector. Can also be used to wait for such an element to appear. :param selector: css selector, eg a[href], button[class*=close], a > img[src] :type selector: str :param timeout: Raise timeout exception when after this many seconds nothing is found. :type timeout: float,int )rMr=Nwait_for)rrMr=r"r"r#selectsz Tab.selectzList[element.Element])r:r=rNc st}|}|}g}z||IdH}WnttfyFYn0|s|IdH||IdH}|||krtd||dIdHqH|S)aq Find multiple elements by text. Can also be used to wait for such elements to appear. :param text: Text to search for. Note: Script contents are also considered text. :type text: str :param timeout: Raise timeout exception when after this many seconds nothing is found. :type timeout: float,int Nr>r?) r@rArBrCfind_elements_by_textrErFrGrH)rr:r=rInowitemsr"r"r#find_alls" z Tab.find_allc st}|}|}g}|rP|dIdH}|D]}|||IdHq4|||IdH|s|IdH||IdH}|||krtd||dIdHqf|S)a Find multiple elements by CSS Selector. Can also be used to wait for such elements to appear. :param selector: css selector, eg a[href], button[class*=close], a > img[src] :type selector: str :param timeout: Raise timeout exception when after this many seconds nothing is found. :type timeout: float,int :param include_frames: Whether to include results in iframes. :type include_frames: bool iframeNr>r?)r@rArBrCquery_selector_allextendrGrH) rrMr=Zinclude_framesrIrSrTframesfrr"r"r# select_all!s$ zTab.select_all about:blanknew_tab new_windowcs|jstd|r|sd}|r|ttdds:ttdddvrZ|jj|fddd|IdHS|jj|fddd|IdHSnP|s|tj|IdH^}}}|IdH|S|jj|fddd|IdHSdS) a Top level get. Utilizes the first tab to retrieve the given url. This is a convenience function known from selenium. This function handles waits/sleeps and detects when DOM events fired, so it's the safest way of navigating. :param url: the url to navigate to :param new_tab: open new tab :param new_window: open new window :return: Page z>This page/tab has no browser attribute, so you can't use get()TZ incognitoN _cdp_browser)cometZatlasFr]) rAttributeErrorgetattr sb_configgetsendcdppageZnavigate)rurlr^r_rZframe_idZ loader_id_r"r"r#reGsP     zTab.getcs|j|dIdHS)N)ri)re)rrir"r"r#r4zszTab.openz0Optional[Union[cdp.dom.Node, 'element.Element']])rM_nodec sT|s |tjddIdH}n|}|jdkr4|j}g}z |tj|j|IdH}Wnty}z|durd|j vrt |ddr|` gWYd}~S| IdHd|_ |||IdHWYd}~Sn|tjIdHWYd}~n d}~00|s gSg}|D]<t|fdd}|s4qt|||}||q|S) a Equivalent of JavaScript "document.querySelectorAll". This is considered one of the main methods to use in this package. It returns all matching :py:obj:`element.Element` objects. :param selector: css selector. (first time? => https://www.w3schools.com/cssref/css_selectors.php ) :type selector: str :param _node: internal use TNIFRAMEcould not find node__lastcs |jkSrnode_idnnidr"r#z(Tab.query_selector_all..)rfrgdom get_document node_namecontent_documentrWrqrmessagelowerrc _Tab__lastupdatedisableutilfilter_recursercreateappend) rrMrkdocnode_idserTnodeelemr"rtr#rW}s@   zTab.query_selector_allz.Optional[Union[cdp.dom.Node, element.Element]]c s@|}|s(|tjddIdH}n|}|jdkr<|j}dz |tj|j|IdHWnt y}z|durd|j vrt |ddr|` gWYd}~S|IdHd|_ |||IdHWYd}~Sn|tjIdHWYd}~n d}~00sdSt|fdd}|s2dSt|||S) z Find a single element based on a CSS Selector string. :param selector: CSS Selector(s) :type selector: str rlTNrmrnrocs |jkSrrprrrpr"r#rvrwz$Tab.query_selector..)rCrfrgrxryrzr{query_selectorrqrr|r}rcr~rrrrrr)rrMrkrrrr"rpr#rs:    zTab.query_selector)r:rNc stjddIdH}tjdIdH\}}|sHgS|rjtj|d|IdH}ng}tj|IdHg}|D]t |fdd}|sʈtjj dIdH}|sqzt ||}Wnt yYqYn0|jdkr,|js|IdH||jp$|qq||qt|d d} | rfd d | D} | D]Pjrdtfd d} | rdfd d | D} |dd| DqdtjIdH|pgS)z Returns element which match the given text. Note: This may (or will) also return any other element (like inline scripts), which happen to contain that text. :param text: rlTNrcs |jkSrrprrrtr"r#rvrwz+Tab.find_elements_by_text..rpcSs |jdkSNrmrzrr"r"r#rvrwcsg|]}t||jqSr"rrr{.0rVr$r"r# !sz-Tab.find_elements_by_text..cs|jdko|jvSNr node_typer}Z node_valuerr:r"r#rv)s csg|]}t|jqSr"rrtreerZ text_node iframe_elemrr"r#r-scss|] }|jVqdSrparentrr"r"r# 1sz,Tab.find_elements_by_text..)rCrfrgrxryperform_searchget_search_resultsdiscard_search_resultsrrZ resolve_noderr BaseExceptionrrrrfilter_recurse_allr{rXr) rr:r search_idnresultrrTrriframes iframes_elemsiframe_text_nodesiframe_text_elemsr"rrurr:r#rRsl             zTab.find_elements_by_textzOptional[bool]zUnion[element.Element, None])r:r;r<rNc sTtjddIdH}tjdIdH\}}|sHdStj|d|IdH}tj|IdH|sg}g}|D]t |fdd} zt | |} Wnt yYqYn0| j dkr| js| IdH|| jp| qq|| qt|dd} | rfd d | D} | D]Htfd d} | r:fd d | D}|d d|Dq:z|sWtjIdHdS|rt|fddd}|p|d} | WtjIdHS|D],} | r| WtjIdHSqWtjIdHntjIdH0dS)a Finds and returns the first element containing , or best match. :param text: :param best_match: When True, which is MUCH more expensive (thus much slower), will find the closest match based on length. When searching for "login", you probably want the button element, and not thousands of tags/scripts containing the "login" string. :type best_match: bool :param return_enclosing_element: rlTNrcs |jkSrrprrrtr"r#rvWrwz*Tab.find_element_by_text..rcSs |jdkSrrrr"r"r#rvprwcsg|]}t||jqSr"rrr$r"r#rssz,Tab.find_element_by_text..cs|jdko|jvSrrrrr"r#rvzs csg|]}t|jqSr"rrrr"r#r~scss|] }|jVqdSrrrr"r"r#rsz+Tab.find_element_by_text..csttt|jSr)abslenZtext_all)elrr"r#rvrw)key)rfrgrxryrCrrrrrrrrrrrrrrXrmin)rr:r;r<rrrrrTrrrrrrZclosest_by_lengthr"rr#rD7s             zTab.find_element_by_textcs|tjdIdHdS)z History backzwindow.history.back()Nrfrgruntimeevaluater$r"r"r#backszTab.backcs|tjdIdHdS)zHistory forwardzwindow.history.forward()Nrr$r"r"r#forwardsz Tab.forwardcs|tjIdHS)zGet Navigation HistoryN)rfrgrhget_navigation_historyr$r"r"r#rszTab.get_navigation_historycs|dIdHS)zGet User Agent Stringznavigator.userAgentNrr$r"r"r#get_user_agentszTab.get_user_agentcs|dIdHS)zGet Cookie Stringzdocument.cookieNrr$r"r"r#get_cookie_stringszTab.get_cookie_stringcs|dIdHS)zGet Locale Codez,navigator.language || navigator.languages[0]Nrr$r"r"r#get_locale_codeszTab.get_locale_codecs|dIdHS)z&Determine if connected to the Internetznavigator.onLineNrr$r"r"r# is_onlinesz Tab.is_onlinez Optional[str] ignore_cachescript_to_evaluate_on_loadcs |tjj||dIdHdS)z Reloads the page :param ignore_cache: When set to True (default), it ignores cache, and re-downloads the items. :param script_to_evaluate_on_load: Script to run on load. rN)rfrgrhreload)rrrr"r"r#rs z Tab.reload) expressionc sb|tjj|d||ddIdH\}}|r2t||r^|rL|jdur^|jSn|jdur^|jjSdS)NT)rZ user_gesture await_promisereturn_by_value allow_unsafe_eval_blocked_by_csp)rfrgrrrvalueZdeep_serialized_value)rrrr remote_objecterrorsr"r"r#rs$   z Tab.evaluatezJUnion[Dict, Tuple[cdp.runtime.RemoteObject, cdp.runtime.ExceptionDetails]])obj_namerrNcsd|}d|}|tjj|d|ddIdH\}}|r\|tjj|d|ddIdH\}}|rht||rz|jr|jSn||fSdS)aU Dump Given js object with its properties and values as a dict. Note: Complex objects might not be serializable, therefore this method is not a "source of truth" :param obj_name: the js object to dump :type obj_name: str :param return_by_value: If you want an tuple of cdp objects (returnvalue, errors), then set this to False. :type return_by_value: bool Example ------- x = await self.js_dumps('window') print(x) '...{ 'pageYOffset': 0, 'visualViewport': {}, 'screenX': 10, 'screenY': 10, 'outerWidth': 1050, 'outerHeight': 832, 'devicePixelRatio': 1, 'screenLeft': 10, 'screenTop': 10, 'styleMedia': {}, 'onsearch': None, 'isSecureContext': True, 'trustedTypes': {}, 'performance': {'timeOrigin': 1707823094767.9, 'timing': {'connectStart': 0, 'navigationStart': 1707823094768, ]... a function ___dump(obj, _d = 0) { let _typesA = ['object', 'function']; let _typesB = ['number', 'string', 'boolean']; if (_d == 2) { console.log('maxdepth reached for ', obj); return } let tmp = {} for (let k in obj) { if (obj[k] == window) continue; let v; try { if (obj[k] === null || obj[k] === undefined || obj[k] === NaN) { console.log('obj[k] is null or undefined or Nan', k, '=>', obj[k]) tmp[k] = obj[k]; continue } } catch (e) { tmp[k] = null; continue } if (_typesB.includes(typeof obj[k])) { tmp[k] = obj[k] continue } try { if (typeof obj[k] === 'function') { tmp[k] = obj[k].toString() continue } if (typeof obj[k] === 'object') { tmp[k] = ___dump(obj[k], _d + 1); continue } } catch (e) {} try { tmp[k] = JSON.stringify(obj[k]) continue } catch (e) { } try { tmp[k] = obj[k].toString(); continue } catch (e) {} } return tmp } function ___dumpY(obj) { var objKeys = (obj) => { var [target, result] = [obj, []]; while (target !== null) { result = result.concat( Object.getOwnPropertyNames(target) ); target = Object.getPrototypeOf(target); } return result; } return Object.fromEntries( objKeys(obj).map(_ => [_, ___dump(obj[_])])) } ___dumpY( %s ) a6 ((obj, visited = new WeakSet()) => { if (visited.has(obj)) { return {} } visited.add(obj) var result = {}, _tmp; for (var i in obj) { try { if (i === 'enabledPlugin' || typeof obj[i] === 'function') { continue; } else if (typeof obj[i] === 'object') { _tmp = recurse(obj[i], visited); if (Object.keys(_tmp).length) { result[i] = _tmp; } } else { result[i] = obj[i]; } } catch (error) { // console.error('Error:', error); } } return result; })(%s) T)rrrN)rfrgrrrr)rrrZ js_code_aZ js_code_brZexception_detailsr"r"r#js_dumpss>)CGz Tab.js_dumpscsN|jrJ|jjrJ|tjj|jjdIdH|IdHtdIdHdS)z.Close the current target (ie: tab,window,page)) target_idN皙?)rrrfrgZ close_targetr&r@rHr$r"r"r#closes  z Tab.closez/Tuple[cdp.browser.WindowID, cdp.browser.Bounds])rNcs&|tj|jIdH\}}||fS)zGet the window BoundsN)rfrgrZget_window_for_targetr)r window_idboundsr"r"r# get_windows zTab.get_windowcs8|tjddIdH}|tjj|jddIdHS)z+Gets the current page source content (html)rlTN)backend_node_idZinclude_shadow_dom)rfrgrxryZget_outer_htmlr)rrr"r"r# get_contentszTab.get_contentcs|jddIdHS)zMaximize page/tab/windowmaximizestateNset_window_stater$r"r"r#rsz Tab.maximizecs|jddIdHS)Minimize page/tab/windowminimizerNrr$r"r"r#rsz Tab.minimizecs|jddIdHS)r fullscreenrNrr$r"r"r#rszTab.fullscreencs|jddIdHS)Nnormalrrr$r"r"r#medimizesz Tab.medimizercs|||||IdHS)aW Set window size and position. :param left: Pixels from the left of the screen to the window top-left corner. :param top: Pixels from the top of the screen to the window top-left corner. :param width: width of the window in pixels :param height: height of the window in pixels Nrrlefttopwidthheightr"r"r#set_window_sizes zTab.set_window_sizecs|||||IdHS)z>Same as set_window_size(). Uses a different naming convention.Nrrr"r"r#set_window_rectszTab.set_window_rectcs |tj|jjIdHdS)z*Active this target (Eg: tab, window, page)N)rfrgrZactivate_targetrr$r"r"r#activatesz Tab.activatecs|IdHdS)zAlias to self.activateN)rr$r"r"r#bring_to_frontszTab.bring_to_frontrc sgd}|IdH\}}|D]"tfdd|DrqXqtdd||fttjj tjjj } | tjjj krtj ||||| }n |j ddIdHtjj | d }| tjj||d IdHdS) a Sets the window size or state. For state you can provide the full name like minimized, maximized, normal, fullscreen, or something which leads to either of those, like min, mini, mi, max, ma, maxi, full, fu, no, nor. In case state is set other than "normal", the left, top, width, and height are ignored. :param left: desired offset from left, in pixels :type left: int :param top: desired offset from the top, in pixels :type top: int :param width: desired width in pixels :type width: int :param height: desired height in pixels :type height: int :param state: can be one of the following strings: - normal - fullscreen - maximized - minimized :type state: str )Z minimizedZ maximizedrrNc3s|]}|vVqdSrr")rxZ state_namer"r#rrwz'Tab.set_window_state..z-could not determine any of %s from input '%s',rr) window_state)r)rallr} NameErrorjoinrcrgrZ WindowStateupperZNORMALZBoundsrrfZset_window_bounds) rrrrrrZavailable_statesrrrr"rr#rs0  zTab.set_window_statec sJ|IdH\}}|tjjdd|j|d ddddddIdHdS)z Scrolls the page down. :param amount: Number in percentage. 25 is a quarter of page, 50 half, and 1000 is 10x the page. :type amount: int NrdTa)ry y_distanceZ y_overscroll x_overscroll prevent_flingrepeat_delay_msspeedrrfrgZinput_Zsynthesize_scroll_gesturerramountrrr"r"r# scroll_downs zTab.scroll_downc sF|IdH\}}|tjjdd|j|ddddddIdHdS)z Scrolls the page up. :param amount: Number in percentage. 25 is a quarter of page, 50 half, and 1000 is 10x the page. :type amount: int NrrTr)rrrrrrrrrr"r"r# scroll_ups  z Tab.scroll_upzOptional[Union[int, float]])rMr:r=rNcst}|}|rl||IdH}|sh||IdH}|||krVtd||dIdHq$|S|r||IdH}|s||IdH}|||krtd||dIdHq|SdS)a Variant on query_selector_all and find_elements_by_text. This variant takes either selector or text, and will block until the requested element(s) are found. It will block for a maximum of seconds, after which a TimeoutError will be raised. :param selector: css selector :param text: text :param timeout: :return: Element :raises: asyncio.TimeoutError Nr>g rh?)r@rArBrrGrHrD)rrMr:r=rIrSrKr"r"r#rP1s,z Tab.wait_forcst|}t|}t|}t|}|drfttt|d}Wdn1s\0Y|}t|}t|}d|||f}tt ||IdHWdn1s0YdS)aThis method uses JavaScript to set/update a common attribute. All matching selectors from querySelectorAll() are used. Example => (Make all links on a website redirect to Google): self.set_attributes("a", "href", "https://google.com"))/z./(ZxpathNzvar $elements = document.querySelectorAll('%s'); var index = 0, length = $elements.length; for(; index < length; index++){ $elements[index].setAttribute('%s','%s');}) reescaperescape_quotes_if_needed startswithrrEZconvert_to_css_selectorr)rrM attributerZ css_selectorZjs_coder"r"r#set_attributesZs&      *   zTab.set_attributescs|dddIdHdS)zqAll `target="_blank"` links become `target="_self"`. This prevents those links from opening in a new tab.z[target="_blank"]r_selfN)rr$r"r"r#internalize_linksvszTab.internalize_linkszOptional[PathLike])rifilenamecs|js@tjd}|jdd||IdHtd||s`|dd}| dd }d ||f}| d IdHd }| IdH| t jj||jt jj|jd gd IdHdS)z Downloads the file by the given url. :param url: The URL of the file. :param filename: The name for the file. If not specified, the name is composed from the url file name Z downloadsT)exist_okNz9No download path set, so creating and using a default of rrl?ra  (elem) => { async function _downloadFile( imageSrc, nameOfDownload, ) { const response = await fetch(imageSrc); const blobImage = await response.blob(); const href = URL.createObjectURL(blobImage); const anchorElement = document.createElement('a'); anchorElement.href = href; anchorElement.download = nameOfDownload; document.body.appendChild(anchorElement); anchorElement.click(); setTimeout(() => { document.body.removeChild(anchorElement); window.URL.revokeObjectURL(href); }, 500); } _downloadFile('%s', '%s') } body) object_id)r  arguments)rpathlibPathcwdmkdirset_download_pathwarningswarnrsplitsplitrWrrfrgrZcall_function_onr Z CallArgument)rrirZdirectory_pathcoder r"r"r# download_file{s4  zTab.download_fileautopng)rformat full_pagerNc s"|IdHd}|dvr(d}d}n|dvr.)rW)r all_assetsr"r$r#get_all_linked_sourcess zTab.get_all_linked_sourcesc sddl}g}|jddIdH}|D]}|s>||jp8|jq"|jD]l\}|dvrHdvrbqHtfddd DszqH|j d |j d dd }| d sqH||qHq"|S) z Convenience function, which returns all links (a,link,img,script,meta). :param absolute: Try to build all the links in absolute form instead of "as is", often relative. :return: List of URLs. rNr9r:)srchref#csg|] }|vqSr"r")rrjvr"r#r8rwz$Tab.get_all_urls..)http//rrr)rCrDws) urllib.parserWrr>r?attrsrTanyr#urljoinrrirr)rabsoluter"resr<r;kZabs_urlr"rAr# get_all_urls"s*  zTab.get_all_urlscs"|jdddIdH}|IdHS)Nhtmlrr=)rLZget_html_async)rrr"r"r#get_htmlBsz Tab.get_htmlcs|IdHSr)rPr$r"r"r#get_page_sourceFszTab.get_page_sourcecs4z|j|ddIdHWdSty.YdS0dS)N{Gz?rOTF)rQrE)rrMr"r"r#is_element_presentIs  zTab.is_element_presentcs d|vrzz|j|ddIdH}Wnty4YdS0|s>dSz$|IdH}|jdkp`|jdkWStyvYdS0ntt|dddd}|ddd ddd}|j|ddIdH}|st||IdH}|stWdd S1s0YdSdS) N :contains(rRrOFr rlr)T)rQrEget_position_asyncrrrrrD)rrMrpositionZtag_namer:r"r"r#is_element_visiblePs.     "zTab.is_element_visiblecsn|rt|dkr.|dIdH|IdH}d|vrFd|vrFd|vsfd|vsfd|vsfd|vsfd |vrjd Sd S) Ni)\(?z data-callback="onCaptchaSuccess"title="reCAPTCHA"id="recaptcha-token"z/challenge-platform/h/b/zid="challenge-widget-zchallenges.cloudfz cf-turnstile-TF)rrHrP)rsourcer"r"r#Z__on_a_cf_turnstile_pagejs&  zTab.__on_a_cf_turnstile_pagecs|dIdHrdSdS)N"iframe[src*="Incapsula_Resource?"]TFrYrargsrr"r"r#Z__on_an_incapsula_hcaptcha_page|sz#Tab.__on_an_incapsula_hcaptcha_pagecs|dIdHrdSdS)Niframe[data--frc-frame-id]TFr_r`r"r"r#Z__on_a_friendly_captcha_pagesz Tab.__on_a_friendly_captcha_pagecsr|dIdH|IdH}d|vs.d|vrR|dIdHrR|dIdHdSd|vrn|dIdHdSd S) Ng?r\r[iframe[title="reCAPTCHA"]rTzcom/recaptcha/api.jsg333333?F)rHrPrS)rrarr]r"r"r#Z__on_a_g_recaptcha_pageszTab.__on_a_g_recaptcha_pagec sd}|dIdHrd}ndS|dIdHtt|j|ddIdH}|d}|d}|IdH}|d}|d }|d kr|d krt||d krt||d krWddS|j|d dIdH}|d} |d} d} d} t t j IdHrd} | | } | | }| |ft _ |dIdHttjj}|4IdH^|IdH|dIdH|j|| | d dIdH|dIdHWdIdHq1IdHs0YWddS1s0YdS)NrcFr?rrOrr innerWidth innerHeightiinr#)\(?皙?rZT)rSrHrrEget_element_rectget_window_rectrget_gui_element_rectr@ to_threadr is_windowsrd _saved_cf_x_yrr MultiBrowser PYAUTOGUILOCKrclick_with_offset)rrM element_recte_xe_y window_rectZ win_widthZ win_heightZgui_element_rectZgui_e_xZgui_e_yx_offsety_offsetrrgui_lockr"r"r#Z__gui_click_recaptchasX     >"zTab.__gui_click_recaptchac sd}|dIdHrFd}d}||IdH}||IdH}|sJdSndS|dIdHd}d}d}ttjj}|4IdH|IdH|dIdHdt j vrd |} d |vrd |} nd |vrd |} t d| ||ft t :|j||ddIdHd}|dIdHWdn1s.0YWdIdHqf1IdHs\0Y|r|dIdHdt j vrt ddSdt j vrt ddS)Nr^ziframe[data-hcaptcha-widget-id]F皙?$y&1?--debug`%s`""%s"''%s'& click_with_offset(%s, %s, %s)rrcenterT333333??z hCaptcha was clicked!z" hCaptcha was NOT clicked!)rYrDZquery_selector_asyncrHrrrrrsrsysargvprintrrEmouse_click_with_offset_async) rrMZouter_selectorZ outer_elementrryrz was_clickedr{displayed_selectorr"r"r#Z__cdp_click_incapsula_hcaptchasT     ^  z"Tab.__cdp_click_incapsula_hcaptchac sd}|dIdHr&||IdH}ndS|dIdHd}d}d}ttjj}|4IdH|IdH|dIdHdtj vrd|}d |vrd |}nd |vrd |}t d |||ft t :|j ||ddIdHd}|dIdHWdn1s0YWdIdHqF1IdHs<0Y|rt|dIdHdtj vrpt ddSdtj vrt ddS)NrbFr|"rrrrrrrrrTrrz& Friendly Captcha was clicked!z* Friendly Captcha was NOT clicked!)rYrDrHrrrrrsrrrrrrEr)rrMrryrzrr{rr"r"r#Z__gui_click_friendly_captchasJ     ^  z Tab.__gui_click_friendly_captchar,c sz|j||dIdH}d}d|vrV|IdH}|j}|j}|j}|j} |||| d}n |dtt |IdH}|S)NrOrT)rrrrz4document.querySelector('%s').getBoundingClientRect()) rQrWrrrrrrrrr) rrMr=r coordinatesrXrrrrr"r"r#rls zTab.get_element_rectcsi}|dIdH}|dIdH}|dIdH}|dIdH}|dIdH}|dIdH}|dIdH}|dIdH} |d IdH} |d IdH} |d IdH} |d IdH} ||d <||d<||d<||d<||d<||d<|r|nd|d<|r|nd|d<|r |nd|d<| r2| nd|d<| rD| nd|d<| rV| nd|d<| rh| nd|d<| rz| nd|d<|S)Nzwindow.innerWidthzwindow.innerHeightzwindow.outerWidthzwindow.outerHeightzwindow.pageXOffsetzwindow.pageYOffsetzwindow.scrollXzwindow.scrollYzwindow.screenLeftzwindow.screenTopzwindow.screenXzwindow.screenYrdre outerWidth outerHeightrrr pageXOffset pageYOffsetscrollXscrollY screenLeft screenToprrr)rrrdrerrrrrrrrrrr"r"r#rm+s8zTab.get_window_rectc s|j||dIdH}|d}|d}|IdH}|d|d}|d}|d|d} |||d} |d} ttd rtjd kr|d |d } | d krd } n | dkrd} | | } | | } | |d} | |d} ||| | dS)z9(Coordinates are relative to the screen. Not the window.)rONrrrrerrr`Zoperarrd8rrr)rrrr)rlrmhasattrrdr`) rrMr=ruZe_widthZe_heightrxZ w_bottom_yZviewport_heightrrZy_scroll_offsetryr"r"r#rnIs.  zTab.get_gui_element_rectcs|dIdHS)Nzdocument.titlerr$r"r"r# get_titledsz Tab.get_titlecs|dIdHS)Nzwindow.location.hrefrr$r"r"r#get_current_urlgszTab.get_current_urlcs|dIdHS)Nzwindow.location.originrr$r"r"r# get_originjszTab.get_origincs(|j||dIdH}||IdHdSNrO)rLZsend_keys_async)rrMr:r=rr"r"r# send_keysmsz Tab.send_keyscs|j|||dIdHdSr)r)rrMr:r=r"r"r#typeqszTab.typecs&|j||dIdH}|IdHdSr)rL click_async)rrMr=rr"r"r#clicktsz Tab.clickcs|}d|vr tj|ddd\}}||IdHr|tt2|j|ddIdH}|IdHWdq1sp0Ynz|dkrdSttV|j||dIdH||IdHr|j|ddIdH}|IdHWdn1s0YdS)NrTz css selectorT)ZbyZxp_okrRrOr)rZrecalculate_selectorrYrrErLr)rrMr=Zoriginal_selectorrjrr"r"r#click_if_visiblexs   . zTab.click_if_visiblecs<|j||dIdH}|IdH|j|||dIdHdS)zClick an element at an {X,Y}-offset location. {0,0} is the top-left corner of the element. This method is used to click on CAPTCHAs.rONr)rLZscroll_into_view_asyncr)rrMrrrr=rr"r"r#rtszTab.click_with_offsetc s0|dIdH|IdH}||IdHr0nf||IdHrR|IdH}|S|IdHrr|IdH}|S|IdHr|IdH}|SdSd}| dIdHrd}np| dIdHrd}nX| dIdHrd}n@| dIdHrd}n&| dIdHrd}n | d IdHr.d }n| d IdHrFd }n| d IdHr^d }n| d IdHrvd }n| d IdHrd }n| dIdHrd}n|| dIdHrd}nd| dIdHrd}nL| dIdHrd}n4| dIdHrd}n| dIdHrd}ndS|s,dS| dIdHr| dIdHs| dIdHs| dIdHs| dIdHrd}t t  | |IdHWdn1s0Yn*| dIdHr>| dIdHs| dIdHr>d}t t  | |IdHWdn1s20Yn| dIdHsb| dIdHrd}t t  | |IdHWdn1s0YnP| d IdHrd!}t t  | |IdHWdn1s0Yt t |d"IdH|j |d#d$IdH}|d%}|d&}d'}d(} ttjIdHrRd'} ||} || } | | ft_|dIdHttjj} | 4IdH^|IdH|d"IdH|j||| d#d$IdH|d)IdHWdIdHq 1IdHs0YWdd*S1s"0YdS)+zThis method does a few things to click a CAPTCHA: 1. Checks to see if a CAPTCHA is on the current page. 2. If found, calls `click_with_offset(*)` to click it.rjNFz[class="cf-turnstile"]z#challenge-form div > divz [style="display: grid;"] div divz[class*=spacer] + div divz.spacer div:not([class])z[data-testid*="challenge-"] divz%div#turnstile-widget div:not([class])zngx-turnstile div:not([class])z1form div:not([class]):has(input[name*="cf-turn"])zform div:not(:has(*))z#body > div#check > div:not([class])z.cf-turnstile-wrapperz"[id*="turnstile"] div:not([class])z%[class*="turnstile"] div:not([class])z"[data-callback="onCaptchaSuccess"]z[div:not([class]):not([id]):not([aria-label]) > div:not([class]):not([id]):not([aria-label])formzform[class*="center"]zform[class*="right"]zform div[class*="center"]zform div[class*="right"]avar $elements = document.querySelectorAll( 'form[class], form div[class]'); var index = 0, length = $elements.length; for(; index < length; index++){ the_class = $elements[index].getAttribute('class'); new_class = the_class.replaceAll('center', 'left'); new_class = new_class.replaceAll('right', 'left'); $elements[index].setAttribute('class', new_class);}zform div[style*="center"]zform div[style*="right"]avar $elements = document.querySelectorAll( 'form[style], form div[style]'); var index = 0, length = $elements.length; for(; index < length; index++){ the_style = $elements[index].getAttribute('style'); new_style = the_style.replaceAll('center', 'left'); new_style = new_style.replaceAll('right', 'left'); $elements[index].setAttribute('style', new_style);}z'form [id*="turnstile"] div:not([class])z*form [class*="turnstile"] div:not([class])avar $elements = document.querySelectorAll( 'form [id*="turnstile"]'); var index = 0, length = $elements.length; for(; index < length; index++){ $elements[index].setAttribute('align', 'left');} var $elements = document.querySelectorAll( 'form [class*="turnstile"]'); var index = 0, length = $elements.length; for(; index < length; index++){ $elements[index].setAttribute('align', 'left');}z/[style*="text-align: center;"] div:not([class])avar $elements = document.querySelectorAll( '[style*="text-align: center;"]'); var index = 0, length = $elements.length; for(; index < length; index++){ the_style = $elements[index].getAttribute('style'); new_style = the_style.replaceAll('center', 'left'); $elements[index].setAttribute('style', new_style);}rkrrOrr rZT)rHrP_Tab__on_a_cf_turnstile_page_Tab__on_a_g_recaptcha_page_Tab__gui_click_recaptcha#_Tab__on_an_incapsula_hcaptcha_page"_Tab__cdp_click_incapsula_hcaptcha _Tab__on_a_friendly_captcha_page _Tab__gui_click_friendly_captcharSrrErrnr@ror rprdrqrrrrrsrrt) rr]resultrMscriptrurvrwryrzrrr{r"r"r# solve_captchas         4 2  2 0    >"zTab.solve_captchacs|IdHdSr)rr$r"r"r# click_captchaCszTab.click_captchacs|tjIdHSr)rfrgrxryr$r"r"r#ryFszTab.get_documentcs|tjIdHSr)rfrgrxget_flattened_documentr$r"r"r#rIszTab.get_flattened_documentcst|jjs|IdHd|jdddd}|tjtjjd|dIdH}i}|D]}|d||d<qZ|S) zq Get local storage items as dict of strings. Proper deserialization may need to be done. NrrrlTZis_local_storageZsecurity_originrr) rrirrrfrg dom_storageZget_dom_storage_items StorageId)roriginrTretvalrKr"r"r#get_local_storageLs  zTab.get_local_storagedict)rTcsVjjsIdHdjddddtjfdd|DIdHdS)z Set local storage. Dict items must be strings. Simple types will be converted to strings automatically. :param items: dict containing {key:str, value:str} :type items: dict[str,str] Nrrrlc s<g|]4\}}tjjtjjddt|t|dqS)Tr)Z storage_idrr)rfrgrZset_dom_storage_itemrr)rrvalrrr"r#rls z)Tab.set_local_storage..)rrirrr@ZgatherrT)rrTr"rr#set_local_storage`s  zTab.set_local_storage)r:rMr=cCs|j|||dS)z Alias to query_selector_all or find_elements_by_text, depending on whether text= is set or selector= is set. :param selector: css selector string :type selector: str )rMr:r=rO)rr:rMr=r"r"r#__call__zs z Tab.__call__)otherc Cs,z|j|jkWSttfy&YdS0dS)NF)rrbrF)rrr"r"r#__eq__sz Tab.__eq__cCs>zt|j|WSty8td|jjd|Yn0dS)Nrz" has no attribute "%s")rc_targetrbr!__name__)rrKr"r"r# __getattr__s  zTab.__getattr__c CsHd}|jjrd|jjd}dt|jd|jd|jd|d }|S) Nrz[url: ])rrirrrtype_)rextrasr"r"r#__repr__s (z Tab.__repr__)N)FTr8)r8)r8)r8F)r\FF)r\)N)N)FT)TN)FT)T)rrrr)rrrr)rrrrr)r)r)rrr8)N)rrF)r)T)N)r,)r,)r,)r,)r,)r)Fr,)rrr8)Yr __module__ __qualname____doc____annotations__rrr%r*propertyr/r6r7rLrQrUr[rer4rWrrRrDrrrrrrrrrrrrrrrrrrrrrrrrrPrrrr5r6rr=rMrPrQrSrYrrrrrrrrlrmrnrrrrrrrrtrrryrrrrrrr __classcell__r"r"r r#rs h    =$(3 9.Y_(     =  ):;"   .-(       1r). __future__rr@r)r&loggingr rrrFr"r contextlibrfilelockrZ seleniumbaserrdZseleniumbase.fixturesrrrr typingr r r r rrrZ cdp_browserrrrr connectionrrZmycdprg getLoggerrloggerrr"r"r"r#s2