a &jd@sddlmZddlZddlZddlmZmZddlmZm Z m Z m Z m Z m Z mZmZddlmZmZmZmZmZddlZddlmZmZmZddlmZmZmZdd lm Z d Z!Gd d d eZ"Gd ddZ#Gddde#Z$dS)) annotationsN)MappingMutableMapping)AnyDict ItemsViewIteratorKeysViewOptionalUnion ValuesView) ParseResultquoteunquote urlencodeurlparse) ProxyErrorURLErrorURLParamsError)URL_ALLOWED_PARAMS URLParamTypesURLTypes)to_str)URL URLParamsProxyc@s*eZdZdZd;ddddZeddd d Zdra A mapping-like object for managing URL query parameters. This class provides a dictionary-like interface for URL parameters, handling the normalization of keys and values into the correct string format and encoding them into a query string. It supports multi-value parameters. Attributes: params (str): The URL-encoded query string representation of the parameters. Examples: >>> params = URLParams({'key1': 'value1', 'key2': ['value2', 'value3']}) >>> print(str(params)) 'key1=value1&key2=value2&key2=value3' >>> params.update({'key3': 4, 'active': True}) >>> print(params) 'key1=value1&key2=value2&key2=value3&key3=4&active=true' >>> 'key1' in params True NzOptional[URLParamTypes])paramscKs|j|fi||_dS)am Initializes the URLParams object. Args: params: A dictionary, another URLParams instance, or a list of tuples to initialize the parameters. **kwargs: Additional key-value pairs to add or overwrite parameters. Raises: URLParamsError: If `params` is not a valid mapping type. N)_prepare_dataselfrkwargsr#>E:\soccer\ml_env\Lib\site-packages\tls_requests/models/urls.py__init__.s zURLParams.__init__strreturncCst|S)z5Returns the encoded URL parameters as a query string.)r&r!r#r#r$r<szURLParams.paramsrNone)rr"r(cKs|j|j|fi|dS)z Updates the current parameters with new ones from a mapping or keyword args. Args: params: A dictionary-like object of parameters to add. **kwargs: Additional key-value pairs to add. N)rupdaterr r#r#r$r+AszURLParams.updater cCs |jS)z%Returns a view of the parameter keys.)rkeysr)r#r#r$r,KszURLParams.keysr cCs |jS)z'Returns a view of the parameter values.)rvaluesr)r#r#r$r-OszURLParams.valuesrcCs |jS)z0Returns a view of the parameter key-value pairs.)ritemsr)r#r#r$r.SszURLParams.itemscCs||jS)z/Returns a shallow copy of the current instance.) __class__rcopyr)r#r#r$r0WszURLParams.copycCst|jddS)z@Returns the URL-encoded string representation of the parameters.T)doseq)rrr)r#r#r$__str__[szURLParams.__str__cCsd|jj|fS)z9Returns the official string representation of the object.<%s: %s>)r/__name__r.r)r#r#r$__repr___szURLParams.__repr__bool)keyr(cCs ||jvS)z)Checks if a key exists in the parameters.rr!r7r#r#r$ __contains__cszURLParams.__contains__)r7valuer(cCs||j|<dS)z7Sets a parameter key-value pair, normalizing the input.Nr8)r!r7r;r#r#r$ __setitem__gszURLParams.__setitem__cCs |j|S)zRetrieves a parameter value.r8r9r#r#r$ __getitem__kszURLParams.__getitem__cCs |j|=dS)zDeletes a parameter key.Nr8r9r#r#r$ __delitem__oszURLParams.__delitem__rcCs t|jS)z,Returns an iterator over the parameter keys.)iterrr)r#r#r$__iter__sszURLParams.__iter__intcCs t|jS)z!Returns the number of parameters.)lenrr)r#r#r$__len__wszURLParams.__len__cCs tt|S)z1Returns the hash of the encoded parameter string.)hashr&r)r#r#r$__hash__{szURLParams.__hash__cCs6t||js&t|tr"||}ndSt|j|jkS)z:Checks for equality based on the encoded parameter string.F) isinstancer/rr6r)r!otherr#r#r$__eq__s    zURLParams.__eq__zDict[str, Any]c s|duri}n6t|jr(t|}nt|trz&URLParams._prepare..) rFr/dictr.rrr+r&byteslisttuplesetrI)r!rr"preparedresultkvr#r)r$rs"     zURLParams._preparer)rKcCsNt|tttttfstdt|tr2t|St|trF|dSt|S)a Converts a supported type into a string. Args: s: The value to normalize (str, bytes, int, float, bool). Returns: The normalized string value. Raises: URLParamsError: If the value type is not supported. zInvalid parameters value type.utf-8) rFr&rOrAfloatr6rlowerdecode)r!rKr#r#r$rIs     zURLParams.normalize)N)N)N)r4 __module__ __qualname____doc__r%propertyrr+r,r-r.r0r2r5r:r<r=r>r@rCrErHrrIr#r#r#r$rs*  %rc@seZdZdZdZd%dddddZed d Zejd d Zed d Z e jdd Z eddddZ eddddZ eddddZ ddZ ddZdddddZd&d!dd"d#d$ZdS)'ras A class for parsing, manipulating, and constructing URLs. This class provides a structured way to interact with URL components, integrating with `URLParams` for easy query string management. It handles IDNA encoding for hostnames and ensures proper URL construction. Attributes: url (str): The full URL string. Can be set to re-parse. params (URLParams): An object managing the URL's query parameters. parsed (ParseResult): The result from `urllib.parse.urlparse`. scheme (str): The URL scheme (e.g., "https"). netloc (str): The network location part (e.g., "user:pass@host:port"). host (str): The hostname, IDNA-encoded. port (str): The port number as a string, if present. path (str): The hierarchical path. query (str): The complete query string, combining original and added params. fragment (str): The fragment identifier. username (str): The username for authentication. password (str): The password for authentication. auth (tuple): A (username, password) tuple. Examples: >>> url = URL("https://example.com/path?q=1#fragment", params={"key": "value"}) >>> print(url.scheme) 'https' >>> print(url.host) 'example.com' >>> print(url.query) 'q=1&key=value' >>> url.params.update({'key2': 'value2'}) >>> print(unquote(url.url)) 'https://example.com/path?q=1&key=value&key2=value2#fragment' >>> url.url = 'https://httpbin.org/get' >>> print(unquote(url.url)) 'https://httpbin.org/get?key=value&key2=value2' )authschemehostportpathfragmentusernamepasswordNrr)urlrcKs |||_d|_t||_dS)aQ Initializes the URL object. Args: url: The URL string, bytes, or another URL object. params: A dictionary-like object to be used as query parameters. **kwargs: Additional keyword arguments for URLParams. Raises: URLError: If the provided URL is invalid. N)r_parsed_urlr_params)r!rgrr"r#r#r$r%s z URL.__init__cCs|jdur|d|_|jS)z#The full, reconstructed URL string.NF)ri_buildr)r#r#r$rg s  zURL.urlcCs|||_|d|_dS)z/Allows setting a new URL, which will be parsed.FN)rrhrkrir!r;r#r#r$rgs cCs|jS)z5The `URLParams` object for managing query parameters.)rjr)r#r#r$rsz URL.paramscCsd|_t||_dS)zSets a new `URLParams` object.N)rirrjrlr#r#r$rsr r'cCs|jS)z3The `ParseResult` object from the standard library.)rhr)r#r#r$parsed"sz URL.parsedr&cCsD|j}d|vr*|dr"|ds*d|}|jr@d||jgS|S)z.The network location, including host and port.:[]z[%s])ra startswithendswithrbjoin)r!rar#r#r$netloc'sz URL.netloccCsVd}|jjr0|jjr0dt|jj|jjg}n"|jjrB|jj}n|jjrR|jj}|S)zAThe combined query string from the original URL and the `params`.&)rmqueryrrsr)r!rwr#r#r$rw/s z URL.querycCs|S)z3Returns the full URL string with the real password.)rkr)r#r#r$r2;sz URL.__str__cCsd|jjt|dfS)zd}|rHd}dd||g|jg}|||jptd}|jr|d||jgn |||jr|d|jd|S)z Constructs the URL string from its components. Args: secure: If True, masks the password in the output. Returns: The final URL string. rurz[secure]rrnr|r}) r`rtrerfrsrrcrwrd)r!rr`urlsrrerfrcr#r#r$rks*        z URL._build)N)F)r4r[r\r]rr%r^rgsetterrrmrtrwr2r5rrkr#r#r#r$rs*(      rc seZdZdZdZd4dddddddddd d d d d fd dZddZeddddZej dddddZdddfdd Z d5dddd d!Z d"d#Z d$d%Z d6d d&d'd(Zd)d*Zed+d,d-d.d/Zed7ddd,d1d2d3ZZS)8ra= A specialized URL class for managing proxy configurations and performance. This class inherits from `URL` and extends it with features for proxy rotation strategies, such as weighting, success/failure tracking, and metadata. It restricts the allowed URL schemes to those common for proxies. Attributes: ALLOWED_SCHEMES (tuple): Allowed proxy schemes ('http', 'https', 'socks5', 'socks5h'). weight (float): The weight of the proxy, used in selection algorithms. region (Optional[str]): A geographical or logical region identifier. latency (Optional[float]): The last recorded latency in seconds. success_rate (Optional[float]): A score indicating reliability (0.0 to 1.0). meta (Dict[str, Any]): A dictionary for arbitrary user-defined data. failures (int): A counter for consecutive connection failures. last_used (Optional[float]): A timestamp of the last time the proxy was used. Examples: >>> proxy = Proxy("http://user:pass@127.0.0.1:8080", weight=5.0, region="us-east") >>> proxy.mark_failed() >>> print(proxy.failures) 1 >>> print(proxy.weight) 4.25 >>> proxy.mark_success() >>> data = proxy.to_dict() >>> print(data['url']) 'http://user:pass@127.0.0.1:8080' )httphttpsZsocks5Zsocks5hN?)weightregionlatency success_ratemetarrrXz Optional[str]zOptional[float]zOptional[Dict[str, Any]])rgrrrrrrc  sJ|pd|_||_||_||_|p"i|_d|_d|_tj|fi|dS)a Initializes the Proxy object. Args: url: The proxy URL string, bytes, or another URL object. params: URL parameters (rarely used for proxies). weight: The initial weight for proxy selection (higher is more likely). region: An identifier for the proxy's region. latency: The initial or last known latency in seconds. success_rate: A score from 0.0 to 1.0 indicating reliability. meta: A dictionary for storing arbitrary user data. **kwargs: Additional keyword arguments passed to the parent `URL` class. Raises: ProxyError: If the URL is invalid or the scheme is not supported. rrN) _weightrrrrfailures last_usedsuperr%) r!rgrrrrrrr"r/r#r$r% s  zProxy.__init__cCs$d|jjt|dt|ddfS)z=Returns a secure representation of the proxy with its weight.z<%s: %s, weight=%s>TrZunset)r/r4rrkgetattrr)r#r#r$r5/s   zProxy.__repr__r'cCs |jpdS)Nr)rr)r#r#r$r7sz Proxy.weightr*)rr(cCs.zt||_Wnty(tdYn0dS)Nz#Weight must be an integer or float.)rXrrr)r!rr#r#r$r;s rxr rycszt|tr|d}nt|}|}d|vr:d|}tt||}t|j |j vrpt d|jdt tt |jdtt |j}d|_d|_|WStyt dt |Yn0dS) a Parses the proxy URL, ensuring it has a valid scheme and format. Overrides the parent `_prepare` to enforce proxy-specific rules. Args: url: The proxy URL to prepare. Returns: A `ParseResult` object containing only scheme and netloc. Raises: ProxyError: If the URL is invalid or the scheme is not allowed. rWrzr~zInvalid proxy scheme `zB`. The allowed schemes are ('http', 'https', 'socks5', 'socks5h').ruzInvalid proxy: N)rFrOrZr&striprrrr`rYALLOWED_SCHEMESrrrrtrcrdr)r!rgZurl_strrmrr#r$rBs$    $ zProxy._prepareFr6r&rcCs^|jpddg}|j}|js |jrJd|j|jg}|r:d}d||jg}||d|S)z Constructs the proxy URL string. Overrides the parent `_build` to exclude path, query, and fragment. Args: secure: If True, masks the password. Returns: The proxy URL string. rrzrnrrru)r`rtrerfrsr)r!rrruserinfor#r#r$rkjs   z Proxy._buildcCst|_dS)z3Sets the `last_used` timestamp to the current time.N)timerr)r#r#r$ mark_usedszProxy.mark_usedcCs$|jd7_td|jd|_dS)z Records a connection failure. Increments the failure count and applies a decay factor to the weight. rg?g333333?N)rmaxrr)r#r#r$ mark_failedszProxy.mark_failed)rcCsF|r ||_td|jd|_|jp$ddd|_td|jd|_dS) z Records a connection success. Resets failure count, updates latency, and improves success rate and weight. Args: latency: The observed connection latency in seconds for this success. rrrgffffff?g?g$@g?N)rrrrminr)r!rr#r#r$ mark_successs zProxy.mark_successcCs|j|j|j|j|j|jdS)z Serializes the proxy's state to a dictionary. Returns: A dictionary containing the proxy's URL and performance metrics. rgrrrrrrr)r#r#r$to_dictsz Proxy.to_dictzdict[str, Any]z'Proxy')datar(cCs,d|vrtd|d}|fd|i|S)ab Creates a Proxy object from a dictionary. Args: data: A dictionary containing a 'url' key and other optional proxy attributes (`weight`, `region`, etc.). Returns: A new `Proxy` instance. Raises: ProxyError: If the 'url' key is missing from the dictionary. rgzUMissing required key: 'url'. The proxy configuration dictionary must include a 'url'.)rpop)clsrrgr#r#r$ from_dicts zProxy.from_dict|)raw separatorr(cCs|}|stddd||D}|d}d}d}t|dkrp|drpzt|d}WntynYn0t|d kr|dr|d}d |vrd |}||||d S) a Parses a proxy from a string with optional attributes. Handles various common formats for representing proxies in text files. Comments (#) and blank lines should be handled by the calling code. Supported Formats: - `http://user:pass@host:port` - `socks5://host:port` - `host:port` (defaults to http) - `host:port|weight` - `host:port|weight|region` - `http://user:pass@host:port|weight|region` Args: raw: The raw proxy string. separator: The character used to separate attributes (default: '|'). Returns: A new `Proxy` instance. Raises: ProxyError: If the proxy string is empty or malformed. zEmpty proxy string.cSsg|] }|qSr#)r)rJpr#r#r$rLrMz%Proxy.from_string..rrNrrrzr~)rr)rrrrBrX Exception)rrrpartsrgrrr#r#r$ from_strings" zProxy.from_string)N)F)N)r)r4r[r\r]rr%r5r^rrrrkrrrr classmethodrr __classcell__r#r#rr$rs2"%( r)% __future__rrrcollections.abcrrtypingrrrrr r r r urllib.parser rrrrr exceptionsrrrtypesrrrutilsr__all__rrrr#r#r#r$s ( 1%