AHj^HdZddlmZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl mZmZmZmZddlmZddlmZmZmZmZddlmZdd lmZerdd lmZdd lm Z dd l!m"Z"dd l#m$Z$edZ%ede&Z'ejPe)Z*GddeZ+d9dZ,d:dZ-d;dZ.ddZ2d?dZ3d@dZ4dAdZ5dBdZ6dCd Z7dDd!Z8dEd"Z9d#Z:dFd$Z;dGd%ZedJd(Z>edKd)Z>edLd*Z>edMd+Z>d,Z>dNd-Z?dOdPd.Z@dQd/ZAdRd0ZBdSd1ZCd2ZDdTd3ZEdOdUd4ZF dO dVd5ZGdWd6ZHdXd7ZIdYd8ZJy)Zz Miscellaneous helper functions. The formatter for ANSI colored console output is heavily based on Pygments terminal colorizing code, originally by Georg Brandl. ) annotationsN)Callable GeneratorIterableSequence)Enum) TYPE_CHECKINGAnyTypeVaroverload) ResponseError)TimeoutFormatError)RedisJobQueue BaseWorker_T_O)boundc eZdZdZdZdZdZdZy)Platformz0Enum representing the operating system platform.windowsmaclinuxothersN)__name__ __module__ __qualname____doc__WINDOWSMACLINUXOTHERS@/root/tools/cai/cai_env/lib/python3.12/site-packages/rq/utils.pyrr0s:G C E Fr)rc tjj}|jdrtj S|dk(rtj S|jdrtjStjS)aCDetect and return the current operating system platform. Returns: Platform: The detected platform enum value. - Platform.WINDOWS for Windows systems - Platform.MAC for macOS systems - Platform.LINUX for Linux systems - Platform.OTHERS for any other platform windarwinr) sysplatformlower startswithrr$r%r&r')r/s r* get_platformr29sd||!!#H5! X ||   W %~~r)ctj|r|j|jfStj|stj |rd|j d|jfSt|tr dt|fStj|st|dr|dfStd|)aResolve a function reference into instance and function name components. Args: func: The function reference to resolve - can be a method, function, builtin, string path, or callable class instance. Returns: A tuple of (instance, func_name) where: - instance: The object instance (for methods/callable instances) or None - func_name: The string representation of the function name/path Raises: TypeError: If func is not a valid callable or string reference. N.__call__z*Expected a callable or a string, but got: )inspectismethod__self__r isfunction isbuiltinr!r" isinstancestras_textisclasshasattr TypeError)funcs r*resolve_function_referencerBOs}}dmm++   D !W%6%6t%<($*;*;)<=== D# WT]"" __T "wtZ'@ZDTFKLLr)c2|Dcgc]}|| c}Scc}w)zExcludes `None` values from a list-like object. Args: lst (list): A list (or list-like) object Returns: object (list): The list without None values r()lstitems r*compactrFjs! 5TD$4D 55 5sct|tr|jdSt|tr|St dt |)zConverts a bytes value to a string using `utf-8`. Args: v (Union[bytes, str]): The value (bytes or string) Raises: ValueError: If the value is not bytes or string Returns: value (str): The decoded string zutf-8z Unknown type )r;bytesdecoder< ValueErrortype)vs r*r=r=vsB!Uxx  As =a 455r)F) decode_valuesc|r6|jDcic]\}}t|t|c}}S|jDcic]\}}t||c}}Scc}}wcc}}w)aDecodes the Redis hash, ensuring that keys are strings Most importantly, decodes bytes strings, ensuring the dict has str keys. Args: h (Dict[Any, Any]): The Redis hash decode_values (bool): If True, also decode values to strings using as_text(). Defaults to False. Returns: Dict[str, Any]: The decoded Redis data (Dictionary) When decode_values=True, returns Dict[str, str] )itemsr=)hrMkrLs r*decode_redis_hashrRsZ34779=41a GAJ&==&'ggi 0daGAJM 00> 0s A& A,zcd tj|S#ttf$r tcYSwxYw)zCReturn JSON string if serializable, otherwise a placeholder string.)jsondumpsr@rJNOT_JSON_SERIALIZABLE)values r*safe_json_dumpsrXs0%zz%  z "%$$%s //c|jd}|dd|dg}}d}t|r( dj|}tj|} | t|Sdj|}t||r t||S|j}dj|} t||}t||std|t||S#t $r#|j d|jYnwxYwt|r#t$rtd|wxYw#td|xYw)a#Returns an attribute from a dotted path name. Example: `path.to.func`. When the attribute we look for is a staticmethod, module name in its dotted path is not the last-before-end word E.g.: package_a.package_b.module_a.ClassA.my_static_method Thus we remove the bits from the end of the name until we can import it Args: name (str): The name (reference) to the path. Raises: ValueError: If no module is found or invalid attribute name. Returns: Any: An attribute (normally a Callable) r4NrzInvalid attribute name: ) splitlenjoin importlib import_module ImportErrorinsertpop __builtins__KeyErrorrJr?getattr) name name_bitsmodule_name_bitsattribute_bitsmodule module_nameattribute_nameattribute_owner_nameattribute_owners r*import_attributerosn& 3I'0"~ " n F   =((#34K,,[9F ~ @% %XXn-Nv~&v~..#'')N88N3F!&*>? ?N 33D6:;; ?N 33/ =  ! !!%5%9%9%; < =   @7v>? ? @F3N3CDEEs)&CD) D2)DDD/2Ect|}t|tstd|ddlm}t ||std||S)z.Import a worker class from a dotted path name.zInvalid worker class: rr)ror;rKrJworkerr issubclass)rfclsrs r*import_worker_classrtsN 4 C c4 1$899" c: &1$899 Jr)ct|}t|tstd|ddlm}t ||std||S)z+Import a job class from a dotted path name.zInvalid job class: rr)ror;rKrJjobrrr)rfrsrs r*import_job_classrwsN 4 C c4 .tf566 c3 .tf566 Jr)ct|}t|tstd|ddlm}t ||std||S)z-Import a queue class from a dotted path name.zInvalid queue class: rr)ror;rKrJqueuerrr)rfrsrs r*import_queue_classrzsN 4 C c4 0788 c5 !0788 Jr)cLtjj|vxs|jd}|s|S|}|jdr|dd}|j tjjr|dd}|j tjjd}|S)a"Normalize configuration path to dotted module path format. Converts file paths like 'directory/config_file.py' or 'directory.config_file' to dotted module paths like 'directory.config_file' for use with importlib.import_module(). Args: config_path: Either a file path (e.g., 'app/cron_config.py', 'app/cron_config') or a dotted module path (e.g., 'app.cron_config') Returns: A dotted module path suitable for importlib.import_module() Examples: normalize_config_path('app/cron_config.py') -> 'app.cron_config' normalize_config_path('app/cron_config') -> 'app.cron_config' normalize_config_path('app.cron_config') -> 'app.cron_config' normalize_config_path('/abs/path/to/config.py') -> 'abs.path.to.config' z.pyNrr4)ospathsependswithr1replace) config_path is_file_path normalizeds r*normalize_config_pathrs(77;;+-L1E1Ee1LL J5!_ RWW[[)^ ##BGGKK5J r)ctjj|std|dtjj |st d|d|S)amValidate that an absolute file path exists and points to a file. Args: file_path: The absolute file path to validate Returns: The same file path if validation passes (for chaining) Raises: FileNotFoundError: If the file does not exist IsADirectoryError: If the path points to a directory instead of a file Examples: validate_absolute_path('/path/to/config.py') # Returns '/path/to/config.py' validate_absolute_path('/path/to/missing.py') # Raises FileNotFoundError validate_absolute_path('/path/to/directory') # Raises IsADirectoryError z!Configuration file not found at ''z7Configuration path points to a directory, not a file: ')r}r~existsFileNotFoundErrorisfileIsADirectoryError) file_paths r*validate_absolute_pathr3sW$ 77>>) $"CI;a PQQ 77>>) $"YZcYdde fgg r)cptjjtjjS)zReturn now in UTC)datetimenowtimezoneutcr(r)r*rrNs%    !2!2!6!6 77r)z%Y-%m-%dT%H:%M:%S.%fZc>|jttSN)strftimer=_TIMESTAMP_FORMAT)dts r* utcformatrVs ;;w01 22r)c tjj|t}|j tj j S#t$r#tjj|d}YUwxYw)Nz%Y-%m-%dT%H:%M:%SZ)tzinfo)rstrptimerrJrrr)stringparseds r*utcparserZslJ""++F4EF >>!2!2!6!6> 77 J""++F4HIJs$A)A<;A<cHt|txrt|t S)zReturns whether the obj is an iterable, but not a string Args: obj (Any): _description_ Returns: bool: _description_ )r;rr<objs r*is_nonstring_iterablercs  c8 $ AZS-A)AAr)cyrr(rs r*ensure_job_listro,/r)cyrr(rs r*rrqrr)cyrr(rs r*rrssNQr)cyrr(rs r*rrus47r)cyrr(rs r*rrws*-r)c^t|trt|ts t|S|gS)zWhen passed an iterable of objects, convert to list, otherwise, it returns a list with just that object in it. Args: obj (Any): _description_ returns: List: _description_ )r;rr<listrs r*rr{s)#31*S#:N49YUXTYYr)cXtjtjS)zKReturns current UTC timestamp Returns: int: _description_ )calendartimegmr utctimetupler(r)r*current_timestamprs ??35--/ 00r)cX| t||St|tr t|S|S)aGet a backend class using its default attribute name or an override Args: holder (_type_): _description_ default_name (_type_): _description_ override (_type_, optional): _description_. Defaults to None. Returns: _type_: _description_ )rer;r<ro)holder default_nameoverrides r* backend_classrs1v|,, Hc "))r)c|s tdt|trt|j St|S)Nz#Empty string or bytestring provided)rJr;rHrrI)date_strs r* str_to_daters8 >?? h &HOO-. .H% %r)cVt|tjs| t|}|S| t|SdS#t$ret|t sJ|dd|ddj }}ddddd} t|||z}n#ttf$r tdwxYwY|wxYw) zGTransfer all kinds of timeout format to an integer representing secondsNrZiQi<r)drPmszTimeout must be an integer or a string representing an integer, or a string with format: digits + unit, unit can be "d", "h", "m", "s", such as "1h", "23m".) r;numbersIntegralintrJr<r0rdr)timeoutdigitunit unit_seconds r* parse_timeoutrs gw// 0W5H 'lGN#.3w<8D8 gs+ ++!#2,(<(<(>4E %DrBK e*{4'88) (+  s' ::B(5BB(B""B('B(ct t|ddst|jdd}|jdddDcgc] }t |}}t |dkr |j dt |dkr t|dt|t|dScc}w#t$rYywxYw) a/ Returns tuple of Redis server version. This function also correctly handles 4 digit redis server versions. Args: connection (Redis): The Redis connection. Returns: version (Tuple[int, int, int]): A tuple representing the semantic versioning format (eg. (5, 0, 9)) __rq_redis_server_versionNserver redis_versionr4r)r ) rer<infor[rr\appendsetattrtupler ) connection version_stri version_partss r* get_versionrsz#>Ejooh7HIK-8->->s-CBQ-GHSVHMHm$q($$Q'm$q( +m$  z#>??I s*AB+B&/B+!B+&B++ B76B7c| |z S)zCeiling division. Returns the ceiling of the quotient of a division operation Args: a (_type_): _description_ b (_type_): _description_ Returns: _type_: _description_ r()abs r*ceildivrsR1W:r)c#VKtdt||D] }||||zyw)zSplits a list into multiple smaller lists having size `segment_size` Args: a_list (Sequence[Any]): A sequence to split segment_size (int): The segment size to split into Yields: list: The splitted listed rN)ranger\)a_list segment_sizers r* split_listrs61c&k< 0+Q\)**+s')c:||St||kDr|d|dzS|S)aTruncate arguments with representation longer than max_length Args: data (str): The data to truncate max_length (Optional[int], optional): The max length. Defaults to None. Returns: truncated (str): The truncated string Nz...)r\)data max_lengths r*truncate_long_stringrs1 *-d)j*@D*  %JdJr)c H|y|Dcgc] }ttt||"}}|jDcgc](\}}|dttt||*}}}|t |z }dj |}|d|dScc}wcc}}w)a Returns a string representation of the call, formatted as a regular Python function invocation statement. If max_length is not None, truncate arguments with representation longer than max_length. Args: func_name (str): The function name args (Any): The function arguments kwargs (Dict[Any, Any]): The function kwargs max_length (int, optional): The max length. Defaults to None. Returns: str: A string representation of the function call. N=z, ())r=rreprrOsortedr]) func_nameargskwargsrargarg_listrQrL list_kwargss r*get_call_stringrs"PTU,T#Y CDUHU[a[g[g[ijSWSTVWaS'"6tAw "KLMNjKj {##H 99X D[$q !! Vjs %B-Bcddlm}g}|D]D}t||r|j|j+|jt |F|S)z;Given a iterable of strings or queues, returns queue namesrr)ryrr;rrfr<)queues_or_namesrnames queue_or_names r* parse_namesr+sM E(- mU + LL++ , LL]+ , - Lr)cRddlm}|D]}t||s|jcSy)z7Given a list of strings or queues, returns a connectionrrN)ryrr;r)rrrs r*get_connection_from_queuesr8s/(, mU + ++ +, r)c|jd}t|dk(r$tjd|t|ddfS|\}}||fS)zMethod returns a parsed composite key. Args: composite_key (str): the composite key to parse Returns: tuple[str, str]: tuple of job id and the execution id :rz4Composite key must contain job_id:execution_id, got r)r[r\warningswarnDeprecationWarning) composite_keyresultjob_id execution_ids r*parse_composite_keyrBs`  %F 6{a  B=/ R  q 2!FL L !!r))returnr)rztuple[Any, str])rDzIterable[_T | None]rzlist[_T])rL bytes | strrr<)rPzdict[bytes | str, Any]rMboolrzdict[str, Any])rWr rr<)rfr<rzCallable[..., Any])rfr<rztype[BaseWorker])rfr<rz type[Job])rfr<rz type[Queue])rr<rr<)rr<rr<)rdatetime.datetime)rrrr<)rr<rr)rr rr)rr<r list[str])rrrz list[Job])rzJob | str | Sequence[Job | str]rzlist[Job | str])rz Iterable[_O]rlist[_O])rrrr)rrr)rrK)rrrr)rzint | float | str | Noner int | None)rrrztuple[int, int, int])rz Sequence[_T]rrrz#Generator[Sequence[_T], None, None])rr<rrrr<) r str | Nonerr rzdict[Any, Any]rrrr )rIterable[str | Queue]rr)rr rz Redis | None)rr<rztuple[str, str])Kr# __future__rrrr^r6rTloggingrr}r.rcollections.abcrrrrenumrtypingr r r r redis.exceptionsr exceptionsrredisrrvrryrrqrrobjectr getLoggerr loggerrr2rBrFr=rRrVrXrortrwrzrrrrrrrrrrrrrrrrrrrrr(r)r*rs#  CC+*" T] T    8 $t,M6 66(KP1"2%24j   (V68 ,38 B / / / / Q Q 7 7 - - Z1&&9,<  + K X\""!$".<"JT"": "r)