jKj[dZddlmZmZmZmZmZmZddlm Z m Z m Z ddl m Z GddedZGd d edZd eed ee fd Zdeeefd e fdZded e fdZded ee fdZded eefdZded eefdZded eefdZdeeefd eefdZ d'deded ee fdZded ee fdZded efdZded e fd Zded e fd!Zded e fd"Zded eeeeffd#Z d$eeeefd ee fd%Z!d efd&Z"y)(z Gemini-specific conversion utilities. This module handles the conversion of Gemini API responses and inputs into standardized formats for PostHog tracking. )AnyDictListOptional TypedDictUnion)FormattedContentItemFormattedMessage TokenUsage)serialize_raw_usageceZdZUdZeed<y) GeminiPartz&Represents a part in a Gemini message.textN)__name__ __module__ __qualname____doc__str__annotations__s/Users/ahmed/devFolder/Ultron/claude-voice/.venv/lib/python3.12/site-packages/posthog/ai/gemini/gemini_converter.pyrrs 0 IrrF)totalcdeZdZUdZeed<eeee ee ffed<eeee fed<eed<y) GeminiMessagez9Represents a Gemini message with various possible fields.rolepartscontentrN) rrrrrrrrrrrrrrrrs?C I j$sCx.01 22 3S > "" Irrrreturncg}|D]c}t|trd|vr|jd|dd0t|tr|jd|dUt|trEd|vrA|d}|j dd}|j drdnd}|j||d t |dr%t|dd}|s|jd|dt |ds|j}t |drPt |d rD|j}|j drdnd}|j|||jd d P|jd|d f|S) aB Format Gemini parts array into structured content blocks. Preserves structure for multimodal content (text + images) instead of concatenating everything into a string. Args: parts: List of parts that may contain text, inline_data, etc. Returns: List of formatted content blocks rtyper inline_data mime_typezimage/imagedocument)r"r#data)r$r() isinstancedictappendrget startswithhasattrgetattrr#r$r()rcontent_blockspartr#r$ content_type text_values r_format_parts_as_content_blocksr4!sx24N dD !fn  ! !64<"H Ic "  ! !64"@ Ad # (=}-K# R8I&/&:&:8&D7*L  ! !(#. T6 " vr2J%%vz&JKT= )**K{K0W[&5Q'11 *3*>*>x*Hwj %% ,)2$/$4$4(%% ''2_l ritemcd|vr6t|dtr#t|d}|jdd|dSd|vre|d}t|tr t|}|jdd|dSt|ts t |}|jdd|dSd|vr|jdd|ddSdt |dS)z Format a dictionary message into standardized format. Args: item: Dictionary containing message data Returns: Formatted message with role and content rruserrrrr)r)listr4r,r)r5r0rs r_format_dict_messager:is$:d7mT:8gG0^LLDy/ gt $output candidaterr1rArJr#r$raw_datar(s rformat_gemini_responserQs&(F x&8+>+>!,,Iy),1B1B689,,g69;L;L;R;R ) 1 1 7 7"40TYY#NN,2,0II!"%T?;@R@R,0,>,>M#NN,60=0B0B5B5G5G1&!"%T=9d>N>N)*.*:*:K(/ [+(VI'.{FC'HH *(E:'-'7'7'A'H'H'Q(0#NN,31:,0!"I!8XMM$/'.F+  +-3Y^^$L#Mu-R M 6 "x}} #%+X]]CD   Mrc|rYt|drM|jrA|jd}t|dd}|#t|dr |jSt |Sy)z)Extract stop reason from Gemini response.r@r finish_reasonNrD)r.r@r/rDr)r>rOrSs rextract_gemini_stop_reasonrT"s^GHl38K8K''*  ?DA  $}f-$)))}% % rchunkct|S)z2Extract stop reason from a Gemini streaming chunk.)rT)rUs r%extract_gemini_stop_reason_from_chunkrW/s %e ,,rconfigc|yt|dr |jSt|tr d|vr|dSt|tr d|vr|dSy)z Extract system instruction from Gemini config parameter. Args: config: Config object or dict that may contain system instruction Returns: System instruction string if present, None otherwise Nsystem_instructionsystemInstruction)r.rZr)r*)rXs r!extract_gemini_system_instructionr\4sd~v+,((( FD !&:f&D*++ FD !&9V&C)** rkwargscHd|vrt|ddr|djSy)z Extract tool definitions from Gemini API kwargs. Args: kwargs: Keyword arguments passed to Gemini API Returns: Tool definitions if present, None otherwise rXtoolsN)r.r_)r]s rextract_gemini_toolsr`Ls.6gfX&6@h%%% rNcontentsct|}t|}|.td|D}|sddlm}d|d}|gt |z}|S)ax Format Gemini input contents into standardized message format, including system instruction handling. Args: contents: Input contents in various possible formats config: Config object or dict that may contain system instruction Returns: List of formatted messages with role and content fields, with system message prepended if needed c3DK|]}|jddk(yw)rsystemN)r,).0msgs r z2format_gemini_input_with_system..ps S@RH4@Rs r)r rdr8)format_gemini_inputr\anyposthog.ai.typesr r9)rarXformatted_messagesrZ has_systemr system_messages rformat_gemini_input_with_systemrn]sd-X6;6B%S@RSS  9!-0N#1!1D9K4L!L  rct|trd|dgSt|trug}|D]l}t|tr|jd|d(t|tr|jt |S|jt |n|St|tr t |gSt |gS)a Format Gemini input contents into standardized message format for PostHog tracking. This function handles various input formats: - String inputs - List of strings, dicts, or objects - Single dict or object - Gemini-specific format with parts array Args: contents: Input contents in various possible formats Returns: List of formatted messages with role and content fields r7r8)r)rr9r+r*r:r=)ra formattedr5s rrhrh}s$(C H566(D!,. D$$  &T!BCD$'  !5d!;<  !7!=>(D!$X.// #8 , --rct|drE|jr8|jD](}t|drl|jr`|j}t|dr|j}|t |dkDryt|dr|j }|t |dkDryt|ds|j st|j ds|j js|j jD]L}t|d s|jst|jd d j}d |vsd |vsKy+y)aO Extract web search count from Gemini response. Gemini bills per request that uses grounding, not per query. Returns 1 if grounding_metadata is present with actual search data, 0 otherwise. Args: response: The response from Gemini API Returns: 1 if web search/grounding was used, 0 otherwise r@grounding_metadataweb_search_queriesrgrounding_chunksrrrArDr% google_search grounding) r.r@rrrslenrurrrAr/lower)r>rOrrquerieschunksr1 function_names rextract_gemini_web_search_countr}s5x&8+>+>!,,I #7800%.%A%A"-/CD0CCG*s7|a/? -/AB/@@F)c&kAo y),1B1B9,,g69;L;L;R;R ) 1 1 7 7"49d>P>P,3 $ 2 2FB-#eg* !0= @#.-#?'(!81-H rmetadatactt|ddt|dd}t|dr|j}|r |dkDr||d<t|dr|j}|r |dkDr||d<t |}|r||d <|S) z Common logic to extract usage from Gemini metadata. Used by both streaming and non-streaming paths. Args: metadata: usage_metadata from Gemini response or chunk Returns: TokenUsage with standardized usage prompt_token_countrcandidates_token_count input_tokens output_tokenscached_content_token_countcache_read_input_tokensthoughts_token_countreasoning_tokens raw_usage)r r/r.rrr )r~usage cache_tokensr serializeds r_extract_usage_from_metadatars X';Q?h(@!D E x56:: L1,/;E+ ,x/0#88  01 4(8E$ %%X.J'k Lrct|dr |js tddSt|j}t |}|dkDr||d<|S)z Extract usage statistics from a full Gemini response (non-streaming). Args: response: The complete response from Gemini API Returns: TokenUsage with standardized usage statistics usage_metadatarrweb_search_count)r.rr rr})r>rrs r"extract_gemini_usage_from_responsersY 8- .h6M6Mq:: ()@)@ AE7x@!$4 ! Lrct}t|}|dkDr||d<t|dr |js|St |j}|j ||S)z Extract usage statistics from a Gemini streaming chunk. Args: chunk: Streaming chunk from Gemini API Returns: TokenUsage with standardized usage statistics rrr)r r}r.rrupdate)rUrrusage_from_metadatas rextract_gemini_usage_from_chunkrsh# E7u=!$4 ! 5* +53G3G 6u7K7KL LL$% LrcJt|dr|jrd|jdSt|dr|jr|jD]}t|ds|jst|jds4|jjsK|jjD]r}t|dr8|j r,|j }d|j |jdd ccSt|dsT|jsad|jdccSy ) z Extract content (text or function call) from a Gemini streaming chunk. Args: chunk: Streaming chunk from Gemini API Returns: Content block dictionary if present, None otherwise rr!r@rrrArBrCrFN)r.rr@rrrArDrI)rUrOr1rAs r!extract_gemini_content_from_chunkr;suf%** 33ul#(8(8))Iy),1B1B9,,g69;L;L;R;R ) 1 1 7 7"49d>P>P,0,>,>M(2,9,>,>1>1C1C-"$%T62tyy,2DII#FF!8*$ raccumulated_contentcnt|tr dd|dgdgSt|trg}g}|D]}t|tr|j|%t|ts6|j ddk(r"|j|j ddl|j ddk(s|r%|jddj |dg}|jd|j did|r#|jddj |d|rd|dgSddddgdgS) z Format the final output from Gemini streaming. Args: accumulated_content: Accumulated content from streaming (string, list of strings, or list of content blocks) Returns: List of formatted messages rHrr!r8r"r%rBrF)r)rr9r+r*r,join)rr text_partsr5s rformat_gemini_streaming_outputrasK%s+$%+5HIJ   %t,.0 'D$$!!$'D$'88F#v-%%dhhvr&:;XXf%3!(.(* (; &( NN$.(,R(@)(8  NN"GGJ/  (W=> >!vr.J-K L MMrcd}t|dr_|jrS|jD]D}t|ds|jst|jdd}|7|t |z }F|S)z Extract total token count from a Gemini embed_content response. Token counts are only available per-embedding via Vertex AI's statistics.token_count. Returns 0 if no token counts are available. r embeddings statistics token_countN)r.rrr/int)r>r embeddingrs r$extract_gemini_embedding_token_countrsm Ex&8+>+>!,,Iy,/I4H4H%i&:&:M4P *S--E - Lr)N)#rtypingrrrrrrrjr r r posthog.ai.utilsr rrr4rr:r=rQrTrWr\r`rnrhrr}rrrrrrrrrrs?> 1% IUE49E>R9SEP#2tCH~#22B#2L3232)932lZSZT2B-CZz  # --#- chsm0c3hHSM$"& @*.#*.$/?*@*.Z4 c4 c4 n"3":"J.3:<#S#Xd38n5M#LDNsDI~.DN DNN c r