jIUdZddlZddlZddlmZmZddlmZddlZddlm Z ddl m Z m Z ddl mZddlmZdd lmZeeZGd d Zdaedzed <d efdZy)z{ IBM watsonx.ai client with automatic IAM token refresh. Tokens expire after 60 minutes - refresh 5 minutes before expiry. N)datetime timedelta)Any)IAMAuthenticator) APIClient Credentials)ModelInference)settings) get_loggerc heZdZdZdZdefdZddZdefdZ dde d e d e dzd e dzd e de f d Zy) WatsonxClientz Manages watsonx.ai API client with automatic token refresh. IAM tokens expire after 60 minutes. We refresh 5 minutes before expiry to avoid mid-request failures. c tj|_tj|_tj |_tj|_d|_ d|_ tjd|j y)Nwatsonx_client_initialized)url) r watsonx_api_keyapi_keywatsonx_project_id project_id watsonx_urlr iam_token_refresh_margin_secondsrefresh_margin_client _token_expiryloggerinfoselfs ;/var/www/html/prparty/backend/app/clients/watsonx_client.py__init__zWatsonxClient.__init__s[// "55''&GG)- .2 0dhh ?returnc|jy|jtjz j}||jkS)zCheck if token needs refresh.T)rrnow total_secondsr)rtime_until_expirys r_should_refresh_tokenz#WatsonxClient._should_refresh_token(sD    %"//(,,.@OOQ D$7$777r NcTtjdt|j|j}t ||j |_tjtdz|_ tjd|jjdy ) z'Create new API client with fresh token.refreshing_watsonx_token)rr) credentialsr<)minuteswatsonx_token_refreshedi) expires_atvalid_for_secondsN) rrrrrrrrrr#rr isoformat)rr)s r_refresh_clientzWatsonxClient._refresh_client1s~ ./!LL ![T__U &\\^i.CC %))335"  r c|jr|j|jJd|jS)z+Get API client, refreshing token if needed.zClient should be initialized)r&r0rrs r get_clientzWatsonxClient.get_clientEs:  % % '  "||'G)GG'||r model_idprompt max_tokens temperaturekwargsc  K|j}|tj}|tj}tj d|t ||tj} t||||d| tj}|jd fdd{} tj|z } tj d|t | t| d | S7I#t$rI} tj|z } tjd |t| t| d d} ~ wwxYww) a Generate text using watsonx.ai foundation model. Args: model_id: Model identifier (e.g., 'ibm/granite-3-3-8b-instruct') prompt: Input prompt max_tokens: Maximum tokens to generate temperature: Sampling temperature (0.0-1.0) **kwargs: Additional model parameters Returns: Generated text Nwatsonx_generate_request)r3 prompt_lengthr5r6)max_new_tokensr6)r3 api_clientparamsc(jS)N)r4) generate_text)modelr4srz-WatsonxClient.generate_text..se111@r watsonx_generate_success)r3response_lengthelapsed_secondswatsonx_generate_error)r3errorrE)r2r granite_max_tokensgranite_temperaturerrlentimer asyncioget_event_looprun_in_executorround ExceptionrGstr) rr3r4r5r6r7client start_timeloopresultelapseder@s ` @rr?zWatsonxClient.generate_textMsS*"  !44J  "66K &f+!#  YY[ # "!!&0#.E))+D//@FiikJ.G KK*! #F %gq 1  M iikJ.G LL(!!f %gq 1    s?A,E1AC=1C;2AC=:E;C== EAE  EE)r!N)NN)__name__ __module__ __qualname____doc__rboolr&r0rr2rQintfloatrr?r rr r s @8t8 (I"&$( JJJ$J J T\ J  J Jr r _watsonx_clientr!c.t tatS)z-Get or create global watsonx client instance.)r`r r_r rget_watsonx_clientrbs'/ r )r[rLrKrrtypingrhttpx!ibm_cloud_sdk_core.authenticatorsribm_watsonx_airr ibm_watsonx_ai.foundation_modelsr app.configr app.logging_configr rXrr r`__annotations__rbr_r rrks^ ( >1;) H BBL)-%,Mr