2RjfddlmZddlmZddlmZddlZddlmZddl m Z m Z m Z m Z mZmZmZddlmZmZmZdd lmZdd lmZmZdd lmZmZd d lmZmZm Z m!Z!m"Z"m#Z#ddl$m%Z%m&Z&ddl'm(Z(m)Z)ddl*m+Z+m,Z,ddl-m.Z.ddl/m0Z0ddl1m2Z2ddl3m4Z4ddl5m6Z6ddl7m8Z8ddgZ9GddeZ:GddeZ;GddZ<GddZ=Gdd Z>Gd!d"Z?y)#) annotations)Optional)LiteralN)_legacy_response)BodyOmitQueryHeadersNotGivenomit not_given) path_templatemaybe_transformasync_maybe_transform)cached_property)SyncAPIResourceAsyncAPIResource)to_streamed_response_wrapper"async_to_streamed_response_wrapper) OutputItemsAsyncOutputItemsOutputItemsWithRawResponseAsyncOutputItemsWithRawResponse OutputItemsWithStreamingResponse%AsyncOutputItemsWithStreamingResponse)SyncCursorPageAsyncCursorPage)run_list_paramsrun_create_params)AsyncPaginatormake_request_options)Metadata)RunListResponse)RunCancelResponse)RunCreateResponse)RunDeleteResponse)RunRetrieveResponseRuns AsyncRunsc LeZdZdZeddZeddZeddZeeddde d ddZ ddde d dd Z eeeeddde d  dd Z ddde d dd Z ddde d dd Zy)r*,Manage and run evals in the OpenAI platform.c,t|jSr-)r_clientselfs h/var/www/html/meridian/meridian-ai/venv/lib/python3.12/site-packages/openai/resources/evals/runs/runs.py output_itemszRuns.output_items(s4<<((ct|Sa This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content. For more information, see https://www.github.com/openai/openai-python#accessing-raw-response-data-eg-headers )RunsWithRawResponser1s r3with_raw_responsezRuns.with_raw_response-s#4((r5ct|Sz An alternative to `.with_raw_response` that doesn't eagerly read the response body. For more information, see https://www.github.com/openai/openai-python#with_streaming_response )RunsWithStreamingResponser1s r3with_streaming_responsezRuns.with_streaming_response7s)..r5Nmetadataname extra_headers extra_query extra_bodytimeoutc |std||jtd|t|||dtj t ||||dditS)  Kicks off a new run for a given evaluation, specifying the data source, and what model configuration to use to test. The datasource will be validated against the schema specified in the config of the evaluation. Args: data_source: Details about the run's data source. metadata: Set of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard. Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters. name: The name of the run. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds 6Expected a non-empty value for `eval_id` but received /evals/{eval_id}/runseval_id data_sourcer?r@ bearer_authTrArBrCrDsecuritybodyoptionscast_to) ValueError_postrrr!RunCreateParamsr#r' r2rJrLr?r@rArBrCrDs r3createz Runs.create@sNUV]U`ab bzz 17 C #. (  "11 )+'%'. &#  r5rArBrCrDc |std||std||jtd||t||||dditS) P Get an evaluation run by ID. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rG5Expected a non-empty value for `run_id` but received /evals/{eval_id}/runs/{run_id}rJrun_idrMTrNrRrSrT_getrr#r)r2r_rJrArBrCrDs r3retrievez Runs.retrieve}sy0UV]U`ab bTU[T^_` `yy :GTZ [(+'%'. (  r5afterlimitorderstatusrArBrCrDc|std||jtd|ttt |||| t ||||dtjdditS a Get a list of runs for an evaluation. Args: after: Identifier for the last run from the previous pagination request. limit: Number of runs to retrieve. order: Sort order for runs by timestamp. Use `asc` for ascending order or `desc` for descending order. Defaults to `asc`. status: Filter runs by status. One of `queued` | `in_progress` | `failed` | `completed` | `canceled`. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rGrHrI)rfrgrhrirMT)rArBrCrDqueryrO)pagerRmodel) rT _get_api_listrrr%r#rr RunListParams r2rJrfrgrhrirArBrCrDs r3listz Runs.listsJUV]U`ab b!! 17 C0(+'%%!&!&!&"(  $11(. "'"  r5c |std||std||jtd||t||||dditS) G Delete an eval run. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rGr\r]r^rMTrNr`rT_deleterr#r(rcs r3deletez Runs.deletesy0UV]U`ab bTU[T^_` `|| :GTZ [(+'%'. &  r5c |std||std||jtd||t||||dditS) U Cancel an ongoing evaluation run. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rGr\r]r^rMTrNr`rTrUrr#r&rcs r3cancelz Runs.cancel sy0UV]U`ab bTU[T^_` `zz :GTZ [(+'%'. &  r5)returnr)r|r8)r|r<rJstrrLzrun_create_params.DataSourcer?zOptional[Metadata] | Omitr@ str | OmitrAHeaders | NonerB Query | NonerC Body | NonerD'float | httpx.Timeout | None | NotGivenr|r'r_r~rJr~rArrBrrCrrDrr|r))rJr~rfrrg int | OmitrhLiteral['asc', 'desc'] | OmitriJLiteral['queued', 'in_progress', 'completed', 'canceled', 'failed'] | OmitrArrBrrCrrDrr|zSyncCursorPage[RunListResponse]r_r~rJr~rArrBrrCrrDrr|r(r_r~rJr~rArrBrrCrrDrr|r&__name__ __module__ __qualname____doc__rr4r9r=r rrXrdrrrwr{r5r3r*r*%s?6))))///3)-$("&;D; ; 2 ; , ;  ; &; ";  ; 9;  ; H)-$("&;D& &  & && "&  & 9&  & X! /3]a)-$("&;D; ;  ;  ; - ; [; &; ";  ; 9;  ); H)-$("&;D& &  & && "&  & 9&  & ^)-$("&;D& &  & && "&  & 9&  & r5c LeZdZdZeddZeddZeddZeeddde d ddZ ddde d dd Z eeeeddde d  dd Z ddde d dd Z ddde d dd Zy)r+r-c,t|jSr/)rr0r1s r3r4zAsyncRuns.output_items6s  --r5ct|Sr7)AsyncRunsWithRawResponser1s r3r9zAsyncRuns.with_raw_response;s(--r5ct|Sr;)AsyncRunsWithStreamingResponser1s r3r=z!AsyncRuns.with_streaming_responseEs.d33r5Nr>c K|std||jtd|t|||dtj d{t ||||ddit d{S7'7w) rFrGrHrIrKNrMTrNrP)rTrUrrr!rVr#r'rWs r3rXzAsyncRuns.createNsNUV]U`ab bZZ 17 C,#. (  "11 )+'%'. &#     s$A A7 A3 "A7.A5/A75A7rYc K|std||std||jtd||t||||dditd {S7w) r[rGr\r]r^rMTrNr`Nrarcs r3rdzAsyncRuns.retrieves0UV]U`ab bTU[T^_` `YY :GTZ [(+'%'. (    AA!AA!rec|std||jtd|ttt |||| t ||||dtjdditSrk) rTrorrr%r#rr rprqs r3rrzAsyncRuns.listsJUV]U`ab b!! 17 C 1(+'%%!&!&!&"(  $11(. "'"  r5c K|std||std||jtd||t||||dditd {S7w) rtrGr\r]r^rMTrNr`Nrurcs r3rwzAsyncRuns.deletes0UV]U`ab bTU[T^_` `\\ :GTZ [(+'%'. &"    rc K|std||std||jtd||t||||dditd {S7w) ryrGr\r]r^rMTrNr`Nrzrcs r3r{zAsyncRuns.cancels0UV]U`ab bTU[T^_` `ZZ :GTZ [(+'%'. &    r)r|r)r|r)r|rr}r)rJr~rfrrgrrhrrirrArrBrrCrrDrr|zAAsyncPaginator[RunListResponse, AsyncCursorPage[RunListResponse]]rrrrr5r3r+r+3s@6....44/3)-$("&;D; ; 2 ; , ;  ; &; ";  ; 9;  ; H)-$("&;D& &  & && "&  & 9&  & X! /3]a)-$("&;D; ;  ;  ; - ; [; &; ";  ; 9;  K; H)-$("&;D& &  & && "&  & 9&  & ^)-$("&;D& &  & && "&  & 9&  & r5c&eZdZddZeddZy)r8cz||_tj|j|_tj|j|_tj|j |_tj|j |_tj|j|_yN)_runsrto_raw_response_wrapperrXrdrrrwr{r2runss r3__init__zRunsWithRawResponse.__init__Bs &>> KK  )@@ MM  %<< II  '>> KK  '>> KK  r5c@t|jjSr/)rrr4r1s r3r4z RunsWithRawResponse.output_itemsUs*$***A*ABBr5Nrr*r|None)r|rrrrrrr4rr5r3r8r8As &CCr5r8c&eZdZddZeddZy)rcz||_tj|j|_tj|j|_tj|j |_tj|j |_tj|j|_yr)rrasync_to_raw_response_wrapperrXrdrrrwr{rs r3rz!AsyncRunsWithRawResponse.__init__\s &DD KK  )FF MM  %BB II  'DD KK  'DD KK  r5c@t|jjSr/)rrr4r1s r3r4z%AsyncRunsWithRawResponse.output_itemsos/tzz/F/FGGr5Nrr+r|r)r|rrrr5r3rr[s &HHr5rc&eZdZddZeddZy)r<c||_t|j|_t|j|_t|j|_t|j |_t|j |_yr)rrrXrdrrrwr{rs r3rz"RunsWithStreamingResponse.__init__vsp 2 KK  5 MM  1 II  3 KK  3 KK  r5c@t|jjSr/)rrr4r1s r3r4z&RunsWithStreamingResponse.output_itemss0 0G0GHHr5Nr)r|rrrr5r3r<r<us &IIr5r<c&eZdZddZeddZy)rc||_t|j|_t|j|_t|j|_t|j |_t|j |_yr)rrrXrdrrrwr{rs r3rz'AsyncRunsWithStreamingResponse.__init__sp 8 KK  ; MM  7 II  9 KK  9 KK  r5c@t|jjSr/)rrr4r1s r3r4z+AsyncRunsWithStreamingResponse.output_itemss5TZZ5L5LMMr5Nr)r|rrrr5r3rrs &NNr5r)@ __future__rtypingrtyping_extensionsrhttpxr_typesrr r r r r r_utilsrrr_compatr _resourcerr _responserrr4rrrrrr paginationrr types.evalsr r! _base_clientr"r#types.shared_params.metadatar$types.evals.run_list_responser%types.evals.run_cancel_responser&types.evals.run_create_responser'types.evals.run_delete_responser(!types.evals.run_retrieve_responser)__all__r*r+r8rr<rrr5r3rs#% !LLLLL';Z;>A5=AAAE ; K ?K \K  K \CC4HH4II4NNr5