6i'~dZddlmZmZmZddlZddlZddlmZddl m Z eje Z Gdd eZy) zt OpenAI-specific batch processing implementation. This module contains the OpenAI batch processing provider class. )AnyOptionalUnionN) BatchProvider) BatchJobInfoceZdZdZ ddeeejfdee ee fdefdZ dede ee ffdZ dedefd Z ded eddfd Zdede ee ffd Zdede ee ffd ZddedeefdZy)OpenAIProviderz OpenAI batch processing providerNfile_path_or_buffermetadatareturnc  ddlm}|}|ddi}tjd|t |t rKtjd|t |d5}|jj|d }dddnut |tjrDtjd |jd|jj|d }ntd t||jjjd |j!dd|}tj#d|j|jS#1swYpxYw#tt$f$r} tj'd| d} ~ wt($r,} tj'd| t+d| | d} ~ wwxYw)zSubmit OpenAI batch jobrOpenAIN descriptionzInstructor batch jobz$Submitting batch job with metadata: zCreating batch file from path: rbbatch)filepurposez'Creating batch file from BytesIO bufferz&Unsupported file_path_or_buffer type: z/v1/chat/completionscompletion_window24h) input_file_idendpointrr z"Successfully submitted batch job: z-Validation error in OpenAI batch submission: zFailed to submit OpenAI batch: )openairloggerdebug isinstancestropenfilescreateioBytesIOseek ValueErrortypebatchesidgetinfo TypeErrorerror Exception RuntimeError) selfr r kwargsrclientf batch_file batch_jobes l/root/.openclaw/workspace/visionaryfx/venv/lib/python3.12/site-packages/instructor/batch/providers/openai.py submit_batchzOpenAIProvider.submit_batchs' M %XF)+AB LL?zJ K-s3 >?R>STU-t4N!'!4!4!W!4!MJNN/< FG#((+#\\00,g1 ! ?!@DE1 L Ms=AE0!E$?C$E0$E-)E00G?F G$'G  Gbatch_idc d ddlm}|}|jj|}|j|j |j t|jddt|jddt|jddddS#t$r}td||d }~wwxYw) zGet OpenAI batch statusrrtotal completedfailed)r;r<r=)r)status created_atrequest_countsz#Failed to get OpenAI batch status: N) rrr(retriever)r>r?getattrr@r.r0r9rr2rr6s r7 get_statuszOpenAIProvider.get_statusCs N %XFNN++H5Ehh,,#..$U%9%97AF!()=)={A!N%e&:&:HaH#   NA!EFA M NsBB B/B**B/c, ddlm}ddl}|}|jj |}|j dk7rt d|j t|dd}|r@t|dd}t|dd}t|dd} |dkDr|dk(rtd | d |jsd } t| D]} td | zd } td| d| dzd| d|j| |jj |}|jrtd|jnu|j dk7rt d|j d| | dz k(std| dttd d | zd|j dt|ddd |j td|jj!|j} | j"S#t $r}t d||d}~wwxYw)zRetrieve OpenAI batch resultsrrNr<Batch not completed, status: r@r=r;All z: batch requests failed. No output file will be available. Output file not ready, waiting s (attempt r/)...Output file now available: Batch status changed to  while waiting for output fileNo output file available after  retries over  seconds. Batch status: , Request counts: unknownz. %Batch has no output file ID availablez#Failed to retrieve OpenAI results: )rrtimer(rAr>r.rBr/output_file_idrangeminprintsleepsumr!contenttext)r0r9rrXr2rr@r<r=r; max_retriesattempt wait_time file_responser6s r7retrieve_resultszOpenAIProvider.retrieve_resultsWsV6 N % XFNN++H5E||{*"? ~ NOO%U,r.rBr/rYrZr[r\r]r^r!r_r writer`)r0r9rfrrXr2rr@r<r=r;rarbrcrdr3r6s r7download_resultszOpenAIProvider.download_resultss|7 N % XFNN++H5E||{*"? ~ NOO%U,messagezFailed to delete OpenAI batch: N)rrr(rAr)r>r.rCs r7 delete_batchzOpenAIProvider.delete_batchsj J %XFNN++H5Ehh,,C   J=aSAB I JsAA A! AA!limitc ddlm}|}|jj|}|jDcgc]%}t j |j'c}Scc}w#t$r}td||d}~wwxYw)zList OpenAI batch jobsrr)rszFailed to list OpenAI batches: N) rrr(listdatar from_openairnr.)r0rsrr2r(rr6s r7 list_batcheszOpenAIProvider.list_batchess J %XFnn)))6GJQ,,AF (()9)9);<  J=aSAB I Js(7A+*A&#A+&A++ B4BB)N)rH)__name__ __module__ __qualname____doc__rrr#r$rdictrr8rDrerkrorrintrur rxr7r r s* .2.M"3 ?3.M4S>*.M .M`N3N4S>N(8N8N8Nt9N9N9N9Nv JS JT#s(^ JJSJT#s(^J J# JtL/A Jrr )r|typingrrrr#loggingbasermodelsr getLoggerryrr rrr7rs@ (' !   8 $bJ]bJr