6i,dZddlmZddlmZmZddlZddlZddlZddl m Z m Z m Z m Z mZddlmZddlmZGd d eeZy) z Batch processor for unified batch processing across providers. This module contains the BatchProcessor class that provides a unified interface for batch processing across different LLM providers. ) annotations)AnyGenericN) BatchResult BatchSuccess BatchError BatchJobInfoT) BatchRequest) get_providerceZdZdZddZ d ddZ d ddZddZddZdddZ d dd Z dd Z dd Z dd Z dd Zy)BatchProcessorz7Unified batch processor that works across all providersc||_||_ |jdd\|_|_t |j|_y#t $r}t d|d}~wwxYw)N/rziModel string must be in format "provider/model-name" (e.g. "openai/gpt-4" or "anthropic/claude-3-sonnet"))modelresponse_modelsplit provider_name model_name ValueErrorr provider)selfrrerrs e/root/.openclaw/workspace/visionaryfx/venv/lib/python3.12/site-packages/instructor/batch/processor.py__init__zBatchProcessor.__init__sn , 27++c12E /D %T%7%78  G  sA A$ AA$Nc |tjj|rtj|g}t |D]g\}}t |j d|||j |j||}|j||j|j|itd|dt|d|Stj} g}t |D]g\}}t |j d|||j |j||}|j| |j|j|itdt|d| jd| S)aCreate batch file from list of message conversations Args: messages_list: List of message conversations, each as a list of message dicts file_path: Path to save the batch request file. If None, returns BytesIO buffer max_tokens: Maximum tokens per request temperature: Temperature for generation Returns: The file path where the batch was saved, or BytesIO buffer if file_path is None zrequest-) custom_idmessagesrr max_tokens temperaturezCreated batch file z with z requestszCreated batch buffer with r)ospathexistsremove enumerater rr save_to_filerappendprintlenioBytesIOseek) r messages_list file_pathr r!batch_requestsir batch_requestbuffers rcreate_batch_from_messagesz)BatchProcessor.create_batch_from_messages%sw$  ww~~i( )$N(7 5 8 ,T-@-@ A (n%#'#6#6//) + ! **9d6H6HI%%m4 5 ' {&^9L8MYW X ZZ\FN(7 5 8 ,T-@-@ A (n%#'#6#6//) + ! **643E3EF%%m4 5 .s>/B.C9M N KKNMc L|ddi}|jj|fd|i|S)aSubmit batch job to the provider and return job ID Args: file_path_or_buffer: Path to the batch request file or BytesIO buffer metadata: Optional metadata to attach to the batch job **kwargs: Additional provider-specific arguments descriptionzInstructor batch jobmetadata)r submit_batch)rfile_path_or_bufferr8kwargss rr9zBatchProcessor.submit_batch^sA  %'=>H)t}}))  *2 6<  r5c8|jj|S)z&Get batch job status from the provider)r get_statusrbatch_ids rget_batch_statuszBatchProcessor.get_batch_statusrs}}''11r5cZ|jj|}|j|S)z2Retrieve and parse batch results from the provider)rretrieve_results parse_results)rr?results_contents rrBzBatchProcessor.retrieve_resultsvs'--88B!!/22r5c8|jj|S)zList batch jobs for the current provider Args: limit: Maximum number of batch jobs to return Returns: List of BatchJobInfo objects with normalized batch information )r list_batches)rlimits rrFzBatchProcessor.list_batches{s}}))%00r5cd|j|}||jj|||S)aGet batch results, optionally saving raw results to a file Args: batch_id: The batch job ID file_path: Optional file path to save raw results. If provided, raw results will be saved to this file. If not provided, results are only kept in memory. Returns: List of BatchResult objects (BatchSuccess[T] or BatchError) )rBrdownload_results)rr?r/rDs r get_resultszBatchProcessor.get_resultss6//9  MM * *8Y ?r5c8|jj|S)zCancel a batch job Args: batch_id: The batch job ID to cancel Returns: Dict containing the cancelled batch information )r cancel_batchr>s rrLzBatchProcessor.cancel_batch}}))(33r5c8|jj|S)zDelete a batch job (only available for completed batches) Args: batch_id: The batch job ID to delete Returns: Dict containing the deletion confirmation )r delete_batchr>s rrOzBatchProcessor.delete_batchrMr5c g}|jjd}|D]5}|js tj|}|j dd}|j |}|r9 |j di|}tt||} |j| nd } d } |jd k(rzd |vrv|d }|j ddk(r]|j di}t|tr.d|vr*|d}|j dd} |j dd} n t!|} d} t|| | |} |j| 8|S#t$rD} t|dd|j jd| |} |j| Yd } ~ Md } ~ wwxYw#t$r0} tddd| d|i} |j| Yd } ~ d } ~ wwxYw)zWParse batch results from content string into Maybe-like results with custom_id tracking runknown)rresult parsing_errorzFailed to parse into z: )r error_type error_messageraw_dataNz Unknown errorextraction_error anthropicrStypeerrormessagezUnknown Anthropic erroranthropic_errorjson_parse_errorzFailed to parse JSON: raw_line)striprjsonloadsget_extract_from_responserrr r( Exceptionr __name__r isinstancedictstr)rrDresultslineslinedatarextracted_datarS batch_resulte error_resultrVrU error_info error_detailss rrCzBatchProcessor.parse_resultss%'%%'--d3= -D::<9 -zz$' HH[)< !%!->$*,=." 14J -> #-"+#-&3!% $L NN<0i= -~]%5'1&/'6,A$BUBUB^B^A__abcad*e%3 (  |445J -)'1$:1#">($/   |,, -sB:F/57E,B.F/ F,(:F'"F/'F,,F// G(8%G##G(c |jdk(r)|dddddd}tj|S|jdk(rd |vry |d }|jd d k(ry |jd d k(rd|vr|dd}t |t rt |dkDrt|D]*}|jd dk(s|jdicS|D]@}|jd dk(s|jdd} tj|cSy y #tj$rY[wxYw#t$rYy wxYw)z>Extract structured data from provider-specific response formatopenairesponsebodychoicesrr\contentrYrSNrZr[ succeededtool_useinputtext) rrbrcrdrhlistr*JSONDecodeErrorrf)rrnrzrSitemr~s rrez%BatchProcessor._extract_from_responsesq' !!X-z*629=a@KIVzz'**##{24'h::f%0::f%4f9L$Y/ :G!'40S\A5E$+=D#xx/:='+xx'< <= %,-D#xx/69'+xx';!-+/::d+;$; -=3F(,';';!-$,!-   s_7D6D6D6(AD6D6D6/D6DD6D6D30D62D33D66 EE)rrjrztype[T])Nig?) r.zlist[list[dict[str, Any]]]r/ str | Noner z int | Noner!z float | Nonereturnstr | io.BytesIO)N)r:rr8dict[str, Any] | Nonerrj)r?rjrdict[str, Any])r?rjrlist[BatchResult]) )rGintrzlist[BatchJobInfo])r?rjr/rrr)rDrjrr)rnrrr)rg __module__ __qualname____doc__rr4r9r@rBrFrJrLrOrCrer`r5rrrsA9&!%!%$' 7177 7 " 7  7x+/ - (  (23 16:(2 . 4 4DL+r5r)r __future__rtypingrrrbr"r+modelsrrr r r requestr providersr rr`r5rrs9# JJ!#RWQZRr5