hh VddlmZmZddlmZddlmZddlmZGddeZ dS))ListOptional)Document) BaseLoader) OBSFileLoaderc TeZdZdZ d dededeedefdZd ee fd Z dS) OBSDirectoryLoaderz!Load from `Huawei OBS directory`.Nbucketendpointconfigprefixcv ddlm}n#t$rtdwxYw|st}|dr||d|_nM||d|d|d | |_||_||_d S) aInitialize the OBSDirectoryLoader with the specified settings. Args: bucket (str): The name of the OBS bucket to be used. endpoint (str): The endpoint URL of your OBS bucket. config (dict): The parameters for connecting to OBS, provided as a dictionary. The dictionary could have the following keys: - "ak" (str, optional): Your OBS access key (required if `get_token_from_ecs` is False and bucket policy is not public read). - "sk" (str, optional): Your OBS secret key (required if `get_token_from_ecs` is False and bucket policy is not public read). - "token" (str, optional): Your security token (required if using temporary credentials). - "get_token_from_ecs" (bool, optional): Whether to retrieve the security token from ECS. Defaults to False if not provided. If set to True, `ak`, `sk`, and `token` will be ignored. prefix (str, optional): The prefix to be added to the OBS key. Defaults to "". Note: Before using this class, make sure you have registered with OBS and have the necessary credentials. The `ak`, `sk`, and `endpoint` values are mandatory unless `get_token_from_ecs` is True or the bucket policy is public read. `token` is required when using temporary credentials. Example: To create a new OBSDirectoryLoader: ``` config = { "ak": "your-access-key", "sk": "your-secret-key" } ``` directory_loader = OBSDirectoryLoader("your-bucket-name", "your-end-endpoint", config, "your-prefix") r) ObsClientzfCould not import esdk-obs-python python package. Please install it with `pip install esdk-obs-python`.get_token_from_ecsECS)serversecurity_provider_policyaksktoken) access_key_idsecret_access_keysecurity_tokenrN)obsr ImportErrordictgetclientr r)selfr r r rrs o/var/www/FlaskApp/flask-venv/lib/python3.11/site-packages/langchain_community/document_loaders/obs_directory.py__init__zOBSDirectoryLoader.__init__ s>  % % % % % % %   H    VVF ::* + + #)8eTTTDKK#)$jj.."(**T"2"2%zz'22 DK  s #returncbd}d}g} |j|j|j||}|jdkrs|jjD]J}t|j|j|j}| | K|jj dur |jj }nn|S)zLoad documents.iNT)rmarkermax_keysi,)r) r listObjectsr rstatusbodycontentsrkeyextendload is_truncated next_marker)r max_nummarkdocsrespcontentloaders r!r-zOBSDirectoryLoader.loadBs ;** DKw+D{S  #y1//G*4; DKXXXFKK ....9)T1190DD  )Nr ) __name__ __module__ __qualname____doc__strrrr"rrr-r6r!r r s++ "& 3333 3  3333jd8nr6r N) typingrrlangchain_core.documentsr)langchain_community.document_loaders.baser-langchain_community.document_loaders.obs_filerr r<r6r!rAs!!!!!!!!------@@@@@@GGGGGGIIIIIIIIIIr6