✏️ 正在编辑: generation.cpython-312.pyc
路径:
/var/opt/nydus/ops/mysql/ai/genai/__pycache__/generation.cpython-312.pyc
提示:
您可以编辑任何文件（包括二进制文件），但请注意不当修改可能导致文件损坏。
� ��'j1 � � � d Z ddlZddlmZmZmZ ddlmZ ddl m Z ddl m Z mZmZ ddlmZ G d� d e� Zy# e$ r ddl mZ Y �/w xY w) z{GenAI LLM integration utilities for MySQL Connector/Python. Provides MyLLM wrapper that issues ML_GENERATE calls via SQL. � N)�Any�List�Optional)�LLM)� PrivateAttr)�atomic_transaction� execute_sql�format_value_sql)�MySQLConnectionAbstractc � � � e Zd ZU dZ e� Zeed< G d� d� Zdef� fd� Z dde de e e d e d e fd �Zed efd �� Zed e fd �� Z� xZS )�MyLLMa� Custom Large Language Model (LLM) interface for MySQL HeatWave. This class wraps the generation functionality provided by HeatWave LLMs, exposing an interface compatible with common LLM APIs for text generation. It provides full support for generative queries and limited support for agentic queries. Attributes: _db_connection (MySQLConnectionAbstract): Underlying MySQL connector database connection. �_db_connectionc � � e Zd ZdZdZy)� MyLLM.ConfigaL Pydantic config for the model. By default, LangChain (through Pydantic BaseModel) does not allow setting or storing undeclared attributes such as _db_connection. Setting extra = "allow" makes it possible to store extra attributes on the class instance, which is required for MyLLM. �allowN)�__name__� __module__� __qualname__�__doc__�extra� � �J/opt/nydus/tmp/pip-target-k0fmikie/lib/python/mysql/ai/genai/generation.py�Configr @ s � � � �r r � db_connectionc �0 �� t �| � � || _ y)aS Initialize the MyLLM instance with an active MySQL database connection. Args: db_connection: A MySQL connection object used to run LLM queries. Notes: The db_connection is stored as a private attribute via object.__setattr__, which is compatible with Pydantic models. N)�super�__init__r )�selfr � __class__s �r r zMyLLM.__init__L s �� � ���� +��r �prompt�stop�kwargs�returnc �( � |j � }|�||d< t |� \ }}t | j � 5 }d|� d�}t |||g|���� t j |j � d � d } ddd� | S # 1 sw Y S xY w)ac Generate a text completion from the LLM for a given input prompt. References: https://dev.mysql.com/doc/heatwave/en/mys-hwgenai-ml-generate.html A full list of supported options (specified by kwargs) can be found under "options" Args: prompt: The input prompt string for the language model. stop: Optional list of stop strings to support agentic and chain-of-thought reasoning workflows. **kwargs: Additional keyword arguments providing generation options to the LLM (these are serialized to JSON and passed to the HeatWave syscall). Returns: The generated model output as a string. (The actual completion does NOT include the input prompt.) Raises: DatabaseError: If provided options are invalid or unsupported. If a database connection issue occurs. If an operational error occurs during execution. Implementation Notes: - Serializes kwargs into a SQL-compatible JSON string. - Calls the LLM stored procedure using a database cursor context. - Uses `sys.ML_GENERATE` on the server to produce the model output. - Expects the server response to be a JSON object with a 'text' key. N�stop_sequencesz SELECT sys.ML_GENERATE("%s", z);)�paramsr �text)�copyr r r r �json�loads�fetchone) r r! r" r# �options�options_placeholder�options_params�cursor�generate_query� llm_responses r �_callz MyLLM._call[ s� � �H �+�+�-�� � �(,�G�$� %�.>�w�.G�+��^� �� 3� 3� 4��!>�?R�>S�SU� X�N� ����7P� �7P� Q� �:�:�f�o�o�&7��&:�;�F�C�L� 5� �� 5� ��s �AB�Bc � � ddiS )z� Return a dictionary of params that uniquely identify this LLM instance. Returns: dict: Dictionary of identifier parameters (should include model_name for tracing/caching). � model_name�mysql_heatwave_llmr �r s r �_identifying_paramszMyLLM._identifying_params� s � � �.� � r c � � y)z� Get the type name of this LLM implementation. Returns: A string identifying the LLM provider (used for logging or metrics). r6 r r7 s r � _llm_typezMyLLM._llm_type� s � � $r )N)r r r r r r r �__annotations__r r �strr r r r3 �property�dictr8 r: � __classcell__)r s @r r r 0 s� �� � � /:�m�N�+�;� � � ,�&=� ,�$ %)�0 ��0 � �t�C�y�!�0 � � 0 � � 0 �d � �T� � � � �$�3� $� �$r r )r r* �typingr r r �#langchain_core.language_models.llmsr � ImportError�langchain.llms.base�pydanticr �mysql.ai.utilsr r r �mysql.connector.abstractsr r r r r �<module>rG sM ��:� � &� &�(�7� !� L� L� =�r$�C� r$�� � (�'�(�s �: � A�A
💾 保存文件
← 返回文件管理器