Skip to content

RewardEmbeddingCachedTokens metric

Bases: EmbeddingModelRewardsOperationalMetric

Prompt tokens served from cache during reward-phase embeddings.

Example:

program.compile(
    metrics=[
        synalinks.metrics.RewardEmbeddingCachedTokens(),
    ],
)
Source code in synalinks/src/metrics/em_metrics.py
@synalinks_export("synalinks.metrics.RewardEmbeddingCachedTokens")
class RewardEmbeddingCachedTokens(EmbeddingModelRewardsOperationalMetric):
    """Prompt tokens served from cache during reward-phase embeddings.

    Example:

    ```python
    program.compile(
        metrics=[
            synalinks.metrics.RewardEmbeddingCachedTokens(),
        ],
    )
    ```
    """

    def __init__(self, name="reward_embedding_cached_tokens"):
        super().__init__(name=name)

    def result(self):
        return int(self._delta("cached_tokens"))