Skip to content

AvgRewardCacheCreationTokensPerCall metric

Bases: LMRewardsOperationalMetric

Average cache-creation tokens per LM call during reward computation.

Example:

program.compile(
    metrics=[
        synalinks.metrics.AvgRewardCacheCreationTokensPerCall(),
    ],
)
Source code in synalinks/src/metrics/lm_metrics.py
@synalinks_export("synalinks.metrics.AvgRewardCacheCreationTokensPerCall")
class AvgRewardCacheCreationTokensPerCall(LMRewardsOperationalMetric):
    """Average cache-creation tokens per LM call during reward computation.

    Example:

    ```python
    program.compile(
        metrics=[
            synalinks.metrics.AvgRewardCacheCreationTokensPerCall(),
        ],
    )
    ```
    """

    def __init__(self, name="avg_reward_cache_creation_tokens_per_call"):
        super().__init__(name=name)

    def result(self):
        calls = self._delta("calls")
        if calls <= 0:
            return 0.0
        return self._delta("cache_creation_tokens") / calls