Skip to content

OptimizerEmbeddingTokensPerSecond metric

Bases: EmbeddingModelOptimizersOperationalMetric

Embedded tokens per second during the optimizer step.

Example:

program.compile(
    metrics=[
        synalinks.metrics.OptimizerEmbeddingTokensPerSecond(),
    ],
)
Source code in synalinks/src/metrics/em_metrics.py
@synalinks_export("synalinks.metrics.OptimizerEmbeddingTokensPerSecond")
class OptimizerEmbeddingTokensPerSecond(EmbeddingModelOptimizersOperationalMetric):
    """Embedded tokens per second during the optimizer step.

    Example:

    ```python
    program.compile(
        metrics=[
            synalinks.metrics.OptimizerEmbeddingTokensPerSecond(),
        ],
    )
    ```
    """

    def __init__(self, name="optimizer_embedding_tokens_per_second"):
        super().__init__(name=name)

    def result(self):
        wall = self._wall_clock_delta()
        if wall <= 0.0:
            return 0.0
        return self._delta("tokens") / wall