evaluate.json

{
    "rouge": {
        "rouge1": 0.6255101764812026,
        "rouge2": 0.4212945982663935,
        "rougeL": 0.5973657536570702,
        "rougeLsum": 0.5985905113024548
    },
    "bleu": {
        "bleu": 0.31871536850070264,
        "precisions": [
            0.6347305389221557,
            0.39490445859872614,
            0.2789115646258503,
            0.19708029197080293
        ],
        "brevity_penalty": 0.9302618655343314,
        "length_ratio": 0.9325842696629213,
        "translation_length": 166.0,
        "reference_length": 178.0
    },
    "metadata": {
        "model": "hf.co/Tonic/GemmaX2-28-2B-gguf:BF16",
        "run_id": "1740853522",
        "timestamp": 1740853573.095875,
        "datetime": "2025-03-01T13:26:13.095875",
        "source_language": "English",
        "source_code": "en",
        "target_language": "Spanish",
        "target_code": "es",
        "source_texts": [
            "It allows me to work by following my vibes and molding my teaching style to the learning style of the audience.",
            "The unrelenting soul-force of those who would hold us accountable blows that all away.",
            "When taken regularly in therapeutic doses, ginger root can effectively cure nausea;",
            "They accomplished their goals and created a legacy of self-determination to which others may aspire.",
            "But faster economic activity could also translate into some degree of inflation.",
            "The main characteristics a stone should possess are uniform surface, grain, and density.",
            "Lettuce, no matter the variety, is considered a cool-weather crop.",
            "It was a trick to lure foolish humans to an ogre who would teach them a very valuable lesson.",
            "Just to clarify, though, assertive is not the same as aggressive or arrogant.",
            "The bus, normally crowded, was stunningly nearly empty at this hour."
        ],
        "prompts": [
            "Translate this from English to Spanish:\nEnglish: It allows me to work by following my vibes and molding my teaching style to the learning style of the audience.\nSpanish:",
            "Translate this from English to Spanish:\nEnglish: The unrelenting soul-force of those who would hold us accountable blows that all away.\nSpanish:",
            "Translate this from English to Spanish:\nEnglish: When taken regularly in therapeutic doses, ginger root can effectively cure nausea;\nSpanish:",
            "Translate this from English to Spanish:\nEnglish: They accomplished their goals and created a legacy of self-determination to which others may aspire.\nSpanish:",
            "Translate this from English to Spanish:\nEnglish: But faster economic activity could also translate into some degree of inflation.\nSpanish:",
            "Translate this from English to Spanish:\nEnglish: The main characteristics a stone should possess are uniform surface, grain, and density.\nSpanish:",
            "Translate this from English to Spanish:\nEnglish: Lettuce, no matter the variety, is considered a cool-weather crop.\nSpanish:",
            "Translate this from English to Spanish:\nEnglish: It was a trick to lure foolish humans to an ogre who would teach them a very valuable lesson.\nSpanish:",
            "Translate this from English to Spanish:\nEnglish: Just to clarify, though, assertive is not the same as aggressive or arrogant.\nSpanish:",
            "Translate this from English to Spanish:\nEnglish: The bus, normally crowded, was stunningly nearly empty at this hour.\nSpanish:"
        ],
        "references": [
            [
                "Me permite trabajar seg\u00fan mis impresiones y ajustar mis m\u00e9todos de ense\u00f1anza al modelo de aprendizaje del p\u00fablico."
            ],
            [
                "La implacable fuerza del alma de quienes nos piden cuentas echa por tierra todo eso."
            ],
            [
                "Si se toma de forma regular en dosis terap\u00e9uticas, la ra\u00edz de jengibre puede ser un remedio efectivo contra las n\u00e1useas;"
            ],
            [
                "Han cumplido sus objetivos y creado un precedente de autodeterminaci\u00f3n al que otros es posible que aspiren."
            ],
            [
                "Sin embargo, la r\u00e1pida actividad econ\u00f3mica tambi\u00e9n podr\u00eda conllevar un cierto grado de inflaci\u00f3n."
            ],
            [
                "Las principales caracter\u00edsticas que deber\u00eda poseer una piedra son una superficie, un granulado y una densidad uniformes."
            ],
            [
                "La lechuga, independientemente de la variedad, se considera un cultivo de clima fr\u00edo."
            ],
            [
                "Fue una estrategia para llevar a ingenuos humanos hasta un ogro que les ense\u00f1ar\u00eda una muy valiosa lecci\u00f3n."
            ],
            [
                "Aunque, como mera aclaraci\u00f3n, asertivo no es lo mismo que agresivo o arrogante."
            ],
            [
                "El autob\u00fas, normalmente lleno de gente, estaba sorprendentemente casi vac\u00edo a esta hora."
            ]
        ],
        "predictions": [
            "Esto me permite trabajar siguiendo mis instintos y modelar mi estilo de ense\u00f1anza en funci\u00f3n del estilo de aprendizaje del p\u00fablico.",
            "La implacable fuerza de los que nos responsabilizar\u00edan dispersa todo eso.",
            "Si se toma regularmente en dosis terap\u00e9uticas, la ra\u00edz de jengibre puede curar eficazmente las n\u00e1useas.",
            "Lograron sus objetivos y dejaron un legado de autodeterminaci\u00f3n al que otros pueden aspirar.",
            "Pero una mayor actividad econ\u00f3mica podr\u00eda traducirse tambi\u00e9n en un cierto grado de inflaci\u00f3n.",
            "Las principales caracter\u00edsticas que deber\u00eda tener una piedra son su superficie, grano y densidad uniformes.",
            "La lechuga, independientemente de la variedad, se considera un cultivo para climas fr\u00edos.",
            "Era un truco para atrapar a unos humanos tontos con el fin de ense\u00f1\u00e1rseles una valiosa lecci\u00f3n.",
            "Pero, a fin de dejarlo claro, el concepto no es lo mismo que la agresividad o el orgullo.",
            "El autob\u00fas estaba incre\u00edblemente vac\u00edo en esta hora normalmente tan concurrida."
        ],
        "samples": 10
    },
    "telemetry": {
        "runtime": 47.645625591278076,
        "avg_eval_time": 0.07864224910736084,
        "avg_pred_time": 4.541392850875854,
        "eval_rate": 2.518594278295445,
        "pred_rate": 13.211805710318231
    }
}