CodeBERTScore: an automatic metric for code generation, based on BERTScore
-
Updated
Mar 1, 2024 - Jupyter Notebook
#
bertscore
Here are 55 public repositories matching this topic...
EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation
natural-language-processing deep-learning text-generation fairness-ai fairness-ml pretrained-language-model bertscore metric-bias
-
Updated
Oct 19, 2022 - Jupyter Notebook
LLM Evaluation and Observability System for Football Content
python mongodb pre-commit openai cosine-similarity evaluation-metrics comet-ml hallucination huggingface-transformers zenml bertscore
-
Updated
Jun 19, 2025 - Python
MAchine Translation Evaluation Online (MATEO)
machine-translation comet ter bleu clarin machine-translation-metrics streamlit bertscore bleurt machine-translation-evaluation chrf
-
Updated
May 8, 2026 - Python
Domain-specialized Gemma 2 27B + Gemma 4 31B for SEC filings — fine-tuned on TPU v6e-8 with PyTorch/XLA FSDPv2, plus a Vertex AI Vector Search RAG demo (69 tickers × 381 filings). Same LoRA recipe, +3.5% / +5.8% BERTScore F1.
finance lora knowledge-distillation gemma tpu peft sec-filings rag streamlit pytorch-xla vertex-ai bertscore gemma-2 gemma-4
-
Updated
Apr 26, 2026 - Python
Fine-tuning GPT-3.5 and Llama3 LLMs for enhanced persona consistency in chatbots using Google's Synthetic Persona Chat dataset
-
Updated
May 3, 2025 - Jupyter Notebook
ViAG: A Novel Framework for Fine-tuning Answer Generation models ultilizing Encoder-Decoder and Decoder-only Transformers's architecture
meteor question-answering bart llama rouge bleu-score encoder-decoder fine-tuning answer-generation t5 plms bartpho llm bertscore instruction-tuning qlora qwen decoder-only vit5
-
Updated
May 26, 2025 - Python
Domain-specific adaptation of CodeT5 for Python docstring generation. Compares pre-trained vs fine-tuned performance using NLP metrics (ROUGE, METEOR, BERTScore), showing significant improvements after targeted training.
nlp machine-learning deep-learning transformers code-generation rouge fine-tuning code-summarization bertscore code-comments-generator codet5
-
Updated
Sep 22, 2025 - Jupyter Notebook
Agent Orchestration - LLM for Legal Metadata Extraction: A Comparative Analysis of Efficiency and Precision (paper 161 PROPOR)
-
Updated
Jul 26, 2026 - Python
Medical Question Answering System using on PubMed dataset.
-
Updated
May 29, 2025 - Jupyter Notebook
[radscore] Evaluation metrics for radiology report generation — BLEU, ROUGE, BERTScore, F1-RadGraph, CheXbert F1 & GREEN in one `pip install`.
machine-learning tutorial deep-learning medical-imaging rouge radiology evaluation-metrics bleu-score multilabel-classification medical-natural-language-processing chexpert report-generation healthcare-ai bertscore radiology-report-generation vision-language-model chexbert radgraph green-metric
-
Updated
Jun 16, 2026 - Python
Hallucination-resistant multi-hop QA using hybrid BM25+FAISS retrieval, cross-encoder reranking, citation selection, and NLI-based verification. Evaluated on HotpotQA (7,405 examples), zero-shot.
nlp question-answering bm25 zero-shot-learning reranking nli faiss rag multi-hop-reasoning hotpotqa cross-encoder llm bertscore ollama hallucination-detection gemma-4
-
Updated
May 26, 2026 - Python
Model-agnostic toolkit to evaluate text-summarization models — ROUGE/BLEU/BERTScore + perplexity + LLM-as-judge, MLflow tracking, CLI + library with unit-tested metrics.
python nlp cli evaluation transformers text-summarization rouge bleu perplexity mlflow huggingface bertscore llm-evaluation llm-as-judge
-
Updated
Jul 25, 2026 - Python
Benchmarking Vector RAG vs Graph RAG for cybersecurity question answering on Australian SMBs using LLaMA 3.1, Mistral 7B, and Qwen3 with ChromaDB and Neo4j
nlp neo4j evaluation transformers knowledge-graph cybersecurity rag vector-search huggingface bertscore chromadb mistral-7b graph-rag llama3 qwen3 australian-smes
-
Updated
Apr 9, 2026 - Python
Implementation of a task-specific QLoRA supervised fine-tuning pipeline for LLaMA-2-7B-Chat, developed for an independent study on structured cover letter generation.
nlp natural-language-processing transformers text-generation pytorch rouge lora model-evaluation fine-tuning peft huggingface llm bertscore supervised-finetuning qlora llama2 parameter-efficient-fine-tuning structured-generation
-
Updated
Aug 6, 2026 - Python
The work presented was developed during the internship, as researchers in the field of Natural Language Generation, at the Insid&s Lab laboratory in Milan-Bicocca. The work carried out deals with the creation of a framework for the correct assessment of the impact of the quality of the input datasets on the quality of the text generated by the N…
python natural-language-processing deep-learning torch artificial-intelligence lstm rdf-triples natural-language-generation nlg rouge-metric bleu-score transformer-architecture bertscore
-
Updated
Mar 30, 2026 - Jupyter Notebook
An LLM-powered application that summarizes scientific research papers, extracts tables, and provides real-time evaluation using BERTScore (F1) and ROUGE. Built using Meta’s LLaMA 3–8B via Groq, with table extraction powered by pdfplumber and pandas.
-
Updated
Jul 23, 2025 - Python
AI-powered research paper summarizer built with Streamlit and Google Gemini. Supports customizable summaries, paper Q&A, ROUGE/BERTScore evaluation, and latency benchmarking.
python nlp artificial-intelligence summarization rouge research-paper gemini-api streamlit llm bertscore prompt-engineering generative-ai
-
Updated
Jun 24, 2026 - Python
Add this topic to your repo
To associate your repository with the bertscore topic, visit your repo's landing page and select "manage topics."