pretraining-bert

Star

Here are 3 public repositories matching this topic...

Creazygao / bert

Star

pre-training your own BERT modelfrom scratch

tf2 bert tensorflow2 training-bert pretraining-bert pre-training-bert you-own-bert

Updated Mar 5, 2023
Jupyter Notebook

sbartlett97 / torch-electra

Sponsor

Star

A Custom implementation of the ELECTRA training method using PyTorch and HuggingFace Transformers

python nlp machine-learning machine-learning-algorithms nlp-machine-learning pretraining masked-image-modeling pretraining-bert

Updated Mar 22, 2025
Python

lycorp-jp / segqu

Star

Official code for "Session-Guided Pre-training for Query Understanding: Constraining Mask Prediction and Improving Query Fine-tunability" (EMNLP 2026 Industry Track).

query-understanding search-sessions pretraining-bert emnlp2026

Updated Sep 2, 2026
Python

Add this topic to your repo

To associate your repository with the pretraining-bert topic, visit your repo's landing page and select "manage topics."

Learn more