GitHub - YL-9/dcis: DCIS: Efficient Length Extrapolation of LLMs via Divide-and-Conquer Scaling Factor Search · GitHub

Name		Name	Last commit message	Last commit date
deepspeed		deepspeed
eval		eval
factors		factors
modeling_source		modeling_source
LICENSE		LICENSE
README.md		README.md
dcis.py		dcis.py
finetune.py		finetune.py
longrope.py		longrope.py
run.sh		run.sh

Repository files navigation

DCIS

This repo contains the code for the DCIS: Efficient Length Extrapolation of LLMs via Divide-and-Conquer Scaling Factor Search

Paper

Reproduction

The run.sh has some sample.

About

DCIS: Efficient Length Extrapolation of LLMs via Divide-and-Conquer Scaling Factor Search

1 star

1 watching

Report repository

Releases

Packages

Contributors

Languages