CHAMELEON

Data-mixing framework using Kernel Ridge Leverage Scores for LLM pretraining and finetuning.

Data-mixing framework using Kernel Ridge Leverage Scores (KRLS) for domain weighting in LLM pretraining and finetuning. Computes domain embeddings and weights to optimize universal generalization and transferability. Integrates with existing training pipelines via simple scripting.