zip2zip

zip2zip

High-performance LZW compression library with Python bindings for adaptive vocabularies.

High-performance C LZW compression library with Python bindings (cffi/ctypes). Supports adaptive vocabularies for LLM tokenization pipelines; includes a novel LZW variant that decompresses LLM- generated sequences without requiring a perfectly encoded input stream. Install via pip or from source.

Large Language Model
Key facts
Maturity
Support
C4DT
Inactive
Lab
Active
  • Technical

Data Science Lab

Data Science Lab
Robert West

Prof. Robert West

Our research aims to make sense of large amounts of data. Frequently, the data we analyze is collected on the Web, e.g., using server logs, social media, wikis, online news, online games, etc. We distill heaps of raw data into meaningful insights by developing and applying algorithms and techniques in areas including social and information network analysis, machine learning, computational social science, data mining, natural language processing, and human computation.

This page was last edited on 2026-03-03.