peakji
/ logits_processor.py
Created
October 20, 2024 05:34
vLLM logits processor for inference-time scaling experiments with Steiner-preview.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Project Steiner, Yichao 'Peak' Ji <pj@ieee.org> | |
| https://huggingface.co/collections/peakji/steiner-preview-6712c6987110ce932a44e9a6 | |
| vLLM logits processor for inference-time scaling experiments. | |
| """ | |
| def reasoning_constraints(min_steps=0, max_steps=10): | |
| """Create logits processor for inference-time scaling experiments.""" |