Invalid eos_token_id type
#2
by
louis-jan - opened
This causes an issue while running with mlx-swift, the eos_token_id should be an array or null (https://github.com/ml-explore/mlx-swift-lm/blob/a3e1bf49f6f44d0e9cba29f1c4a61576f646a1b4/Libraries/MLXVLM/Models/Qwen3VL.swift#L352). And generation_config.json is presented, which would override later, which provides proper eos_token_ids.
louis-jan changed pull request status to
closed
louis-jan changed pull request status to
open