Commit History

  1. Update config.json

    Verified signature
    a1a768b
  2. Using max_position_embeddings instead of max_sequence_length to standardise with HF

    Verified signature
    9894fa3
  3. Fix causal mode

    Verified signature
    0ac9186
  4. Update config.json

    Verified signature
    c473569
  5. Update config.json

    Verified signature
    21a82ec
  6. Fixing AutoModel initialization to intialize as encoder + Fixing sequence length reading for MTEB

    Verified signature
    ba5a699

  1. fixed output format

    Verified signature
    b4ba7c8
  2. fix NaNs

    Verified signature
    f694326

  1. make FlashAttention logic more robust

    Verified signature
    7df4bf5

  1. Update config.json

    Verified signature
    f467488
  2. Upload model.safetensors with huggingface_hub

    Verified signature
    5d9cfde

  1. fix

    Verified signature
    d8479bb

  1. Update config.json

    Verified signature
    7307034

  1. removed SDPA

    Verified signature
    2c0c592
  2. Update modeling_gptbert.py

    Verified signature
    67e8a0f
  3. fixed SDPA for older PyTorch versions

    Verified signature
    8537e95

  1. Update config.json

    Verified signature
    054cf5f
  2. Update README.md

    Verified signature
    d6cfcbd
  3. Upload model_performance.png

    Verified signature
    fe150de
  4. Update README.md

    Verified signature
    2959d58

  1. FlashAttention support

    Verified signature
    801d9ed
  2. FlashAttention support

    Verified signature
    9aae5ff
  3. FlashAttention support

    Verified signature
    91025a2

  1. Update special_tokens_map.json

    Verified signature
    851343d
  2. Update modeling_gptbert.py

    Verified signature
    a3f5ab3

  1. Delete state_dict.bin

    Verified signature
    d64766f
  2. Upload folder using huggingface_hub

    Verified signature
    460fdd7
  3. initial commit

    Verified signature
    60727a1