Integrate Novita AI as exclusive inference provider - Add Novita AI API integration with DeepSeek-R1-Distill-Qwen-7B model - Remove all local model dependencies - Optimize token allocation for user inputs and context - Add Anaconda environment setup files - Add comprehensive test scripts and documentation
927854c
Quick Test: Novita AI Connection with Anaconda
Step-by-Step Instructions
1. Open Anaconda Prompt
- Search for "Anaconda Prompt" in Windows Start menu
- This ensures conda commands work properly
2. Navigate to Project Directory
cd C:\Users\85jat\GenAI_work_V2\Prototyping\Research_AI_Assistant_V2\Research_AI_Assistant_API
3. Create Conda Environment (First Time Only)
conda create -n research-ai-assistant python=3.10 -y
4. Activate Environment
conda activate research-ai-assistant
5. Install Required Packages
pip install openai>=1.0.0
pip install -r requirements.txt
6. Set Environment Variables
# Set your Novita API key
set NOVITA_API_KEY=your_api_key_here
set NOVITA_BASE_URL=https://api.novita.ai/dedicated/v1/openai
set NOVITA_MODEL=deepseek-ai/DeepSeek-R1-Distill-Qwen-7B:de-1a706eeafbf3ebc2
7. Run Test
python test_novita_connection.py
Alternative: Use Batch Script
Simply double-click or run:
test_novita_conda.bat
Expected Output
You should see: ```
NOVITA AI CONNECTION TEST
============================================================ TEST 1: Configuration Loading
✓ Configuration loaded successfully Novita API Key: Set Base URL: https://api.novita.ai/dedicated/v1/openai Model: deepseek-ai/DeepSeek-R1-Distill-Qwen-7B:de-1a706eeafbf3ebc2 ...
============================================================ TEST 4: Simple API Call
✓ API call successful! Response: ...
🎉 All tests passed! Novita AI connection is working correctly.
## Troubleshooting
**If conda command not found:**
- Use Anaconda Prompt instead of regular PowerShell
- Or run: `C:\Users\85jat\anaconda3\Scripts\activate.bat` (adjust path as needed)
**If environment activation fails:**
- Create environment first: `conda create -n research-ai-assistant python=3.10`
**If import errors:**
- Ensure environment is activated: `conda activate research-ai-assistant`
- Install packages: `pip install openai>=1.0.0`