Skip to content

Conversation

ajeetraina
Copy link
Owner

TCP Support for Model Runner

This PR adds TCP support for connecting to the Model Runner, allowing the application to connect to the model runner via host.docker.internal:12434 instead of using model-runner.docker.internal.

Changes

  1. Updated backend.env to use the TCP connection to the model runner at host.docker.internal:12434
  2. Modified compose.yaml to add the necessary extra_hosts configuration

Testing

  • Updated environment variables to use host.docker.internal:12434
  • Added extra_hosts configuration to Docker Compose
  • Tested connection to Model Runner via TCP

Benefits of TCP Support

Using TCP support instead of Docker socket communication provides several benefits:

  1. Improved Security: Reduces the need for direct Docker socket access
  2. Enhanced Flexibility: Allows the application to connect to the Model Runner from hosts that don't have direct Docker access
  3. Network Simplicity: Uses standard TCP/IP networking, which is more universally supported
  4. Cross-Host Compatibility: Enables the application to connect to Model Runners running on different hosts

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant