#AWS internal server error

4 messages · Page 1 of 1 (latest)

clever flint
#

When I try to byok through Amazon bedrock it says internal server error. Everything is setup, I have the policies and the JSON is setup right but it still doesn't work

waxen radishBOT
#

I'm an AI assistant - my answers may be incorrect and I cannot see screenshots. Please verify information with the OpenRouter docs.

To help debug your BYOK setup with Amazon Bedrock, I need a bit more information:

  1. What is the exact error message or full response you receive from OpenRouter when attempting to use your Bedrock key?
  2. Which specific AWS region are you using in your configuration?
  3. Can you share the (redacted) JSON config you're submitting for BYOK?

These details will help pinpoint if the issue is with your credentials, IAM setup, region, or something else. For reference, the required fields and permissions are:

  • "accessKeyId": your AWS Access Key ID
  • "secretAccessKey": your AWS Secret Access Key
  • "region": AWS region (e.g., "us-east-1")

You also need IAM permissions for:

  • bedrock:InvokeModel
  • bedrock:InvokeModelWithResponseStream

See the section "AWS Bedrock API Keys" in the BYOK documentation for full details.

-# This is an automated response powered by Answer HQ. Use !mute to stop the bot from responding.

The author you are looking for could not be found.

clever flint
#

I'm using sillytavern with an openrouter API key and got internal server error when trying to use the Amazon bedrock model provider. I'm us-east-1

waxen radishBOT
#

Thanks for the details. Here are the key requirements for using Amazon Bedrock with OpenRouter:

  • Your BYOK JSON must include these fields:
    {
      "accessKeyId": "your-aws-access-key-id",
      "secretAccessKey": "your-aws-secret-access-key",
      "region": "us-east-1"
    }
    
  • Your IAM user needs these permissions:
    • bedrock:InvokeModel
    • bedrock:InvokeModelWithResponseStream

"Make sure your AWS IAM user or role has the necessary permissions to access Amazon Bedrock services. At minimum, you’ll need permissions for: bedrock:InvokeModel, bedrock:InvokeModelWithResponseStream"
BYOK Documentation

Troubleshooting steps:

  1. Double-check that your keys are correct and have not expired or been rotated.
  2. Ensure the IAM user is allowed to access Bedrock in the us-east-1 region.
  3. Verify the policy is attached to the user whose keys you provided.
  4. Make sure your JSON is formatted exactly as shown above (no trailing commas or extra fields).

If everything is correct and you still get "internal server error," please provide:

  • The full error message/response from SillyTavern or OpenRouter.
  • The model identifier you are trying to use (e.g., amazon/nova-pro-v1).

This will help further narrow down the issue. For more info, see the BYOK Documentation.

If the error persists after checking these points, you may need to contact the mods through the Discord server for account-specific troubleshooting.

-# This is an automated response powered by Answer HQ. Use !mute to stop the bot from responding.