AWS Bedrock configuration
To set up AWS Bedrock with a model, see this guide. You can configure the connection to AWS Bedrock in a few different ways:
Using a profile
You can use a locally set up AWS CLI profile that is logged in to AWS. If this profile does not specify a region, you must set the region
option. You may also specify the profile and region using the environment variables AWS_PROFILE
and AWS_REGION
.
siren-ai:
provider: 'aws'
providerConfig:
aws:
connection:
profile: 'my-bedrock-profile'
region: 'us-east-2' # Only needed if the profile does not specify a region
parameters:
model: 'meta.llama3-3-70b-instruct-v1:0'
Specifying credentials explicitly
This can be done either by filling in the credentials
object as illustrated below. The region must also be specified, though it can be set using the AWS_REGION
environment variable.
siren-ai:
provider: 'aws'
providerConfig:
aws:
connection:
region: 'us-east-2' # Can be set using the AWS_REGION environment variable
credentials:
accessKeyId: 'access-key'
secretAccessKey: 'secret-access-key'
sessionToken: 'token' # Optional
credentialScope: '<scope>' # Optional
accountId: '<ID>' # Optional
parameters:
model: 'meta.llama3-3-70b-instruct-v1:0'
Specifying credentials using environment variables
Credentials can be specified using environment variables instead of in the config file: AWS_ACCESS_KEY_ID
, AWS_SECRET_ACCESS_KEY
, AWS_SESSION_TOKEN
, and AWS_CREDENTIAL_EXPIRATION
. AWS_SESSION_TOKEN
, and AWS_CREDENTIAL_EXPIRATION
are only needed when you are using temporary credentials. The region must also be specified, though it can be set using the AWS_REGION
environment variable.
siren-ai:
provider: 'aws'
providerConfig:
aws:
connection:
region: 'us-east-2' # Can be set using the AWS_REGION environment variable
parameters:
model: 'meta.llama3-3-70b-instruct-v1:0'
Running on ECS or EC2
When running Investigate on ECS or EC2, credentials will be automatically fetched. The region must be specified, though it can be set using the AWS_REGION
environment variable.
siren-ai:
provider: 'aws'
providerConfig:
aws:
connection:
region: 'us-east-2' # Can be set using the AWS_REGION environment variable
parameters:
model: 'meta.llama3-3-70b-instruct-v1:0'