272 lines
10 KiB
Markdown
272 lines
10 KiB
Markdown
<!-- generated file, do not edit directly -->
|
|
|
|
# @aws-sdk/client-bedrock-runtime
|
|
|
|
## Description
|
|
|
|
AWS SDK for JavaScript BedrockRuntime Client for Node.js, Browser and React Native.
|
|
|
|
<p>Describes the API operations for running inference using Amazon Bedrock models.</p>
|
|
|
|
## Installing
|
|
To install this package, simply type add or install @aws-sdk/client-bedrock-runtime
|
|
using your favorite package manager:
|
|
- `npm install @aws-sdk/client-bedrock-runtime`
|
|
- `yarn add @aws-sdk/client-bedrock-runtime`
|
|
- `pnpm add @aws-sdk/client-bedrock-runtime`
|
|
|
|
## Getting Started
|
|
|
|
### Import
|
|
|
|
The AWS SDK is modulized by clients and commands.
|
|
To send a request, you only need to import the `BedrockRuntimeClient` and
|
|
the commands you need, for example `ListAsyncInvokesCommand`:
|
|
|
|
```js
|
|
// ES5 example
|
|
const { BedrockRuntimeClient, ListAsyncInvokesCommand } = require("@aws-sdk/client-bedrock-runtime");
|
|
```
|
|
|
|
```ts
|
|
// ES6+ example
|
|
import { BedrockRuntimeClient, ListAsyncInvokesCommand } from "@aws-sdk/client-bedrock-runtime";
|
|
```
|
|
|
|
### Usage
|
|
|
|
To send a request, you:
|
|
|
|
- Initiate client with configuration (e.g. credentials, region).
|
|
- Initiate command with input parameters.
|
|
- Call `send` operation on client with command object as input.
|
|
- If you are using a custom http handler, you may call `destroy()` to close open connections.
|
|
|
|
```js
|
|
// a client can be shared by different commands.
|
|
const client = new BedrockRuntimeClient({ region: "REGION" });
|
|
|
|
const params = { /** input parameters */ };
|
|
const command = new ListAsyncInvokesCommand(params);
|
|
```
|
|
|
|
#### Async/await
|
|
|
|
We recommend using [await](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Operators/await)
|
|
operator to wait for the promise returned by send operation as follows:
|
|
|
|
```js
|
|
// async/await.
|
|
try {
|
|
const data = await client.send(command);
|
|
// process data.
|
|
} catch (error) {
|
|
// error handling.
|
|
} finally {
|
|
// finally.
|
|
}
|
|
```
|
|
|
|
Async-await is clean, concise, intuitive, easy to debug and has better error handling
|
|
as compared to using Promise chains or callbacks.
|
|
|
|
#### Promises
|
|
|
|
You can also use [Promise chaining](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Guide/Using_promises#chaining)
|
|
to execute send operation.
|
|
|
|
```js
|
|
client.send(command).then(
|
|
(data) => {
|
|
// process data.
|
|
},
|
|
(error) => {
|
|
// error handling.
|
|
}
|
|
);
|
|
```
|
|
|
|
Promises can also be called using `.catch()` and `.finally()` as follows:
|
|
|
|
```js
|
|
client
|
|
.send(command)
|
|
.then((data) => {
|
|
// process data.
|
|
})
|
|
.catch((error) => {
|
|
// error handling.
|
|
})
|
|
.finally(() => {
|
|
// finally.
|
|
});
|
|
```
|
|
|
|
#### Callbacks
|
|
|
|
We do not recommend using callbacks because of [callback hell](http://callbackhell.com/),
|
|
but they are supported by the send operation.
|
|
|
|
```js
|
|
// callbacks.
|
|
client.send(command, (err, data) => {
|
|
// process err and data.
|
|
});
|
|
```
|
|
|
|
#### v2 compatible style
|
|
|
|
The client can also send requests using v2 compatible style.
|
|
However, it results in a bigger bundle size and may be dropped in next major version. More details in the blog post
|
|
on [modular packages in AWS SDK for JavaScript](https://aws.amazon.com/blogs/developer/modular-packages-in-aws-sdk-for-javascript/)
|
|
|
|
```ts
|
|
import * as AWS from "@aws-sdk/client-bedrock-runtime";
|
|
const client = new AWS.BedrockRuntime({ region: "REGION" });
|
|
|
|
// async/await.
|
|
try {
|
|
const data = await client.listAsyncInvokes(params);
|
|
// process data.
|
|
} catch (error) {
|
|
// error handling.
|
|
}
|
|
|
|
// Promises.
|
|
client
|
|
.listAsyncInvokes(params)
|
|
.then((data) => {
|
|
// process data.
|
|
})
|
|
.catch((error) => {
|
|
// error handling.
|
|
});
|
|
|
|
// callbacks.
|
|
client.listAsyncInvokes(params, (err, data) => {
|
|
// process err and data.
|
|
});
|
|
```
|
|
|
|
### Troubleshooting
|
|
|
|
When the service returns an exception, the error will include the exception information,
|
|
as well as response metadata (e.g. request id).
|
|
|
|
```js
|
|
try {
|
|
const data = await client.send(command);
|
|
// process data.
|
|
} catch (error) {
|
|
const { requestId, cfId, extendedRequestId } = error.$metadata;
|
|
console.log({ requestId, cfId, extendedRequestId });
|
|
/**
|
|
* The keys within exceptions are also parsed.
|
|
* You can access them by specifying exception names:
|
|
* if (error.name === 'SomeServiceException') {
|
|
* const value = error.specialKeyInException;
|
|
* }
|
|
*/
|
|
}
|
|
```
|
|
|
|
## Getting Help
|
|
|
|
Please use these community resources for getting help.
|
|
We use the GitHub issues for tracking bugs and feature requests, but have limited bandwidth to address them.
|
|
|
|
- Visit [Developer Guide](https://docs.aws.amazon.com/sdk-for-javascript/v3/developer-guide/welcome.html)
|
|
or [API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/index.html).
|
|
- Check out the blog posts tagged with [`aws-sdk-js`](https://aws.amazon.com/blogs/developer/tag/aws-sdk-js/)
|
|
on AWS Developer Blog.
|
|
- Ask a question on [StackOverflow](https://stackoverflow.com/questions/tagged/aws-sdk-js) and tag it with `aws-sdk-js`.
|
|
- Join the AWS JavaScript community on [gitter](https://gitter.im/aws/aws-sdk-js-v3).
|
|
- If it turns out that you may have found a bug, please [open an issue](https://github.com/aws/aws-sdk-js-v3/issues/new/choose).
|
|
|
|
To test your universal JavaScript code in Node.js, browser and react-native environments,
|
|
visit our [code samples repo](https://github.com/aws-samples/aws-sdk-js-tests).
|
|
|
|
## Contributing
|
|
|
|
This client code is generated automatically. Any modifications will be overwritten the next time the `@aws-sdk/client-bedrock-runtime` package is updated.
|
|
To contribute to client you can check our [generate clients scripts](https://github.com/aws/aws-sdk-js-v3/tree/main/scripts/generate-clients).
|
|
|
|
## License
|
|
|
|
This SDK is distributed under the
|
|
[Apache License, Version 2.0](http://www.apache.org/licenses/LICENSE-2.0),
|
|
see LICENSE for more information.
|
|
|
|
## Client Commands (Operations List)
|
|
|
|
<details>
|
|
<summary>
|
|
ApplyGuardrail
|
|
</summary>
|
|
|
|
[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/bedrock-runtime/command/ApplyGuardrailCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/ApplyGuardrailCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/ApplyGuardrailCommandOutput/)
|
|
</details>
|
|
<details>
|
|
<summary>
|
|
Converse
|
|
</summary>
|
|
|
|
[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/bedrock-runtime/command/ConverseCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/ConverseCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/ConverseCommandOutput/)
|
|
</details>
|
|
<details>
|
|
<summary>
|
|
ConverseStream
|
|
</summary>
|
|
|
|
[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/bedrock-runtime/command/ConverseStreamCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/ConverseStreamCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/ConverseStreamCommandOutput/)
|
|
</details>
|
|
<details>
|
|
<summary>
|
|
CountTokens
|
|
</summary>
|
|
|
|
[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/bedrock-runtime/command/CountTokensCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/CountTokensCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/CountTokensCommandOutput/)
|
|
</details>
|
|
<details>
|
|
<summary>
|
|
GetAsyncInvoke
|
|
</summary>
|
|
|
|
[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/bedrock-runtime/command/GetAsyncInvokeCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/GetAsyncInvokeCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/GetAsyncInvokeCommandOutput/)
|
|
</details>
|
|
<details>
|
|
<summary>
|
|
InvokeModel
|
|
</summary>
|
|
|
|
[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/bedrock-runtime/command/InvokeModelCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/InvokeModelCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/InvokeModelCommandOutput/)
|
|
</details>
|
|
<details>
|
|
<summary>
|
|
InvokeModelWithBidirectionalStream
|
|
</summary>
|
|
|
|
[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/bedrock-runtime/command/InvokeModelWithBidirectionalStreamCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/InvokeModelWithBidirectionalStreamCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/InvokeModelWithBidirectionalStreamCommandOutput/)
|
|
</details>
|
|
<details>
|
|
<summary>
|
|
InvokeModelWithResponseStream
|
|
</summary>
|
|
|
|
[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/bedrock-runtime/command/InvokeModelWithResponseStreamCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/InvokeModelWithResponseStreamCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/InvokeModelWithResponseStreamCommandOutput/)
|
|
</details>
|
|
<details>
|
|
<summary>
|
|
ListAsyncInvokes
|
|
</summary>
|
|
|
|
[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/bedrock-runtime/command/ListAsyncInvokesCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/ListAsyncInvokesCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/ListAsyncInvokesCommandOutput/)
|
|
</details>
|
|
<details>
|
|
<summary>
|
|
StartAsyncInvoke
|
|
</summary>
|
|
|
|
[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/bedrock-runtime/command/StartAsyncInvokeCommand/) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/StartAsyncInvokeCommandInput/) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/Package/-aws-sdk-client-bedrock-runtime/Interface/StartAsyncInvokeCommandOutput/)
|
|
</details>
|