aws-kinesis

Interact with the Amazon Kinesis Data Streams, a service that scales elastically for real-time processing of streaming big data. tldr-pages

On several platforms

Several platforms

Show all streams in the account

aws kinesis list-streamsIdentify

Write one record to a Kinesis stream

aws kinesis put-record --stream-name name --partition-key key --data base64_encoded_messageIdentify

--stream-nameThe name of the stream to put the data record into. AWS CLI reference

--partition-keyDetermines which shard in the stream the data record is assigned to. AWS CLI reference

--dataThe data blob to put into the record, which is base64-encoded when the blob is serialized. AWS CLI reference

Write a record to a Kinesis stream with inline Base64 encoding

aws kinesis put-record --stream-name name --partition-key key --data "$( echo "my raw message" | base64 )"Identify

--stream-nameThe name of the stream to put the data record into. AWS CLI reference

--partition-keyDetermines which shard in the stream the data record is assigned to. AWS CLI reference

--dataThe data blob to put into the record, which is base64-encoded when the blob is serialized. AWS CLI reference

List the shards available on a stream

aws kinesis list-shards --stream-name nameIdentify

--stream-nameThe name of the data stream whose shards you want to list. AWS CLI reference

Get a shard iterator for reading from the oldest message in a stream's shard

aws kinesis get-shard-iterator --shard-iterator-type TRIM_HORIZON --stream-name name --shard-id shard_idIdentify

--shard-iterator-typeDetermines how the shard iterator is used to start reading data records from the shard. AWS CLI reference

--stream-nameThe name of the Amazon Kinesis data stream. AWS CLI reference

--shard-idThe shard ID of the Kinesis Data Streams shard to get the iterator for. AWS CLI reference

Read records from a shard, using a shard iterator

aws kinesis get-records --shard-iterator iteratorIdentify

--shard-iteratorThe position in the shard from which you want to start sequentially reading data records. AWS CLI reference