Simple Queue Service
On This Page
Fully managed message queues for microservices, distributed systems, and serverless applications
SQS offers two types of message queues. Standard queues offer maximum throughput, best-effort ordering, and at-least-once delivery. SQS FIFO queues are designed to guarantee that messages are processed exactly once, in the exact order that they are sent.
SQS is a fully managed message queuing service that enables to decouple & scale microservices, distributed systems, & serverless applications.
Messages are published to an Amazon SNS topic and then pushed to Amazon SQS subscriber queues. This eliminates the need for periodic polling and allows for messages to be processed in parallel asynchronously by the subscribers.
- Apache Kafka
- Google Cloud Pub/Sub
- IBM MQ
- TIBCO Enterprise Message Service
- AWS IoT Core
- Amazon CloudWatch
- Azure Service Bus
- Visibility timeout:
- Other consumers will not receive a message being processed for the configured time period (default 30 seconds, min - 0, max - 12 hours)
- Consumer processing a message can call ChangeMessageVisibility to increase visibility timeout of a message (before visibility timeout)
- Time period before a new message is visible on the queue
- Delay Queue = Create Queue + Delay Seconds default - 0, max - 15 minutes
- Can be set at Queue creation or updated using SetQueueAttributes
- Use message timers to configure a message specific DelaySeconds value
- Message retention period: Maximum period a message can be on the queue Default - 4 days, Min - 60 seconds, Max - 14 days
- MaxReceiveCount: Maximum number of failures in processing a message
- Long polling: Long polling will reduce the overhead of the CPU and not require excessive dolls.
- Visibility timeout: a period of time during which Amazon SOS prevents other consumers from receiving and processing the message. The default visibility timeout for a message is 30 seconds. The minimum is O seconds. The maximum is 12 hours
- Delay queue: Delay queues let you postpone the delivery of new messages to a queue for a number of seconds. If you create a delay queue, any messages that you send to the queue remain invisible to consumers for the duration of the delay period Know FIFO vs Standard Queue
- SQS is a fully managed message queuing service that enables you to decouple and scale micro-services, distributed systems, and Serverless applications
- SNS: To receive subset of messages, subscriber can apply filter policy to topic subscription.
- If use case has subscribed to email notification, go with SNS as opposed to SQS.
- By default only the queue owner is allowed to use the queue. Configure SQS Queue Access Policy to provide access to other AWS accounts
Type: Application integration
Same type services: SNS, SQS, AppSync, EventBridge
Which endpoint is considered to be best practice when analyzing data within a Configuration Stream of AWS Config?