Logo

dev-resources.site

for different kinds of informations.

Aurora Limitless - Creation

Published at
11/24/2024
Categories
aws
postgres
distributed
aurora
Author
franckpachot
Categories
4 categories in total
aws
open
postgres
open
distributed
open
aurora
open
Author
12 person written this
franckpachot
open
Aurora Limitless - Creation

Announced last year at re:Invent 2023, Aurora Limitless (PostgreSQL compatible) is available in preview. If you didn't look at the preview, I'm starting a blog series so that you get some general information before getting more details from the re:Invent 2024 sessions about it. Here is the first post of this series.

Aurora Limitless is not a different engine. It is a managed sharding option built on top of Aurora Serverless. Aurora Limitless can make it easier to operate if you have a PostgreSQL application designed for database sharding.

The Engine is Aurora (PostgreSQL Compatible):
Engine

Not all PostgreSQL compatibility versions allow this option:
Version

A Limitless database consists of multiple database instances. Some act as stateless query coordinators (called routers), and some are storage nodes (called shards) organized into a shard group. A minimum and maximum Aurora Capacity Unit (ACU) determines the system's capacity, influencing the number of routers and shards within the shard group.
Configuration

An Aurora Limitless database cluster has only one shard group, which defines the compute instances (routers and shards). The cluster itself encompasses the storage ("Grover," the Aurora distributed storage servers).

Sharding alone does not ensure resilience. Regarding High Availability, it mitigates the impact of failures when they concern only one shard. However, the storage uses Aurora multi-AZ storage, which safeguards data. Additional standbys can be provisioned for faster failover and serving stale reads, and Aurora Limitless recovers the Two-Phase Commit pending transactions.

In the next few posts of this series, I'll explore how sharding works, its advantages, such as recharding and cross-node consistency, and its limitations in terms of performance and PostgreSQL compatibility.

distributed Article's
30 articles in total
Favicon
PostgreSQL plan_cache_mode
Favicon
Index Filtering in PostgreSQL and YugabyteDB (Index Scan instead of Index Only Scan)
Favicon
Book Review: Designing Data-Intensive Applications
Favicon
More details in pg_locks for YugabyteDB
Favicon
Large IntentsDB MemTable with Many Small SST Files
Favicon
MapReduce - A Simplified Approach to Big Data Processing
Favicon
Challenges of Asynchronous Messaging in Software Design
Favicon
Aurora DSQL: How it Compares to YugabyteDB
Favicon
Document data modeling to avoid write skew anomalies
Favicon
When to replace IN() with EXISTS() - correlated and uncorrelated subqueries
Favicon
2024.2: Faster with Shared Memory Between PostgreSQL and TServer Layers
Favicon
DynamoDB-style Limits for Predictable SQL Performance?
Favicon
Aurora DSQL: Create a Serverless Cluster and Connect with PostgreSQL Client
Favicon
Amazon Aurora DSQL: Which PostgreSQL Service Should I Use on AWS ?
Favicon
YugabyteDB MVCC and Updates: columns vs. JSON
Favicon
Aurora Limitless - Creation
Favicon
No Gap Ordered Numbering in SQL: A Unique Index to Serialize In Read Committed
Favicon
What's behind the Call Home option?
Favicon
Reverse Proxy and Load Balancing: Do we need both?
Favicon
AWS re:Invent 2024 - Which sessions I'll try to attend.
Favicon
pgSphere and Q3C on Distributed SQL
Favicon
IN() Index Scan in PostgreSQL 17 and YugabyteDB LSM Tree
Favicon
Frequent Re-Connections improved by Connection Manager
Favicon
Maintaining Throughput With Less Physical Connections
Favicon
YugabyteDB Connection Manager: a Database Resident Connection Pool with Shared Processes
Favicon
Parallel JavaScript Machine
Favicon
Asynch replication for Disaster Recovery, Read Replicas, and Change Data Capture
Favicon
RocksDB, Key-Value Storage, and Packed Rows: the backbone of YugabyteDB's distributed tablets flexibility
Favicon
SQL as fast as NoSQL, Bulk Loads, Covering and Partial Indexes
Favicon
Fault Tolerance with Raft and no Single Point of Failure

Featured ones: