Redis

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search
Redis
Redis Logo.svg
Original author(s)Salvatore Sanfilippo[1][2]
Developer(s)Redis Labs[1][2]
Initial releaseMay 10, 2009; 10 years ago (2009-05-10)
Stable release
5.0.5 / May 15, 2019; 4 months ago (2019-05-15)[3]
Repository Edit this at Wikidata
Written inANSI C
Operating systemPOSIX systems,[4]
Available inEnglish
TypeData structure store, key-value database
LicenseBSD 3-clause[5]
Websiteredis.io

Redis (/ˈrɛdɪs/;[6][7] Remote Dictionary Server)[6] is an in-memory data structure project implementing a distributed, in-memory key-value database with optional durability. Redis supports different kinds of abstract data structures, such as strings, lists, maps, sets, sorted sets, HyperLogLogs, bitmaps, streams, and spatial indexes. The project is mainly developed by Salvatore Sanfilippo and as of 2019, is sponsored by Redis Labs.[8] It is open-source software released under a BSD 3-clause license.[5]

History[edit]

The name Redis means REmote DIctionary Server.[6] The Redis project began when Salvatore Sanfilippo, nicknamed antirez, the original developer of Redis, was trying to improve the scalability of his Italian startup, developing a real-time web log analyzer. After encountering significant problems in scaling some types of workloads using traditional database systems, Sanfilippo began to prototype a first proof of concept version of Redis in Tcl.[9] Later Sanfilippo translated that prototype to the C language and implemented the first data type, the list. After a few weeks of using the project internally with success, Sanfilippo decided to open source it, announcing the project on Hacker News. The project began to get traction, more so among the Ruby community, with GitHub and Instagram being among the first companies adopting it. [10] [11]

Sanfilippo was hired by VMware in March, 2010.[12][13][14]

In May, 2013, Redis was sponsored by Pivotal Software (a VMware spin-off).[15]

In June 2015, development became sponsored by Redis Labs.[16]

In October 2018 Redis 5.0 was released, introducing Redis Stream - a new data structure that allows storage of multiple fields and string values with an automatic, time-based sequence at a single key.[17]

Differences with other database systems[edit]

Redis made popular the idea of a system that can be considered at the same time a store and a cache, using a design where data is always modified and read from the main computer memory, but also stored on disk in a format that is unsuitable for random access of data, but only to reconstruct the data back in memory once the system restarts. At the same time, Redis provides a data model that is very unusual compared to relational database management system (RDBMS), as user commands do not describe a query to be executed by the database engine, but specific operations that are performed on given abstract data types, hence data must be stored in a way which is suitable later for fast retrieval, without help from the database system in form of secondary indexes, aggregations or other common features of traditional RDBMS. The Redis implementation makes heavy use of the Fork (system call), to duplicate the process holding the data, so that the parent process continues to serve clients, while the child process creates a copy of the data on disk.

Popularity[edit]

According to monthly DB-Engines rankings, Redis is often the most popular key-value database.[18] Redis has also been ranked the #4 NoSQL database in user satisfaction and market presence based on user reviews,[19] the most popular NoSQL database in containers,[20] and the #1 NoSQL database of 2015 by ranking website stackshare.io.[21] It was voted most loved database in the Stack Overflow Developer Survey in 2017, 2018 and 2019.[22]

Supported languages[edit]

Since version 2.6, Redis features server-side scripting in the language Lua.[23]

Many programming languages have Redis language bindings on the client side, including:[24] ActionScript, C, C++, C#, Chicken, Clojure, Common Lisp, Crystal, D, Dart, Elixir, Erlang, Go, Haskell, Haxe, Io, Java, JavaScript (Node.js), Julia, Lua, Objective-C, OCaml, Perl, PHP, Pure Data, Python, R,[25] Racket, Ruby, Rust, Scala, Smalltalk, Swift, and Tcl. Several client software programs exist in these languages.[24]

Data types[edit]

Redis maps keys to types of values. An important difference between Redis and other structured storage systems is that Redis supports not only strings, but also abstract data types:

  • Lists of strings
  • Sets of strings (collections of non-repeating unsorted elements)
  • Sorted sets of strings (collections of non-repeating elements ordered by a floating-point number called score)
  • Hash tables where keys and values are strings
  • HyperLogLogs used for approximated set cardinality size estimation, available since Redis 2.8.9 in April 2014.[26]
  • Stream of entries with consumer groups, allows you to store multiple fields and string values with an automatic, time-based sequence at a single key, available since Redis 5.0 in October 2018[27]
  • Geospatial data through the implementation of the geohash technique, available since Redis 3.2.[28]

The type of a value determines what operations (called commands) are available for the value. Redis supports high-level, atomic, server-side operations like intersection, union, and difference between sets and sorting of lists, sets and sorted sets.

More data types are supported based on Redis Modules API[29]. The Redis module RedisJSON implements ECMA-404 (the JavaScript Object Notation (JSON) Data Interchange Standard) as a native data type.[30]

Persistence[edit]

Redis typically holds the whole dataset in memory. Versions up to 2.4 could be configured to use what they refer to as virtual memory[31] in which some of the dataset is stored on disk, but this feature is deprecated. Persistence in Redis can be achieved through two different methods. First by snapshotting, where the dataset is asynchronously transferred from memory to disk at regular intervals as a binary dump, using the Redis RDB Dump File Format. Alternatively by journaling, where a record of each operation that modifies the dataset is added to an append-only file (AOF) in a background process. Redis can rewrite the append-only file in the background to avoid an indefinite growth of the journal. Journaling was introduced in version 1.1 and is generally considered the safer approach.

By default, Redis writes data to a file system at least every 2 seconds, with more or less robust options available if needed. In the case of a complete system failure on default settings, only a few seconds of data would be lost.

Replication[edit]

Redis supports master-replica replication. Data from any Redis server can replicate to any number of replicas. A replica may be a master to another replica. This allows Redis to implement a single-rooted replication tree. Redis replicas can be configured to accept writes, permitting intentional and unintentional inconsistency between instances. The publish/subscribe feature is fully implemented, so a client of a replica may subscribe to a channel and receive a full feed of messages published to the master, anywhere up the replication tree. Replication is useful for read (but not write) scalability or data redundancy.[32]

Performance[edit]

When the durability of data is not needed, the in-memory nature of Redis allows it to perform well compared to database systems that write every change to disk before considering a transaction committed.[6] Redis operates as a single process and is single-threaded or double-threaded when it rewrites the AOF (append-only file).[33] Thus, a single Redis instance cannot use parallel execution of tasks such as stored procedures.

Clustering[edit]

Redis introduced clustering in April 2015 with the release of version 3.0.[34] The cluster specification implements a subset of Redis commands: all single-key commands are available, multi-key operations (commands related to unions and intersections) are restricted to keys belonging to the same node, and commands related to database selection operations are unavailable.[35] A Redis cluster can scale up to 1,000 nodes, achieve "acceptable" write safety and to continue operations when some nodes fail.[36][37]

Use cases[edit]

Due to the nature of the database design, typical use cases are session caching, full page cache, message queue applications, leaderboards and counting among others.[38] Large companies such as Twitter are using Redis,[39] Amazon Web Services is offering Redis in its portfolio, and Microsoft is offering the Redis Cache in Azure.[40]

See also[edit]

Commercial implementations[edit]

Some companies have used Redis and created commercial offerings around it:

On February 21, 2019, Redis Labs relicensed some Redis Modules under Redis Source Available License [42], which is a source-available arrangement that prohibits users from selling the software.[43][44] Redis Modules were formerly licensed under the Affero General Public License.[45][46]

References[edit]

  1. ^ a b Bernardi, Stefano (January 4, 2011). "An interview with Salvatore Sanfilippo, creator of Redis, working out of Sicily". EU-Startups. Menlo Media.
  2. ^ a b Haber, Itamar (July 15, 2015). "Salvatore Sanfilippo: Welcome to Redis Labs". Redis Labs.
  3. ^ Sanfilippo, Salvatore. "Redis 5.0 release notes". GitHub. Retrieved 2019-04-30.
  4. ^ "Introduction to Redis". Redis is written in ANSI C and works in most POSIX systems like Linux, *BSD, OS X without external dependencies.
  5. ^ a b "Copying". GitHub.
  6. ^ a b c d "FAQ: Redis". Redis.io.
  7. ^ "Google Groups". groups.google.com.
  8. ^ Kepes, Ben (July 15, 2015). "Redis Labs hires the creator of Redis, Salvatore Sanfilippo". Network World. Retrieved August 30, 2015.
  9. ^ Sanfilippo, Salvatore (April 28, 2017). "Tcl prototype of Redis". GitHub Gist. Retrieved October 8, 2018.
  10. ^ Wanstrath, Chris (November 3, 2009). "Introducing Resque". Blog. Retrieved October 8, 2018.
  11. ^ Krieger, Mike (October 31, 2011). "Storing hundreds of millions of simple key-value pairs in Redis". Instagram Engineering Blog. Retrieved October 8, 2018.
  12. ^ Shapira, Gwen (March 17, 2010). "VMware Hires Redis Key Developer – But Why?". Blog. Retrieved September 25, 2016.
  13. ^ Sanfilippo, Salvatore (March 15, 2010). "VMware: the new Redis home". Blog. Retrieved September 25, 2016.
  14. ^ Collison, Derek (March 15, 2010). "VMware: The Console: VMware hires key developer for Redis". VMware Blog. Archived from the original on March 22, 2010. Retrieved September 25, 2016.
  15. ^ Sanfilippo, Salvatore. "Redis Sponsors". Redis.io. Redis Labs. Retrieved April 11, 2019.
  16. ^ Sanfilippo, Salvatore (July 15, 2015). "Thanks Pivotal, Hello Redis Labs". <antirez>. Retrieved 2019-04-03.
  17. ^ https://redislabs.com/blog/redis-5-0-is-here/
  18. ^ "DB-Engines Ranking - popularity ranking of key-value stores". DB-Engines.
  19. ^ "Best NoSQL Databases: Fall 2015 Report from G2 Crowd". G2 Crowd.
  20. ^ "8 Surprising Facts about Real Docker Adoption". Datadog.
  21. ^ "Top 50 Developer Tools & Services of 2015 - StackShare". StackShare.
  22. ^ "Developer Survey Results 2019: Most Loved, Dreaded, and Wanted Databases". Stack Overflow. Stack Exchange. Retrieved 2018-11-10.
  23. ^ "EVAL – Redis". redis.io.
  24. ^ a b "Redis". redis.io.
  25. ^ Lewis, B. W. (5 July 2015). "rredis: "Redis" Key/Value Database Client". The Comprehensive R Archive Network. Retrieved 2019-04-03.
  26. ^ https://redislabs.com/blog/redis-5-0-is-here/
  27. ^ https://redislabs.com/blog/redis-5-0-is-here/
  28. ^ "Redis 3.2 Release Notes". GitHub. Retrieved 2017-03-10.
  29. ^ "Redis Modules: an introduction to the API". redis.io. Retrieved 2019-07-10.
  30. ^ "RedisJSON - a JSON data type for Redis". redisjson.io.
  31. ^ "Virtual Memory". Redis.io. Retrieved April 11, 2019.
  32. ^ "Google Code Archive - Long-term storage for Google Code Project Hosting". code.google.com.
  33. ^ "Redis on the Raspberry Pi: adventures in unaligned lands - <antirez>". antirez.com.
  34. ^ "Redis 3.0 Release Notes". Retrieved 2017-03-10.
  35. ^ "Cluster Spec". Retrieved 2017-03-10.
  36. ^ "Cluster Spec". Retrieved 2017-03-10.
  37. ^ "Cluster Tutorial". Retrieved 2017-03-10.
  38. ^ "Top 5 Redis use cases - ObjectRocket". ObjectRocket. Rackspace. 7 November 2017.
  39. ^ "How Twitter Uses Redis to Scale - 105TB RAM, 39MM QPS, 10,000+ Instances - High Scalability". Highscalability.com.
  40. ^ "Azure Redis Cache - Redis cache cloud service - Microsoft Azure". azure.microsoft.com.
  41. ^ "Memorystore: Google Cloud". cloud.google.com.
  42. ^ "Moving from Apache2 modified with Commons Clause to Redis Source Available License (RSAL)". Redis Labs Blog. Retrieved 2019-07-10.
  43. ^ "Commons Clause License". Commons Clause License. Retrieved 2018-08-24.
  44. ^ Asay, Matt. "Why Redis Labs made a huge mistake when it changed its open source licensing strategy". TechRepublic. CBS Interactive. Retrieved 2018-08-24.
  45. ^ Shoolman, Yiftach (5 July 2016). "Why Redis Labs' Modules are AGPL". Redis Labs. Retrieved 2018-08-24.
  46. ^ Claburn, Thomas. "Redis has a license to kill: Open-source database maker takes some code proprietary". The Register. Retrieved 2018-08-24.

Further reading[edit]

External links[edit]