mirrors/dragonfly
1
0
Fork 0
mirror of https://github.com/dragonflydb/dragonfly synced 2024-11-21 23:19:53 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,207 Commits 48 Branches 79 Tags 74 MiB
0394387a5f
Commit Graph

2207 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Roman Gershman
0394387a5f
chore: export pipeline related metrics (#3104) 
* chore: export pipeline related metrics

Export in /metrics
1. Total pipeline queue length
2. Total pipeline commands
3. Total pipelined duration

Signed-off-by: Roman Gershman <roman@dragonflydb.io>

---------

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2024-05-30 19:10:35 +03:00
Vladislav
137bd313ef
fix(server): Sync FLUSH with tiering (#3098) 
* fix(server): Sync FLUSH with tiering

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
 2024-05-30 16:50:12 +03:00
adiholden
ba0f2932e5
bug(server): fix replication stuck in full sync (#3103) 
fix server: fix replication stuck in full sycn

Signed-off-by: adi_holden <adi@dragonflydb.io>
 2024-05-30 12:34:15 +00:00
Shahar Mike
d1e3c82eaa
feat(cluster_mgr): Allow attaching replicas (#3105) 2024-05-30 15:29:58 +03:00
Hao.Dong
2fe39e8521
fix: bit shift of kTagMask (#3099) 
fix: bit shift

update link
 2024-05-30 06:28:50 +03:00
Vladislav
99949ca6cc
feat(tiering): Defragmentation (#3021) 
* feat(tiering): Defragmentation
 2024-05-29 20:31:52 +03:00
Vladislav
7910c7cb67
feat(streams): Stream optimizations (#3091) 
Allows single shard xread to do all its work with a single hop
 2024-05-29 15:55:26 +03:00
Kostas Kyrimis
b89997c5ba
chore: improve Migration() (#3033) 2024-05-28 18:14:48 +03:00
Borys
b02a789ebf
fix: add timeout for DFLYMIGRATE ACK to prevent deadlock (#3093) 
* fix: add timeout for DFLYMIGRATE ACK to prevent deadlock
 2024-05-28 17:41:51 +03:00
Borys
9360ee2768
fix: prevent crashing if error happened during snapshot moving (#3092) 2024-05-28 12:17:47 +03:00
Vladislav
68d1a8680c
fix(tiering): Async delete for small bins (#3068) 
* fix(tiering): Async delete for small bins

---------

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
 2024-05-28 12:08:59 +03:00
adiholden
b2213b05d1
fix(replication): fullsync phase write to sync on noop (#3084) 
* fix replication: fullsync phase write to sync on noop

Signed-off-by: adi_holden <adi@dragonflydb.io>
 2024-05-27 17:52:07 +03:00
adiholden
c45f7bfea5
feat(server): remove multi shard sync from replication (#3085) 
feat server: remove multi shard sync from replication

Signed-off-by: adi_holden <adi@dragonflydb.io>
 2024-05-27 14:44:37 +03:00
Vladislav
3474eebbb7
chore(streams): Some refactoring (#3088) 
* chore: small refactor

* chore: refactor replies

* chore: introduce HasEntries()
 2024-05-27 13:36:48 +03:00
Shahar Mike
07b5e00424
feat(server): Expose serialization bytes via INFO and /metrics (#3087) 
* feat(server): Expose serialization bytes via `INFO` and `/metrics`

* Also expose pipeline_cmd_cache_bytes via `/metrics` (it's already in `INFO`)
 2024-05-27 07:15:51 +00:00
Kostas Kyrimis
2391f49e1c
fix(acl): return -NOPERM instead of response error (#3049) 2024-05-27 09:25:54 +03:00
Borys
0dea257f41
fix: fix cluster incorrect keys status (#3083) 
* fix: fix cluster incorrect keys status
 2024-05-26 15:10:01 +03:00
Roman Gershman
5534ee5c23
chore: minor fixes (#3082) 
1. script errors are now logged continously but at most 5 per second.
2. "memory arena" is introduced - it prints the arena stats per thread.
   "memory malloc-stats" now only prints the global stats.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2024-05-26 10:14:02 +03:00
Roman Gershman
20c98c29c1
fix: increase lua stack limit to 8KB (#3080) 
Before that 'lua_checkstack(lua(), 7000)' would not pass because we limited lua stack to 4KB.
7000 is the max limit used by bullmq, so we raising it to support this case.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2024-05-25 23:11:27 +03:00
Vladislav
fd5ece09fb
chore: small replayer fixes (#3081) 2024-05-25 22:48:29 +03:00
Vladislav
42500c3d1e
fix(tiering): wait for IO before test teardown (#3079) 
* chore: wait for IO before test teardown

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>

---------

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
 2024-05-25 20:05:47 +03:00
Vladislav
82d8b02348
chore: bpop prints (#3076) 
Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
 2024-05-25 11:11:18 +03:00
Roman Gershman
8a0007d761
chore: add replication memory stats to the dashboard (#3065) 2024-05-22 08:11:54 +03:00
Jirapong Pansak
3babe99cf6
<chore>!: Update grafana panel (#3064) 
update panel
 2024-05-19 15:56:44 +00:00
Roman Gershman
fd74fd5b4b
chore: Export replication memory stats (#3062) 2024-05-18 22:40:14 +03:00
Roman Gershman
9d623d0f4b
chore: remove unneeded check-fails (#3054) 2024-05-16 18:45:26 +03:00
romange
d73ffc27b9 chore(helm-chart): update to v1.18.1 2024-05-16 13:22:25 +00:00
Roman Gershman
494ccdf2c6
chore: update deprecated actions (#3052) 2024-05-16 13:02:10 +03:00
Roman Gershman
73e44a941e
chore: reset enable_direct_fd to avoid socket leakage in kernel (#3051) 
The leakage can be identified by checking /proc/net/sockstat
Fixes #3045

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2024-05-16 09:44:53 +03:00
Roman Gershman
6b8a8b6410
fix: header for oom_errors_total (#3043) 2024-05-13 14:00:47 +03:00
Roman Gershman
5bf7e3b146
chore: update helio together with new mimalloc version (#3040) 
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2024-05-13 12:48:05 +03:00
Roman Gershman
8721ca7fca
chore: add half-range indices (#3041) 
Add indices in form of [:end] or [start:]
Also, enable jsonpathv2 by default

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2024-05-13 10:30:58 +03:00
Roman Gershman
3e0a9e16cc
chore: prevent updating gcc on macos (#3037) 
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2024-05-13 10:30:42 +03:00
Stepan Bagritsevich
d3a585113f
fix(set): fix random in SRANDMEMBER and SPOP commands (#3022) 
Signed-off-by: Stepan Bagritsevich <sbagritsevich@quantumbrains.com>
 2024-05-13 10:08:01 +03:00
Borys
4cd142d42c
fix: reduce delay when stop replica #3020 (#3028) 
* fix: reduce delay when stop replica #3020
 2024-05-12 17:30:06 +03:00
Roman Gershman
a9956e9723
feat: support subrange expressions in jsonpathv2 (#3036) 
Support for expressions like `$.arr[1:-2]`.

The change applies to our own implementation of jsonpath,
jsoncons already supports this format.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2024-05-11 22:30:55 +03:00
Vladislav
b7fdc41d2e
chore: fix macos tiering (#3032) 2024-05-09 14:46:14 +00:00
romange
ab2ce0fef8 chore(helm-chart): update to v1.18.0 2024-05-09 08:44:05 +00:00
Roman Gershman
b3c08a3eb1
chore: update versions and remove caching code (#3030) 2024-05-09 11:39:41 +03:00
Borys
3dd6c4959c
feat: add defragment command (#3003) 
* feat: add defragment command and improve auto defragmentation algorithm
 2024-05-08 14:26:42 +03:00
Vladislav
d675e63ab0
chore(dash): Replace comparator with predicate (#3025) 
Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
 2024-05-08 13:03:15 +03:00
Roman Gershman
25e6930ac3
Revert "chore: get rid of kv_args and replace it with slices to full_… (#3024) 
Revert "chore: get rid of kv_args and replace it with slices to full_args (#2942)"

This reverts commit de0e5cb0bd.
 2024-05-08 03:01:37 +03:00
Vladislav
5c4279c285
feat(tiering): MGET support (#3013) 
* feat(tiering): MGET support

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
 2024-05-07 23:13:36 +03:00
Vladislav
f27506e678
feat(tiering): simple offload loop (#2987) 
Simple offloading for tiering

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
 2024-05-06 22:28:45 +03:00
Vladislav
8697b20a9e
chore: Remove tiering test skip (#3011) 
chore: reduce test limits

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
 2024-05-06 21:19:54 +03:00
adiholden
186ff31e29
Fix benchmark (#3017) 
* fix(benchmark): fix lag check

Signed-off-by: adi_holden <adi@dragonflydb.io>

---------

Signed-off-by: adi_holden <adi@dragonflydb.io>
 2024-05-06 18:38:13 +03:00
Stepan Bagritsevich
7d522fd00b
fix(zset): fix random in ZRANDMEMBER command (#2994) 
fixes dragonflydb#2850

Signed-off-by: Stepan Bagritsevich <sbagritsevich@quantumbrains.com>
 2024-05-06 18:22:25 +03:00
adiholden
a4f67fbfad
fix(server): shrink replication steaming buf (#3012) 
* fix server: shrink replication steaming buf


Signed-off-by: adi_holden <adi@dragonflydb.io>
 2024-05-06 15:06:23 +00:00
adiholden
dd80d06be5
fix(server): non auto journal write after callback finish (#3016) 
fix server: non auto journal write after callback finish

Signed-off-by: adi_holden <adi@dragonflydb.io>
 2024-05-06 17:18:51 +03:00
Roman Gershman
de0e5cb0bd
chore: get rid of kv_args and replace it with slices to full_args (#2942) 
The main change is in tx_base.* where we introduce ShardArgs slice that
is only forward iterable. It allows us to go over sub-ranges of the full arguments
slice or read an index of any of its elements.

Since ShardArgs provide now indices into the original argument list we do not need to build the reverse index in transactions.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2024-05-06 15:53:30 +03:00