-
Notifications
You must be signed in to change notification settings - Fork 78
Description
Describe the bug
there are a lot of same output in the console:
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
(KVStorageActor pid=6738) RocksDB flushed for partition
To Reproduce
atomic_config.yaml:
global_params:
working_dir: cache
graph_backend: kuzu # graph database backend, support: kuzu, networkx
kv_backend: rocksdb # key-value store backend, support: rocksdb, json_kv
nodes:
- id: read
op_name: read
type: source
dependencies: []
params:
input_path:
- examples/input_examples/red_yellow_demo.pdf
- id: chunk
op_name: chunk
type: map_batch
dependencies:
- read
execution_params:
replicas: 4
params:
chunk_size: 1024
chunk_overlap: 100
- id: build_kg
op_name: build_kg
type: map_batch
execution_params:
replicas: 1
batch_size: 8
dependencies:
- chunk
- id: partition
op_name: partition
type: aggregate
dependencies:
- build_kg
params:
method: dfs
method_params:
max_units_per_community: 1
- id: generate
op_name: generate
type: map_batch
dependencies:
- partition
execution_params:
replicas: 1
batch_size: 8
save_output: true
params:
method: atomic
data_format: Alpaca
and I config mineru with http format.