Swarmlab docs

Application development in a distributed system

Development of Distributed Systems from Design to Application


You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

138 lines
4.3 KiB

3 years ago
= dummy_service
== WriteToMongo/fluent/fluent.conf
[source,javascript]
----
<match debug.*>
@type stdout
</match>
3 years ago
<source> // <1>
@type tail
3 years ago
3 years ago
path /var/log/*.log
path_key tailed_path
pos_file /tmp/fluentd--1605454018.pos
3 years ago
pos_file_compaction_interval 30s
refresh_interval 30s
skip_refresh_on_startup
3 years ago
tag stats.node
3 years ago
3 years ago
enable_stat_watcher false
enable_watch_timer true
3 years ago
read_from_head true
follow_inodes true # Without this parameter, file rotation causes log duplication
<parse>
3 years ago
@type none
3 years ago
keep_time_key true
</parse>
</source>
3 years ago
<source> // <1>
@type tail // <2>
3 years ago
3 years ago
path /var/log-in/*/* // <3>
3 years ago
path_key tailed_path
3 years ago
pos_file /tmp/fluentd--1605454014.pos // <4>
pos_file_compaction_interval 10s
3 years ago
refresh_interval 30s
skip_refresh_on_startup
3 years ago
tag log.node // <5>
3 years ago
3 years ago
enable_stat_watcher false // <6>
enable_watch_timer true // <7>
3 years ago
read_from_head true
follow_inodes true # Without this parameter, file rotation causes log duplication
<parse>
3 years ago
@type none // <8>
3 years ago
keep_time_key true
</parse>
</source>
3 years ago
<match log.*> // <9>
3 years ago
@type copy
3 years ago
copy_mode deep // <10>
<store ignore_error> // <11>
3 years ago
@type mongo
3 years ago
connection_string mongodb://mongo.poc-datacollector_datacollector-net:27017/fluentdb // <12>
3 years ago
#database fluentdb
collection test
#host mongo.poc-datacollector_datacollector-net
#port 27017
num_retries 60
3 years ago
capped // <13>
capped_size 100m // <14>
3 years ago
<inject>
# key name of timestamp
time_key time
</inject>
<buffer>
retry_wait 50s
3 years ago
flush_mode immediate // <15>
3 years ago
#flush_interval 10s
</buffer>
</store>
<store ignore_error>
@type stdout
</store>
<store ignore_error>
@type file
path /tmp/mylog
<buffer>
timekey 1d
timekey_use_utc true
timekey_wait 10s
</buffer>
</store>
</match>
----
3 years ago
<1> *<source>* directives determine the input sources. The source submits events to the Fluentd routing engine. An event consists of three entities: *tag*, *time* and *record*.
3 years ago
<2> *localhost* inside of a container will resolve to the network stack of this container
3 years ago
image::ROOT:fluent-mongo.png["<2>",float=right]
3 years ago
<3> *localhost* inside of a container will resolve to the network stack of this container
<4> *localhost* inside of a container will resolve to the network stack of this container
<5> *localhost* inside of a container will resolve to the network stack of this container
<6> *localhost* inside of a container will resolve to the network stack of this container
<7> *localhost* inside of a container will resolve to the network stack of this container
<8> *localhost* inside of a container will resolve to the network stack of this container
3 years ago
<9> *<match>* directives determine the output destinations. The match directive looks for events with matching tags and processes them. The most common use of the match directive is to *output events to other systems*.
3 years ago
<10> *localhost* inside of a container will resolve to the network stack of this container
<11> *localhost* inside of a container will resolve to the network stack of this container
<12> *localhost* inside of a container will resolve to the network stack of this container
<13> *localhost* inside of a container will resolve to the network stack of this container
<14> *localhost* inside of a container will resolve to the network stack of this container
<15> *localhost* inside of a container will resolve to the network stack of this container
3 years ago