I'm afraid there's not enough information here for us to know what's going on. 
Since you didn't indicate exactly how you generated the timestamp output that 
you included, I can't say for sure that the value represents what the influx 
batch filter is actually receiving.

Also it should be noted that Heka doesn't use the Lua that's on your system; it 
has its own Lua 5.1 interpreter that is included as part of the lua_sandbox 
that Heka ships with, separate from anything that might be in use elsewhere.

-r


On 05/05/2016 07:08 AM, Jorge Pereira wrote:
Hi,

I can't figure out the reason, but sounds like a bug with influx_batch
during the process of "Timestamp"

1) I receive the timestamp with milliseconds.

|Timestamp: 2016-05-04 14:30:08.669840094 +0000 UTC |

2) but, the influx_batch ignore the milliseconds in the series timestamp.

|:Payload: webapps_response_bytes,rule_id=7eGMfyZYlK value=825.000000
1462372207000 |

This is a big problem when we receive multiple repeated requests with
same second but different milliseconds.

Below my influx config set.

|[InfluxdbOutput] type = "HttpOutput" message_matcher =
"Fields[payload_name] == 'influx_line'" encoder = "PayloadEncoder"
address = "https://influx-host:8086/write?db=mydb&precision=ms"; username
= "user" password = "caipirinha" [InfluxdbOutput.tls]
insecure_skip_verify = true [InfluxdbLineFilter] type = "SandboxFilter"
message_matcher = "Type =~ /.*influx.zen_metrics/" filename =
"lua_filters/influx_batch.lua" [InfluxdbLineFilter.config] skip_fields =
"**all_base** rule_id FilePath NumProcesses Environment TickerInterval
Severity Uuid Timestamp" tag_fields = "rule_id" timestamp_precision=
"ms" flush_count = 1 |

My setup:

|# dpkg -l | grep -E "(lua|heka)" ii heka 0.10.0 amd64 High performance
data gathering, analysis, monitoring, and reporting. ii
liblua5.2-0:amd64 5.2.3-1 amd64 Shared library for the Lua interpreter
version 5.2 ii lua5.2 5.2.3-1 amd64 Simple, extensible, embeddable
programming language #|



_______________________________________________
Heka mailing list
[email protected]
https://mail.mozilla.org/listinfo/heka


_______________________________________________
Heka mailing list
[email protected]
https://mail.mozilla.org/listinfo/heka

Reply via email to