java - Should I use a key/value database to store my API logs? -

-

i lot of logs api. analyse logs interesting information how many users api in month or type of activities do.

all of analysis depend on period. so timestamp important me.

in fact, use indexes on timestamp. problem timestamp continue.

my question database more appropriate use case?

i heard key/value databases, interesting use timestamp key?

thanks.

this two-year-old article ibm talks more sql implementation, possibly keep in mind when nosql implementation:

of course, app different, i'm not sure of granularity of time-stamping, possible have 2 items logfiled @ same timestamp.

you might better off creating other form of unique key algorithm key-value store, adding sort of serialization per timestamp. first item @ timestamp ".1", second ".2", etc. you'd have sort of timestamp.serialid format.

the other thought have is: merging api log files multiple applications/processes or machines? might able sort of elementid.appid.timestamp.serialid make unique key.

it depends on use case, can't more sure. wonder want key-value store in terms of reads/analysis after-the-fact, might highly alter nosql solution. if planning lot of log analysis, then, yes, there's reason put nosql database, if want fast analysis of data, , push of older items disk storage.

as databases, each vendor stick product; choose best tool job. best try before buy, , test things out specific setup. i'm aerospike, i'm biased towards key-value store: http://www.aerospike.com/

talked smart guy today, , suggested might want use "milliseconds since date-time 'x'" primary key. depending on logging, there might still chance of collision primary key.

therefore, suggestion take entries primary key (ex: log entries millisecond) , load them same record, in kind of "bucket." you'd need application logic parse out multiple log entries under same primary key, that's way skin cat.


Comments

Post a Comment

Popular posts from this blog

java - Oracle EBS .ClassNotFoundException: oracle.apps.fnd.formsClient.FormsLauncher.class ERROR -

-
i need in configuring java on machine because, when try loading forms, loader goes in circles , gives error: java.lang.classnotfoundexception: oracle.apps.fnd.formsclient.formslauncher.class @ sun.plugin2.applet.applet2classloader.findclass(unknown source) @ sun.plugin2.applet.plugin2classloader.loadclass0(unknown source) @ sun.plugin2.applet.plugin2classloader.loadclass(unknown source) @ sun.plugin2.applet.plugin2classloader.loadclass(unknown source) @ java.lang.classloader.loadclass(unknown source) @ sun.plugin2.applet.plugin2classloader.loadcode(unknown source) @ sun.plugin2.applet.plugin2manager.createapplet(unknown source) @ sun.plugin2.applet.plugin2manager$appletexecutionrunnable.run (unknown source) @ java.lang.thread.run(unknown source) i have tried re-installing firefox, older versions of java runtime environments, disabling proxy. what missing? application working on other machines. i spent around 100 hours finding s
Read more

c# - how to use buttonedit in devexpress gridcontrol -

-
Image
i trying create gridcontrol buttonedit in 1 of columns. when user clicks button edit, popups form select product. when selection done on popup, returns datarow selection main grid below. but when column loses focus, value wrote column disappear. here code creates gridcontrol's data , buttonedit's click event. private void frmsiparisnew_load(object sender, eventargs e) { dt = new datatable(); dt.columns.add("malzeme_kodu",typeof(string)); dt.columns.add("malzeme_aciklama", typeof(string)); dt.columns.add("adet", typeof(decimal)); dt.columns.add("birim", typeof(string)); dt.columns.add("fiyat", typeof(decimal)); dt.columns.add("kur", typeof(string)); dt.columns.add("tutar", typeof(decimal)); datarow dr = dt.newrow(); dt.rows.add(dr); gc.datasource = dt; } private void repositoryitembuttoneditmal
Read more

How do you convert a timestamp into a datetime in python with the correct timezone? -

-
you naively expect work: import pytz datetime import datetime def tz_datetime_from_timestamp(timestamp): """convert timestamp datetime """ tz = pytz.timezone('australia/perth') server_time = datetime.utcnow() delta = tz.utcoffset(server_time) value = datetime.utcfromtimestamp(timestamp).replace(tzinfo=tz) return value + delta print tz_datetime_from_timestamp(1416387060) and convert timestamp 1416387060 wed nov 19 16:51:00 2014 gmt+8:00. ...but not. prints: 2014-11-19 16:51:00+07:43 the timezone of australia/perth not gmt+7:43. it gmt+8:00. unequivocally stated on australian government website http://www.australia.gov.au/about-australia/our-country/time : awst equal coordinated universal time plus 8 hours (utc +8). so, heck pytz pulling 7.43 from? well, turns out pytz pulls data http://www.iana.org/time-zones time zone database, , database states: # western australia # # rule name type in on @
Read more