<    April 2017    >
Su Mo Tu We Th Fr Sa  
                   1  
 2  3  4  5  6  7  8  
 9 10 11 12 13 14 15  
16 17 18 19 20 21 22  
23 24 25 26 27 28 29  
30
00:06 dh1tw joined
00:15 Cohedri__ joined
00:18 jennings joined
00:23 Cohedrin joined
00:24 soveran joined
00:28 indi_ joined
00:33 timg__ joined
00:44 Cohedrin joined
01:21 EyePulp joined
01:32 irsol joined
01:46 minimalism joined
01:51 ogres joined
02:00 Cohedrin joined
02:27 soveran joined
02:31 indi_ joined
02:37 cliluw joined
03:25 enigma_raz joined
03:26 winteriscoming joined
03:29 soveran joined
03:58 shinnya joined
04:27 svm_invictvs joined
04:36 indi_ joined
04:36 atomi joined
04:38 svm_invictvs joined
04:53 EyePulp joined
05:04 ppang joined
05:05 EyePulp joined
05:23 wlanboy_ joined
05:23 EyePulp joined
05:30 soveran joined
05:47 EyePulp joined
05:50 Cohedrin joined
05:52 svm_invictvs joined
05:59 fakenerd joined
06:13 BrianMiller left
06:16 enigma_raz joined
06:36 Guest96 joined
06:40 indi_ joined
06:48 EyePulp joined
06:53 soveran joined
06:57 Guest96 joined
06:58 indi_ joined
07:03 Guest96 joined
07:06 rendar joined
07:15 EyePulp joined
07:18 mortenie joined
07:25 tarkus joined
07:27 EyePulp joined
07:55 ahtik__ joined
08:16 timg__ joined
08:19 ppang_ joined
08:19 ntnn joined
08:20 ppang__ joined
08:23 ppang joined
08:42 adac joined
08:42 Guest96 joined
09:01 indi_ joined
09:05 shinnya joined
09:14 Malediction joined
09:22 EyePulp joined
09:33 EyePulp joined
09:50 codeone joined
10:02 Mr__Anderson joined
10:21 eddd joined
10:35 EyePulp joined
10:35 EyePulp joined
11:06 indi_ joined
11:23 eddd joined
11:43 soveran joined
12:10 chipotle joined
12:15 timg__ joined
12:53 chipotle joined
13:05 Guest96 joined
13:11 indi_ joined
13:13 brodolfo joined
13:24 sz0 joined
13:25 enigma_raz joined
13:34 brodolfo joined
13:40 basiclaser joined
13:43 Guest96 joined
13:45 soveran joined
13:45 soveran joined
13:45 Guest96 joined
13:54 tavish joined
14:04 EyePulp joined
14:26 Guest96 joined
14:27 Guest96 joined
14:30 Guest96 joined
14:34 Guest96 joined
14:48 timg__ joined
14:53 adac joined
14:56 forgotmynick joined
15:13 rburton joined
15:13 <rburton> re
15:13 <rburton> Is it allowed to put an expire on a single element within RPOPLPUSH
15:15 <rburton> Answer is no - okay now how to resolve this
15:15 indi_ joined
15:24 rburton joined
15:29 eddd joined
15:40 edrocks joined
15:47 soveran joined
16:21 timg__ joined
16:22 cyborg-one joined
16:45 edrocks joined
16:48 edrocks_ joined
16:55 edrocks joined
17:01 enigma_raz joined
17:04 edrocks_ joined
17:06 chipotle joined
17:07 edrocks joined
17:14 eddd joined
17:15 chipotle joined
17:19 indi_ joined
17:21 edrocks_ joined
17:22 edrocks__ joined
17:23 chipotle joined
17:26 timg__ joined
17:35 edrocks joined
17:36 efphe joined
17:37 edrocks_ joined
17:44 wCPO joined
17:51 soveran joined
17:52 EyePulp joined
17:52 EyePulp joined
17:55 bannakaffalatta joined
18:07 eddd joined
18:19 Guest96_ joined
18:22 indi_ joined
18:27 MrXXIV joined
18:27 timg__ joined
18:29 ogres joined
18:32 CVTJNII__ joined
18:33 hkdsun joined
18:44 hkdsun joined
18:44 winem_ joined
18:48 timg__ joined
18:52 soveran joined
18:52 soveran joined
18:53 <wCPO> I currently have around ~ 200 Linux boxes which "ping" my backend roughly every 5 minute, I want to store the last 100 pings and expire pings after 14 days, looking through the datatypes, list seems like the ideal solution but then I would need a list per box, is that a bad idea?
18:53 adac joined
18:53 cyborg-one joined
18:56 <minus> using a list per box and trimming it to 100? sounds like a plan
18:57 <minus> 200 lists with each 100 entries is nothing, if you're asking that
18:58 <hkdsun> That shouldn't even be a blip :) I've seen thousands of push/pops per second on tens of lists
18:59 <wCPO> minus, and then just some sort of "cronjob" which remove old "pings", I can only use the EXPIRE functionally for the whole list as I understand.
19:00 <minus> wCPO: correct
19:00 <minus> you could also just have the pinging clients do that
19:01 edrocks joined
19:02 <wCPO> I'm mostly asking because I got a bit "scared" by this: http://www.mikeperham.com/2015/09/24/storing-data-with-redis/ , but prefixing every list with ex: box- so the list name would be box-<mac address>, should work I think.
19:02 <minus> https://redis.io/commands/ltrim there's even an example about that there
19:03 <wCPO> minus, the box could vanish without warning, so I still need something to cleanup "vanished" boxes, so some sort of cronjob seems easiest.
19:04 <minus> you could set an expire on the whole list for that
19:06 <wCPO> minus, but looping through the list every 5 minute when the client "ping" seems a bit overkill, running a cronjob once six 6 seems more optimal performance wise.
19:06 <hkdsun> Could he use a sorted set with timestamps as scores? and then trim based on the age (timestamp) of members (pings)?
19:06 <minus> regarding that article: that's about storing different kinds of data mainly, e.g. sessions and persistent data. if you don't store multiple types in your instance it doesn't affect you anyway
19:07 <wCPO> hkdsun, I looked a bit on that, but I don't understand how I could get the last 100 pings for X box?
19:07 <wCPO> minus, I see now :)
19:07 <minus> wCPO: LTRIM would just trim the list to 100 entries, nothing with age. for age-based trimming hkdsun's suggestions works best
19:08 Cohedrin joined
19:09 <wCPO> The current solution is based on PHP and MySQL and it works, but there currently isn't anything cleaning up the table. So this is mostly rewriting for fun (and I have a few other "parts" where I also want to use redis), I don't really need the performance, but hopeful I will at some point.
19:11 <wCPO> minus, but how can I get ex the last 100 pings from X box, with hkdsun approch? I don't really get that part..
19:11 <minus> trimming a sorted set to 100 elements would work with ZREMRANGEBYRANK and trimming it to 14 days by ZREMRANGEBYSCORE
19:11 <hkdsun> ZRANGE box-X-pings -100 -1 should give you the 100 most recent pings if your scores are timestamps
19:12 <hkdsun> double-check my command though :)
19:12 <wCPO> hkdsun, oh yeh, a sorted set per box. I had one big sorted set in my head :)
19:12 <hkdsun> and minus' suggestion for trimming
19:15 <wCPO> A list with ltrim and expire on "ping" seems like the most simple solution. I could end up with a list with 99 > days old ping, but I don't care too much about that.
19:15 <wCPO> 99 > 14 old pings*
19:17 <wCPO> Thanks for the inputs both of you :)
19:17 <hkdsun> good luck!
19:23 hkdsun joined
19:26 tarkus joined
19:37 rendar joined
19:37 rendar joined
19:47 Guest96 joined
19:54 Guest96 joined
19:54 atomi joined
19:59 svm_invictvs joined
20:12 Cohedrin joined
20:24 winem_ joined
20:25 indi_ joined
20:28 brk_ joined
20:29 winem_ joined
20:31 wrkrcoop joined
20:31 <wrkrcoop> hello. im trying to connect to my redis cluster (elastic cache service) on aws but im getting this error: Error: Redis connection to d2-.usw1.cache.amazonaws.com:6379 failed - connect ETIMEDOUT 1xx.xx.xx.xxx:6379
20:32 <wrkrcoop> i figure ppl in here have used redis with AWS, anyone know what this could mean?
20:32 hkdsun joined
20:35 hndk joined
20:44 Guest96 joined
20:45 saurabhjha joined
20:53 soveran joined
21:01 Guest96 joined
21:08 saurabhjha joined
21:12 winem_ joined
21:13 soveran joined
21:13 soveran joined
21:21 saurabhjha joined
21:24 brk__ joined
21:43 saurabhjha joined
21:51 brk joined
21:54 saurabhjha joined
22:01 timg__ joined
22:28 indi_ joined
22:33 saurabhjha joined
22:41 soveran joined
22:41 soveran joined
22:47 EyePulp joined
23:15 enigma_raz joined
23:21 hkdsun joined
23:28 Guest96 joined
23:46 chipotle joined
23:53 hkdsun joined