Tuesday, 2015-10-27

*** jcrossley3 is now known as jcrossley3-away00:32
*** lance|afk is now known as lanceball00:35
*** cemerick <cemerick!~cemerick@c-24-34-140-98.hsd1.ma.comcast.net> has joined #immutant00:37
*** terjesb <terjesb!~terjesb@ec2-54-247-167-129.eu-west-1.compute.amazonaws.com> has quit IRC (Ping timeout: 246 seconds)01:00
*** tcrawley-away is now known as tcrawley01:01
*** terjesb <terjesb!~terjesb@ec2-54-247-167-129.eu-west-1.compute.amazonaws.com> has joined #immutant01:03
*** tcrawley is now known as tcrawley-away01:05
*** danielglauser <danielglauser!~danielgla@2601:282:800:27f2:bdf1:24d0:5889:583d> has quit IRC (Remote host closed the connection)01:35
*** danielglauser <danielglauser!~danielgla@2601:282:800:27f2:a8bf:8768:3665:47ec> has joined #immutant01:37
*** danielglauser <danielglauser!~danielgla@2601:282:800:27f2:a8bf:8768:3665:47ec> has quit IRC (Remote host closed the connection)01:53
*** cemerick <cemerick!~cemerick@c-24-34-140-98.hsd1.ma.comcast.net> has quit IRC (Ping timeout: 264 seconds)02:19
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has joined #immutant05:13
*** bobmcw <bobmcw!~bobmcw@redhat/jboss/bobmcw> has joined #immutant05:53
*** bobmcw <bobmcw!~bobmcw@redhat/jboss/bobmcw> has quit IRC (Ping timeout: 240 seconds)05:58
*** mgoldmann|away is now known as mgoldmann06:46
*** jcrossley3-away <jcrossley3-away!~user@redhat/jboss/jc3> has quit IRC (Remote host closed the connection)06:50
*** jcrossley3-away <jcrossley3-away!~user@71-90-202-1.dhcp.stls.mo.charter.com> has joined #immutant06:50
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has quit IRC (Remote host closed the connection)08:08
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has joined #immutant08:10
*** cemerick <cemerick!~cemerick@c-24-34-140-98.hsd1.ma.comcast.net> has joined #immutant08:37
*** qwerty_nor <qwerty_nor!~Thunderbi@37.229.49.175> has joined #immutant08:43
*** jeepers <jeepers!6567105a@gateway/web/freenode/ip.101.103.16.90> has joined #immutant08:53
*** jeepers <jeepers!6567105a@gateway/web/freenode/ip.101.103.16.90> has left #immutant08:56
*** deadghost <deadghost!~deadghost@122.167.158.153> has joined #immutant09:06
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has quit IRC (Remote host closed the connection)09:23
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has joined #immutant09:23
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has quit IRC (Ping timeout: 244 seconds)09:28
*** deadghost <deadghost!~deadghost@122.167.158.153> has quit IRC (Ping timeout: 255 seconds)09:35
*** dm3 <dm3!~dm3@pub082136076233.dh-hfc.datazug.ch> has joined #immutant10:06
*** bbrowning_away is now known as bbrowning10:11
*** bbrowning is now known as bbrowning_away10:44
*** bbrowning_away <bbrowning_away!~bbrowning@redhat/jboss/bbrowning> has quit IRC (Ping timeout: 240 seconds)10:48
*** xcv <xcv!~xcv@cable-86-56-59-207.cust.telecolumbus.net> has joined #immutant11:03
*** xcv <xcv!~xcv@cable-86-56-59-207.cust.telecolumbus.net> has quit IRC (Ping timeout: 250 seconds)11:07
*** cemerick <cemerick!~cemerick@c-24-34-140-98.hsd1.ma.comcast.net> has quit IRC (Ping timeout: 268 seconds)11:54
*** tcrawley-away is now known as tcrawley12:13
*** agarman <agarman!~agarman@169.130.108.20> has joined #immutant12:26
*** xeqi <xeqi!uid81119@gateway/web/irccloud.com/x-sakaeaqufkxacerr> has quit IRC (Quit: Connection closed for inactivity)12:31
*** conan <conan!~conan@mdproctor.plus.com> has quit IRC (Quit: Computer has gone to sleep.)12:38
*** jcrossley3-away is now known as jcrossley312:38
*** bobmcw <bobmcw!~bobmcw@va-67-233-86-120.dhcp.embarqhsd.net> has joined #immutant12:53
*** bobmcw <bobmcw!~bobmcw@va-67-233-86-120.dhcp.embarqhsd.net> has quit IRC (Changing host)12:53
*** bobmcw <bobmcw!~bobmcw@redhat/jboss/bobmcw> has joined #immutant12:53
*** jcrossley3 <jcrossley3!~user@71-90-202-1.dhcp.stls.mo.charter.com> has quit IRC (Quit: ERC Version 5.3 (IRC client for Emacs))12:59
*** jcrossley3 <jcrossley3!~user@redhat/jboss/jc3> has joined #immutant12:59
*** jcrossley3 <jcrossley3!~user@redhat/jboss/jc3> has quit IRC (Remote host closed the connection)13:02
*** jcrossle_ <jcrossle_!~user@71-90-202-1.dhcp.stls.mo.charter.com> has joined #immutant13:02
*** bbrowning <bbrowning!~bbrowning@redhat/jboss/bbrowning> has joined #immutant13:02
*** xcv <xcv!~xcv@2a02:2450:102b:5b:9cb2:53cf:3111:6432> has joined #immutant13:04
*** jcrossle_ is now known as jcrossley313:12
*** charliekilo <charliekilo!charliekil@2600:3c00::f03c:91ff:fe56:b738> has quit IRC (Quit: ZNC - http://znc.in)13:36
*** bbrowning <bbrowning!~bbrowning@redhat/jboss/bbrowning> has quit IRC (Ping timeout: 246 seconds)13:47
*** conan <conan!~conan@host86-187-114-211.range86-187.btcentralplus.com> has joined #immutant13:50
*** bbrowning <bbrowning!~bbrowning@redhat/jboss/bbrowning> has joined #immutant13:56
*** conan <conan!~conan@host86-187-114-211.range86-187.btcentralplus.com> has quit IRC (Quit: Computer has gone to sleep.)13:58
*** cemerick <cemerick!~cemerick@c-24-34-140-98.hsd1.ma.comcast.net> has joined #immutant14:02
*** conan <conan!~conan@host86-187-114-211.range86-187.btcentralplus.com> has joined #immutant14:08
*** deadghost <deadghost!~deadghost@198.8.80.149> has joined #immutant14:16
*** conan <conan!~conan@host86-187-114-211.range86-187.btcentralplus.com> has quit IRC (Quit: Computer has gone to sleep.)14:19
*** deadghost <deadghost!~deadghost@198.8.80.149> has quit IRC (Ping timeout: 240 seconds)14:43
*** xcv <xcv!~xcv@2a02:2450:102b:5b:9cb2:53cf:3111:6432> has quit IRC (Remote host closed the connection)14:44
*** xcv <xcv!~xcv@2a02:2450:102b:5b:9cb2:53cf:3111:6432> has joined #immutant14:44
*** xcv <xcv!~xcv@2a02:2450:102b:5b:9cb2:53cf:3111:6432> has quit IRC (Ping timeout: 256 seconds)14:49
*** qwerty_nor <qwerty_nor!~Thunderbi@37.229.49.175> has quit IRC (Read error: Connection reset by peer)14:57
*** qwerty_nor <qwerty_nor!~Thunderbi@37.229.49.175> has joined #immutant15:00
*** deadghost <deadghost!~deadghost@122.166.171.228> has joined #immutant15:07
*** conan <conan!~conan@31.55.35.73> has joined #immutant15:10
*** danielglauser <danielglauser!~danielgla@174.51.85.216> has joined #immutant15:20
*** dm3_ <dm3_!~dm3@pub082136076233.dh-hfc.datazug.ch> has joined #immutant15:25
*** xeqi <xeqi!uid81119@gateway/web/irccloud.com/x-qhaeazyhfxmpmwfm> has joined #immutant15:28
*** dm3 <dm3!~dm3@pub082136076233.dh-hfc.datazug.ch> has quit IRC (Ping timeout: 246 seconds)15:28
*** dm3_ <dm3_!~dm3@pub082136076233.dh-hfc.datazug.ch> has quit IRC (Ping timeout: 240 seconds)15:29
*** cemerick <cemerick!~cemerick@c-24-34-140-98.hsd1.ma.comcast.net> has quit IRC (Ping timeout: 240 seconds)16:12
jodaroyo16:19
jodarohttps://gist.github.com/joshrotenberg/7f570a5339f43003a97b16:19
jodarodoes that mean anything to you fellas?16:19
*** deadghost <deadghost!~deadghost@122.166.171.228> has quit IRC (Ping timeout: 244 seconds)16:20
tcrawleyjodaro: no, do you have any exclusions around logback in project.clj?16:21
jodarono sir16:21
jodaronot sure if that hornetq message is related or not16:22
jodarobut it was the last thing before (aside from my own debugging logs)16:22
tcrawleyit shouldn't be related, since it's coming from quartz16:22
*** bbrowning is now known as bbrowning_away16:23
tcrawleyare you logging from your job, or is this coming from quartz internals?16:23
jodarowell16:24
tcrawleycan you gist the output of `lein deps :tree`?16:24
jodarothere is logging somewhere in the stack of what happens in that job, for sure16:24
jodarousing clojure.tools.logging16:24
jodaroyeah16:24
jodarohttps://gist.github.com/joshrotenberg/7f570a5339f43003a97b#file-gistfile2-txt16:29
jodaroConsider using these exclusions:16:29
jodaro[org.immutant/immutant "2.1.0" :exclusions [org.slf4j/slf4j-api]]16:29
jodarorelated?16:29
tcrawleyI don't think so, since the missing class comes from logback16:32
tcrawleyis there more to the deps :tree output? the actual deps tree?16:32
jodarohmmm, thats all the output actually16:34
tcrawleythat's weird16:36
jodarooh wait16:37
jodarosorry16:37
jodarolet me update16:37
*** conan <conan!~conan@31.55.35.73> has quit IRC (Quit: Computer has gone to sleep.)16:37
jodarook reloadify16:38
jcrossley3tcrawley: did you see that someone other than us answered an SO question?16:39
jcrossley3not really related to immutant, though16:39
tcrawleyjodaro: reload https://gist.githubusercontent.com/joshrotenberg/7f570a5339f43003a97b/raw/3c9785a7257a14926fb72e65bf069fdbdacdd702/gistfile2.txt ? I still don't see the tree16:39
tcrawleyjcrossley3: yeah, I saw that :)16:39
*** conan_ <conan_!~conan@31.55.35.73> has joined #immutant16:42
jodarohttps://gist.github.com/joshrotenberg/7f570a5339f43003a97b#file-deps16:45
jodarothats the exact output as saved from an emacs shell buffer16:46
tcrawleyhmm, and logback-classic 1.1.3 definitely has that class16:48
*** bbrowning_away is now known as bbrowning16:49
jodarothis is running as a standalone uberjar16:49
jodaronot sure if that makes any difference16:50
tcrawleyany changes you've made recently?16:50
tcrawleyare you doing anything weird with classloaders?16:51
jodarono, nothing weird16:51
jodaroits a newish app so its all changes16:52
jodarodoesn't seem to happen under little stress in dev16:52
jodarobut has happened thrice this morning under production load16:52
tcrawleyah, interesting16:53
jodaroseems to happen after ~10 minutes but hard to say for sure because the load is bursty16:53
jodaroprocesses a bunch of stuff in the first 1-2 minutes of each ten minute period16:53
jodarothen chills out16:53
jodarountil the next ten minute period16:53
*** xcv <xcv!~xcv@37.120.14.172> has joined #immutant16:54
tcrawleyit looks like quartz is trying to report an uncaught exception, which triggers logback to try and load ThrowableProxy16:56
tcrawleyso you may not be throwing an exception when not under load16:56
tcrawleybut it's weird, because ch.qos.logback.classic.spi.LoggingEvent is in the same jar as ThrowableProxy16:57
jcrossley3fuck logging16:58
tcrawleyjodaro: can you try something for me? can you wrap the function you are passing to schedule with (bound-fn your-fn)?16:58
tcrawleyjodaro: actually, that will only transfer dynamic bindings, so never mind16:59
tcrawleyI was thinking about the TCCL16:59
tcrawleybut that probably doesn't matter either16:59
tcrawleylet me see if I can recreate16:59
jodarojcrossley3:  totally17:00
jodarologging is such a pain in the ass17:01
jodaroits probably the one thing that makes me come this close to becoming a pig farmer almost daily17:01
*** pandeiro <pandeiro!~user@189.33.244.242> has joined #immutant17:02
jcrossley3jodaro: that's altogether different kind of logging... http://i.kinja-img.com/gawker-media/image/upload/s--96Q5oWNM--/18ha560ii1h2yjpg.jpg17:02
tcrawleydammit!17:03
* jcrossley3 winks at tcrawley17:03
jodarohahah17:06
tcrawleyjodaro: I can't reproduce it with a simple case (just depending on [org.immutant/scheduling "2.1.0], `(s/schedule (fn [] (throw (Exception. "BOOM"))) (s/every 5 :seconds))` from main)17:06
jodarojcrossley3: impressive17:06
tcrawleyI have to run out for a bit, but if you'd be willing to create an app that reproduces it that you can share, that would be super17:06
jcrossley3jodaro: one of our older "team memes"17:06
jcrossley3a classic17:06
tcrawleyand one that needs to die17:06
jcrossley3one of tcrawley's favorites17:07
*** mgoldmann is now known as mgoldmann|away17:08
*** tcrawley is now known as tcrawley-away17:11
jodarowell, i'll see if i can reproduce it more reliably17:12
jodaroand let you know if i figure it out17:12
jodaroi could just stop logging17:13
jodaroif shit breaks, it breaks17:13
jodarowho cares, really17:13
jodarono one is going into space or getting their brain operated on17:13
jcrossley3jodaro: amen, brother :)17:16
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has joined #immutant17:30
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has quit IRC (Remote host closed the connection)17:38
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has joined #immutant17:39
*** conan_ <conan_!~conan@31.55.35.73> has quit IRC (Quit: Computer has gone to sleep.)17:40
jodarothat moment, or really, those moments (days, weeks, months) when your job gets in the way of getting real work done17:43
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has quit IRC (Ping timeout: 240 seconds)17:43
*** deadghost <deadghost!~deadghost@122.166.171.228> has joined #immutant17:52
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has joined #immutant17:54
*** agarman_ <agarman_!~agarman@169.130.108.37> has joined #immutant18:01
*** agarman <agarman!~agarman@169.130.108.20> has quit IRC (Ping timeout: 240 seconds)18:04
*** agarman_ <agarman_!~agarman@169.130.108.37> has quit IRC (Remote host closed the connection)18:44
*** agarman <agarman!~agarman@169.130.108.37> has joined #immutant18:52
*** agarman <agarman!~agarman@169.130.108.37> has quit IRC (Remote host closed the connection)18:58
*** agarman <agarman!~agarman@169.130.108.37> has joined #immutant19:03
*** agarman <agarman!~agarman@169.130.108.37> has quit IRC (Remote host closed the connection)19:05
*** agarman <agarman!~agarman@169.130.108.37> has joined #immutant19:06
*** agarman <agarman!~agarman@169.130.108.37> has quit IRC ()19:13
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has quit IRC (Remote host closed the connection)19:16
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has joined #immutant19:41
*** qwerty_nor <qwerty_nor!~Thunderbi@37.229.49.175> has quit IRC (Ping timeout: 260 seconds)19:46
*** deadghost <deadghost!~deadghost@122.166.171.228> has quit IRC (Ping timeout: 240 seconds)20:02
*** deadghost <deadghost!~deadghost@198.8.80.83> has joined #immutant20:14
*** jcrossle_ <jcrossle_!~user@71-90-202-1.dhcp.stls.mo.charter.com> has joined #immutant20:22
*** jcrossley3 <jcrossley3!~user@71-90-202-1.dhcp.stls.mo.charter.com> has quit IRC (Ping timeout: 240 seconds)20:23
*** jcrossle_ is now known as jcrossley320:27
*** conan_ <conan_!~conan@mdproctor.plus.com> has joined #immutant20:32
*** deadghost <deadghost!~deadghost@198.8.80.83> has quit IRC (Ping timeout: 244 seconds)20:54
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has quit IRC (Remote host closed the connection)21:18
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has joined #immutant21:19
*** bbrowning is now known as bbrowning_away21:21
*** dm3 <dm3!~dm3@pub082136109248.dh-hfc.datazug.ch> has quit IRC (Ping timeout: 260 seconds)21:23
*** lanceball is now known as lance|afk21:30
*** xcv <xcv!~xcv@37.120.14.172> has quit IRC (Ping timeout: 246 seconds)22:41
*** pandeiro <pandeiro!~user@189.33.244.242> has quit IRC (Remote host closed the connection)23:52

Generated by irclog2html.py 2.9.2 by Marius Gedminas - find it at mg.pov.lt!