Thursday, 2015-08-13

*** tcrawley-away is now known as tcrawley00:03
*** tcrawley is now known as tcrawley-away00:04
projectodd-ciProject immutant2-incremental-integs-eap build #73: FAILURE in 1 hr 29 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/73/00:14
projectodd-ciToby Crawley: Run stream send tests 100 times each.00:14
*** cap10morgan_ <cap10morgan_!~cap10morg@2602:43:6c7:d900:f0c8:12b9:ec58:904> has quit IRC (Quit: (null))00:28
*** jcrossley3 is now known as jcrossley3-away00:30
*** cap10morgan_ <cap10morgan_!~cap10morg@67-6-199-217.hlrn.qwest.net> has joined #immutant01:01
*** cap10morgan_ <cap10morgan_!~cap10morg@67-6-199-217.hlrn.qwest.net> has quit IRC (Ping timeout: 256 seconds)01:09
*** cap10morgan_ <cap10morgan_!~cap10morg@2602:43:6c7:d900:6500:2ffa:7caf:b16b> has joined #immutant01:32
projectodd-ciProject immutant2-incremental-integs-eap build #74: ABORTED in 1 hr 30 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/74/01:44
*** cap10morgan_ <cap10morgan_!~cap10morg@2602:43:6c7:d900:6500:2ffa:7caf:b16b> has quit IRC (Ping timeout: 244 seconds)01:56
*** jwm <jwm!~jwm@69.65.15.96> has quit IRC (Ping timeout: 245 seconds)02:29
projectodd-ciProject immutant2-incremental-integs-eap build #75: STILL FAILING in 1 hr 19 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/75/03:03
*** jcrossle_ <jcrossle_!~user@71-90-202-1.dhcp.stls.mo.charter.com> has joined #immutant03:25
*** jcrossley3-away <jcrossley3-away!~user@71-90-202-1.dhcp.stls.mo.charter.com> has quit IRC (Ping timeout: 244 seconds)03:30
*** pandeiro` <pandeiro`!~user@177.33.155.221> has joined #immutant04:04
*** pandeiro <pandeiro!~user@177.33.155.221> has quit IRC (Ping timeout: 244 seconds)04:05
projectodd-ciProject immutant2-incremental-integs-eap build #76: STILL FAILING in 1 hr 13 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/76/04:17
*** gphillips <gphillips!~gphillips@169.130.108.37> has joined #immutant04:51
*** gphillips <gphillips!~gphillips@169.130.108.37> has quit IRC (Ping timeout: 250 seconds)04:55
*** jcrossle_ is now known as jcrossley3-away05:26
projectodd-ciProject immutant2-incremental-integs-eap build #77: STILL FAILING in 1 hr 26 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/77/05:43
*** je <je!~je@109.202.140.162> has joined #immutant06:06
*** dm3 <dm3!~dm3@78.60.230.119> has joined #immutant06:15
projectodd-ciProject immutant2-incremental-integs-eap build #78: STILL FAILING in 1 hr 19 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/78/07:02
*** mgoldmann|away is now known as mgoldmann07:17
*** projectodd-ci <projectodd-ci!~PircBotx@ec2-54-221-39-150.compute-1.amazonaws.com> has quit IRC (*.net *.split)07:41
*** justinmcp <justinmcp!~quassel@198.199.115.124> has quit IRC (*.net *.split)07:41
*** projectodd-ci <projectodd-ci!~PircBotx@ec2-54-221-39-150.compute-1.amazonaws.com> has joined #immutant07:43
*** justinmcp <justinmcp!~quassel@198.199.115.124> has joined #immutant07:43
*** projectodd-ci <projectodd-ci!~PircBotx@ec2-54-221-39-150.compute-1.amazonaws.com> has quit IRC (Ping timeout: 256 seconds)07:46
*** justinmcp <justinmcp!~quassel@198.199.115.124> has quit IRC (Ping timeout: 256 seconds)07:46
*** justinmcp <justinmcp!~quassel@198.199.115.124> has joined #immutant07:47
*** dm3 <dm3!~dm3@78.60.230.119> has quit IRC (Remote host closed the connection)07:48
*** dm3 <dm3!~dm3@78.60.230.119> has joined #immutant07:49
*** dm3 <dm3!~dm3@78.60.230.119> has quit IRC (Ping timeout: 246 seconds)07:53
*** dm3 <dm3!~dm3@78-60-152-177.static.zebra.lt> has joined #immutant08:30
*** marianoguerra <marianoguerra!~marianogu@emesene/grandpa/marianoguerra> has joined #immutant08:43
*** jbossbot <jbossbot!~JBossBot@redhat/jbossbot> has quit IRC (Ping timeout: 264 seconds)10:02
*** deadghost <deadghost!~deadghost@124.214.50.60.cbj04-home.tm.net.my> has joined #immutant10:02
*** jbossbot <jbossbot!~JBossBot@redhat/jbossbot> has joined #immutant10:12
*** cemerick <cemerick!~cemerick@c-24-34-140-98.hsd1.ma.comcast.net> has joined #immutant10:29
*** gphillips <gphillips!~gphillips@169.130.108.37> has joined #immutant10:39
*** pandeiro` <pandeiro`!~user@177.33.155.221> has quit IRC (Remote host closed the connection)10:40
*** cemerick <cemerick!~cemerick@c-24-34-140-98.hsd1.ma.comcast.net> has quit IRC (Ping timeout: 252 seconds)10:43
*** gphillips <gphillips!~gphillips@169.130.108.37> has quit IRC (Ping timeout: 255 seconds)10:44
*** qwerty_nor <qwerty_nor!~Thunderbi@37.229.49.175> has joined #immutant11:23
*** bobmcw <bobmcw!~bobmcw@redhat/jboss/bobmcw> has joined #immutant12:13
*** tcrawley-away is now known as tcrawley12:18
*** bbrowning_away is now known as bbrowning12:22
*** agarman <agarman!~agarman@169.130.108.20> has quit IRC (Read error: Connection reset by peer)12:59
*** agarman_ <agarman_!~agarman@169.130.108.20> has joined #immutant12:59
*** jcrossley3-away is now known as jcrossley313:05
jcrossley3tcrawley: did you fix your dns yet?13:06
tcrawleyI haven't looked at it13:07
*** gphillips <gphillips!~gphillips@169.130.108.37> has joined #immutant13:15
tcrawleyjcrossley3: where did you see that ActionStatusService calls getHostAddress? I don't see it in the src13:20
jcrossley3https://github.com/jbosstm/narayana/blob//ArjunaCore/arjuna/classes/com/arjuna/ats/arjuna/recovery/TransactionStatusManager.java#L13613:21
jcrossley3sorry, https://github.com/jbosstm/narayana/blob/master/ArjunaCore/arjuna/classes/com/arjuna/ats/arjuna/recovery/TransactionStatusManager.java#L13613:22
*** mgoldmann is now known as mgoldmann|away13:23
tcrawleyah13:28
*** lance|afk is now known as lanceball13:34
*** gphillips <gphillips!~gphillips@169.130.108.37> has quit IRC (Remote host closed the connection)13:45
*** je <je!~je@109.202.140.162> has quit IRC (Ping timeout: 272 seconds)13:56
*** gphillips <gphillips!~gphillips@169.130.108.37> has joined #immutant14:02
*** gphillips <gphillips!~gphillips@169.130.108.37> has quit IRC (Remote host closed the connection)14:05
tcrawleyjcrossley3: java.net.InetAddress/getLocalHost is where it spends all its time: https://gist.github.com/f50b69cd09fc0a7a9bf514:07
tcrawleynow to figure out why :)14:08
tcrawleyit's probably something wrong with my /etc/hosts14:08
tcrawleyI'll be dipped in poo. I *was* able to fix it via /etc/hosts14:11
tcrawleyyou owe that former coworker a beer14:11
*** cemerick <cemerick!~cemerick@c-24-34-140-98.hsd1.ma.comcast.net> has joined #immutant14:16
jcrossley3he reminds me a little of you, actually14:25
jcrossley3"all problems can be traced back to /etc/hosts"14:26
*** Guest9000 <Guest9000!~textual@c-71-198-23-174.hsd1.ca.comcast.net> has joined #immutant14:47
*** deadghost <deadghost!~deadghost@124.214.50.60.cbj04-home.tm.net.my> has quit IRC (Ping timeout: 252 seconds)14:51
*** Guest9000 <Guest9000!~textual@c-71-198-23-174.hsd1.ca.comcast.net> has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…)14:58
*** Guest9000 <Guest9000!~textual@c-71-198-23-174.hsd1.ca.comcast.net> has joined #immutant15:13
*** Guest9000 <Guest9000!~textual@c-71-198-23-174.hsd1.ca.comcast.net> has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…)15:32
*** lanceball is now known as lance|afk15:42
*** gphillips <gphillips!~gphillips@169.130.108.37> has joined #immutant15:57
*** dm3 <dm3!~dm3@78-60-152-177.static.zebra.lt> has quit IRC (Remote host closed the connection)15:57
*** dm3 <dm3!~dm3@78-60-152-177.static.zebra.lt> has joined #immutant15:58
*** gphillips <gphillips!~gphillips@169.130.108.37> has quit IRC (Ping timeout: 264 seconds)16:02
*** dm3 <dm3!~dm3@78-60-152-177.static.zebra.lt> has quit IRC (Ping timeout: 250 seconds)16:02
*** gphillips <gphillips!~gphillips@169.130.108.37> has joined #immutant16:17
*** deadghost <deadghost!~deadghost@175.144.181.144> has joined #immutant16:29
*** bbrowning is now known as bbrowning_away16:29
*** cemerick <cemerick!~cemerick@c-24-34-140-98.hsd1.ma.comcast.net> has quit IRC (Ping timeout: 264 seconds)16:36
*** GitHub102 <GitHub102!~GitHub102@192.30.252.41> has joined #immutant16:44
GitHub102[wunderboss] tobias pushed 1 new commit to master: http://git.io/v3Kz316:44
GitHub102wunderboss/master cb2d171 Toby Crawley: Set content-length to zero when data is null....16:44
*** GitHub102 <GitHub102!~GitHub102@192.30.252.41> has left #immutant16:44
jbossbotTitle: Set content-length to zero when data is null. · projectodd/wunderboss@cb2d171 · GitHub16:44
*** bbrowning_away is now known as bbrowning16:54
*** projectodd-ci <projectodd-ci!~PircBotx@ec2-54-221-39-150.compute-1.amazonaws.com> has joined #immutant16:57
*** marianoguerra <marianoguerra!~marianogu@emesene/grandpa/marianoguerra> has quit IRC (Ping timeout: 240 seconds)17:15
*** gphillips <gphillips!~gphillips@169.130.108.37> has quit IRC (Remote host closed the connection)18:01
jbossbotgit [immutant] push master 631dc71.. Toby Crawley If close requested, close via send on last element...18:01
jbossbotgit [immutant] push master 0a9e213.. Toby Crawley Update to wboss that always sets content-type on first send if closing18:01
jbossbotgit [immutant] push master e37a6cd.. Toby Crawley Print debug info when state is retrieved.18:01
jbossbotgit [immutant] push master URL: http://github.com/immutant/immutant/compare/454c914...e37a6cd18:01
*** jcrossley3 is now known as jcrossley3-away18:02
*** gphillips <gphillips!~gphillips@169.130.108.37> has joined #immutant18:03
*** lance|afk is now known as lanceball18:04
projectodd-ciProject immutant2-incremental-integs-eap build #87: ABORTED in 1 hr 3 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/87/18:04
*** qwerty_nor <qwerty_nor!~Thunderbi@37.229.49.175> has quit IRC (Ping timeout: 245 seconds)18:05
projectodd-ciProject immutant2-incremental build #626: SUCCESS in 5 min 2 sec: https://projectodd.ci.cloudbees.com/job/immutant2-incremental/626/18:08
*** je_ <je_!~je@x1-6-c0-3f-0e-f8-01-dc.cpe.webspeed.dk> has joined #immutant18:16
*** cemerick <cemerick!~cemerick@c-24-34-140-98.hsd1.ma.comcast.net> has joined #immutant18:17
projectodd-ciProject immutant2-incremental-integs build #112: SUCCESS in 12 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs/112/18:20
projectodd-ci* Toby Crawley: If close requested, close via send on last element18:20
projectodd-ci* Toby Crawley: Update to wboss that always sets content-type on first send if closing18:20
projectodd-ci* Toby Crawley: Print debug info when state is retrieved.18:20
*** rnowling <rnowling!~rnowling@2602:306:8bad:2e10::44> has joined #immutant18:24
projectodd-ciYippee, build fixed!18:25
projectodd-ciProject immutant2-incremental-integs-eap build #88: FIXED in 14 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/88/18:25
projectodd-ci* Toby Crawley: If close requested, close via send on last element18:25
projectodd-ci* Toby Crawley: Update to wboss that always sets content-type on first send if closing18:25
projectodd-ci* Toby Crawley: Print debug info when state is retrieved.18:25
projectodd-ciProject immutant2-incremental-integs-eap build #89: SUCCESS in 14 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/89/18:40
*** cemerick <cemerick!~cemerick@c-24-34-140-98.hsd1.ma.comcast.net> has quit IRC (Ping timeout: 265 seconds)18:44
*** gphillips <gphillips!~gphillips@169.130.108.37> has quit IRC (Remote host closed the connection)18:52
projectodd-ciProject immutant2-incremental-integs-eap build #90: SUCCESS in 13 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/90/18:53
*** dm3 <dm3!~dm3@78.60.230.119> has joined #immutant19:05
projectodd-ciProject immutant2-incremental-integs-eap build #91: SUCCESS in 15 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/91/19:09
projectodd-ciProject immutant2-incremental-integs-eap build #92: FAILURE in 12 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/92/19:22
*** danielglauser <danielglauser!~danielgla@c-76-25-33-200.hsd1.co.comcast.net> has quit IRC (Remote host closed the connection)19:23
*** jcrossley3-away is now known as jcrossley319:27
jbossbotgit [immutant] push master 230cca6.. Toby Crawley Wait longer for completion to help with slow CI.19:28
jbossbotgit [immutant] push master URL: http://github.com/immutant/immutant/commit/230cca6e319:28
jcrossley3tcrawley: so it's fixed?19:30
tcrawleyit seems to be more stable now, so yay?19:30
* tcrawley isn't quite ready to pop the champagne 19:31
jcrossley3i'd rather know why it's fixed19:31
tcrawleythat's part of why I'm not ready to celebrate19:32
jcrossley3but just so i am clear, we weren't sending the length header before, and now we are?19:32
tcrawleyright, for an empty sequence, we were sending no content-length, and no data, but flushing the output stream, then closing19:33
jcrossley3i could see the client being pissed about that19:34
projectodd-ciProject immutant2-incremental build #627: SUCCESS in 4 min 33 sec: https://projectodd.ci.cloudbees.com/job/immutant2-incremental/627/19:35
tcrawleythe thing is, the client timing out wasn't on that request though, it was a standard ring request to read the state19:35
jcrossley3actual: java.util.concurrent.TimeoutException: No response received after 6000019:36
jcrossley3 at com.ning.http.client.providers.netty.NettyAsyncHttpProvider$ReaperFuture.run (NettyAsyncHttpProvider.java:1869)19:36
jcrossley3that? ^19:36
tcrawleyyes19:36
jcrossley3it's got "client" right there!19:37
tcrawleyright, that is the client reading the state, which is a standard ring request, so async isn't involved at all19:37
tcrawleywe weren't sending the content-length for a zero-length http stream19:37
projectodd-ciProject immutant2-incremental-integs-eap build #93: STILL FAILING in 16 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/93/19:38
jcrossley3tcrawley: what would the transfer-encoding be for that 0-len http stream?19:39
*** danielglauser <danielglauser!~danielgla@2601:282:4200:c210:417:b7c7:e176:dcb1> has joined #immutant19:40
tcrawleyit should be "chunked", but that's up to jbossweb to set. maybe it doesn't set it unless you actually write data19:41
tcrawleyI guess I could have dumped the headers for the request to see19:41
jcrossley3you could still19:41
tcrawleyI guess I could undo my changes to async and see, yeah19:42
jcrossley3if it doesn't happen soon, i say revert the previous change and dump the headers19:42
tcrawleyI nave a theory: what if there are only 8 web threads by default, and iter's 0-7 tie those up, because what we were doing before wasn't properly closing the request and freeing the thread?19:44
tcrawleythen the call to read the state times out waiting for a thread to become available19:45
tcrawleythen, an internal timeout starts freeing the threads, causing EOFExceptions in the log?19:45
*** agarman_ <agarman_!~agarman@169.130.108.20> has quit IRC (Ping timeout: 265 seconds)19:49
*** gphillips <gphillips!~gphillips@169.130.108.37> has joined #immutant19:52
projectodd-ciProject immutant2-incremental-integs build #113: SUCCESS in 17 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs/113/19:55
projectodd-ciToby Crawley: Wait longer for completion to help with slow CI.19:55
projectodd-ciYippee, build fixed!19:56
projectodd-ciProject immutant2-incremental-integs-eap build #94: FIXED in 17 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/94/19:56
projectodd-ciToby Crawley: Wait longer for completion to help with slow CI.19:56
jcrossley3tcrawley: sounds reasonable19:56
jcrossley3we should be able to confirm the #threads19:57
tcrawleyI'm trying to figure that out now19:57
*** gphillips <gphillips!~gphillips@169.130.108.37> has quit IRC (Ping timeout: 265 seconds)19:57
jcrossley3https://docs.jboss.org/jbossweb/2.1.x/config/executor.html19:58
jbossbotTitle: JBoss Web Configuration Reference - The Executor (thread pool)19:58
tcrawleyit's also possible that a prior test was triggering the same issue, so it added up19:58
jcrossley3looks like the default >819:58
jcrossley3pb19:58
tcrawleyjconsole shows 131 web threads currently19:59
tcrawleybut it's possible that without the fix, we maxed the pool out at 200, and aren't hitting the max now20:00
*** gphillips <gphillips!~gphillips@169.130.108.37> has joined #immutant20:02
jcrossley3i think we're convincing ourselves to back out the fix :)20:03
tcrawleyheh20:03
tcrawleyit's possible other tests are leaking threads, we just don't know it because it's not enough to use up the max20:06
tcrawleywhy didn't we see thread leaks locally?20:06
jcrossley3good question20:07
jcrossley3the answer is usually CI's diminished resources20:07
tcrawleysure, but what about those causes the threads to be released more slowly?20:08
projectodd-ciProject immutant2-incremental-integs-eap build #95: SUCCESS in 16 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/95/20:12
jcrossley3tcrawley: slow reaper?20:16
tcrawleymaybe. we should probably write our own20:16
tcrawleyI just got a few client timeout errors locally, but in different places20:17
tcrawleyso I think we may still leak threads20:17
tcrawleymaybe20:17
jcrossley3tcrawley: only on eap?20:19
tcrawleyyeah, only on eap I think20:19
tcrawleyesp since the 100-run tests all pass on WF20:19
tcrawleyand ooc20:19
jcrossley3pb20:24
*** bobmcw <bobmcw!~bobmcw@redhat/jboss/bobmcw> has quit IRC (Remote host closed the connection)20:27
*** dm3 <dm3!~dm3@78.60.230.119> has quit IRC (Remote host closed the connection)20:27
*** dm3 <dm3!~dm3@78.60.230.119> has joined #immutant20:28
projectodd-ciProject immutant2-incremental-integs-eap build #96: SUCCESS in 16 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/96/20:28
*** dm3 <dm3!~dm3@78.60.230.119> has quit IRC (Ping timeout: 255 seconds)20:32
*** je_ <je_!~je@x1-6-c0-3f-0e-f8-01-dc.cpe.webspeed.dk> has quit IRC (Ping timeout: 245 seconds)20:41
projectodd-ciProject immutant2-incremental-integs-eap build #97: SUCCESS in 19 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/97/20:47
*** je_ <je_!~je@mail.natur-energi.dk> has joined #immutant20:53
*** rnowling <rnowling!~rnowling@2602:306:8bad:2e10::44> has quit IRC (Ping timeout: 246 seconds)21:01
*** marianoguerra <marianoguerra!~marianogu@emesene/grandpa/marianoguerra> has joined #immutant21:01
projectodd-ciProject immutant2-incremental-integs-eap build #98: SUCCESS in 14 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/98/21:02
*** bbrowning is now known as bbrowning_away21:04
*** je_ <je_!~je@mail.natur-energi.dk> has quit IRC (Quit: Leaving)21:11
projectodd-ciProject immutant2-incremental-integs-eap build #99: SUCCESS in 14 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/99/21:16
*** lanceball is now known as lance|afk21:24
*** gphillips <gphillips!~gphillips@169.130.108.37> has quit IRC (Remote host closed the connection)21:24
projectodd-ciProject immutant2-incremental-integs-eap build #100: SUCCESS in 14 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/100/21:31
projectodd-ciProject immutant2-incremental-integs-eap build #101: SUCCESS in 16 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/101/21:48
*** conan_ <conan_!~conan@mdproctor.plus.com> has joined #immutant21:50
*** deadghost <deadghost!~deadghost@175.144.181.144> has quit IRC (Ping timeout: 240 seconds)21:56
*** tcrawley is now known as tcrawley-away21:58
projectodd-ciProject immutant2-incremental-integs-eap build #102: SUCCESS in 22 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/102/22:11
*** gphillips <gphillips!~gphillips@169.130.108.37> has joined #immutant22:25
projectodd-ciProject immutant2-incremental-integs-eap build #103: FAILURE in 16 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/103/22:27
*** gphillips <gphillips!~gphillips@169.130.108.37> has quit IRC (Ping timeout: 256 seconds)22:29
projectodd-ciYippee, build fixed!22:46
projectodd-ciProject immutant2-incremental-integs-eap build #104: FIXED in 19 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/104/22:46
projectodd-ciProject immutant2-incremental-integs-eap build #105: FAILURE in 11 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/105/22:58
projectodd-ciYippee, build fixed!23:18
projectodd-ciProject immutant2-incremental-integs-eap build #106: FIXED in 17 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/106/23:18
*** jcrossley3 is now known as jcrossley3-away23:33
*** marianoguerra <marianoguerra!~marianogu@emesene/grandpa/marianoguerra> has quit IRC (Ping timeout: 265 seconds)23:34
projectodd-ciProject immutant2-incremental-integs-eap build #107: SUCCESS in 16 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/107/23:35
projectodd-ciProject immutant2-incremental-integs-eap build #108: SUCCESS in 24 min: https://projectodd.ci.cloudbees.com/job/immutant2-incremental-integs-eap/108/23:59

Generated by irclog2html.py 2.9.2 by Marius Gedminas - find it at mg.pov.lt!