00:10:29 what do you mean? 00:13:55 im not able to output proper utf-8 files, im using hstringtemplates (that are in .st files in utf8 encoding) 00:14:12 and everything just shows up filled with ?, except for the values i fetch from DB (which are also utf-8) 00:16:10 for readFile etc you need to either use ghc 6.12 or something like Codec.Binary.UTF8.Light(.readUTF8File) 00:16:29 ghc 6.10 has some issues with utf8 IO 00:17:23 and then you should define a meta-tag for your html output 00:17:31 00:17:32 i have the meta tag 00:17:36 ok 00:17:51 and the .st files are utf-8 00:18:05 then try ghc 6.12 or use that lib 00:19:10 ok, ill go for the lib 00:19:21 thanks 00:19:51 just make sure you replace your readFile / writeFile / putStr etc with the utf8 versions 00:19:59 i dont have those 00:20:03 im using hstringtemplate 00:20:07 which probably uses those 00:20:12 oh 00:20:14 okay… 00:20:44 ill try to patch it, or find a workaround, in order to use those 00:21:04 updating to 6.12 is not that hard… 00:21:05 ;) 00:21:20 i dont have the time right now :/ 00:21:32 and i would need to do it also on the server 00:22:43 yeh ok 00:22:52 updating ghc is always a pain 00:23:04 but in case of utf8 compatibility it was worth it imo 00:28:37 ok 00:28:39 The Glorious Glasgow Haskell Compilation System, version 6.12.1 00:28:41 done 00:28:48 (in my dev machine only... yet) 00:29:15 now its time to cabal all the stuff... 00:32:54 I'd remove the whole /usr/lib/ghc-* directories 00:33:05 had some weird problems with cabalized packages until I did that 00:38:12 ok, done 00:38:49 :) 00:38:50 good luck 00:39:00 happstack installed fine 00:39:29 http://npaste.de/snowman/ my happstack-app with utf8 00:39:29 ;D 00:40:24 allright :) 00:55:13 HugoDaniel: happstack itself should work fine with utf-8 00:55:38 HugoDaniel: internally and String that happstack gives you will already be utf-8 decoded and contain proper unicode characters 00:56:13 if HStringTemplate is giving you issues, make sure that the ToMessage instance for HStringTemplate is properly encoding the String as utf-8 when it converts it to a ByteString 00:57:10 and also make the ToMessaeg instance is setting the charset 00:57:28 and make sure your html includes the line McManiaC mentioned 00:58:05 I don't use HStringTemplate, so I have never checked that it does the right thing 00:58:24 but I know HSP does, so you can look in happstack/happstack/src/Happstack/Server/HTML/HSP.hs I think 01:01:25 stepcut: I'm having trouble installing urlt because of conflicting quickcheck dependencies. 01:03:04 mightybyte: oh ? you should be able to have multiple versions of quickcheck installed, right? 01:03:27 stepcut: im using HtmlString on the stringtemplate output 01:03:34 mightybyte: what is causing the conflict... everything installs for us 01:03:52 and i think the HtmlString code is doing a pack on it 01:04:03 stepcut: The conflict was on cabal install urlt. 01:04:25 mightybyte: urlt itself only depends on quickcheck 2, yes? 01:04:25 Says happstack-util requires quickcheck < 2 01:04:32 Yes 01:04:58 hmm. well I think happstack-util in head uses quickcheck 2 now 01:05:05 not sure why you can't have both installed though 01:05:11 did it give you an error or just a warning? 01:05:20 did you update ghc recently? 01:05:32 Not sure 01:05:47 McManiaC: Yes. Just today I updated my arch packages and got 6.12 01:05:50 I had to remove /usr/lib/ghc-* and ~/.ghc ~/.cabal to get everything working again 01:06:15 stepcut: I also got this 01:06:15 after that everything installed just fine 01:06:21 Warning: URLT.cabal: Unknown fields: build-type (line 17) 01:06:31 I had version errors too 01:06:41 HugoDaniel: in happstack/happstack/src/Happstack/Server/HStringTemplate.hs, it looks like ToMessage just does L.pack.. that won't work 01:06:55 and after fixing them by manually saying which version to use I had "module ... not found" errors 01:07:23 HugoDaniel: it needs to use Data.ByteString.Lazy.UTF8.fromString. look at, happstack/happstack/src/Happstack/Server/HSP/HTML.hs 01:08:02 ah 01:08:07 that explains... 01:08:09 but... 01:08:24 ...it works with the data from the DB 01:08:28 which is utf-8 01:09:02 now i just trashed my dev machine with ghc 6.12.1 01:09:04 :/ 01:09:18 trashed? 01:09:36 cabal doesn't work its giving me strange error messages 01:09:41 ghc-pkg check just outputs trash 01:09:51 ...so im guessing i should just rm -rf /* 01:10:02 update cabal-install and rm those directories 01:10:29 (then reinstall ghc, of course) 01:10:54 I dont know why GHC is such a pain to update… 01:11:55 mightybyte: that build-type warning is harmless, but fixed in darcs now 01:12:08 mightybyte: what did you think of the formlets changes? 01:12:37 argh, reinstalling cabal and ghc didnt work 01:12:39 bah 01:12:56 stepcut: I'm still trying to get my app to build. 01:13:03 what OS are you working on? 01:13:03 mightybyte: oh :) 01:13:05 Been busy with some other things 01:13:17 arch linux 01:13:29 arch linux should have everything you need 01:13:32 run as root: 01:13:38 mightybyte: yeah, no rush. 01:13:53 mightybyte: it's not like I didn't spend a month getting them merged :p 01:14:11 pacman -Rd ghc cabal-install && rm -r /usr/lib/ghc* ~/.cabal ~/.ghc && pacman -Sy ghc cabal-install 01:14:14 ^^ 01:14:40 stepcut: I'm been procrastinating getting gitit working in my app. 01:15:02 Any plans to get more of your package infrastructure in hackage? 01:15:25 McManiaC: The rm -r /usr/lib/ghc* part scares me 01:15:51 mightybyte: heh. Do you care about the GPL issues involved with using gitit in your app? 01:16:28 mightybyte: you mean like updated versions of URLT and stuff ? 01:16:35 mightybyte: Yes to the second. 01:16:47 Oops, s/mightybyte/stepcut/ 01:17:23 mightybyte: I would like to. But I am kind of waiting on formlets because I think happstack-extra depends on formlets, and most other things depend on happstack-extra 01:17:34 stepcut: Hadn't noticed that gitit was GPLd 01:17:55 mightybyte: gitit and pandoc are .. bunch of jerks ;) 01:18:24 mightybyte: I know but I found it to be the only way to get ghc 6.12 working again 01:18:35 I spent a whole day on this 01:18:35 ^^ 01:18:44 McManiaC: Ok, I'll keep that in mind. 01:18:56 done it on my local machine and server and everything works fine again 01:19:01 McManiaC: yeah, that is why we build *everything* as debian packages at work :) 01:19:31 McManiaC: makes upgrades a lot easier (though still requires hacking around sometimes) 01:19:31 you could remove all the haskell-* packages with pacman first 01:19:57 stepcut: I only had problems with debians haskell packages 01:20:29 thank god I can finally run arch linux on my servers 01:20:31 :D 01:22:44 McManiaC: I'm going to try without deleting the lib stuff. 01:22:51 McManiaC: But thanks for the tip. 01:23:03 good luck 01:23:06 it didnt work for me 01:23:07 :) 01:23:19 What failed? 01:23:27 So far I've been able to build happstack 01:23:34 and I havent heard of anyone not having any problems 01:24:22 mightybyte: at first I had problems installing happstack because it wanted some old version of package xy 01:24:37 after fixing that by hand ghc couldnt find System.Log.Logger 01:24:57 and a couple of other packages just couldnt get found 01:25:06 although they were definitly installed with cabal 01:25:28 after removing the lib directories everything works out of the box 01:25:29 :) 01:27:02 Who installs those /usr/lib directories? Is that cabal or arch haskell packages? 01:27:15 arch haskell packages 01:27:23 as long as you run cabal as user 01:28:39 mightybyte: you could also just rename the /usr/lib/ghc- directory, test if everything works and than remove/restore it ;) 15:54:41 stepcut: Still having problems compiling urlt 16:04:57 mightybyte: hmm 16:07:25 apparently I did not push the patch that updates happstack to quickcheck 2 16:08:06 it is pushed now 16:20:45 Hmmm, just pulled and re-built, but I'm still getting the same problem. 16:21:21 :-/ 16:21:45 the new happstack-util explicitly says: 16:21:47 QuickCheck >= 2 && < 3, 16:21:59 has the error message changed at all? 16:22:11 Yep, I see that. 16:22:27 Doesn't look like it. 16:22:41 how did you install the updated happstack ? 16:22:46 cabal: cannot configure happstack-util-0.4.1. It requires QuickCheck <2 16:22:46 For the dependency on QuickCheck <2 there are these packages: QuickCheck-1.0, 16:22:58 ./bin/build-install-all.sh ? or some other method? 16:23:03 bin/build-install-all.sh 16:23:34 and then how did you try to install URLT? 16:23:39 cabal install 16:24:08 when you do, ghc describe happstack-util, what version of QuickCheck does it list under depends? 16:24:29 also, does it list more than one version of happstack-util? 16:24:36 : does not exist: describe 16:24:42 ghc-pkg list happstack-util 16:24:58 happstack-util-0.4.1 16:25:09 only one match?b 16:25:16 Yeah 16:25:27 in the global package index, or your home directory? 16:25:32 Home directory 16:26:07 ghc-pkg describe happstack-util 16:26:11 what version of QuickCheck ? 16:26:36 QuickCheck 1.2 16:27:10 Let me blow away ~/.cabal and ~/.ghc again and reinstall now that I have the updated head. 16:27:32 I'll be back in half an hour or so with the results of that. 16:27:36 hmm 16:27:45 that seems awfully aggressive 16:27:58 I've done it several times already. 16:28:04 :) 16:28:11 And happstack is the only thing I've installed since the last time I did that. 16:28:12 and it hasn't helped yet :p 16:28:17 True 16:28:30 ./bin/clean-all.sh 16:28:37 ./bin/build-install-all.sh 16:28:39 that should do it 16:28:40 Ok 16:28:58 just check that the happstack-util.cabal in that directory really says QuickCheck 2 16:29:35 Ok 16:29:58 Yep, it's right. 16:30:12 Rebuilding... 16:30:26 I have to step out. Be back in 30 minutes or so. 16:30:40 ok 16:49:25 stepcut: Same problem. 16:51:46 You think cabal is somehow checking the quickcheck dependency for the hackage version of happstack-util instead of my local version? 17:00:31 no, but perhaps it is installing the hackage version of happstack-util instead of the local version 17:00:43 look carefully at your logs.. 17:01:12 or do, runhaskell Setup configure --user && runhaskell Setup build && runhaskell Setup install, to avoid any chance of looking at hackage.. 17:07:18 Hmmm, it works when I do the runhaskell for urlt 17:07:21 But it gives me a warning 17:07:30 Configuring URLT-0.13... 17:07:30 Warning: This package indirectly depends on multiple versions of the same 17:07:30 package. This is highly likely to cause a compile failure. 17:07:30 package happstack-util-0.4.1 requires QuickCheck-1.2.0.0 17:07:30 package URLT-0.13 requires QuickCheck-2.1.0.3 17:08:04 But it seems to compile fin. 17:08:05 fine 17:08:07 yes 17:08:15 that is actually what I expected to happen 17:08:21 apparently cabal is more militant about it 17:08:26 I guess so 17:08:37 except, you shouldn't have any version of happstack-util on your system which requires QuickCheck 1 17:08:43 so something funny is gonig on there 17:08:55 Yeah 17:09:14 in the buildbot, we have seen a case where cabal install will download a library from hackage even though it is already installed locally 17:09:18 I wonder if that is happening to you 17:09:31 Maybe 17:09:42 It seems that it's something like that. 17:10:08 ghc-pkg describe happstack-util still tells me quickcheck 1.2 17:10:39 right, you would have to look at your build results for ./bin/build-install-all.sh and see if you see happstack-util being installed twice 17:10:55 once from the local directory, and once when it is trying to resolve dependencies for another package 17:11:03 Ok, let me try that. 17:13:45 Is there a way to redirect both stdout and stderr to the same file? 17:14:39 yes 17:14:49 in bash? 17:14:53 Yeah 17:15:15 foo > out.log 2&>1 I think 17:15:22 there is a shorcut cut though... 17:15:25 let me double check 17:15:43 I usually just run everything in emacs and do M-x shell 17:15:43 ;) 17:16:22 foo &> log.txt 17:16:36 Ok 17:18:24 http://hpaste.org/fastcgi/hpaste.fcgi/view?id=16273#a16275 17:18:26 how can i fix this ? 17:18:58 is it possible that HtmlString is breaking stuff ? 17:20:45 HugoDaniel: unless you patched the ToMessage instance, HtmlString is definitely breaking stuff 17:21:14 stepcut: Yes, it does happstack-util twice. 17:21:26 ...in immediate succession. 17:21:29 oh 17:21:32 how do i fix that ? 17:21:59 ill define a HtmlUTF8String 17:23:07 HugoDaniel: in happstack/happstack/src/Happstack/Server/HStringTemplate.hs it needs to use Data.ByteString.Lazy.UTF8.fromString instead of L.pack 17:23:16 look at, happstack/happstack/src/Happstack/Server/HSP/HTML.hs 17:23:22 and then submit a patch :) 17:23:49 oh, okey, thanks... you told me that yesterday but i lost the logs 17:24:04 yeah, I still have the buffer open, so I copied and pasted ;) 17:24:45 however, we do have channel logs: http://happstack.com/irc-logs/ 17:24:51 oh nice :) 17:25:11 the empty files are the days nobody said anything :p 17:25:30 e.g., the 14th 17:25:40 stepcut: It would be nice if cabal would tell you whether it was getting the package locally or from hackage. 17:25:42 so, i should add a HtmlUTF8String to happstack-helpers, and also try to add support for utf8 in hstringtemplate 17:26:57 ? 17:27:51 what is the difference between HtmlString and HtmlUTF8String ? 17:28:27 uses Data.ByteString.Lazy.UTF8.fromString instead of L.pack 17:28:52 HtmlString should be using fromString not L.pack.. it's broken 17:29:55 its using L.pack, and B.pack, where B is Data.ByteString.Char8, and L is Data.ByteString.Lazy.Char8 17:33:45 This is weird. I just ran ghc-pkg list and it showed all the happstack packages at 0.4.1 17:34:01 Then I built happstack-auth with "cabal install" 17:34:18 And it rebuilt happstack-0.4.1 17:34:49 And now URLT is showing up red in "ghc-pkg list" 17:36:09 mightybyte: I blame dcoutts.. what version of GHC ? 17:37:00 hmm 17:37:19 6.12.1 17:37:26 so, ive done a quickfix in happstack-helpers 17:37:32 how do i create and send a patch ? 17:37:55 HugoDaniel: um.. 17:38:43 im getting "HTTP request failed with: : hLookAhead: resource vanished (Connection reset by peer) " 17:38:55 HugoDaniel: why did you patch anything in happstack-helpers? 17:39:12 HtmlString is from happstack-helpers 17:39:32 bummer, it still doesn't work 17:40:11 HugoDaniel: oh, HtmlString is not the same as StringTemplate.. 17:40:16 one moment 17:43:26 HugoDaniel: anyway if you add: 17:43:37 import qualified Data.ByteString.Lazy.UTF8 as L 17:43:41 to Common.hs 17:43:49 and change the instance to: 17:43:50 instance ToMessage HtmlString where 17:43:50 toContentType _ = B.pack "text/html;charset=utf-8" 17:43:50 toMessage (HtmlString s) = L.fromString s 17:43:53 17:43:57 I think it should work 17:44:58 okey 17:45:03 i forgot the charset=utf-8 17:45:52 its also necessary to add utf8-string to the .cabal file 17:46:28 yes 17:47:34 ok, i keep having the same problem... 17:47:48 Apenas poder�o entrar os professores de ci�ncia 17:48:34 if you do, HtmlString "°", where ° is a unicode character of your choice, does that work? 17:48:42 let me try it... 17:50:07 also, what browser? 17:51:23 yes, it works 17:51:35 opera, with forced UTF-8 encoding 17:51:47 (the automatic also recognizes utf-8 as the encoding) 17:51:51 so, it seems like the source your are reading the data from is where it is getting corrupted now 17:51:59 hmm 17:52:17 $ enca -L none login.st 17:52:19 Universal transformation format 8 bits; UTF-8 17:52:28 yeah 17:53:27 it displays fine in kwrite 17:53:51 I am not really clear how, do { c <- UTF.readFile fp ; return $ toResponse $ HtmlString c }, could go wrong 17:54:40 does, do { c <- UTF.readFile fp ; UTF.putStrLn c }, work ? 17:56:14 let me try it 17:57:26 how do i import qualified in ghci ? 17:58:25 HugoDaniel: you can't, you just have to specify the full path 17:58:36 ah, yes, i did that 17:58:40 it works fine in ghci 17:58:50 the file shows up properly with the proper characters 17:59:02 konsole is using UTF-8 as the default charset 17:59:23 ill try to kill opera... perhaps is the cache or whatnot 18:05:17 ok 18:05:32 it works fine in konqueror if i specifically set the encoding to be UTF-8 18:05:38 the automatic encoding doesn't work 18:05:43 in opera, still doesn't work 18:05:48 hmm 18:06:37 i noticed this on the opera request: HeaderPair {hName = "accept-charset", hValue = ["iso-8859-1, utf-8, utf-16, *;q=0.1"]}) 18:07:36 yes, that seems fine 18:07:55 do you have the tag in the ? 18:07:56 konqueror request has instead: HeaderPair {hName = "accept-charset", hValue = ["utf-8, utf-8;q=0.5, *;q=0.5"]} 18:08:19 stepcut, i do 18:08:29 18:09:32 now konquerer stoped working with utf-8, it displays the same as opera (which is ? instead of the correct char) 18:09:45 and i haven't done anything... just a few refreshes 18:09:57 sweet! 18:10:12 ah 18:10:16 i know 18:10:17 maybe that character just isn't in the font ? 18:10:34 is this public visible on the Internet ? 18:10:44 if i do a refresh i konqueror it displays the ? instead of the character, i then have to manually switch the charset to utf-8, and it stays fine... 18:11:27 stepcut: no, but i can make it available... w8 a sec 18:17:17 (im just patching up the happstack helpers on the server) 18:22:01 http://serv.fcsh.unl.pt/a3es/ 18:22:08 it works fine now :/ 18:22:19 in the server it works fine... 18:22:30 something tells me my linux instalation is completly messed up 18:23:29 :) 18:25:04 i should definetly switch to freebsd 18:26:12 :p 18:26:46 anyway, that patch to the ToMessage instances is certainly required.. 18:26:57 so you should submit a patch to the maintainer of that library 18:27:14 happstack-helpers ? aint that you ? 18:27:19 nope 18:27:34 http://hackage.haskell.org/package/happstack-helpers 18:27:40 thomas hartman I believe 18:27:50 I don't know how my name got on it :-/ 18:27:54 thats the author, the maintainer is creighton hogg 18:27:56 ill mail him 18:35:02 done 18:47:44 in ArchLinux, UTF-8 encoding is identified by "utf8" instead of "UTF-8" 18:47:51 i guess this might have something to do with it... 19:03:29 hmm 19:13:32 http://hpaste.org/fastcgi/hpaste.fcgi/view?id=16279#a16279 here is the fixed function, using hstringtemplate with utf8, if anyone cares... 19:15:02 HugoDaniel: so what was wrong besides the ToMessage instance? 19:17:52 im not sure, i didn't test it, i guess ToMessage was the only thing 19:18:01 i dont know if hstringtemplate reads utf8 properly or not... 19:19:24 ah 19:22:30 ok, i tested it, reads the files correctly 19:22:38 ToMessage was the only thing... 19:23:15 spiffy 22:27:10 i usualy feel the need for a url mapper in happstack 22:27:24 is there such a thing ? im stuck to using dir and other kind of functions... 22:38:33 HugoDaniel: I have a url mapper of sorts, http://hackage.haskell.org/package/URLT 22:39:03 probably need the darcs version, http://src.seereason.com/urlt/ 22:39:38 but you could easily write your own different url mapper.. 22:40:28 hmm yes 22:42:00 URLT is really more than a url mapper.. 22:42:23 I have a write up on it here, http://src.seereason.com/~jeremy/SimpleSite1.html 22:42:41 how would your ideal url mapper work? 22:42:55 oh, this is cool 22:43:06 hmm 22:43:44 my url mapper would match url sections and pass them as inputs to the functions it mapped 22:43:55 match in what way? 22:44:51 something like ("teacher-$id$/$day$-$month$-$year$", myfunc) 22:45:28 and myfunc would be something like :: Int -> Int -> Int -> Int -> Stuff 22:45:57 what would the type of, ("teacher-$id$/$day$-$month$-$year$", myfunc) be? 22:47:24 i haven't thought about it yet.. i dont know if using a tuple might be the best thing to do... 22:47:41 probably (String, Args -> Stuff) 22:48:06 I assume you want to have more than one case to match on ? 22:48:19 and args could be [Either Int String] 22:48:32 yes 22:48:39 so [(String, Args -> Stuff)] 22:49:04 where, type Args = [either Int String] ? 22:49:11 yes, something like that 22:49:49 i dont see great use to pass around other data types, but im not sure... people can find very strange things to pass around in url's 22:50:07 stepcut: dcoutts says to bump the version for happstack-util head to force cabal to use it 22:50:39 mightybyte: but it's already installed, why does it want to install another version? 22:51:05 Not sure of the details, but it interprets same version as interchangeable. 22:51:12 stepcut: the thing you have to realise is that sometimes it is necessary to rebuild packages, so as to achieve consistent deps 22:51:30 cabal will try to use the installed version where possible 22:52:07 but if the consistent install plan it comes up with assigns different deps to a package than is provided by the installed instance, then we cannot use the installed instance 22:52:15 at some point we might add support for --constraint="foo installed" 22:52:34 well, time to sleep now... thanks for all the support 22:52:42 to commit earlier to picking the installed one, which might then cause other decisions to be taken, or might end in failure with a suitable explanation 22:53:04 given that it does sometimes need to rebuild, it has to work on the assumption that foo-1.0 is just as good as foo-1.0 22:53:20 Yeah, that makes sense. 22:53:28 so best practise is if you've got non-trivial changes in the dev version, to bump the versino 22:53:36 esp if there are changes in the dependencies 22:53:39 And the whole point of version numbers in the first place is to disambiguate. 22:53:56 dcoutts: so what is happening is that we do cabal install 'a' and something good gets intalled. But then we do cabal install 'b', and we realize the choices that were made for 'a' don't work for 'b', so we upgrade 'a' so that it is compatible with the choices for 'b'? 22:54:07 since that's exactly what would cause the deps of the installed instance to not match the expected/required deps assigned in the install plan 22:54:25 stepcut: rebuild 'a' (not upgrade), yes. 22:55:17 and if you've got an installed instance for 'a' that you really wanted to use then this is annoying 22:55:35