#mapnik log: Monday 08, February 2010

2010 | 02

previous | next
00:49:24 *** D3f0 has quit (Ping timeout: 258 seconds)
00:52:14 *** D3f0 (~D3f0@190.177.71.148) has joined #mapnik
01:46:20 *** myselfhimself has quit (Read error: Operation timed out)
01:52:30 *** D3f0 has quit (Remote host closed the connection)
02:01:35 *** mperry_ (~mperry@c-67-164-175-65.hsd1.co.comcast.net) has joined #mapnik
02:01:35 *** mperry has quit (Read error: Connection reset by peer)
02:01:36 *** mperry_ is now known as mperry
02:25:19 *** Ldp__ has quit (Ping timeout: 240 seconds)
03:06:19 *** D3f0 (~D3f0@190.177.71.148) has joined #mapnik
03:47:09 *** mperry_ (~mperry@c-67-164-175-65.hsd1.co.comcast.net) has joined #mapnik
03:47:09 *** mperry has quit (Read error: Connection reset by peer)
03:47:10 *** mperry_ is now known as mperry
03:51:20 *** rcoup (~rcoup@ip-118-90-67-200.xdsl.xnet.co.nz) has joined #mapnik
04:06:01 <CIA-31> mapnik-utils: dane.springmeyer * r913 /sandbox/tools/irc_tools/logserver.py: pad days and months to make sure we match log files using glob
04:28:11 *** D3f0 has quit (Read error: Connection reset by peer)
04:37:27 *** tomhughes has quit (Read error: Operation timed out)
04:37:27 *** tomhughes (~tom@gosford.compton.nu) has joined #mapnik
04:42:23 *** ajturner (~ajturner@pool-72-66-109-70.washdc.fios.verizon.net) has joined #mapnik
04:44:13 *** rcoup has quit (Quit: rcoup)
05:14:21 *** ajturner has quit (Quit: ajturner)
06:13:38 *** springmeyer (~springmey@c-76-28-156-154.hsd1.wa.comcast.net) has joined #mapnik
06:13:39 *** springmeyer has quit (Excess Flood)
06:20:24 *** springmeyer (~springmey@c-76-28-156-154.hsd1.wa.comcast.net) has joined #mapnik
06:57:50 *** mperry_ (~mperry@c-67-164-175-65.hsd1.co.comcast.net) has joined #mapnik
06:57:50 *** mperry has quit (Read error: Connection reset by peer)
06:57:51 *** mperry_ is now known as mperry
07:00:43 *** jfreeman has quit (Remote host closed the connection)
07:27:32 <Arc> hey, where are you guys on Py3 support?
07:27:59 <Arc> is it done? being tested? on the short list? on the back burner? not even a speck on the horizon?
07:28:56 <Arc> i'm trying to evaluate whether to use mapnik or memphis.  the target server uses Py3 WSGI, i would rather write the map generation backend using Genie than be forced to use fastcgi for it
07:52:18 <dodobas> memphis?
07:52:36 <dodobas> i dont know where are we on py3 support
07:54:32 *** Ldp__ (~thid@osm.xs4all.nl) has joined #mapnik
10:14:16 *** HounD (~HounD@unics1.grfc.ru) has joined #mapnik
11:31:37 *** D3f0 (~D3f0@www.transpa-sa.com.ar) has joined #mapnik
11:35:28 *** HounD has parted #mapnik (None)
12:47:23 *** HounD (~HounD@unics1.grfc.ru) has joined #mapnik
13:06:04 *** HounD has parted #mapnik (None)
13:30:55 *** ajturner (~ajturner@209.155.228.129) has joined #mapnik
13:39:23 *** tomhughes has quit (Read error: Operation timed out)
13:43:25 *** tomhughes (~tom@gosford.compton.nu) has joined #mapnik
13:54:04 *** Phurl has quit (Quit: Ex-Chat)
14:02:51 *** Phurl_ (~mdupont@cl-1773.dus-01.de.sixxs.net) has joined #mapnik
14:13:53 *** tomhughes has quit (Read error: Operation timed out)
14:18:14 *** tomhughes (~tom@gosford.compton.nu) has joined #mapnik
14:56:31 *** hobu has quit (Excess Flood)
14:57:13 *** hobu (~hobu@epimetheus.hobu.net) has joined #mapnik
15:05:27 *** hobu has quit (Changing host)
15:05:27 *** hobu (~hobu@osgeo/member/hobu) has joined #mapnik
15:12:09 *** ajashton (~aj@c-69-136-229-112.hsd1.dc.comcast.net) has joined #mapnik
15:15:54 *** mperry has quit (Ping timeout: 240 seconds)
16:23:38 *** chad_burt (~chad_burt@mm-01.msi.ucsb.edu) has joined #mapnik
16:24:10 *** mperry (~mperry@c-67-164-175-65.hsd1.co.comcast.net) has joined #mapnik
16:28:28 *** ajturner has quit (Quit: ajturner)
16:39:01 <springmeyer> Arc: py3k support is planned, #334
16:39:04 <nikq> Ticket #334: Mapnik Boost.Python py3k support, http://trac.mapnik.org/ticket/334
16:46:50 *** StormTide (~Kevin@2002:186c:64c0:0:21d:60ff:fe5e:cf66) has joined #mapnik
16:58:34 *** D3f0 has quit (Quit: Saliendo)
17:33:54 *** ajashton has quit (Remote host closed the connection)
17:40:21 *** tcarobruce (~tcarobruc@adsl-75-10-247-30.dsl.pltn13.sbcglobal.net) has joined #mapnik
18:11:30 *** mperry has quit (Ping timeout: 240 seconds)
18:14:26 *** mperry (~mperry@c-67-164-175-65.hsd1.co.comcast.net) has joined #mapnik
18:51:00 *** jburgess (~jburgess@15.92.187.81.in-addr.arpa) has joined #mapnik
18:53:51 *** Phurl_ has quit (Read error: Connection reset by peer)
18:56:49 *** Phurl_ (~mdupont@cl-1773.dus-01.de.sixxs.net) has joined #mapnik
18:59:11 *** ajashton (~aj@c-69-136-229-112.hsd1.dc.comcast.net) has joined #mapnik
19:18:50 *** mperry has quit (Ping timeout: 256 seconds)
19:19:29 *** mperry (~mperry@c-67-164-175-65.hsd1.co.comcast.net) has joined #mapnik
19:22:17 *** springmeyer has quit (Quit: springmeyer)
19:22:25 *** springmeyer (~springmey@c-76-28-156-154.hsd1.wa.comcast.net) has joined #mapnik
19:23:28 <dodobas> yello
19:32:02 *** cgs_bob has quit (Read error: Connection reset by peer)
19:32:18 *** cgs_bob (~bob@122.135-78-65.ftth.swbr.surewest.net) has joined #mapnik
19:35:23 <springmeyer> hey dodobas
19:36:24 <dodobas> o springmeyer, good day
19:36:36 <springmeyer> cheers :)
19:38:19 <dodobas> i've started playing with 300dpi style
19:38:30 <Arc> springmeyer: so we can build mapnik for Py3 right now?
19:38:48 <springmeyer> dodobas: nice
19:38:55 <springmeyer> Arc: no
19:39:19 <dodobas> also calculating scale distorsions, i mean taking it into accont when generating city plans
19:39:25 <StormTide> anyone know how long it should take to render about a state's worth of data with generate_tiles? say per zoom level 15
19:39:25 <dodobas> or any maps
19:39:54 <dodobas> StormTide: depends on many many many things :D
19:40:09 <dodobas> first of all, layers of data, style complexity...etc
19:40:14 <dodobas> your hardware
19:40:42 <springmeyer> yes, the the scaling factor to apply to the actual map scale is tricky, glad you are testing it out
19:41:27 <Arc> springmeyer: ok, then I do not understand the ticket comments at all.  What is the state of the Py3 bindings?
19:41:31 <StormTide> dodobas, well theres a lot of layers, but only about 3 covering any given area...
19:41:40 <StormTide> just lookin for a ballpark... been rendering for about 3 days now heh
19:41:51 <Arc> r1518, r1519 adds support for using python scons/scons.py PYTHON=/some/py3k/bin/python
19:41:52 <nikq> http://trac.mapnik.org/changeset/1519, at , by dane: scons: support py3k in python configuration detection
19:41:54 <Arc> SCons does not work with py3k, but building with py2.x against py3.x should work with the above commit
19:42:15 <Arc> yes, that *reads* as if Py3 support was finished and builds
19:42:43 <StormTide> as for the hardware question, well, this script doesn't seem to be utilizing what i have available very well
19:42:58 <StormTide> top - 11:44:05 up 4 days, 14:48,  4 users,  load average: 0.34, 0.92, 0.89
19:43:11 <dodobas> well im doing it manualy...if i want 1:2000 scale, first i calculate distorted scale for that area...
19:43:29 <dodobas> then calcualte scale at '300dpi'
19:43:29 <springmeyer> Arc: right, I've not gotten very far yet
19:43:33 <StormTide> tis a core2 with 4gigs... 2 of which are listed as free... and it's not iobound
19:43:53 <Arc> ... ok, so does that mean instead that the build script is setup to support Py3, but the code does not yet?
19:43:55 <dodobas> StormTide: i guess you shoud check nomber of files generated per hour...
19:44:04 <springmeyer> Arc: next step is to port the actual bindings, now that SCons can be used to build against py3k version
19:44:17 <Arc> if you need help, I can certainly advise re: changes to PyModule, but I know nothing about boost
19:44:21 <springmeyer> Arc: right, build script will work now, bindings do not have support yet
19:44:58 <Arc> the c-api actually didnt change very much, most of the changes are in string conversion and PyModule
19:45:02 <springmeyer> Arc: 99% of work will be done in C++ (boost.python)
19:45:11 <springmeyer> right
19:45:21 <StormTide> dodobas, not sure how to check that, but, iostat -m says its writing 0.09 MB/s to the drive...
19:45:26 <StormTide> which is pretty low
19:45:39 <springmeyer> I doubt it will be too hard to accomplish...
19:45:40 <StormTide> iowait is 0.22%
19:45:53 <dodobas> StormTide: where are you writing that files
19:46:12 <StormTide> dodobas, a sata-connected ext3 drive/partition
19:46:39 <dodobas> well check that drive, get the number of files
19:46:43 <dodobas> check in 10min...
19:46:49 <dodobas> etc...
19:46:58 <StormTide> how do you get a file count on linux again?
19:47:09 <dodobas> find . |wc -l
19:47:15 <dodobas> or better
19:47:18 <dodobas> find . -type f |wc -l
19:48:09 <dodobas> what are you using for tile generation
19:48:43 <StormTide> generate_tiles.py with a mapnik.xml using some esri style shapefiles
19:49:13 <StormTide> http://dev.stormtide.ca/test.htm <--- trying to render out that tileset
19:49:32 <dodobas> doesn't generate_tiles produce some output?
19:49:45 <StormTide> yep
19:49:46 <StormTide> it does
19:50:10 <StormTide> maybe a page worth of lines every 10 seconds
19:50:51 <StormTide> anyway, just wondering how long it usually takes
19:51:03 <dodobas> err...you did use bbox of your area...not the whole world?
19:51:11 <StormTide> yes
19:51:39 <StormTide>     bbox = (-153.0,42.0,121,61.0)
19:51:52 <StormTide> trying to render zoom levels 10-16
19:51:56 <dodobas> can you paste somewhere couple of lines of that output?
19:52:03 <StormTide> at 14 after 3 days
19:52:31 <StormTide> sure two secs
19:52:57 <StormTide> unknown : 14 2447 5853   Empty Tile
19:52:57 <StormTide>  <--- i'd say 90% are empty tiles, but they're colored so they're meaningful
19:53:49 <StormTide> http://www.phpriot.com/2682
19:54:32 <dodobas> ah well...
19:54:52 <dodobas> i never used generate_tiles for something other then testing
19:55:15 <dodobas> but your load is too low...
19:55:33 <StormTide> ya, thats the peculiar part to me
19:55:40 <StormTide> i cant find a bottleneck
19:55:58 <StormTide> definitely not cpu bound, lots of free memory, io seems good...
19:56:15 <StormTide> its almost as if theres some sort of governor in the code to stop it from running away
19:56:22 <StormTide> like a sleep(1) or somethin
20:42:14 *** ajturner (~ajturner@209.155.228.129) has joined #mapnik
20:51:37 <nikq> Mapnik Trac: world_borders.zip attached to XMLGettingStarted | http://trac.mapnik.org/attachment/wiki/XMLGettingStarted/world_borders.zip
20:55:23 <dodobas> when mapnik closes file on render_to_file ?
20:55:31 <dodobas> can i close it manually?
20:56:23 <nikq> Mapnik Trac: Changeset [1619]: mapnik.org: avoid use of invalid list slicing in latest django | http://trac.mapnik.org/changeset/1619
20:57:14 <nikq> Mapnik Trac: Changeset [1620]: mapnik.org: use new multidb approach in settings | http://trac.mapnik.org/changeset/1620
20:57:37 <springmeyer> dodobas: not that I know of
20:58:13 <springmeyer> dodobas: what is your usecase?
20:58:33 <dodobas> a for loop that iterates over differnt bboces
20:58:36 <dodobas> *bboxes
20:58:55 <nikq> Mapnik Trac: Changeset [1621]: mapnik.org: avoid deprecated urls.py syntax | http://trac.mapnik.org/changeset/1621
20:59:27 <springmeyer> dodobas: can you render to a mapnik.Image, then use im.view() and save out chunks?
21:01:00 <dodobas> hmm, i can try...
21:01:48 <nikq> Mapnik Trac: Changeset [1622]: mapnik.org: make years listing of blog posts dynamic | http://trac.mapnik.org/changeset/1622
21:02:01 <springmeyer> dodobas: just an idea, I don't have an example...
21:02:36 <springmeyer> you could also render to a mapnik.Image, then write im.to_string() to a file you create yourself
21:02:48 <springmeyer> then you'd be able to manually close it/flush it
21:04:11 <nikq> Mapnik Trac: Changeset [1623]: mapnik.org: upgrade news app to django trunk, use new moderation framework  ... | http://trac.mapnik.org/changeset/1623
21:10:19 <nikq> Mapnik Trac: XMLGettingStarted edited | http://trac.mapnik.org/wiki/XMLGettingStarted?version=13
21:12:16 <nikq> Mapnik Trac: XMLGettingStarted edited | http://trac.mapnik.org/wiki/XMLGettingStarted?version=14
21:12:26 <dodobas> springmeyer: err...my error was that i've tried to generate image with bbox = 0 :D
21:12:31 <dodobas> oops
21:13:59 <springmeyer> oh, okay
21:14:04 <springmeyer> so what was happening?
21:14:11 <springmeyer> should an error have been thrown?
21:17:26 <dodobas> nope...rendering just hangs
21:21:05 <nikq> Mapnik Trac: Changeset [1624]: mapnik.org: only show comments count if comments are enabled | http://trac.mapnik.org/changeset/1624
21:21:47 <springmeyer> dodobas: hangs? thats not good
21:22:04 <springmeyer> why do you think it hangs?
21:25:48 <dodobas> ill check that tomorrow, my mind is not in 'debug' mode right now
21:25:50 <dodobas> :)
21:26:54 <springmeyer> dodobas: I hear you :)
21:26:57 <springmeyer> good luck
21:31:16 <StormTide> is there a standard blue-marble data layer to render the lower-zoom levels?
21:34:28 <nikq> Mapnik Trac: XMLGettingStarted edited | http://trac.mapnik.org/wiki/XMLGettingStarted?version=15
21:36:55 <springmeyer> StormTide: which ever blue marble you like :)
21:37:17 <StormTide> springmeyer, got a list ;)
21:38:22 <springmeyer> nope
21:52:54 <nikq> Mapnik Trac: world_borders.zip attached to XMLGettingStarted | http://trac.mapnik.org/attachment/wiki/XMLGettingStarted/world_borders.zip
22:11:52 *** jfreeman (~jfreeman@mail.agileware.net) has joined #mapnik
22:12:56 <springmeyer> jfreeman: you ever get tillmill.py working?
22:13:19 <jfreeman> springmeyer: hey mate!
22:13:32 <jfreeman> springmeyer: sort of
22:13:37 <springmeyer> ah?
22:14:13 <jfreeman> springmeyer: well, actually. it was working OK. But I setup a TileCache + Apache server for the map. And then seeded the tile pages
22:14:47 <springmeyer> so you got it working but didn't use it?
22:14:54 <jfreeman> springmeyer: but it's all good. Thanks for your help the other day, really helped me out with a steep learning curve
22:15:43 <jfreeman> springmeyer: sorry, no tilemill - never got that working :)
22:16:22 <springmeyer> ah, right thats what I was wondering
22:16:33 <springmeyer> did you end up trying to get it working at all?
22:16:41 * springmeyer just curious if you got any farther...
22:16:45 <jfreeman> springmeyer: I was thinking of that TileLite script
22:16:57 <springmeyer> sure, gocha
22:17:12 <jfreeman> names very similar :)
22:17:36 <jfreeman> I dropped TileMill entirely, don't have the luxury of time for that one
22:17:39 <springmeyer> alas, yes
22:17:53 <springmeyer> okay, thats what I was wondering
22:17:58 <jfreeman> TileLite enabled me to get the prototype up and running.
22:18:07 <jfreeman> Then switched to TileCache for production
22:18:16 <springmeyer> I'm not aware of anyone who has had success with TileMill
22:18:17 <jfreeman> so hopefully, it'll all go well
22:18:21 <springmeyer> great, sounds good
22:18:36 <springmeyer> glad things are working for you either way....
22:18:44 <jfreeman> yes, well combined we spent about 5 working days on it
22:18:53 <jfreeman> and that's a lot of man hours to get no where
22:19:04 <springmeyer> 5 days with TileMill?
22:19:22 <jfreeman> that's my estimate
22:20:01 <jfreeman> anyway, solution works and I know now to avoid TM until better doco comes out
22:20:04 <jfreeman> and it's stable :)
22:22:09 <springmeyer> well, sounds like it would have helped most if the mapbox docs recommended that you test locally __first__
22:29:20 <jfreeman> yes, quite possibly
22:29:44 <jfreeman> thanks again for your help, really got things moving :)
22:30:39 * springmeyer nods
22:36:02 *** mperry_ (~mperry@c-67-164-175-65.hsd1.co.comcast.net) has joined #mapnik
22:36:02 *** mperry has quit (Read error: Connection reset by peer)
22:36:03 *** mperry_ is now known as mperry
22:46:11 * jfreeman gets back to work
23:15:35 *** ajturner has quit (Read error: Operation timed out)
23:15:48 <StormTide> springmeyer, is there any way that the bbox in gen tiles could be a radius?
23:16:13 <StormTide> lat,long,distance?
23:19:56 <springmeyer> ultimately Mapnik needs a bbox. but sure if you want to create a bbox from a lon,lat,radius then ya
23:20:23 <StormTide> can a bbox be anything but square?
23:20:44 <StormTide> like, can there be multiple boxes
23:21:05 <springmeyer> a bbox need not be square
23:21:10 <springmeyer> not sure what you mean by multiple
23:21:23 <StormTide> nm
23:21:49 <StormTide> i think i can write a python func to render a series of smaller bboxes corresponding to a radius
23:21:54 <StormTide> instead of a big one
23:22:28 <StormTide> basically, im realizing that this chart, once tiled, is way over my mobile device size limit
23:23:16 <StormTide> if only i could build mapnik, and run it on the phone haha
23:31:37 <Ldp__> wait a few years, and it won't sound that crazy anymore
23:37:20 *** springmeyer_ (~springmey@c-76-28-156-154.hsd1.wa.comcast.net) has joined #mapnik
23:37:21 *** springmeyer has quit (Read error: Connection reset by peer)
23:37:22 *** springmeyer_ is now known as springmeyer