1 2011-09-24T00:20:28 * ThomasWaldmann gets near to something committable
2 2011-09-24T03:20:50 <CIA-65> Thomas Waldmann <tw AT waldmann-edv DOT de> storage-ng * 847:b2542a3cfefe 2.0/MoinMoin/storage/ (32 files in 4 dirs): remove current storage code
3 2011-09-24T03:20:51 <CIA-65> Thomas Waldmann <tw AT waldmann-edv DOT de> storage-ng * 848:ebd15cde707e 2.0/MoinMoin/storage/ (35 files in 7 dirs): add new storage-ng storage/indexing/... subsystem
4 2011-09-24T03:20:52 <CIA-65> Thomas Waldmann <tw AT waldmann-edv DOT de> storage-ng * 849:7cfec134a4c5 2.0/MoinMoin/search/ (_tests/test_indexing.py indexing.py): remove indexing + tests
5 2011-09-24T03:20:53 <CIA-65> Thomas Waldmann <tw AT waldmann-edv DOT de> storage-ng * 850:fe6df588025c 2.0/MoinMoin/script/maint/xml.py: remove xml serialization (will be replaced by simpler method)
6 2011-09-24T03:20:53 <CIA-65> Thomas Waldmann <tw AT waldmann-edv DOT de> storage-ng * 851:cd8afd44521e 2.0/ (17 files in 9 dirs): storage fixes / extensions, made ACLs work, updated MoinMoin.config
7 2011-09-24T03:20:54 <CIA-65> Thomas Waldmann <tw AT waldmann-edv DOT de> storage-ng * 852:5ad4ae0b1e09 2.0/MoinMoin/ (25 files in 17 dirs): lots of fixes / adaptions for storage-ng code
8 2011-09-24T03:20:54 <CIA-65> Thomas Waldmann <tw AT waldmann-edv DOT de> storage-ng * 853:bc36120169a9 2.0/MoinMoin/ (7 files in 4 dirs): added serialization script, config import fixes
9 2011-09-24T03:20:56 <CIA-65> Thomas Waldmann <tw AT waldmann-edv DOT de> storage-ng * 854:c9a78e5a58c4 2.0/MoinMoin/ (5 files in 5 dirs): (log message trimmed)
10 2011-09-24T03:20:56 <CIA-65> fix script startup deadlock, add script params to create storage and index, fix fs store
11 2011-09-24T03:21:15 <CIA-65> To build an index, use this:
12 2011-09-24T03:21:15 <CIA-65> moin index-build -s -i
13 2011-09-24T03:21:15 <CIA-65> moin index-build --storage-create --index-create
14 2011-09-24T03:21:15 <CIA-65> Usually moin would expect an existing index and storage when starting up
15 2011-09-24T03:21:16 <CIA-65> and fail if it is not there. This is a problem for moin index-* commands,
16 2011-09-24T03:21:16 <CIA-65> Thomas Waldmann <tw AT waldmann-edv DOT de> storage-ng * 855:166fd85f1538 2.0/wikiconfig.py: add hierarchic key/value to wikiconfig
17 2011-09-24T03:21:17 <CIA-65> Thomas Waldmann <tw AT waldmann-edv DOT de> storage-ng * 856:5cc6049a1eba 2.0/MoinMoin/conftest.py: conftest: use create_index/destroy_index here, too
18 2011-09-24T03:21:23 <ThomasWaldmann> ronny: ^^ storage-ng branch
19 2011-09-24T03:21:46 <ThomasWaldmann> the tests work better than before now, but interactive moin usage is still broken
20 2011-09-24T03:22:02 <ThomasWaldmann> for first moin start use: moin moin -s -i
21 2011-09-24T03:22:19 <ThomasWaldmann> (that creates empty storage and index)
22 2011-09-24T10:58:00 <dreimark> moin
23 2011-09-24T10:58:45 <dreimark> ThomasWaldmann: that did not work for me
24 2011-09-24T10:59:02 <dreimark> AttributeError: 'FieldCache' object has no attribute 'code'
25 2011-09-24T10:59:14 <dreimark> which patch for whoosh do i need?
26 2011-09-24T10:59:57 <ThomasWaldmann> see my whoosh bitbucket repo
27 2011-09-24T11:10:17 <dreimark> pip install https://bitbucket.org/thomaswaldmann/whoosh/get/1192ee5d0e9f.tar.gz
28 2011-09-24T11:10:40 <dreimark> thats also a feature i like from pip ;)
29 2011-09-24T11:19:26 *** raignarok
30 2011-09-24T11:21:28 <ThomasWaldmann> ah, nice :)
31 2011-09-24T11:31:03 <dreimark> at least the wiki did not crash on startup, but it is also empty ;)
32 2011-09-24T11:31:27 <ThomasWaldmann> yes, it's empty
33 2011-09-24T11:35:31 <ThomasWaldmann> if brunomartin makes the serializer for old storage, we could feed some stuff into it :)
34 2011-09-24T11:36:36 <dreimark> http://hg.moinmo.in/moin/2.0/file/5cc6049a1eba/MoinMoin/storage/backends/_tests/test_fileserver.py#l42
35 2011-09-24T11:36:58 <dreimark> is that test the right one to look for an example how to get something into the store?
36 2011-09-24T11:37:23 <dreimark> for e.g. fixing maint_create_item ?
37 2011-09-24T11:38:55 <ThomasWaldmann> no, fileserver is special as it is readonly
38 2011-09-24T11:39:25 <dreimark> ic
39 2011-09-24T11:41:52 <ThomasWaldmann> http://hg.moinmo.in/moin/2.0/file/5cc6049a1eba/MoinMoin/storage/backends/_tests/__init__.py#l56
40 2011-09-24T11:42:37 <ThomasWaldmann> this is how to do it on backend level (but we usually operate on index or protector level)
41 2011-09-24T11:43:44 <ThomasWaldmann> http://hg.moinmo.in/moin/2.0/file/5cc6049a1eba/MoinMoin/storage/middleware/_tests/test_indexing.py#l51
42 2011-09-24T11:43:50 <ThomasWaldmann> this is on indexer lever
43 2011-09-24T11:43:58 <ThomasWaldmann> level*
44 2011-09-24T11:47:08 <ThomasWaldmann> btw, be careful to work on the right branch
45 2011-09-24T11:47:24 <dreimark> i know
46 2011-09-24T11:49:40 <dreimark> someone should invent a hg tool similiar to qpython
47 2011-09-24T11:53:49 <dreimark> bbl
48 2011-09-24T12:06:33 <ThomasWaldmann> dreimark: for create item/revision script, it would maybe make sense to give it a meta.json and a data.bin file
49 2011-09-24T12:11:23 *** raignarok
50 2011-09-24T12:22:58 <ThomasWaldmann> bbl
51 2011-09-24T12:28:49 <dreimark> sounds like we want to have a meta.json template or some kind of generator, questionary
52 2011-09-24T13:34:44 *** greg_f
53 2011-09-24T13:53:32 *** MattMaker
54 2011-09-24T13:57:17 *** MattMaker
55 2011-09-24T14:14:28 *** MattMaker
56 2011-09-24T16:25:13 *** humbu
57 2011-09-24T16:25:42 <humbu> Hello, i saw you use mercurial - which WebInterface do you use?
58 2011-09-24T16:46:35 *** humbu
59 2011-09-24T17:48:36 <ThomasWaldmann> greetings from shackspace
60 2011-09-24T18:55:33 <CIA-65> Thomas Waldmann <tw AT waldmann-edv DOT de> storage-ng * 857:d90218b64094 2.0/setup.py: setup.py: remove mercurial, fix comment about sqlalchemy
61 2011-09-24T18:55:34 <CIA-65> Thomas Waldmann <tw AT waldmann-edv DOT de> storage-ng * 858:3183a202d916 2.0/MoinMoin/ (apps/frontend/views.py storage/middleware/protecting.py): fix searchform
62 2011-09-24T19:40:20 *** greg_f
63 2011-09-24T19:54:35 *** grad
64 2011-09-24T20:28:10 <ThomasWaldmann> ronny: how about serializing to plain text if the item is plain text?
65 2011-09-24T20:28:36 <ThomasWaldmann> that means using fixed-length ascii digits instead of 32bit ints
66 2011-09-24T20:38:25 <ronny> re
67 2011-09-24T20:38:54 <ronny> ThomasWaldmann: im not sure what you mean, can you rephase?
68 2011-09-24T21:09:43 <ThomasWaldmann> 000000000042
69 2011-09-24T21:09:46 <ThomasWaldmann> {
70 2011-09-24T21:09:50 <ThomasWaldmann> json metadata
71 2011-09-24T21:09:53 <ThomasWaldmann> }
72 2011-09-24T21:09:59 <ThomasWaldmann> wiki text data
73 2011-09-24T21:10:02 <ThomasWaldmann> ...
74 2011-09-24T21:10:07 <ThomasWaldmann> 00000000023
75 2011-09-24T21:10:09 <ThomasWaldmann> ....
76 2011-09-24T21:10:12 <ThomasWaldmann> 0000000000000
77 2011-09-24T21:10:43 <ronny> ThomasWaldmann: its like that already
78 2011-09-24T21:10:58 <ThomasWaldmann> no, it is binary, i mean text
79 2011-09-24T21:11:11 <ronny> it writes out everything as bytes
80 2011-09-24T21:11:17 <ronny> it doesnt care if its text or not
81 2011-09-24T21:11:32 <ThomasWaldmann> i mean the length values, they are binary currently
82 2011-09-24T21:11:50 <ronny> yes, thats pretty convient
83 2011-09-24T21:12:01 <ronny> should they be a line instead?
84 2011-09-24T21:12:11 <ThomasWaldmann> if they were ascii digits, you could load stuff into an editor even
85 2011-09-24T21:13:02 <ThomasWaldmann> (at least for text items)
86 2011-09-24T21:13:21 <ronny> serialize could be (INTEGER NEWLINE metadata text NEWLINE BYTE*medatata['data_len'])* INTEGER(0)
87 2011-09-24T21:14:24 <ronny> hmm
88 2011-09-24T21:14:32 <ronny> needs a newline after the data as well
89 2011-09-24T21:15:27 <ronny> ThomasWaldmann: does the serializer format truely need to be editable?
90 2011-09-24T21:15:55 <ThomasWaldmann> not sure, maybe we rather want some wrapper commandline script than directly editing
91 2011-09-24T21:19:31 <ThomasWaldmann> ronny: did you look at the stuff i pushed?
92 2011-09-24T21:19:38 <ronny> mom
93 2011-09-24T21:20:21 <ronny> ThomasWaldmann: you didnt push to bb, did you?
94 2011-09-24T21:20:30 <ronny> (the moin branch that is)
95 2011-09-24T21:22:26 <ThomasWaldmann> ehrm, maybe better look at hg.moinmo.in
96 2011-09-24T21:22:43 <ThomasWaldmann> if it is not on bb, it didn't want to create new remote branches
97 2011-09-24T21:23:40 <ronny> why not?
98 2011-09-24T21:28:15 <ronny> bbl
99 2011-09-24T21:55:27 * ThomasWaldmann fixed bb push
100