Recent changes to tickets

#15 Transform not producing output chunks

Justin M Wozniak — Tue, 20 May 2014 21:32:01 -0000

This look good...

#15 Transform not producing output chunks

Guy Jennings — Wed, 14 May 2014 19:12:33 -0000

I've pushed changes so that the chunk buffers are allocated with calloc, so that swift can free them, and I have optimized the memory allocation strategy so that chunk objects are only actually allocated when they are used - this should minimize memory usage.

#12 Bring in weights

Guy Jennings — Wed, 14 May 2014 19:09:56 -0000

Two buffers is slightly easier - they will both be the same size for a given chunk

#13 Design question: Logging framework

Guy Jennings — Wed, 14 May 2014 19:09:02 -0000

If you can use CctwObject::printMessage that would be best

#14 File descriptor cache

Guy Jennings — Wed, 14 May 2014 19:08:02 -0000

This should happen automatically by using the existing code

#15 Transform not producing output chunks

Guy Jennings — Tue, 13 May 2014 19:49:20 -0000

Pushed a revised version of the tcl commands - this now assumes that the file name and dataset name are setup beforehand for each instance, e.g. by reading a startup script, then you call cctw_transform which reads one chunk of input data, transforms it and returns a list of transformed chunks, each represented by a list of 4 numbers -
{ chunkid dataptr weightptr length } for each chunk.

I need to change the code so that the chunks are allocated with malloc so that swift can free them and I need to change the code to reduce the storage size and initialization times

#15 Transform not producing output chunks

Justin M Wozniak — Tue, 13 May 2014 14:54:42 -0000

I put some notes about this at: https://sourceforge.net/p/cctw/wiki/SwiftFrameworkRequirements

#15 Transform not producing output chunks

Justin M Wozniak — Tue, 13 May 2014 14:27:32 -0000

Ok I removed the static methods.

#15 Transform not producing output chunks

Justin M Wozniak — Tue, 13 May 2014 02:51:38 -0000

Ok I will revert first thing tomorrow.

#15 Transform not producing output chunks

Guy Jennings — Mon, 12 May 2014 21:48:44 -0000

I think a better approach is to make more direct use of the algorithms already in place for the desktop version, but with slight tweaks to the ownership of data items. I have a revised version of Cctwtcl_Transform_Cmd that just takes a single chunk number and reads that chunk from the input data, transforms it and returns a list of partial output chunks to be merged. In this formulation we don't need Cctwtcl_Input_Cmd at all. It appears to be working for me but I don't want to push it to the repo with all your static stuff in it - I'd suggest reverting that commit if you are amenable