Wed, 02 May 2018 16:14:40 +0200
makes destructor functions for *_free_content() optional + more documentation for UcxProperties
universe@264 | 1 | --- |
universe@264 | 2 | title: Modules |
universe@264 | 3 | --- |
universe@259 | 4 | |
universe@259 | 5 | UCX provides several modules for data structures and algorithms. |
universe@259 | 6 | You may choose to use specific modules by inclueding the corresponding header |
universe@259 | 7 | file. |
universe@259 | 8 | Please note, that some modules make use of other UCX modules. |
universe@259 | 9 | For instance, the [Allocator](#allocator) module is used by many other modules |
universe@259 | 10 | to allow flexible memory allocation. |
universe@259 | 11 | By default the header files are placed into an `ucx` directory within your |
universe@259 | 12 | systems include directory. In this case you can use an module by including it |
universe@259 | 13 | via `#include <ucx/MODULENAME.h>`. |
universe@259 | 14 | Required modules are included automatically. |
universe@259 | 15 | |
universe@267 | 16 | <div id="modules" align="center"> |
universe@267 | 17 | |
universe@267 | 18 | ----------------------- ---------------------- ---------------------------- ------------------------- |
universe@267 | 19 | [Allocator](#allocator) [AVL Tree](#avl) [Buffer](#buffer) [List](#list) |
universe@267 | 20 | [Logging](#logging) [Map](#map) [Memory Pool](#mempool) [Properties](#properties) |
universe@267 | 21 | [Stack](#stack) [String](#string) [Testing](#test) [Utilities](#utils) |
universe@267 | 22 | ----------------------- ---------------------- ---------------------------- ------------------------- |
universe@267 | 23 | |
universe@267 | 24 | </div> |
universe@267 | 25 | |
universe@259 | 26 | <a name="allocator"></a> |
universe@259 | 27 | |
universe@259 | 28 | ## Allocator |
universe@259 | 29 | |
universe@259 | 30 | *Header file:* [allocator.h](api/allocator_8h.html) |
universe@259 | 31 | *Required modules:* None. |
universe@259 | 32 | |
universe@259 | 33 | A UCX allocator consists of a pointer to the memory area / pool and four |
universe@259 | 34 | function pointers to memory management functions operating on this memory |
universe@259 | 35 | area / pool. These functions shall behave equivalent to the standard libc |
universe@259 | 36 | functions `malloc`, `calloc`, `realloc` and `free`. |
universe@259 | 37 | |
universe@259 | 38 | The signature of the memory management functions is based on the signature |
universe@259 | 39 | of the respective libc function but each of them takes the pointer to the |
universe@259 | 40 | memory area / pool as first argument. |
universe@259 | 41 | |
universe@259 | 42 | As the pointer to the memory area / pool can be arbitrarily chosen, any data |
universe@259 | 43 | can be provided to the memory management functions. One example is the |
universe@259 | 44 | [UCX Memory Pool](#mempool). |
universe@259 | 45 | |
universe@259 | 46 | <a name="avl"></a> |
universe@259 | 47 | |
universe@259 | 48 | ## AVL Tree |
universe@259 | 49 | |
universe@259 | 50 | *Header file:* [avl.h](api/avl_8h.html) |
universe@259 | 51 | *Required modules:* [Allocator](#allocator) |
universe@259 | 52 | |
universe@259 | 53 | This binary search tree implementation allows average O(1) insertion and |
universe@259 | 54 | removal of elements (excluding binary search time). |
universe@259 | 55 | All common binary tree operations are implemented. Furthermore, this module |
universe@259 | 56 | provides search functions via lower and upper bounds. |
universe@259 | 57 | |
universe@259 | 58 | <a name="buffer"></a> |
universe@259 | 59 | |
universe@259 | 60 | ## Buffer |
universe@259 | 61 | |
universe@259 | 62 | *Header file:* [buffer.h](api/buffer_8h.html) |
universe@259 | 63 | *Required modules:* None. |
universe@259 | 64 | |
universe@259 | 65 | Instances of this buffer implementation can be used to read from or to write to |
universe@259 | 66 | memory like you would do with a stream. This allows the use of |
universe@259 | 67 | `ucx_stream_copy` from the [Utilities](#utils) module to copy contents from one |
universe@259 | 68 | buffer to another or from file or network streams to the buffer and |
universe@259 | 69 | vice-versa. |
universe@259 | 70 | |
universe@259 | 71 | More features for convenient use of the buffer can be enabled, like automatic |
universe@259 | 72 | memory management and automatic resizing of the buffer space. |
universe@259 | 73 | See the documentation of the macro constants in the header file for more |
universe@259 | 74 | information. |
universe@259 | 75 | |
universe@259 | 76 | <a name="list"></a> |
universe@259 | 77 | |
universe@259 | 78 | ## List |
universe@259 | 79 | |
universe@259 | 80 | *Header file:* [list.h](api/list_8h.html) |
universe@259 | 81 | *Required modules:* [Allocator](#allocator) |
universe@259 | 82 | |
universe@259 | 83 | This module provides the data structure and several functions for a doubly |
universe@259 | 84 | linked list. Among the common operations like insert, remove, search and sort, |
universe@259 | 85 | we allow convenient iteration via a special `UCX_FOREACH` macro. |
universe@259 | 86 | |
universe@259 | 87 | <a name="logging"></a> |
universe@259 | 88 | |
universe@259 | 89 | ## Logging |
universe@259 | 90 | |
universe@259 | 91 | *Header file:* [logging.h](api/logging_8h.html) |
universe@259 | 92 | *Required modules:* [Map](#map), [String](#string) |
universe@259 | 93 | |
universe@259 | 94 | The logging module comes with some predefined log levels and allows some more |
universe@259 | 95 | customization. You may choose if you want to get timestamps or source file and |
universe@259 | 96 | line number logged automatically when outputting a message. |
universe@259 | 97 | |
universe@259 | 98 | |
universe@259 | 99 | <a name="map"></a> |
universe@259 | 100 | |
universe@259 | 101 | ## Map |
universe@259 | 102 | |
universe@259 | 103 | *Header file:* [map.h](api/map_8h.html) |
universe@259 | 104 | *Required modules:* [Allocator](#allocator), [String](#string) |
universe@259 | 105 | |
universe@259 | 106 | This module provides a hash map implementation using murmur hash 2 and separate |
universe@259 | 107 | chaining with linked lists. Similarly to the list module, we provide a |
universe@259 | 108 | `UCX_MAP_FOREACH` macro to conveniently iterate through the key/value pairs. |
universe@259 | 109 | |
universe@259 | 110 | <a name="mempool"></a> |
universe@259 | 111 | |
universe@259 | 112 | ## Memory Pool |
universe@259 | 113 | |
universe@259 | 114 | *Header file:* [mempool.h](api/mempool_8h.html) |
universe@259 | 115 | *Required modules:* [Allocator](#allocator) |
universe@259 | 116 | |
universe@259 | 117 | Here we have a concrete allocator implementation in the sense of a memory pool. |
universe@259 | 118 | This pool allows you to register destructor functions for the allocated memory, |
universe@259 | 119 | which are automatically called on the destruction of the pool. |
universe@259 | 120 | But you may also register *independent* destructor functions within a pool in |
universe@259 | 121 | case, some external library allocated memory for you, which you wish to be |
universe@259 | 122 | destroyed together with this pool. |
universe@259 | 123 | |
universe@259 | 124 | <a name="properties"></a> |
universe@259 | 125 | |
universe@259 | 126 | ## Properties |
universe@259 | 127 | |
universe@259 | 128 | *Header file:* [properties.h](api/properties_8h.html) |
universe@259 | 129 | *Required modules:* [Map](#map) |
universe@259 | 130 | |
universe@259 | 131 | This module provides load and store function for `*.properties` files. |
universe@259 | 132 | The key/value pairs are stored within an UCX Map. |
universe@259 | 133 | |
universe@277 | 134 | ### Example: Loading properties from a file |
universe@277 | 135 | |
universe@277 | 136 | ```C |
universe@277 | 137 | // Open the file as usual |
universe@277 | 138 | FILE* file = fopen("myprops.properties", "r"); |
universe@277 | 139 | if (!file) { |
universe@277 | 140 | // error handling |
universe@277 | 141 | return 1; |
universe@277 | 142 | } |
universe@277 | 143 | |
universe@277 | 144 | // Load the properties from the file |
universe@277 | 145 | UcxMap* myprops = ucx_map_new(16); |
universe@277 | 146 | if (ucx_properties_load(myprops, file)) { |
universe@277 | 147 | // error handling |
universe@277 | 148 | fclose(file); |
universe@277 | 149 | ucx_map_free(myprops); |
universe@277 | 150 | return 1; |
universe@277 | 151 | } |
universe@277 | 152 | |
universe@277 | 153 | // Print out the key/value pairs |
universe@277 | 154 | char* propval; |
universe@277 | 155 | UcxMapIterator propiter = ucx_map_iterator(myprops); |
universe@277 | 156 | UCX_MAP_FOREACH(key, propval, propiter) { |
universe@277 | 157 | printf("%s = %s\n", (char*)key.data, propval); |
universe@277 | 158 | } |
universe@277 | 159 | |
universe@277 | 160 | // Don't forget to free the values before freeing the map |
universe@277 | 161 | ucx_map_free_content(myprops, NULL); |
universe@277 | 162 | ucx_map_free(myprops); |
universe@277 | 163 | fclose(file); |
universe@277 | 164 | ``` |
universe@277 | 165 | |
universe@259 | 166 | <a name="stack"></a> |
universe@259 | 167 | |
universe@259 | 168 | ## Stack |
universe@259 | 169 | |
universe@259 | 170 | *Header file:* [stack.h](api/stack_8h.html) |
universe@259 | 171 | *Required modules:* [Allocator](#allocator) |
universe@259 | 172 | |
universe@259 | 173 | This concrete implementation of an UCX Allocator allows you to grab some amount |
universe@259 | 174 | of memory which is then handled as a stack. |
universe@259 | 175 | Please note, that the term *stack* only refers to the behavior of this |
universe@259 | 176 | allocator. You may still choose if you want to use stack or heap memory |
universe@259 | 177 | for the underlying space. |
universe@259 | 178 | |
universe@259 | 179 | A typical use case is an algorithm where you need to allocate and free large |
universe@259 | 180 | amounts of memory very frequently. |
universe@259 | 181 | |
universe@259 | 182 | <a name="string"></a> |
universe@259 | 183 | |
universe@259 | 184 | ## String |
universe@259 | 185 | |
universe@259 | 186 | *Header file:* [string.h](api/string_8h.html) |
universe@259 | 187 | *Required modules:* [Allocator](#allocator) |
universe@259 | 188 | |
universe@259 | 189 | This module provides a safe implementation of bounded string. |
universe@259 | 190 | Usually C strings do not carry a length. While for zero-terminated strings you |
universe@259 | 191 | can easily get the length with `strlen`, this is not generally possible for |
universe@259 | 192 | arbitrary strings. |
universe@259 | 193 | The `sstr_t` type of this module always carries the string and its length to |
universe@259 | 194 | reduce the risk of buffer overflows dramatically. |
universe@259 | 195 | |
universe@267 | 196 | ### Initialization |
universe@267 | 197 | |
universe@267 | 198 | There are several ways to create an `sstr_t`: |
universe@267 | 199 | |
universe@267 | 200 | ```C |
universe@267 | 201 | /* (1) sstr() uses strlen() internally, hence cstr MUST be zero-terminated */ |
universe@267 | 202 | sstr_t a = sstr(cstr); |
universe@267 | 203 | |
universe@267 | 204 | /* (2) cstr does not need to be zero-terminated, if length is specified */ |
universe@267 | 205 | sstr_t b = sstrn(cstr, len); |
universe@267 | 206 | |
universe@267 | 207 | /* (3) S() macro creates sstr_t from a string using sizeof() and using sstrn(). |
universe@267 | 208 | This version is especially useful for function arguments */ |
universe@267 | 209 | sstr_t c = S("hello"); |
universe@267 | 210 | |
universe@267 | 211 | /* (4) ST() macro creates sstr_t struct literal using sizeof() */ |
universe@267 | 212 | sstr_t d = ST("hello"); |
universe@267 | 213 | ``` |
universe@267 | 214 | |
universe@267 | 215 | You should not use the `S()` or `ST()` macro with string of unknown origin, |
universe@267 | 216 | since the `sizeof()` call might not coincide with the string length in those |
universe@267 | 217 | cases. If you know what you are doing, it can save you some performance, |
universe@267 | 218 | because you do not need the `strlen()` call. |
universe@267 | 219 | |
universe@267 | 220 | ### Finding the position of a substring |
universe@267 | 221 | |
universe@267 | 222 | The `sstrstr()` function gives you a new `sstr_t` object starting with the |
universe@267 | 223 | requested substring. Thus determining the position comes down to a simple |
universe@267 | 224 | subtraction. |
universe@267 | 225 | |
universe@267 | 226 | ```C |
universe@267 | 227 | sstr_t haystack = ST("Here we go!"); |
universe@267 | 228 | sstr_t needle = ST("we"); |
universe@267 | 229 | sstr_t result = sstrstr(haystack, needle); |
universe@267 | 230 | if (result.ptr) |
universe@267 | 231 | printf("Found at position %zd.\n", haystack.length-result.length); |
universe@267 | 232 | else |
universe@267 | 233 | printf("Not found.\n"); |
universe@267 | 234 | ``` |
universe@267 | 235 | |
universe@267 | 236 | ### Spliting a string by a delimiter |
universe@267 | 237 | |
universe@267 | 238 | The `sstrsplit()` function (and its allocator based version `sstrsplit_a()`) is |
universe@267 | 239 | very powerful and might look a bit nasty at a first glance. But it is indeed |
universe@267 | 240 | very simple to use. It is even more convenient in combination with a memory |
universe@267 | 241 | pool. |
universe@267 | 242 | |
universe@267 | 243 | ```C |
universe@267 | 244 | sstr_t test = ST("here::are::some::strings"); |
universe@267 | 245 | sstr_t delim = ST("::"); |
universe@267 | 246 | |
universe@267 | 247 | ssize_t count = 0; /* no limit */ |
universe@267 | 248 | UcxMempool* pool = ucx_mempool_new_default(); |
universe@267 | 249 | |
universe@267 | 250 | sstr_t* result = sstrsplit_a(pool->allocator, test, delim, &count); |
universe@267 | 251 | for (ssize_t i = 0 ; i < count ; i++) { |
universe@267 | 252 | /* don't forget to specify the length via the %*s format specifier */ |
universe@267 | 253 | printf("%*s\n", result[i].length, result[i].ptr); |
universe@267 | 254 | } |
universe@267 | 255 | |
universe@267 | 256 | ucx_mempool_destroy(pool); |
universe@267 | 257 | ``` |
universe@267 | 258 | The output is: |
universe@267 | 259 | |
universe@267 | 260 | here |
universe@267 | 261 | are |
universe@267 | 262 | some |
universe@267 | 263 | strings |
universe@267 | 264 | |
universe@267 | 265 | The memory pool ensures, that all strings are freed. |
universe@267 | 266 | |
universe@259 | 267 | <a name="test"></a> |
universe@259 | 268 | |
universe@259 | 269 | ## Testing |
universe@259 | 270 | |
universe@259 | 271 | *Header file:* [test.h](api/test_8h.html) |
universe@259 | 272 | *Required modules:* None. |
universe@259 | 273 | |
universe@259 | 274 | This module provides a testing framework which allows you to execute test cases |
universe@259 | 275 | within test suites. |
universe@259 | 276 | To avoid code duplication within tests, we also provide the possibility to |
universe@259 | 277 | define test subroutines. |
universe@259 | 278 | |
universe@259 | 279 | <a name="utils"></a> |
universe@259 | 280 | |
universe@259 | 281 | ## Utilities |
universe@259 | 282 | |
universe@259 | 283 | *Header file:* [utils.h](api/utils_8h.html) |
universe@259 | 284 | *Required modules:* [Allocator](#allocator), [String](#string) |
universe@259 | 285 | |
universe@259 | 286 | In this module we provide very general utility function for copy and compare |
universe@259 | 287 | operations. |
universe@259 | 288 | We also provide several `printf` variants to conveniently print formatted data |
universe@259 | 289 | to streams or strings. |
universe@259 | 290 |