docs/src/modules.md

Mon, 20 Nov 2017 16:10:23 +0100

author
Mike Becker <universe@uap-core.de>
date
Mon, 20 Nov 2017 16:10:23 +0100
changeset 267
f4789572c9d6
parent 264
24f5484bae97
child 277
f819fe5e20f5
permissions
-rw-r--r--

restructures documentation + adds some examples for sstr_t

universe@264 1 ---
universe@264 2 title: Modules
universe@264 3 ---
universe@259 4
universe@259 5 UCX provides several modules for data structures and algorithms.
universe@259 6 You may choose to use specific modules by inclueding the corresponding header
universe@259 7 file.
universe@259 8 Please note, that some modules make use of other UCX modules.
universe@259 9 For instance, the [Allocator](#allocator) module is used by many other modules
universe@259 10 to allow flexible memory allocation.
universe@259 11 By default the header files are placed into an `ucx` directory within your
universe@259 12 systems include directory. In this case you can use an module by including it
universe@259 13 via `#include <ucx/MODULENAME.h>`.
universe@259 14 Required modules are included automatically.
universe@259 15
universe@267 16 <div id="modules" align="center">
universe@267 17
universe@267 18 ----------------------- ---------------------- ---------------------------- -------------------------
universe@267 19 [Allocator](#allocator) [AVL&nbsp;Tree](#avl) [Buffer](#buffer) [List](#list)
universe@267 20 [Logging](#logging) [Map](#map) [Memory&nbsp;Pool](#mempool) [Properties](#properties)
universe@267 21 [Stack](#stack) [String](#string) [Testing](#test) [Utilities](#utils)
universe@267 22 ----------------------- ---------------------- ---------------------------- -------------------------
universe@267 23
universe@267 24 </div>
universe@267 25
universe@259 26 <a name="allocator"></a>
universe@259 27
universe@259 28 ## Allocator
universe@259 29
universe@259 30 *Header file:* [allocator.h](api/allocator_8h.html)
universe@259 31 *Required modules:* None.
universe@259 32
universe@259 33 A UCX allocator consists of a pointer to the memory area / pool and four
universe@259 34 function pointers to memory management functions operating on this memory
universe@259 35 area / pool. These functions shall behave equivalent to the standard libc
universe@259 36 functions `malloc`, `calloc`, `realloc` and `free`.
universe@259 37
universe@259 38 The signature of the memory management functions is based on the signature
universe@259 39 of the respective libc function but each of them takes the pointer to the
universe@259 40 memory area / pool as first argument.
universe@259 41
universe@259 42 As the pointer to the memory area / pool can be arbitrarily chosen, any data
universe@259 43 can be provided to the memory management functions. One example is the
universe@259 44 [UCX Memory Pool](#mempool).
universe@259 45
universe@259 46 <a name="avl"></a>
universe@259 47
universe@259 48 ## AVL Tree
universe@259 49
universe@259 50 *Header file:* [avl.h](api/avl_8h.html)
universe@259 51 *Required modules:* [Allocator](#allocator)
universe@259 52
universe@259 53 This binary search tree implementation allows average O(1) insertion and
universe@259 54 removal of elements (excluding binary search time).
universe@259 55 All common binary tree operations are implemented. Furthermore, this module
universe@259 56 provides search functions via lower and upper bounds.
universe@259 57
universe@259 58 <a name="buffer"></a>
universe@259 59
universe@259 60 ## Buffer
universe@259 61
universe@259 62 *Header file:* [buffer.h](api/buffer_8h.html)
universe@259 63 *Required modules:* None.
universe@259 64
universe@259 65 Instances of this buffer implementation can be used to read from or to write to
universe@259 66 memory like you would do with a stream. This allows the use of
universe@259 67 `ucx_stream_copy` from the [Utilities](#utils) module to copy contents from one
universe@259 68 buffer to another or from file or network streams to the buffer and
universe@259 69 vice-versa.
universe@259 70
universe@259 71 More features for convenient use of the buffer can be enabled, like automatic
universe@259 72 memory management and automatic resizing of the buffer space.
universe@259 73 See the documentation of the macro constants in the header file for more
universe@259 74 information.
universe@259 75
universe@259 76 <a name="list"></a>
universe@259 77
universe@259 78 ## List
universe@259 79
universe@259 80 *Header file:* [list.h](api/list_8h.html)
universe@259 81 *Required modules:* [Allocator](#allocator)
universe@259 82
universe@259 83 This module provides the data structure and several functions for a doubly
universe@259 84 linked list. Among the common operations like insert, remove, search and sort,
universe@259 85 we allow convenient iteration via a special `UCX_FOREACH` macro.
universe@259 86
universe@259 87 <a name="logging"></a>
universe@259 88
universe@259 89 ## Logging
universe@259 90
universe@259 91 *Header file:* [logging.h](api/logging_8h.html)
universe@259 92 *Required modules:* [Map](#map), [String](#string)
universe@259 93
universe@259 94 The logging module comes with some predefined log levels and allows some more
universe@259 95 customization. You may choose if you want to get timestamps or source file and
universe@259 96 line number logged automatically when outputting a message.
universe@259 97
universe@259 98
universe@259 99 <a name="map"></a>
universe@259 100
universe@259 101 ## Map
universe@259 102
universe@259 103 *Header file:* [map.h](api/map_8h.html)
universe@259 104 *Required modules:* [Allocator](#allocator), [String](#string)
universe@259 105
universe@259 106 This module provides a hash map implementation using murmur hash 2 and separate
universe@259 107 chaining with linked lists. Similarly to the list module, we provide a
universe@259 108 `UCX_MAP_FOREACH` macro to conveniently iterate through the key/value pairs.
universe@259 109
universe@259 110 <a name="mempool"></a>
universe@259 111
universe@259 112 ## Memory Pool
universe@259 113
universe@259 114 *Header file:* [mempool.h](api/mempool_8h.html)
universe@259 115 *Required modules:* [Allocator](#allocator)
universe@259 116
universe@259 117 Here we have a concrete allocator implementation in the sense of a memory pool.
universe@259 118 This pool allows you to register destructor functions for the allocated memory,
universe@259 119 which are automatically called on the destruction of the pool.
universe@259 120 But you may also register *independent* destructor functions within a pool in
universe@259 121 case, some external library allocated memory for you, which you wish to be
universe@259 122 destroyed together with this pool.
universe@259 123
universe@259 124 <a name="properties"></a>
universe@259 125
universe@259 126 ## Properties
universe@259 127
universe@259 128 *Header file:* [properties.h](api/properties_8h.html)
universe@259 129 *Required modules:* [Map](#map)
universe@259 130
universe@259 131 This module provides load and store function for `*.properties` files.
universe@259 132 The key/value pairs are stored within an UCX Map.
universe@259 133
universe@259 134 <a name="stack"></a>
universe@259 135
universe@259 136 ## Stack
universe@259 137
universe@259 138 *Header file:* [stack.h](api/stack_8h.html)
universe@259 139 *Required modules:* [Allocator](#allocator)
universe@259 140
universe@259 141 This concrete implementation of an UCX Allocator allows you to grab some amount
universe@259 142 of memory which is then handled as a stack.
universe@259 143 Please note, that the term *stack* only refers to the behavior of this
universe@259 144 allocator. You may still choose if you want to use stack or heap memory
universe@259 145 for the underlying space.
universe@259 146
universe@259 147 A typical use case is an algorithm where you need to allocate and free large
universe@259 148 amounts of memory very frequently.
universe@259 149
universe@259 150 <a name="string"></a>
universe@259 151
universe@259 152 ## String
universe@259 153
universe@259 154 *Header file:* [string.h](api/string_8h.html)
universe@259 155 *Required modules:* [Allocator](#allocator)
universe@259 156
universe@259 157 This module provides a safe implementation of bounded string.
universe@259 158 Usually C strings do not carry a length. While for zero-terminated strings you
universe@259 159 can easily get the length with `strlen`, this is not generally possible for
universe@259 160 arbitrary strings.
universe@259 161 The `sstr_t` type of this module always carries the string and its length to
universe@259 162 reduce the risk of buffer overflows dramatically.
universe@259 163
universe@267 164 ### Initialization
universe@267 165
universe@267 166 There are several ways to create an `sstr_t`:
universe@267 167
universe@267 168 ```C
universe@267 169 /* (1) sstr() uses strlen() internally, hence cstr MUST be zero-terminated */
universe@267 170 sstr_t a = sstr(cstr);
universe@267 171
universe@267 172 /* (2) cstr does not need to be zero-terminated, if length is specified */
universe@267 173 sstr_t b = sstrn(cstr, len);
universe@267 174
universe@267 175 /* (3) S() macro creates sstr_t from a string using sizeof() and using sstrn().
universe@267 176 This version is especially useful for function arguments */
universe@267 177 sstr_t c = S("hello");
universe@267 178
universe@267 179 /* (4) ST() macro creates sstr_t struct literal using sizeof() */
universe@267 180 sstr_t d = ST("hello");
universe@267 181 ```
universe@267 182
universe@267 183 You should not use the `S()` or `ST()` macro with string of unknown origin,
universe@267 184 since the `sizeof()` call might not coincide with the string length in those
universe@267 185 cases. If you know what you are doing, it can save you some performance,
universe@267 186 because you do not need the `strlen()` call.
universe@267 187
universe@267 188 ### Finding the position of a substring
universe@267 189
universe@267 190 The `sstrstr()` function gives you a new `sstr_t` object starting with the
universe@267 191 requested substring. Thus determining the position comes down to a simple
universe@267 192 subtraction.
universe@267 193
universe@267 194 ```C
universe@267 195 sstr_t haystack = ST("Here we go!");
universe@267 196 sstr_t needle = ST("we");
universe@267 197 sstr_t result = sstrstr(haystack, needle);
universe@267 198 if (result.ptr)
universe@267 199 printf("Found at position %zd.\n", haystack.length-result.length);
universe@267 200 else
universe@267 201 printf("Not found.\n");
universe@267 202 ```
universe@267 203
universe@267 204 ### Spliting a string by a delimiter
universe@267 205
universe@267 206 The `sstrsplit()` function (and its allocator based version `sstrsplit_a()`) is
universe@267 207 very powerful and might look a bit nasty at a first glance. But it is indeed
universe@267 208 very simple to use. It is even more convenient in combination with a memory
universe@267 209 pool.
universe@267 210
universe@267 211 ```C
universe@267 212 sstr_t test = ST("here::are::some::strings");
universe@267 213 sstr_t delim = ST("::");
universe@267 214
universe@267 215 ssize_t count = 0; /* no limit */
universe@267 216 UcxMempool* pool = ucx_mempool_new_default();
universe@267 217
universe@267 218 sstr_t* result = sstrsplit_a(pool->allocator, test, delim, &count);
universe@267 219 for (ssize_t i = 0 ; i < count ; i++) {
universe@267 220 /* don't forget to specify the length via the %*s format specifier */
universe@267 221 printf("%*s\n", result[i].length, result[i].ptr);
universe@267 222 }
universe@267 223
universe@267 224 ucx_mempool_destroy(pool);
universe@267 225 ```
universe@267 226 The output is:
universe@267 227
universe@267 228 here
universe@267 229 are
universe@267 230 some
universe@267 231 strings
universe@267 232
universe@267 233 The memory pool ensures, that all strings are freed.
universe@267 234
universe@259 235 <a name="test"></a>
universe@259 236
universe@259 237 ## Testing
universe@259 238
universe@259 239 *Header file:* [test.h](api/test_8h.html)
universe@259 240 *Required modules:* None.
universe@259 241
universe@259 242 This module provides a testing framework which allows you to execute test cases
universe@259 243 within test suites.
universe@259 244 To avoid code duplication within tests, we also provide the possibility to
universe@259 245 define test subroutines.
universe@259 246
universe@259 247 <a name="utils"></a>
universe@259 248
universe@259 249 ## Utilities
universe@259 250
universe@259 251 *Header file:* [utils.h](api/utils_8h.html)
universe@259 252 *Required modules:* [Allocator](#allocator), [String](#string)
universe@259 253
universe@259 254 In this module we provide very general utility function for copy and compare
universe@259 255 operations.
universe@259 256 We also provide several `printf` variants to conveniently print formatted data
universe@259 257 to streams or strings.
universe@259 258

mercurial