1strbuf API 2========== 3 4strbuf's are meant to be used with all the usual C string and memory 5APIs. Given that the length of the buffer is known, it's often better to 6use the mem* functions than a str* one (memchr vs. strchr e.g.). 7Though, one has to be careful about the fact that str* functions often 8stop on NULs and that strbufs may have embedded NULs. 9 10An strbuf is NUL terminated for convenience, but no function in the 11strbuf API actually relies on the string being free of NULs. 12 13strbufs has some invariants that are very important to keep in mind: 14 15. The `buf` member is never NULL, so it can be used in any usual C 16string operations safely. strbuf's _have_ to be initialized either by 17`strbuf_init()` or by `= STRBUF_INIT` before the invariants, though. 18+ 19Do *not* assume anything on what `buf` really is (e.g. if it is 20allocated memory or not), use `strbuf_detach()` to unwrap a memory 21buffer from its strbuf shell in a safe way. That is the sole supported 22way. This will give you a malloced buffer that you can later `free()`. 23+ 24However, it is totally safe to modify anything in the string pointed by 25the `buf` member, between the indices `0` and `len-1` (inclusive). 26 27. The `buf` member is a byte array that has at least `len + 1` bytes 28 allocated. The extra byte is used to store a `'\0'`, allowing the 29 `buf` member to be a valid C-string. Every strbuf function ensure this 30 invariant is preserved. 31+ 32NOTE: It is OK to "play" with the buffer directly if you work it this 33 way: 34+ 35---- 36strbuf_grow(sb, SOME_SIZE); <1> 37strbuf_setlen(sb, sb->len + SOME_OTHER_SIZE); 38---- 39<1> Here, the memory array starting at `sb->buf`, and of length 40`strbuf_avail(sb)` is all yours, and you can be sure that 41`strbuf_avail(sb)` is at least `SOME_SIZE`. 42+ 43NOTE: `SOME_OTHER_SIZE` must be smaller or equal to `strbuf_avail(sb)`. 44+ 45Doing so is safe, though if it has to be done in many places, adding the 46missing API to the strbuf module is the way to go. 47+ 48WARNING: Do _not_ assume that the area that is yours is of size `alloc 49- 1` even if it's true in the current implementation. Alloc is somehow a 50"private" member that should not be messed with. Use `strbuf_avail()` 51instead. 52 53Data structures 54--------------- 55 56* `struct strbuf` 57 58This is the string buffer structure. The `len` member can be used to 59determine the current length of the string, and `buf` member provides access to 60the string itself. 61 62Functions 63--------- 64 65* Life cycle 66 67`strbuf_init`:: 68 69 Initialize the structure. The second parameter can be zero or a bigger 70 number to allocate memory, in case you want to prevent further reallocs. 71 72`strbuf_release`:: 73 74 Release a string buffer and the memory it used. You should not use the 75 string buffer after using this function, unless you initialize it again. 76 77`strbuf_detach`:: 78 79 Detach the string from the strbuf and returns it; you now own the 80 storage the string occupies and it is your responsibility from then on 81 to release it with `free(3)` when you are done with it. 82 83`strbuf_attach`:: 84 85 Attach a string to a buffer. You should specify the string to attach, 86 the current length of the string and the amount of allocated memory. 87 The amount must be larger than the string length, because the string you 88 pass is supposed to be a NUL-terminated string. This string _must_ be 89 malloc()ed, and after attaching, the pointer cannot be relied upon 90 anymore, and neither be free()d directly. 91 92`strbuf_swap`:: 93 94 Swap the contents of two string buffers. 95 96* Related to the size of the buffer 97 98`strbuf_avail`:: 99 100 Determine the amount of allocated but unused memory. 101 102`strbuf_grow`:: 103 104 Ensure that at least this amount of unused memory is available after 105 `len`. This is used when you know a typical size for what you will add 106 and want to avoid repetitive automatic resizing of the underlying buffer. 107 This is never a needed operation, but can be critical for performance in 108 some cases. 109 110`strbuf_setlen`:: 111 112 Set the length of the buffer to a given value. This function does *not* 113 allocate new memory, so you should not perform a `strbuf_setlen()` to a 114 length that is larger than `len + strbuf_avail()`. `strbuf_setlen()` is 115 just meant as a 'please fix invariants from this strbuf I just messed 116 with'. 117 118`strbuf_reset`:: 119 120 Empty the buffer by setting the size of it to zero. 121 122* Related to the contents of the buffer 123 124`strbuf_rtrim`:: 125 126 Strip whitespace from the end of a string. 127 128`strbuf_reencode`:: 129 130 Replace the contents of the strbuf with a reencoded form. Returns -1 131 on error, 0 on success. 132 133`strbuf_cmp`:: 134 135 Compare two buffers. Returns an integer less than, equal to, or greater 136 than zero if the first buffer is found, respectively, to be less than, 137 to match, or be greater than the second buffer. 138 139* Adding data to the buffer 140 141NOTE: All of the functions in this section will grow the buffer as necessary. 142If they fail for some reason other than memory shortage and the buffer hadn't 143been allocated before (i.e. the `struct strbuf` was set to `STRBUF_INIT`), 144then they will free() it. 145 146`strbuf_addch`:: 147 148 Add a single character to the buffer. 149 150`strbuf_insert`:: 151 152 Insert data to the given position of the buffer. The remaining contents 153 will be shifted, not overwritten. 154 155`strbuf_remove`:: 156 157 Remove given amount of data from a given position of the buffer. 158 159`strbuf_splice`:: 160 161 Remove the bytes between `pos..pos+len` and replace it with the given 162 data. 163 164`strbuf_add_commented_lines`:: 165 166 Add a NUL-terminated string to the buffer. Each line will be prepended 167 by a comment character and a blank. 168 169`strbuf_add`:: 170 171 Add data of given length to the buffer. 172 173`strbuf_addstr`:: 174 175Add a NUL-terminated string to the buffer. 176+ 177NOTE: This function will *always* be implemented as an inline or a macro 178that expands to: 179+ 180---- 181strbuf_add(..., s, strlen(s)); 182---- 183+ 184Meaning that this is efficient to write things like: 185+ 186---- 187strbuf_addstr(sb, "immediate string"); 188---- 189 190`strbuf_addbuf`:: 191 192 Copy the contents of an other buffer at the end of the current one. 193 194`strbuf_adddup`:: 195 196 Copy part of the buffer from a given position till a given length to the 197 end of the buffer. 198 199`strbuf_expand`:: 200 201 This function can be used to expand a format string containing 202 placeholders. To that end, it parses the string and calls the specified 203 function for every percent sign found. 204+ 205The callback function is given a pointer to the character after the `%` 206and a pointer to the struct strbuf. It is expected to add the expanded 207version of the placeholder to the strbuf, e.g. to add a newline 208character if the letter `n` appears after a `%`. The function returns 209the length of the placeholder recognized and `strbuf_expand()` skips 210over it. 211+ 212The format `%%` is automatically expanded to a single `%` as a quoting 213mechanism; callers do not need to handle the `%` placeholder themselves, 214and the callback function will not be invoked for this placeholder. 215+ 216All other characters (non-percent and not skipped ones) are copied 217verbatim to the strbuf. If the callback returned zero, meaning that the 218placeholder is unknown, then the percent sign is copied, too. 219+ 220In order to facilitate caching and to make it possible to give 221parameters to the callback, `strbuf_expand()` passes a context pointer, 222which can be used by the programmer of the callback as she sees fit. 223 224`strbuf_expand_dict_cb`:: 225 226 Used as callback for `strbuf_expand()`, expects an array of 227 struct strbuf_expand_dict_entry as context, i.e. pairs of 228 placeholder and replacement string. The array needs to be 229 terminated by an entry with placeholder set to NULL. 230 231`strbuf_addbuf_percentquote`:: 232 233 Append the contents of one strbuf to another, quoting any 234 percent signs ("%") into double-percents ("%%") in the 235 destination. This is useful for literal data to be fed to either 236 strbuf_expand or to the *printf family of functions. 237 238`strbuf_humanise_bytes`:: 239 240 Append the given byte size as a human-readable string (i.e. 12.23 KiB, 241 3.50 MiB). 242 243`strbuf_addf`:: 244 245 Add a formatted string to the buffer. 246 247`strbuf_commented_addf`:: 248 249 Add a formatted string prepended by a comment character and a 250 blank to the buffer. 251 252`strbuf_fread`:: 253 254 Read a given size of data from a FILE* pointer to the buffer. 255+ 256NOTE: The buffer is rewound if the read fails. If -1 is returned, 257`errno` must be consulted, like you would do for `read(3)`. 258`strbuf_read()`, `strbuf_read_file()` and `strbuf_getline()` has the 259same behaviour as well. 260 261`strbuf_read`:: 262 263 Read the contents of a given file descriptor. The third argument can be 264 used to give a hint about the file size, to avoid reallocs. 265 266`strbuf_read_file`:: 267 268 Read the contents of a file, specified by its path. The third argument 269 can be used to give a hint about the file size, to avoid reallocs. 270 271`strbuf_readlink`:: 272 273 Read the target of a symbolic link, specified by its path. The third 274 argument can be used to give a hint about the size, to avoid reallocs. 275 276`strbuf_getline`:: 277 278 Read a line from a FILE *, overwriting the existing contents 279 of the strbuf. The second argument specifies the line 280 terminator character, typically `'\n'`. 281 Reading stops after the terminator or at EOF. The terminator 282 is removed from the buffer before returning. Returns 0 unless 283 there was nothing left before EOF, in which case it returns `EOF`. 284 285`strbuf_getwholeline`:: 286 287 Like `strbuf_getline`, but keeps the trailing terminator (if 288 any) in the buffer. 289 290`strbuf_getwholeline_fd`:: 291 292 Like `strbuf_getwholeline`, but operates on a file descriptor. 293 It reads one character at a time, so it is very slow. Do not 294 use it unless you need the correct position in the file 295 descriptor. 296 297`stripspace`:: 298 299 Strip whitespace from a buffer. The second parameter controls if 300 comments are considered contents to be removed or not. 301 302`strbuf_split_buf`:: 303`strbuf_split_str`:: 304`strbuf_split_max`:: 305`strbuf_split`:: 306 307 Split a string or strbuf into a list of strbufs at a specified 308 terminator character. The returned substrings include the 309 terminator characters. Some of these functions take a `max` 310 parameter, which, if positive, limits the output to that 311 number of substrings. 312 313`strbuf_list_free`:: 314 315 Free a list of strbufs (for example, the return values of the 316 `strbuf_split()` functions). 317 318`launch_editor`:: 319 320 Launch the user preferred editor to edit a file and fill the buffer 321 with the file's contents upon the user completing their editing. The 322 third argument can be used to set the environment which the editor is 323 run in. If the buffer is NULL the editor is launched as usual but the 324 file's contents are not read into the buffer upon completion.