100 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
andrew	c44b0262bc	Merge pull request 'schemagen: reject absent additionalProperties' (#58) from weaselbot/weaseljson:weaselbot/issue-55 into main ... Reviewed-on: #58	2026-07-20 18:06:53 +00:00
andrew	814b24efba	Merge pull request 'Fix schemagen integer parser rejecting zero with negative exponents' (#57) from weaselbot/weaseljson:weaselbot/issue-56 into main ... Reviewed-on: #57	2026-07-20 18:00:36 +00:00
andrew	16f5d3cd9d	Merge pull request 'Handle null parser in WeaselJsonParser_parse' (#54) from null-parser into main ... Reviewed-on: #54	2026-07-15 22:03:59 +00:00
andrew	6beb538b61	Add missing status enum to weaseljson.py	2026-07-15 17:55:22 -04:00
andrew	6520039dc2	Address review feedback	2026-07-15 14:12:41 -04:00
andrew	93203b14f5	Add missing unlikely annotation	2026-07-15 12:31:17 -04:00
andrew	09c0fb72ca	Handle null parser in WeaselJsonParser_parse ... Closes #51	2026-07-15 12:31:09 -04:00
andrew	70bb33eeaf	Merge pull request 'make WeaselJson_OVERFLOW a terminal state like WeaselJson_REJECT' (#53) from weaselbot/weaseljson:weaselbot/issue-52 into main ... Reviewed-on: #53	2026-07-13 20:58:14 +00:00
andrew	42d37d1fd7	Don't list all terminal statuses for weaseljson ... Also simplifies codegen slightly presumably. OK and AGAIN should be the only non-terminal statuses ever.	2026-07-13 16:49:16 -04:00
andrew	f5ceb392c2	Merge pull request 'schemagen: add regression test for nullable cyclic $ref targets' (#50) from weaselbot/weaseljson:weaselbot/issue-14 into main ... Reviewed-on: #50	2026-06-30 16:50:07 +00:00
andrew	d281c35811	Merge pull request 'schemagen: reject self-referential array $ref cycles instead of crashing' (#49) from weaselbot/weaseljson:weaselbot/issue-33 into main ... Reviewed-on: #49	2026-06-30 16:37:02 +00:00
andrew	f6617a1558	Merge pull request 'schemagen: escape control characters in generated C++ string literals' (#48) from weaselbot/weaseljson:weaselbot/issue-35 into main ... Reviewed-on: #48	2026-06-30 16:30:21 +00:00
andrew	e22bc039ae	Merge pull request 'schemagen: fix quadratic leading-zero strip in integer fallback' (#47) from weaselbot/weaseljson:weaselbot/issue-34 into main ... Reviewed-on: #47	2026-06-30 16:16:44 +00:00
andrew	241c29073b	Merge pull request 'schemagen: handle WeaselJsonParser_create failure in RootBuilder' (#46) from weaselbot/weaseljson:weaselbot/issue-36 into main ... Reviewed-on: #46	2026-06-30 15:35:20 +00:00
andrew	4bd1088018	Merge pull request 'Include <cstdint> in json_value.h for uint8_t' (#45) from weaselbot/weaseljson:weaselbot/issue-37 into main ... Reviewed-on: #45	2026-06-29 18:57:40 +00:00
andrew	82bdc8a080	Merge pull request 'python: raise OSError when shared library is missing' (#44) from weaselbot/weaseljson:weaselbot/issue-38 into main ... Reviewed-on: #44	2026-06-29 18:53:49 +00:00
andrew	6508616edc	Merge pull request 'Handle null parser in WeaselJsonParser_reset and _destroy' (#42) from weaselbot/weaseljson:weaselbot/issue-41 into main ... Reviewed-on: #42	2026-06-29 18:26:48 +00:00
andrew	08b864d31b	Reject invalid UTF-16 surrogate pairs and lone low surrogates for clarity ... The string unescape logic treated any code unit in the surrogate range (0xD800-0xDFFF) as the start of a surrogate pair. The concrete example from issue #39 (\uDC00\uDC00) was already rejected by the existing 0x10FFFF bounds check, but the check was misleading and would accept a lone low surrogate as a regular BMP code point if the second surrogate happened to be in a narrower range. Clean this up so the intent is obvious. Changes in src/parser3.h: - Fast path (n_string2): only treat high surrogates (0xD800-0xDBFF) as the start of a surrogate pair, and explicitly reject lone low surrogates (0xDC00-0xDFFF). - Slow path (t_hex2): same high-surrogate check, with explicit rejection of lone low surrogates. The t_hex3 path already validates that the second code unit is a low surrogate (0xDC00-0xDFFF), so no change is needed there. Also commit the current fuzzer corpus. Closes #39	2026-06-29 13:37:58 -04:00
andrew	4ce2002663	Merge pull request 'schemagen: reject scalar root values when root schema is object/array' (#32) from weaselbot/weaseljson:weaselbot/issue-16 into main ... Reviewed-on: #32	2026-06-24 19:34:06 +00:00
andrew	e5cbaac401	Merge pull request 'schemagen: cache non-object $defs entries to avoid duplicate types' (#31) from weaselbot/weaseljson:weaselbot/issue-17 into main ... Reviewed-on: #31	2026-06-24 17:02:38 +00:00
andrew	1404ebdfbd	Merge pull request 'fix schemagen integer parsing boundary bugs' (#30) from weaselbot/weaseljson:weaselbot/issue-19 into main ... Reviewed-on: #30	2026-06-24 00:40:09 +00:00
andrew	ceb4bc1041	Merge pull request 'schemagen: drop support for additionalProperties: true' (#28) from weaselbot/weaseljson:weaselbot/issue-20 into main ... Reviewed-on: #28	2026-06-23 20:56:58 +00:00
andrew	e8830e27e9	Merge pull request 'schemagen: reserve generated Root/Skip/RootScalar and avoid Kind/ArrN collisions' (#27) from weaselbot/weaseljson:weaselbot/issue-21 into main ... Reviewed-on: #27	2026-06-23 17:48:57 +00:00
andrew	5427db4b3d	Merge pull request 'schemagen: fix nullable root types (#13)' (#29) from weaselbot/weaseljson:weaselbot/issue-13 into main ... Reviewed-on: #29	2026-06-23 17:43:19 +00:00
andrew	8d37b9b602	Merge pull request 'Reject negative lengths in WeaselJsonParser_parse' (#25) from weaselbot/weaseljson:weaselbot/issue-24 into main ... Reviewed-on: #25	2026-06-22 18:53:20 +00:00
andrew	3d7dc97471	Merge pull request 'check WeaselJsonParser_create return value in Python bindings' (#26) from weaselbot/weaseljson:weaselbot/issue-23 into main ... Reviewed-on: #26	2026-06-22 18:52:46 +00:00
andrew	5e18347e35	Merge pull request 'schemagen: add C++20 keywords to the C++ keyword allow-list' (#22) from weaselbot/weaseljson:weaselbot/issue-18 into main ... Reviewed-on: #22	2026-06-22 00:54:04 +00:00
andrew	05185eb3ee	Merge pull request 'Make parser reject state sticky after WeaselJson_REJECT' (#15) from weaselbot/weaseljson:weaselbot/issue-12 into main ... Reviewed-on: #15	2026-06-19 17:17:10 +00:00
andrew	b641489a59	Merge pull request 'schemagen: support objects with >32 properties' (#9) from weaselbot/weaseljson:weaselbot/issue-3 into main ... Reviewed-on: #9	2026-06-18 22:23:52 +00:00
andrew	7c1c18fe6f	Merge pull request 'Reset transient parser state in Parser3::reset' (#10) from weaselbot/weaseljson:weaselbot/issue-2 into main ... Reviewed-on: #10	2026-06-18 20:09:32 +00:00
andrew	3d9772357d	Merge pull request 'schemagen: keep null elements in arrays with nullable item types' (#8) from weaselbot/weaseljson:weaselbot/issue-5 into main ... Reviewed-on: #8	2026-06-18 20:07:48 +00:00
andrew	644d244990	Merge pull request 'schemagen: deduplicate enum constants that collide after sanitization' (#11) from weaselbot/weaseljson:weaselbot/issue-4 into main ... Reviewed-on: #11	2026-06-18 20:01:08 +00:00
andrew	db759a9333	schemagen: accept integral exponent/decimal numbers for integer slots ... JSON Schema's 'integer' type matches any number with a zero fractional part, but the generated builder rejected forms like 1e3 or 2.0 because it only ran std::from_chars<int64_t>. Keep that exact path for plain integer literals (so large values near INT64_MAX stay exact), and fall back to parsing as double for the rest, requiring an integral value within int64 range. Add <cmath> for std::trunc and cover the new cases in test_gen.	2026-06-15 00:57:30 -04:00
andrew	4301351042	Fix stack overflow in no-musttail fallback for direct continuations ... The no-musttail trampoline (063872e) only rerouted keepGoing dispatch. Continuations that tail-call each other directly still recursed on the C stack when MUSTTAIL is a no-op, so deep input overflowed it -- nested arrays via n_value <-> n_array2, and runs of string escapes via n_string2 -> n_string2 (the latter isn't even bounded by stackSize). Add a TAILCALL(fn) macro: a direct musttail tail call when available, otherwise a bounce to the parse() trampoline (which re-dispatches continuations[top()] == fn, valid because fn's symbol is already on top of the stack at every site). Route the 10 direct continuation tail calls through it. The musttail build is unchanged; the fallback no longer recurses without bound.	2026-06-15 00:53:50 -04:00
andrew	4bb13a23ff	Bigger symbol stack so actual stack might overflow	2026-06-15 00:47:19 -04:00
andrew	8a1a922353	Add more coverage ... Collected in trampoline fallback mode	2026-06-15 00:45:17 -04:00
andrew	ceaadfb750	Add deep nested-array fuzz seed ... Seeds the n_value<->n_array2 recursion that overflows the C stack in the no-musttail fallback build (a good mutation seed once stackSize is raised past the harness default of 1024).	2026-06-15 00:42:45 -04:00
andrew	8191df404d	Return int (not WeaselJsonStatus) from internal continuations ... The no-musttail trampoline used WeaselJsonStatus(-1) as a re-dispatch sentinel, but WeaselJsonStatus has no fixed underlying type, so its valid range is only [0,3]; forming -1 is undefined behavior in C++. A compiler may assume the value is in range (e.g. -fstrict-enums) and fold the trampoline's '== WeaselJsonStatus(-1)' check to false, breaking the loop. Introduce an internal 'using ContinuationStatus = int' (a WeaselJsonStatus value, or kBounce) for the Continuation typedef, every continuation/helper function, and keepGoing. parse() converts back to WeaselJsonStatus only at the public boundary, where the value is always 0..3. The public enum is unchanged, so C consumers are unaffected.	2026-06-15 00:34:29 -04:00
andrew	b3dac03f70	Reject too-small stackSize in WeaselJsonParser_create ... A stackSize smaller than the bootstrap symbols pushed by reset() (or a negative one) left the parser with an empty stack: reset() swallowed the push() overflow via std::ignore, and the first parse() then read past the empty stack (top() dereferences *(stackPtr-1)), crashing. Detect this in create() by checking empty() after construction and returning null, and guard against negative stackSize wrapping the allocation size. Also fix an incremental-build bug: the ld -r bundle step only had an order-only dependency on the object library under Ninja, so editing lib.cpp rebuilt the object but never relinked the libraries. Add the object files to DEPENDS so the bundle (and the .so/.a) rebuild on change.	2026-06-15 00:06:03 -04:00
andrew	dfcac64330	Add JSON Schema -> C++ streaming parser generator ... Generates a C++ type and a streaming builder parser from a JSON Schema, built on weaseljson. The builder copies incoming bytes directly into their final destinations in the result struct (no intermediate DOM) and hands back ownership via take() once parsing completes. Supports objects/structs, required vs optional (std::optional) fields, nullable types, string enums, arrays, $ref including recursion (broken with unique_ptr), and additionalProperties (strict reject or skip). Unsupported schema constructs are rejected at generation time; schema violations are rejected at parse time.	2026-06-14 23:46:15 -04:00
andrew	ca6f69424f	Run fuzz corpus from ctest	2026-06-14 23:34:15 -04:00
andrew	46408fd56f	Add a fallback fuzz binary if libfuzzer not available	2026-06-14 23:30:42 -04:00
andrew	063872ed3c	Fix potential stack overflow for no musttail ... Closes #1	2026-06-14 23:29:31 -04:00
andrew	b76f47abf7	Set cmake_minimum_required to 3.10	2026-06-14 22:43:12 -04:00
andrew	2a52162d7f	Add stack chk symbols to aarch64 imports	2026-06-14 20:47:28 -04:00
andrew	e8f51eff53	Guard --nobranchprotection behind a version check ... Older versions of hardening-check (as shipped by some Ubuntu releases) don't support --nobranchprotection and error out. Probe --help at configure time and only add the flag when it's available; old versions that lack the flag also don't check for branch protection, so omitting it is safe.	2026-06-14 20:34:29 -04:00
andrew	9ea798dba4	Fix aarch64 multi-byte UTF-8 parsing and add symbol imports file ... On aarch64, char is unsigned by default, so *buf < 0x20 never held for bytes >= 0x80, causing strDfa.scan to be skipped for multi-byte UTF-8 sequences in batch mode. Cast to int8_t to get the same signed comparison used by the SIMD path. Also add aarch64-symbol-imports.txt with the GLIBC 2.17 versioned symbols imported by the library on that platform.	2026-06-14 19:42:41 -04:00
andrew	12c976a62c	Fix make build by depending on target name instead of TARGET_OBJECTS in custom command ... The Makefile generator does not create a rule for individual object files when $<TARGET_OBJECTS:...> is used in DEPENDS of add_custom_command. Depending on the target name instead establishes a proper target-level dependency.	2026-06-14 19:28:47 -04:00
andrew	b079b293f7	Include <cstdlib> for malloc and free in lib.cpp	2026-06-14 19:22:32 -04:00
andrew	d48fe618ac	Add CI	2026-06-14 19:18:31 -04:00
andrew	470564a5df	Improve coverage	2026-06-14 18:03:30 -04:00
andrew	b9142bf36a	Avoid some unnecessary string destruction in bench	2026-06-14 17:53:29 -04:00
andrew	97f1d3d352	Skip string and go directly to string2 from object3	2026-06-14 17:16:45 -04:00
andrew	d8c9491eb3	Add fuzz test that finds previously missed coverage	2026-06-14 16:50:36 -04:00
andrew	b4144298bb	Update doctest.h to 2.5.2	2026-06-14 16:35:53 -04:00
andrew	b894ae7a80	Fix arch-specific hardening_check ignore flags ... hardening-check tests both CET (x86-only) and branch protection (arm64-only). Pass the ignore flag for whichever doesn't apply to the build arch so the test passes on all supported architectures.	2026-06-14 16:31:08 -04:00
andrew	eb9925ffec	Only pass -pie when linking executables ... Passing -pie globally made the driver link Scrt1.o into shared libraries, which fails with an undefined reference to main.	2026-06-14 16:20:48 -04:00
andrew	995ddf329f	Fixes for gcc 15	2025-11-06 12:49:38 -05:00
andrew	5fc823b392	This didn't belong here and isn't really necessary	2025-08-25 16:50:43 -04:00
andrew	490b49e55d	Remove redundancy	2025-08-25 16:49:21 -04:00
andrew	6fc263074e	Simplify flowchart	2025-08-25 16:46:46 -04:00
andrew	befb464619	More README tinkers	2025-08-25 16:39:01 -04:00
andrew	f2bb72b3dc	More clarifications in README	2025-08-25 16:19:34 -04:00
andrew	81814fa590	Simplify flow chart	2025-08-25 16:00:58 -04:00
andrew	611bccfb9b	Update README	2025-08-25 15:57:07 -04:00
andrew	e8d2855b36	Add maintainer notice	2025-08-25 15:43:37 -04:00
andrew	1f540a436a	Tailor readme to prospective users	2025-08-25 15:34:29 -04:00
andrew	c303478ad7	Avoid Utf8Dfa scan if there's no non-ascii	2025-08-15 19:45:00 -04:00
andrew	0b24636c4f	Update corpus	2025-08-04 14:42:50 -04:00
andrew	bcb5a20f27	Distinguish on_string_data and on_key_data	2025-08-04 14:15:49 -04:00
andrew	39fe9be4dc	Clarify header comments	2025-08-04 12:44:00 -04:00
andrew	7801dbe6d7	Add missing files	2025-08-04 12:43:45 -04:00
andrew	0ed07e454a	Merge remote-tracking branch 'origin/flags'	2025-08-04 12:36:20 -04:00
andrew	18a66009e1	Clarify memory usage comment in readme	2025-08-04 12:35:48 -04:00
andrew	6e244d1318	Add packaging and symbol visibility tests ... Only tested on x86 linux so far	2025-08-04 12:35:26 -04:00
andrew	9e4f90f218	Add WeaselJsonRaw flag	2025-06-25 18:44:37 -04:00
andrew	3e72181bee	Add flags argument to WeaselJsonParser_create	2025-06-25 16:44:31 -04:00
andrew	01d81981f7	Fix arm build	2025-06-25 11:55:19 -04:00
andrew	89211753e2	Add to corpus	2025-06-24 15:58:58 -04:00
andrew	2e803b5a76	Fix bogus assert. 0x10ffff is a valid code point	2025-06-24 15:48:16 -04:00
andrew	a8aab0187e	Add some comments	2025-06-24 15:10:01 -04:00
andrew	63a1be497b	Remove unused table ... It was making it into the shared object somehow	2025-06-24 15:09:21 -04:00
andrew	7470c69845	Ignore error in some places where push can't fail	2025-06-24 14:57:27 -04:00
andrew	c2f5d6983a	Store stackEnd instead of stackSize	2025-06-24 14:57:11 -04:00
andrew	575b6e5c62	Direct call to next continuation in some cases	2025-06-24 14:46:20 -04:00
andrew	67e63dc611	Multiply stackSize by sizeof stack element	2025-06-24 13:33:39 -04:00
andrew	9319076b44	Remove Parser3::complete	2025-06-24 13:15:39 -04:00
andrew	d1de15a0ca	Don't flush strings from keepGoing	2025-06-24 13:02:54 -04:00
andrew	dfce1ae412	Buf fix: Check for empty before resuming n_string2	2025-06-24 12:43:01 -04:00
andrew	5e3fa62a06	Remove acceptsEmptyString table	2025-06-24 12:19:31 -04:00
andrew	330101a937	Handle unescaping directly in n_string2 if space permits	2025-06-24 10:43:40 -04:00
andrew	9803364adb	Use table for hex values	2025-06-23 21:52:17 -04:00
andrew	2299904557	Compare dfa and simdjson::validate_utf8	2025-06-23 14:29:49 -04:00
andrew	578e507b96	Remove .clang-format	2025-06-23 14:29:40 -04:00
andrew	d536f7ba69	Add debugging printf commented out	2025-06-23 14:18:15 -04:00
andrew	851d07bc43	Use != instead of > 0	2025-06-23 14:15:25 -04:00
andrew	451c07747e	Move dfa's to tables.h	2025-06-23 14:15:05 -04:00
andrew	5df9d958ab	Unroll whitespace-skipping loop	2025-06-23 14:00:29 -04:00
andrew	47a418b689	Separate "normal" and "unicode" escapes	2025-06-23 13:18:05 -04:00
andrew	fe60881476	Add literals bench	2025-06-23 13:10:41 -04:00