301 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
andrew	c44b0262bc	Merge pull request 'schemagen: reject absent additionalProperties' (#58) from weaselbot/weaseljson:weaselbot/issue-55 into main ... Reviewed-on: #58	2026-07-20 18:06:53 +00:00
andrew	814b24efba	Merge pull request 'Fix schemagen integer parser rejecting zero with negative exponents' (#57) from weaselbot/weaseljson:weaselbot/issue-56 into main ... Reviewed-on: #57	2026-07-20 18:00:36 +00:00
weaselbot	86b58e83cb	schemagen: reject absent additionalProperties ... Per the README contract, an object schema without an explicit `additionalProperties` was documented as rejected at generation time, but the code defaulted it to `false` and silently generated a strict parser that rejects valid documents with extra properties. Make the code match the documented contract by raising GenError when `additionalProperties` is absent, with a clear message instructing the author to set it explicitly to false. Update the README prose section to list absent additionalProperties alongside true, and fix existing schemas and tests to declare additionalProperties explicitly. Closes #55	2026-07-19 22:06:23 -04:00
weaselbot	cdff634057	Fix schemagen integer parser rejecting zero with negative exponents ... Move the zero-detection check in the generated parseJsonInt64 before the finalExp < 0 guard. Previously, valid JSON numbers whose mathematical value is 0 but written with a large negative exponent (e.g. 0e-2, 0.0e-2, -0e-2, 0e-20) were rejected because the negative-finalExp early return ran before the all-zero-digits branch could set out = 0. Non-zero values with negative exponents are still correctly rejected. Closes #56	2026-07-19 22:00:15 -04:00
andrew	16f5d3cd9d	Merge pull request 'Handle null parser in WeaselJsonParser_parse' (#54) from null-parser into main ... Reviewed-on: #54	2026-07-15 22:03:59 +00:00
andrew	6beb538b61	Add missing status enum to weaseljson.py	2026-07-15 17:55:22 -04:00
andrew	6520039dc2	Address review feedback	2026-07-15 14:12:41 -04:00
andrew	93203b14f5	Add missing unlikely annotation	2026-07-15 12:31:17 -04:00
andrew	09c0fb72ca	Handle null parser in WeaselJsonParser_parse ... Closes #51	2026-07-15 12:31:09 -04:00
andrew	70bb33eeaf	Merge pull request 'make WeaselJson_OVERFLOW a terminal state like WeaselJson_REJECT' (#53) from weaselbot/weaseljson:weaselbot/issue-52 into main ... Reviewed-on: #53	2026-07-13 20:58:14 +00:00
andrew	42d37d1fd7	Don't list all terminal statuses for weaseljson ... Also simplifies codegen slightly presumably. OK and AGAIN should be the only non-terminal statuses ever.	2026-07-13 16:49:16 -04:00
weaselbot	5e462f1477	make WeaselJson_OVERFLOW a terminal state like WeaselJson_REJECT ... When a parse step returned WeaselJson_OVERFLOW, the pushdown stack was left corrupted (frames had been popped before the failing push), but the overflow status was not made sticky the way WeaselJson_REJECT is. A subsequent end-of-data call WeaselJsonParser_parse(parser, nullptr, 0) could then dispatch through the corrupted stack and return WeaselJson_OK, accepting an incomplete, invalid too-deeply-nested document as valid JSON. Add an `overflowed` flag, set it whenever a continuation returns WeaselJson_OVERFLOW, and short-circuit parse() to return WeaselJson_OVERFLOW on every subsequent call. reset() clears the flag so a reused parser can accept a different document. This mirrors the existing stickiness handling for WeaselJson_REJECT. Closes #52	2026-07-13 16:07:36 -04:00
andrew	f5ceb392c2	Merge pull request 'schemagen: add regression test for nullable cyclic $ref targets' (#50) from weaselbot/weaseljson:weaselbot/issue-14 into main ... Reviewed-on: #50	2026-06-30 16:50:07 +00:00
weaselbot	be92755cbf	schemagen: add regression test for nullable cyclic $ref targets (issue #14) ... The generator already preserves nullability for self-referential object $defs thanks to prior fixes, but issue #14 had no regression coverage. Add a test using the exact reproduction schema from the issue and verify that both the outer and recursive `self` fields accept `null`.	2026-06-30 12:42:03 -04:00
andrew	d281c35811	Merge pull request 'schemagen: reject self-referential array $ref cycles instead of crashing' (#49) from weaselbot/weaseljson:weaselbot/issue-33 into main ... Reviewed-on: #49	2026-06-30 16:37:02 +00:00
andrew	f6617a1558	Merge pull request 'schemagen: escape control characters in generated C++ string literals' (#48) from weaselbot/weaseljson:weaselbot/issue-35 into main ... Reviewed-on: #48	2026-06-30 16:30:21 +00:00
weaselbot	ababd3a8fd	schemagen: reject self-referential array $ref cycles instead of crashing ... Cyclic array definitions (directly or through a chain of array $defs) created a self-referential TArr, which then caused infinite recursion in base_cpp, storage_cpp, and _walk_arrays. Object-only cycles are already broken with std::unique_ptr, but array-only cycles have no object edge for break_cycles to cut. Detect them after building an array's items by following TArr.elem links and raise a clear GenError so generation fails gracefully rather than overflowing the Python stack. Closes #33	2026-06-30 12:29:37 -04:00
weaselbot	681892107f	schemagen: escape control characters in generated C++ string literals ... Fixes #35. Add a helper to escape C++ string literals so that JSON control characters (\n, \r, \t, and other bytes below 0x20) are emitted as escape sequences instead of raw bytes. Use it for: - field comments that include the JSON property key - object key comparison literals in matchKey() - enum name arrays Also add regression tests that generate and syntax-check headers for schemas containing newlines and other control characters in property keys and enum values.	2026-06-30 12:26:10 -04:00
andrew	e22bc039ae	Merge pull request 'schemagen: fix quadratic leading-zero strip in integer fallback' (#47) from weaselbot/weaseljson:weaselbot/issue-34 into main ... Reviewed-on: #47	2026-06-30 16:16:44 +00:00
weaselbot	ceb16e5405	schemagen: fix quadratic leading-zero strip in integer fallback ... Replace the O(k^2) loop that erased leading zeros one byte at a time from the front of a std::string with a single linear scan and one erase(0, n) call. Also adds regression tests for issue #34: - correctness cases for numbers with leading fractional zeros - a static check that the generated code no longer contains the quadratic pattern - a large-input case (100k leading zeros) that reproduces the vulnerable shape Closes #34	2026-06-30 12:09:26 -04:00
andrew	241c29073b	Merge pull request 'schemagen: handle WeaselJsonParser_create failure in RootBuilder' (#46) from weaselbot/weaseljson:weaselbot/issue-36 into main ... Reviewed-on: #46	2026-06-30 15:35:20 +00:00
weaselbot	abeaae7ed7	schemagen: handle WeaselJsonParser_create failure in RootBuilder ... If WeaselJsonParser_create returns nullptr (e.g. negative stack size or allocation failure), set the existing error_ flag so that subsequent feed()/finish() calls return WeaselJson_REJECT instead of dereferencing the null parser_. Also add a regression test in test_gen.cpp that constructs a RootBuilder with an invalid stack size and verifies it rejects without crashing. Closes #36	2026-06-30 11:26:59 -04:00
andrew	4bd1088018	Merge pull request 'Include <cstdint> in json_value.h for uint8_t' (#45) from weaselbot/weaseljson:weaselbot/issue-37 into main ... Reviewed-on: #45	2026-06-29 18:57:40 +00:00
andrew	82bdc8a080	Merge pull request 'python: raise OSError when shared library is missing' (#44) from weaselbot/weaseljson:weaselbot/issue-38 into main ... Reviewed-on: #44	2026-06-29 18:53:49 +00:00
andrew	6508616edc	Merge pull request 'Handle null parser in WeaselJsonParser_reset and _destroy' (#42) from weaselbot/weaseljson:weaselbot/issue-41 into main ... Reviewed-on: #42	2026-06-29 18:26:48 +00:00
weaselbot	e5c970a605	Include <cstdint> in json_value.h for uint8_t ... `escapeAsJsonString` uses `uint8_t` but the header did not include `<cstdint>`, making it dependent on other headers to define the type. Add the missing include so `json_value.h` is self-contained.	2026-06-29 14:04:04 -04:00
weaselbot	96f61665bf	python: raise OSError when shared library is missing ... Replace sys.exit(1) in WeaselJsonParser.__init__ with an OSError so callers can handle a missing libweaseljson gracefully. Also add a test that verifies the constructor raises OSError for a non-existent build directory. Closes #38	2026-06-29 14:03:03 -04:00
weaselbot	34fc22a7c2	Handle null parser in WeaselJsonParser_reset and _destroy ... WeaselJsonParser_create can return nullptr when allocation fails or the requested stack size is too small. Previously, passing that nullptr to WeaselJsonParser_reset or WeaselJsonParser_destroy dereferenced it before doing any work, causing immediate undefined behavior. Add an early null check to both functions so they behave like free(nullptr) (i.e., are a safe no-op). Also add a doctest case covering both a null returned from create and a literal nullptr. Closes #41	2026-06-29 13:53:31 -04:00
andrew	08b864d31b	Reject invalid UTF-16 surrogate pairs and lone low surrogates for clarity ... The string unescape logic treated any code unit in the surrogate range (0xD800-0xDFFF) as the start of a surrogate pair. The concrete example from issue #39 (\uDC00\uDC00) was already rejected by the existing 0x10FFFF bounds check, but the check was misleading and would accept a lone low surrogate as a regular BMP code point if the second surrogate happened to be in a narrower range. Clean this up so the intent is obvious. Changes in src/parser3.h: - Fast path (n_string2): only treat high surrogates (0xD800-0xDBFF) as the start of a surrogate pair, and explicitly reject lone low surrogates (0xDC00-0xDFFF). - Slow path (t_hex2): same high-surrogate check, with explicit rejection of lone low surrogates. The t_hex3 path already validates that the second code unit is a low surrogate (0xDC00-0xDFFF), so no change is needed there. Also commit the current fuzzer corpus. Closes #39	2026-06-29 13:37:58 -04:00
andrew	4ce2002663	Merge pull request 'schemagen: reject scalar root values when root schema is object/array' (#32) from weaselbot/weaseljson:weaselbot/issue-16 into main ... Reviewed-on: #32	2026-06-24 19:34:06 +00:00
weaselbot	df693ef4c9	schemagen: reject scalar root values when root schema is object/array ... The generated RootBuilder crashed (undefined behavior on std::vector::back()) when a JSON document's root value was a scalar or null while the schema declared a non-nullable object or array root. The stack starts empty for object/array roots, but cbStringData, cbNumberData, and cbBool called stack_.back() without checking for an empty stack. Add an empty-stack guard to the three scalar callbacks so they reject instead of crashing. cbNull already handles the empty-stack case. Regression tests added for: - non-nullable object root rejecting null, boolean, number, and string roots - nullable object root rejecting scalar roots - nullable array root rejecting scalar roots Closes #16	2026-06-24 14:30:36 -04:00
andrew	e5cbaac401	Merge pull request 'schemagen: cache non-object $defs entries to avoid duplicate types' (#31) from weaselbot/weaseljson:weaselbot/issue-17 into main ... Reviewed-on: #31	2026-06-24 17:02:38 +00:00
weaselbot	e155e0bbf4	schemagen: restore nullable tuple return for object schemas ... The previous change to cache object definitions started returning the bare TObj from build_type for object schemas, discarding the nullable flag. This caused nullable root objects to be emitted as plain structs instead of std::optional<RootInner>, breaking the nullable root tests. Return the (TObj, nullable) tuple so callers (including the root emitter) see the correct nullability again.	2026-06-24 09:51:19 -04:00
weaselbot	717f30099f	schemagen: cache non-object $defs entries to avoid duplicate types ... Extend the existing per-definition cache (`self._building`) to enum, array, and scalar $defs, not just object definitions. This ensures that multiple $refs to the same non-object definition reuse the same C++ type instead of generating Role, Role2, Role3, etc. - Cache the built (type, nullable) tuple under defname for enum, scalar, and array definitions. - Pre-register array definitions before recursing into items so $ref cycles resolve to the same TArr instance. - Store object definitions as (TObj, nullable) tuples so nullable object $defs also preserve their nullability when referenced. Add a regression test for issue #17 covering reused enum and array-of-enum $defs.	2026-06-23 22:16:34 -04:00
andrew	1404ebdfbd	Merge pull request 'fix schemagen integer parsing boundary bugs' (#30) from weaselbot/weaseljson:weaselbot/issue-19 into main ... Reviewed-on: #30	2026-06-24 00:40:09 +00:00
weaselbot	38079cc278	schemagen: parse integer fallback exactly for decimal/exponent forms ... Replace the double-based fallback in generated integer slots with a string-to-int64 parser that handles decimal points and exponents without losing precision near the int64 boundaries. The old path used std::from_chars<double> and compared against ±9223372036854775808.0, which rounds the int64 max and min so that valid values are rejected and out-of-range negatives are accepted. The new helper: - Parses sign, integer part, optional fraction, and optional exponent. - Strips trailing zeros to cancel fractional places. - Rejects non-integral values and overflow using exact uint64_t arithmetic. Adds regression tests covering root integer and object-field integer boundary values, including the cases from issue #19.	2026-06-23 18:36:53 -04:00
andrew	ceb4bc1041	Merge pull request 'schemagen: drop support for additionalProperties: true' (#28) from weaselbot/weaseljson:weaselbot/issue-20 into main ... Reviewed-on: #28	2026-06-23 20:56:58 +00:00
weaselbot	16f13c241c	schemagen: drop support for additionalProperties: true ... Following review feedback, the generator no longer supports permissive objects. Changes: - Reject `additionalProperties: true` at generation time. - Treat an absent `additionalProperties` as `false`, so every object is strict by default and unknown keys are rejected during parsing. - Remove the now-dead permissive-object infrastructure: `Kind::Skip`, `Cat::Skip`, `kSkip`, the per-frame `unknown` key set, and `isStrict()`. - Update the README feature/rejection tables accordingly. - Remove the permissive "loose" object from example.schema.json and the associated tests from test_gen.cpp. - Add Python unit tests verifying the new `additionalProperties` behavior. All tests pass (`ctest --output-on-failure`).	2026-06-23 15:11:48 -04:00
weaselbot	ab95fefb09	schemagen: reject duplicate unknown keys in non-strict objects ... Track unknown keys in a per-object unordered_set so that permissive objects (additionalProperties absent/true) still reject duplicate keys, matching the README guarantee. - Add std::unordered_set<std::string> to Frame. - Insert unknown keys in cbKeyData and reject duplicates before skipping. - Add a permissive "loose" subobject to example.schema.json. - Test single unknown key accepted and duplicate unknown/known keys rejected.	2026-06-23 15:08:48 -04:00
andrew	e8830e27e9	Merge pull request 'schemagen: reserve generated Root/Skip/RootScalar and avoid Kind/ArrN collisions' (#27) from weaselbot/weaseljson:weaselbot/issue-21 into main ... Reviewed-on: #27	2026-06-23 17:48:57 +00:00
andrew	5427db4b3d	Merge pull request 'schemagen: fix nullable root types (#13)' (#29) from weaselbot/weaseljson:weaselbot/issue-13 into main ... Reviewed-on: #29	2026-06-23 17:43:19 +00:00
weaselbot	b5491afb38	schemagen: fix nullable root types (#13) ... The C++ code generator now handles schemas where the top-level type is nullable ("type": ["object", "null"], ["string", "null"], or ["array", "null"]). Changes to weaseljson_schemagen.py: - Rename the inner object struct when the root is a nullable object, so the `using Root = std::optional<...>` alias no longer conflicts with `struct Root`. - Treat nullable root objects and arrays as container roots, emplacing the inner value before pushing the root frame and pointing the frame at the contained value. - For nullable root scalars/enums, engage() now returns a pointer to the value inside the optional rather than to the optional wrapper itself. - cbNull() now safely accepts a top-level null when the root is nullable and rejects it otherwise. Regression tests added: - nullable_object.schema.json + test_nullable_root.cpp - nullable_string.schema.json - nullable_array.schema.json Closes #13	2026-06-23 12:58:28 -04:00
weaselbot	46ff8e2164	schemagen: reserve generated Root/Skip/RootScalar and avoid Kind/ArrN collisions ... Make the type-name allocator aware of the identifiers the generator emits itself (`Root` alias, `Skip`/`RootScalar` Kind enumerators) so user `$defs` names can no longer collide with them. Array-kind names (`Arr0`, `Arr1`, ...) are now allocated only after checking for object/enum names, preventing duplicate `Kind` enumerators when a schema defines e.g. `Arr0`. Add Python regression tests that also syntax-check the generated headers with a C++ compiler. Closes #21	2026-06-23 12:23:09 -04:00
andrew	8d37b9b602	Merge pull request 'Reject negative lengths in WeaselJsonParser_parse' (#25) from weaselbot/weaseljson:weaselbot/issue-24 into main ... Reviewed-on: #25	2026-06-22 18:53:20 +00:00
andrew	3d7dc97471	Merge pull request 'check WeaselJsonParser_create return value in Python bindings' (#26) from weaselbot/weaseljson:weaselbot/issue-23 into main ... Reviewed-on: #26	2026-06-22 18:52:46 +00:00
weaselbot	a26e101191	check WeaselJsonParser_create return value in Python bindings ... Raise ValueError from __init__ when the C constructor returns NULL, instead of storing a NULL pointer that segfaults on parse()/reset(). Add defensive RuntimeError checks in parse() and reset() for closed or failed parsers. Add a test covering stackSize values that the C API rejects (-1, 0, 1, 2). Fixes #23	2026-06-22 02:29:13 -04:00
weaselbot	43e3c9904f	Reject negative lengths in WeaselJsonParser_parse ... `Parser3::parse` previously formed `buf + len` immediately, so passing a negative `len` from the C API caused undefined pointer arithmetic. Add an explicit `len < 0` check that returns `WeaselJson_REJECT` (and makes the rejected state sticky) before any `buf + len` computation. Also document the non-negative length precondition in the public header and add a regression test. Closes #24	2026-06-22 02:26:30 -04:00
andrew	5e18347e35	Merge pull request 'schemagen: add C++20 keywords to the C++ keyword allow-list' (#22) from weaselbot/weaseljson:weaselbot/issue-18 into main ... Reviewed-on: #22	2026-06-22 00:54:04 +00:00
weaselbot	9cd74631b6	schemagen: add C++20 keywords to the C++ keyword allow-list ... Add concept, consteval, constinit, co_await, co_return, co_yield, requires, module, and import to _CPP_KEYWORDS so property names that happen to be C++20 keywords get sanitized with a trailing underscore. Closes #18	2026-06-21 12:52:07 -04:00
andrew	05185eb3ee	Merge pull request 'Make parser reject state sticky after WeaselJson_REJECT' (#15) from weaselbot/weaseljson:weaselbot/issue-12 into main ... Reviewed-on: #15	2026-06-19 17:17:10 +00:00