From 02e44bade6370309c0292e84178095c2bae299be Mon Sep 17 00:00:00 2001 From: jsmall-nvidia Date: Thu, 20 Dec 2018 13:23:58 -0500 Subject: Feature/lex memory reduction (#762) * Only do scrubbing if needed. When allocating content try to limit size (with scrubbing each token takes up 1k), now it's 16 bytes min size. * Don't allocate for every call to write on the CallbackWriter - use the m_appendBuffer. * Don't allocate memory for CallbackWriter use m_appendBuffer. * Use UnownedStringSlice for suffix output for parsing float/int literals. Fix typo in invalidFloatingPointLiteralSuffix * Using memory arena to hold tokens that are not in SourceManager. * Improve comment on lexing. * Make UnownedStringSlice allocation simpler on SourceManager. * Fix error on gcc around UnownedStringSlice - because VC converted string + UnownedStringSlice automatically into a String. * Fix generateName needing concat string for gcc. * When constructing a Token in parseAttributeName - because it's a Identifier, we have to set the Name. * Remove translation through String on getIntrinsicOp * Make func-cbuffer-param disablable with -exclude compatibility-issue * Move memory leak in render-test. * From review - can just use "?:" instead of performing a concat. --- source/slang/token.h | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) (limited to 'source/slang/token.h') diff --git a/source/slang/token.h b/source/slang/token.h index e3b6f48ff..d7d45882d 100644 --- a/source/slang/token.h +++ b/source/slang/token.h @@ -36,13 +36,13 @@ public: SourceLoc loc; void* ptrValue; - String Content; + UnownedStringSlice Content; Token() = default; Token( TokenType typeIn, - const String & contentIn, + const UnownedStringSlice & contentIn, SourceLoc locIn, TokenFlags flagsIn = 0) : flags(flagsIn) -- cgit v1.2.3