compiler error: directive output may be truncated writing between 2 and 8 bytes

[stephanecharette]

When attempting to build on a 64-bit ARM device (NVIDIA Jetson Xavier NX) I'm getting the following compiler error:

src-json/json.hpp: In member function ‘void nlohmann::detail::serializer<BasicJsonType>::dump_escaped(const string_t&, bool) [with BasicJsonType = nlohmann::basic_json<>]’:
src-json/json.hpp:15935:10: error: ‘%.2X’ directive output may be truncated writing between 2 and 8 bytes into a region of size 3 [-Werror=format-truncation=]
     void dump_escaped(const string_t& s, const bool ensure_ascii)
          ^~~~~~~~~~~~
src-json/json.hpp:15935:10: note: directive argument in the range [0, 2147483647]
In file included from /usr/include/stdio.h:862:0,
                 from /usr/include/c++/7/cstdio:42,
                 from /usr/include/c++/7/ext/string_conversions.h:43,
                 from /usr/include/c++/7/bits/basic_string.h:6361,
                 from /usr/include/c++/7/string:52,
                 from /usr/include/c++/7/bits/locale_classes.h:40,
                 from /usr/include/c++/7/bits/ios_base.h:41,
                 from /usr/include/c++/7/ios:42,
                 from /usr/include/c++/7/istream:38,
                 from /usr/include/c++/7/fstream:38,
                 from src-common/Project.hpp:11,
                 from src-config/Config.cpp:3:
/usr/include/aarch64-linux-gnu/bits/stdio2.h:65:44: note: ‘__builtin___snprintf_chk’ output between 3 and 9 bytes into a destination of size 3
        __bos (__s), __fmt, __va_arg_pack ());
                                            ^
cc1plus: all warnings being treated as errors

What is the issue you have?

I'm using the "single include" updated a few days ago with the year update, 085d497

I see this problem has been reported in the past, but as a side issue in another ticket, and without resolution: #1117.

Build with the following g++ flags on ARM device:

ADD_DEFINITIONS ("-Wall -Wextra -Werror -Wno-unused-parameter")

Including json.hpp causes our build to fail. Will need to setup exceptions around the json include file.

Which compiler and operating system are you using?

> g++ --version
g++ (Ubuntu/Linaro 7.5.0-3ubuntu1~18.04) 7.5.0

> cat /etc/lsb-release 
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=18.04
DISTRIB_CODENAME=bionic
DISTRIB_DESCRIPTION="Ubuntu 18.04.5 LTS"

This is the standard NVIDIA image for the Jetson Xavier NX device.

Which version of the library did you use?

• latest release version 3.9.1

[stephanecharette]

Workaround for now:

#pragma GCC diagnostic push
#pragma GCC diagnostic ignored "-Wformat-truncation"
#include "json.hpp"
#pragma GCC diagnostic pop

[gregmarr]

I think this is evaluating this code and not taking into account that the max value of byte is only 255.

std::string sn(3, '\0');
(std::snprintf)(&sn[0], sn.size(), "%.2X", byte);

[stephanecharette]

Probably. Note I'm happy with the workaround I posted a few hours ago if you're sure there isn't a bug. Other than that 1 compiler issue, everything seems to be working fine, I've already got it parsing and outputting json files.

[nlohmann]

I don't see anything we can do here:

• %.2X, means we want to print at least 2 digits.
• The value type std::uint8_t, so the maximal value is 255, or 0xFF.

Therefore, we will print exactly two digits, and a buffer of size 3 is sufficient. So the warning is a false positive, because the output will never be truncated.

However, as the code is only called in case of an exception (i.e., it is not performance critical), we may refactor it to silence the warning. Could it make sense to change std::string sn(3, '\0'); to std::string sn(8, '\0'); here?

[stephanecharette]

Also see: https://stackoverflow.com/a/57780456/13022 where using % can tell the compiler that the range of value is limited.

But like I said, I'm happy with my current workaround.

[nlohmann]

As I never saw this warning (though testing with GCC 11 and -Wformat-truncation=2), could you please try if it disappears when changing

(std::snprintf)(&sn[0], sn.size(), "%.2X", byte);

to

(std::snprintf)(&sn[0], sn.size(), "%.2X", byte % 256);

?

[stephanecharette]

I went to try your proposed fix...and I cannot reproduce anymore. I'm very confused. I've changed quite a lot in the project over the last few days, added several Boost libraries and other things, so our CMake files have also changed considerably. I tried to pare it down to see if I can get it to happen again, but I'm sorry Niels, I don't know exactly how to reproduce the error any more.

Regardless, thanks for the great JSON C++ library.

[nlohmann]

You're welcome!

[stephanecharette]

So this just happened again! I figured out how to get it to repro. In debug mode, I'm not seeing it. Only when I make a release mode builds do I see this error.

I tried several different ways to fix it, first with "% 256" and "(byte % 256)", but was not successful.

In the end, I've gone back to my workaround as described in my 2nd comment.

[gregmarr]

I think changing 3 to 8 in the size is probably fine. It is still within the small buffer optimization of MSVC, libc++ and libstdc++ and so should not trigger an allocation.