Net Native compilation fails with Out of Memory (Xamarin/UWP)

[jkotas]

From @sebastianfilke on March 22, 2018 13:54

We have a big problem with the net native compilation in a relative big project.
The release build only works if we disable the option “Compile with .NET Native tool chain” or “Optimize code”.
Otherwise the build takes up to 10 minutes and ends with an out of memory error.

The build log file is attached: build.log

There is also an ilcRepro.zip file attached:
https://drive.google.com/file/d/1bhEwZco0fugxxRDxj0hi86jnb9eJIpOV/view?usp=sharing

We tried several different settings in the Default.rd.xml, but nothing worked yet.

• We comment out the application assembly tag

• We also tried to add an extra assembly tag for every assembly and with DoNotOptimize

But neither worked.

Please give me an advice or another solution. I don’t know if this is a bug or an assembly doesn’t worked or is not ready for net native.

Copied from original issue: dotnet/core#1372

[jkotas]

From @Petermarcu on March 22, 2018 23:26

@jkotas do you know where this issue should get tracked/discussed?

[jkotas]

cc @sergiy-k @MattWhilden

[sergiy-k]

@hoyMS, could you please take a look? It seems NUTC fails due to OOM:
Error: NUTC300F:Internal Compiler Error: Native compilation failed due to out of memory error

[sebastianfilke]

Further information's: we tried this on several machines. all equipped with 16GB ram. 200 GB free space on disk and newest intel core processors. it doesn't matter.

[sebastianfilke]

Microsoft Visual Studio Professional 2017
Version 15.6.2
VisualStudio.15.Release/15.6.2+27428.2005
Microsoft .NET Framework
Version 4.7.02556

Installed Version: Professional

Visual F# Tools 10.1 for F# 4.1 00370-20000-91176-AA803
Microsoft Visual F# Tools 10.1 for F# 4.1

Application Insights Tools for Visual Studio Package 8.11.10212.1
Application Insights Tools for Visual Studio

ASP.NET and Web Tools 2017 15.0.40301.0
ASP.NET and Web Tools 2017

ASP.NET Core Razor Language Services 1.0
Provides languages services for ASP.NET Core Razor.

Azure App Service Tools v3.0.0 15.0.40215.0
Azure App Service Tools v3.0.0

C# Tools 2.7.0-beta3-62707-11. Commit Hash: 75dfc9b33ed624dff3985c7435c902c3c58c0e5c
C# components used in the IDE. Depending on your project type and settings, a different version of the compiler may be used.

Common Azure Tools 1.10
Provides common services for use by Azure Mobile Services and Microsoft Azure Tools.

JavaScript Language Service 2.0
JavaScript Language Service

JavaScript Project System 2.0
JavaScript Project System

JavaScript UWP Project System 2.0
JavaScript UWP Project System

JetBrains ReSharper Ultimate 2017.3.3 Build 111.0.20180302.65130
JetBrains ReSharper Ultimate package for Microsoft Visual Studio. For more information about ReSharper Ultimate, visit http://www.jetbrains.com/resharper. Copyright © 2018 JetBrains, Inc.

Markdown Editor 1.11.231
A full featured Markdown editor with live preview and syntax highlighting. Supports GitHub flavored Markdown.

Merq 1.1.17-rc (cba4571)
Command Bus, Event Stream and Async Manager for Visual Studio extensions.

Microsoft Continuous Delivery Tools for Visual Studio 0.3
Simplifying the configuration of continuous build integration and continuous build delivery from within the Visual Studio IDE.

Microsoft JVM Debugger 1.0
Provides support for connecting the Visual Studio debugger to JDWP compatible Java Virtual Machines

Microsoft MI-Based Debugger 1.0
Provides support for connecting Visual Studio to MI compatible debuggers

Microsoft Visual Studio Tools for Containers 1.1
Develop, run, validate your ASP.NET Core applications in the target environment. F5 your application directly into a container with debugging, or CTRL + F5 to edit & refresh your app without having to rebuild the container.

Microsoft Visual Studio VC Package 1.0
Microsoft Visual Studio VC Package

Mono Debugging for Visual Studio 4.9.11-pre (71eb098)
Support for debugging Mono processes with Visual Studio.

NuGet Package Manager 4.6.0
NuGet Package Manager in Visual Studio. For more information about NuGet, visit http://docs.nuget.org/.

ProjectServicesPackage Extension 1.0
ProjectServicesPackage Visual Studio Extension Detailed Info

ReSharper.AutoFormatOnSave 1.0
Runs silent Reformat Code command upon file save.

SQL Server Data Tools 15.1.61801.210
Microsoft SQL Server Data Tools

TypeScript Tools 15.6.20202.3
TypeScript Tools for Microsoft Visual Studio

Visual Basic Tools 2.7.0-beta3-62707-11. Commit Hash: 75dfc9b33ed624dff3985c7435c902c3c58c0e5c
Visual Basic components used in the IDE. Depending on your project type and settings, a different version of the compiler may be used.

Visual Studio Code Debug Adapter Host Package 1.0
Interop layer for hosting Visual Studio Code debug adapters in Visual Studio

Visual Studio Tools for Universal Windows Apps 15.0.27428.01
The Visual Studio Tools for Universal Windows apps allow you to build a single universal app experience that can reach every device running Windows 10: phone, tablet, PC, and more. It includes the Microsoft Windows 10 Software Development Kit.

VisualStudio.Mac 1.0
Mac Extension for Visual Studio

Xamarin 4.9.0.749 (9b0fce36d)
Visual Studio extension to enable development for Xamarin.iOS and Xamarin.Android.

Xamarin Designer 4.10.58 (cee1369d0)
Visual Studio extension to enable Xamarin Designer tools in Visual Studio.

Xamarin.Android SDK 8.2.0.15 (HEAD/22d97e153)
Xamarin.Android Reference Assemblies and MSBuild support.

Xamarin.iOS and Xamarin.Mac SDK 11.8.0.20 (1c6f300)
Xamarin.iOS and Xamarin.Mac Reference Assemblies and MSBuild support.

[htyu]

Yes, I confirm it is a NUTC OOM failure. A solution is to use the 64bit NUTC.

[sergiy-k]

@hoyMS. could you please provide instructions?

[htyu]

Sure. To enable the 64bit compilation all you need is to add the Use64BitCompiler property to the specific group in the csproj file you are compiling.

Take the $(Platform)' == 'Release|x86' as an example,

<PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Release|x86'">
<OutputPath>bin\x86\Release\</OutputPath>
<DefineConstants>TRACE;NETFX_CORE;WINDOWS_UWP</DefineConstants>
<Optimize>true</Optimize>
<NoWarn>;2008</NoWarn>
<DebugType>pdbonly</DebugType>
<PlatformTarget>x86</PlatformTarget>
<UseVSHostingProcess>false</UseVSHostingProcess>
<ErrorReport>prompt</ErrorReport>
<Prefer32Bit>true</Prefer32Bit>
<UseDotNetNativeToolchain>true</UseDotNetNativeToolchain>
<Use64BitCompiler>true</Use64BitCompiler>   <===========================================
</PropertyGroup> 

Then reload the solution file in Visual Studio and rebuild. To check if it triggers the 64bit compilation, go to the compilation log file located in your object folder.You should see the following command line and check if the nutc_driver.exe is from the Tools64 folder instead of Tools.
C:\Program Files (x86)\Microsoft SDKs\NuGetPackagesFallback\microsoft.net.native.compiler\2.0.2\tools\x86\ilc\Tools64\nutc_driver.exe @""E:\test\App9-771694524\obj\x86\Release\ilc\intermediate\MDIL\App9.rsp"