Matt Ward

NuGet Support in Visual Studio for Mac 7.7

Changes

  • NuGet 4.8 support
  • Support PackageReferences without a Version
  • Fixed NuGet sdk resolver not being found in Mono 5.16
  • Fixed null reference exception in package compatiblity check
  • Fixed Update menu enabled when project has no PackageReferences
  • Fixed updating a NuGet package changing a reference’s ItemGroup
  • Fixed updating a NuGet package changing a fully qualified reference hint path to a relative path

More information on all the new features and changes in Visual Studio for Mac 7.7 can be found in the release notes.

NuGet 4.8 support

NuGet 4.8.0.5385 is now included with Visual Studio for Mac 7.7.2.

Support PackageReferences without a Version

Visual Studio for Mac did not support projects that used PackageReferences without specifying a version.

<ItemGroup>
    <PackageReference Include="Newtonsoft.Json" />
</ItemGroup>

The version may be defined elsewhere in another MSBuild file, such as the Directory.props file, or by the .NET Core SDK, as with the Microsoft.AspNetCore.App PackageReference in ASP.NET Core projects. By default a PackageReference without a version will restore the lowest available version for the NuGet package.

However in Visual Studio for Mac there were several problems with PackageReferences that did not specify a version.

Opening a project with a PackageReference without a Version would result in an ArgumentNullException being logged and the Add Packages dialog could not be opened.

If the PackageReference, in a non-SDK project, had no Version then it was not displayed in the Packages folder and a null reference exception was logged. The Solution window would try to find the package to check if it was installed which is not possible with a missing version and NuGet’s VersionFolderPathResolver would throw a null reference exception.

If a PackageReference had no Version then a null reference exception was logged when checking for updates. A null version is now handled.

Right clicking the package in the Packages folder would log a null reference exception if a non-SDK style project was used and it had a PackageReference without a version. This is now handled and the menu label will show “Version None”.

Bug Fixes

Fixed NuGet sdk resolver not being found in Mono 5.16

More recent versions of MSBuild, such as MSBuild 16.0.40 which is included with Mono 5.16.0.173, allow the sdk resolver to use a manifest.xml file to define the assembly where the resolver can be found:

<SdkResolver>
  <Path>..\..\Microsoft.Build.NuGetSdkResolver.dll</Path>
</SdkResolver>

This manifest file not supported and resulted in the NuGet sdk resolver not being loaded. Any projects that use an MSBuild sdk from a NuGet package no longer worked and would result in an ‘Invalid configuration mapping’ error shown in the Solution window. The sdk resolution in Visual Studio for Mac has now been updated based on the latest MSBuild source code.

Fixed null reference exception in compatiblity check

Changing the target framework of a project that uses a packages.config file will result in a package compatiblity check being run. If the project had both a PackageReference and a packages.config file the package compatiblity check would fail with a null reference exception. Visual Studio for Mac was treating the project as though it was using a packages.config file, when it should have been treated as a PackageReference project. This resulted in a null reference exception being thrown when checking for package compatiblity.

Fixed Update menu enabled when project has no PackageReferences

The Update menu was enabled if the project used PackageReferences but had none in the project. Without any PackageReferences in the project there is no packages to update. The check to determine if the Update menu should be enabled has been changed to make sure the project has PackageReferences in the project file, not just imported PackageReferences. The Update NuGet Packages menu, which is used to update packages for the solution, has also been changed to have the same behaviour.

Fixed updating a NuGet package changing a reference’s ItemGroup

On updating a NuGet package the Reference item will now be modified in place in the project file.

On updating a NuGet package in a project that used a packages.config the old NuGet package is uninstalled and the new one is installed. This removes the old references and adds new references. If the references are in an ItemGroup with a condition then the new reference may be added into a different ItemGroup if there are other ItemGroups with references. To prevent this from happening the changes to made to references are cached and not applied to the project until all the NuGet actions have all been run. This allows a NuGet package update which would remove a reference and then add a new reference to be converted into an update of the original Reference in the project, changing just its HintPath, so its location in the project file is not changed.

This was fixed in Visual Studio for Mac 7.7.3.

Fixed updating a NuGet package changing a fully qualified reference hint path to a relative path

Updating a NuGet package, where the project, which uses a packages.config file, had been modified so the original reference had a fully qualified hint path, would result in a relative path used for the hint path when the reference was updated.

Now if the original hint path was full path then if the hint path for the reference is changed it is saved using a full path. This is different behaviour to how Visual Studio on Windows works, which will always add a relative hint path for the reference.

This was fixed in Visual Studio for Mac 7.7.3.

Proxy Testing a Mac Application with Apache

Here we look at using Apache as a proxy server in order to test that a Mac client application, such as Safari or Visual Studio for Mac, can make web requests through a proxy. Enabling Basic and NTLM proxy authentication with Apache will be covered, as well as using the Apache as a proxy without any authentication.

Apache will run on a separate Windows machine. Using a separate machine allows us to check that the Mac client application is not bypassing the proxy and making direct web requests to any server. This check can be done by configuring the local firewall to block all direct connections out from the Mac machine but allow connections from the machine running Apache.

Apache Proxy – No authentication

Unzip Apache and extract the files to c:\Apache24\ which is the default ServerRoot configured in the conf\httpd.conf file.

Define SRVROOT "/Apache24"

In the httpd.config file configure the port to be used by the Apache server if required. By default port 80 is used. Here we will be using port 8888.

Listen 8888
ServerName localhost:8888

mod_proxy, mod_proxy_connect and mod_proxy_http should be loaded. Edit the http.conf file and ensure these modules are loaded.

LoadModule proxy_module modules/mod_proxy.so
LoadModule proxy_connect_module modules/mod_proxy_connect.so
LoadModule proxy_http_module modules/mod_proxy_http.so

Add a VirtualHost and Proxy section to the httpd.conf file.

<VirtualHost *>
     ProxyRequests On

    <Proxy *>
        Require all granted
    </Proxy>
</VirtualHost>

To run Apache, open a command prompt, change into the Apache24\bin directory, then run httpd.exe

cd c:\Apache24\bin
httpd.exe

On running Apache for the first time you will see a Windows Firewall dialog.

Windows Firewall alert for Apache

Allow Apache to access both the private and public networks.

Configuring the Mac to use Apache as its proxy server can be done by opening System Preferences – Network. For the active network select the Advanced button and open the Proxies tab. Enter the machine IP address where Apache is running and its port into the Web Proxy (HTTP) and Secure Web Proxy (HTTPS) sections, and ensure both of these are checked.

Mac web proxy settings

Finally click OK and Apply to enable the proxy settings.

Now http and https requests should be sent through Apache. A simple way to test this is to open Safari and view a web page. In the C:\Apache24\logs\access.log file you should see entries for the sites accessed.

192.168.1.100 - - [28/Oct/2018:12:18:47 +0000] "GET http://neverssl.com/ HTTP/1.1" 200 1183
192.168.1.100 - - [28/Oct/2018:12:18:47 +0000] "GET http://neverssl.com/favicon.ico HTTP/1.1" 200 124
192.168.1.100 - - [28/Oct/2018:12:18:41 +0000] "CONNECT www.nuget.org:443 HTTP/1.1" 200 -

Apache Proxy – Basic authentication

To enable Basic authentication change the Proxy section in the httpd.conf file as shown below.

<VirtualHost *>
     ProxyRequests On

    <Proxy *>
        AuthType Basic
        AuthName "Authentication required"
        AuthBasicProvider file
        AuthUserFile proxy-password.file
        Require valid-user
    </Proxy>
</VirtualHost>

Here we will be using htpasswd.exe to create a file to store the username and password required to authenticate against the proxy server. htpasswd.exe is in the Apache bin directory. Run the following to generate the proxy-password.file, replacing user with the username to be used with the proxy.

htpasswd.exe -c proxy-password.file user

Enter the password when prompted.

Copy the proxy-password.file to the Apache server’s root directory c:\Apache24

To make it easier to see the basic auth header being sent you may want to enable forensic logging in Apache. To do this add a LoadModule to the httpd.conf file.

LoadModule log_forensic_module modules/mod_log_forensic.so

Define the path to the forensic log file using an IfModule.

<IfModule log_forensic_module> 
    ForensicLog "logs/forensic.log"
</IfModule> 

Run httpd.exe from the Apache24\bin directory.

When connecting through the proxy for the first time the Mac will show a dialog asking for credentials.

Mac proxy authentication required dialog

Clicking the System Preferences button will show open a dialog where you can enter the credentials for the proxy.

Mac proxy authentication required - credentials dialog

Entering the credentials will result in the Mac’s key chain being updated with the credentials associated with the proxy’s address.

Proxy credentials stored in Mac key chain

If you open the Mac’s Network settings you will see the Web Proxy and Secure Web Proxy settings now have a username and password associated with them.

Username and password associated with proxy in network settings

In the Apache access.log you should see the requests being made and a Proxy authentication 407 status code.

192.168.1.100 - - [28/Oct/2018:12:44:47 +0000] "CONNECT www.nuget.org:443 HTTP/1.1" 407 415
192.168.1.100 - - [28/Oct/2018:12:44:53 +0000] "GET http://neverssl.com/ HTTP/1.1" 407 415

In the forensic.log file you should see the basic proxy authorization header being used by the Mac.

GET http%3a//neverssl.com/ HTTP/1.1|Host:neverssl.com|Connection:keep-alive|Proxy-Connection:keep-alive|Upgrade-Insecure-Requests:1|Proxy-Authorization:Basic MTox|Accept:text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8|User-Agent:Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_6) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0 Safari/605.1.15|Accept-Language:en-gb|DNT:1|Accept-Encoding:gzip, deflate
CONNECT www.nuget.org%3a443 HTTP/1.1|Host:www.nuget.org%3a443|User-Agent:Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_6) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0 Safari/605.1.15|Connection:keep-alive|Proxy-Authorization:Basic MTox|Proxy-Connection:keep-alive

Apache Proxy – NTLM authentication

In order to enable NTLM authentication the NTLM authentication module needs to be downloaded. Download Mod Auth NTLM for Apache 2.4.x x64 – mod_authn_ntml.zip, extract the files and copy the mod_auth_ntlm.so file to the Apache24\modules directory.

Add a LoadModule to the httpd.conf file for the mod_authn_ntlm.so file.

LoadModule auth_ntlm_module modules/mod_authn_ntlm.so

Change the VirtualHost Proxy section as shown below:

<VirtualHost *>
    ProxyRequests On

    <Proxy *>
        AuthType SSPI
        AuthName "Auth required"
        NTLMAuth On
        NTLMAuthoritative On

        <RequireAll>
            <RequireAny>
                Require valid-user
            </RequireAny>

            <RequireNone>
                Require user "ANONYMOUS LOGON"
                Require user "NT AUTHORITY\ANONYMOUS LOGON"
            </RequireNone>
        </RequireAll>
    </Proxy>
</VirtualHost>

The username and password used to authenticate against the proxy needs to match an account on the Windows machine. As with basic authentication, the Mac will prompt for credentials if they do not match what is stored in the key chain for the proxy.

Run httpd.exe and then use Safari to open a web site to check web requests are being sent through the proxy. You should see the Windows account being used to authenticate in Apache’s access.log.

192.168.1.100 - - [28/Oct/2018:13:09:19 +0000] "GET http://neverssl.com/ HTTP/1.1" 407 415
192.168.1.100 - windows\\useraccount [28/Oct/2018:13:09:19 +0000] "GET http://neverssl.com/ HTTP/1.1" 304 -
192.168.1.100 - - [28/Oct/2018:13:09:38 +0000] "CONNECT www.nuget.org:443 HTTP/1.1" 407 415
192.168.1.100 - windows\\useraccount [28/Oct/2018:13:09:12 +0000] "CONNECT www.nuget.org:443 HTTP/1.1" 200 -

The forensic log should show that the NTLM header is being used by the Mac.

CONNECT www.nuget.org%3a443 HTTP/1.1|Host:www.nuget.org%3a443|User-Agent:Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_6) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0 Safari/605.1.15|Connection:keep-alive|Proxy-Authorization:NTLM T...|Proxy-Connection:keep-alive
GET http%3a//neverssl.com/ HTTP/1.1|Host:neverssl.com|Proxy-Connection:keep-alive|Proxy-Authorization:NTLM T...|If-Modified-Since:Thu, 14 Jun 2018 00%3a16%3a40 GMT|Accept:text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8|Accept-Language:en-gb|Accept-Encoding:gzip, deflate|Content-Length:0|User-Agent:Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_6) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0 Safari/605.1.15|Connection:keep-alive|Upgrade-Insecure-Requests:1|DNT:1

Proxy Testing a Mac Application with Fiddler

Here we look at using Fiddler as a proxy server in order to test a Mac client application, such as Safari or Visual Studio for Mac, can make web requests through the proxy. Enabling Basic proxy authentication with Fiddler will be covered, as well as using the Fiddler as a proxy without any authentication.

Fiddler will run on a separate Windows machine. Using a separate machine allows us to check that the Mac client application is not bypassing the proxy and making direct web requests to any server. This check can be done by configuring the local firewall to block all direct connections out from the Mac machine but allow connections from the machine running Fiddler.

  • Mac High Sierra 10.13
  • Fiddler 5.0 on Windows

Fiddler Proxy – No authentication

To enable the Mac to use Fiddler as its proxy first configure Fiddler to allow remote connections. This can be done by open the Tools menu, selecting Options, opening the Connections tab, and checking Allow remote computers to connect.

Fiddler allow remote connections

Configuring the Mac to use Fiddler as its proxy server can be done by opening System Preferences – Network. For the active network select the Advanced button and open the Proxies tab. Enter the Fiddler’s machine IP address and port into the Web Proxy (HTTP) and Secure Web Proxy (HTTPS) sections, and ensure both of these are checked.

Mac web proxy settings

Finally click OK and Apply to enable the proxy settings.

Now http and https requests should be sent through Fiddler. A simple way to test this is to open Safari and open a web page.

Fiddler https request recorded

Fiddler Proxy – Basic authentication

To enable Basic proxy authentication in Fiddler open the Rules menu and ensure that Require Proxy Authentication is checked.

Fiddler require proxy authentication option

This will result in Fiddler requiring Basic authentication with a username ‘1’ and a password ‘1’.

Unfortunately it seems that the native Mac networking API does not work with Fiddler for https requests but will work for non-secure http requests. Opening a web page in Safari will cause the Mac to prompt for the proxy credentials.

Mac proxy authentication required dialog

Clicking the System Preferences button will show open a dialog where you can enter the credentials for the proxy.

Mac proxy authentication required - credentials dialog

Entering the credentials will result in the Mac’s key chain being updated with the credentials associated with the proxy’s address.

Proxy credentials stored in Mac key chain

If you open the Mac’s Network settings you will see the Web Proxy and Secure Web Proxy settings now have a username and password associated with them.

Username and password associated with proxy in network settings

Safari will display an error page when accessing a web page over https when the Mac is configured to use Fiddler’s basic authentation proxy.

Safari 310 proxy error

It seems that for a https request the Mac sends the request with two keep alive headers:

  • Connection: keep-alive
  • Proxy-Connection: keep-alive

Fiddler responds with a 407 proxy authentication required response and a close header.

  • Connection: close

Fiddler https request denied

Since the keep-alive is not being honoured by Fiddler the web request sent from the Mac fails and an kCFErrorDomainCFNetwork 310 error occurs. This maps to the kCFErrorHTTPSProxyConnectionFailure status code.

Other applications that do not use the native Mac networking API, such as the Google Chrome web browser, will work with Fiddler and will prompt for credentials.

Unfortunately you currently cannot use Fiddler with basic proxy authentication enabled to test a Mac application making https requests. As an alternative you can use another proxy server, such as Apache.

.NET Core Support in Visual Studio for Mac 7.6

Changes

  • NuGet SDK resolver now used to find NuGet SDK packages
  • Fixed Synchronous operation cancelled message on stopping debugging
  • Fixed debugger hanging when debugging unit tests
  • Fixed command line arguments not used with a new project
  • Fixed hang when discovering unit tests
  • Allow loading of SDK style projects without a main PropertyGroup
  • Fixed TargetFramework not being updated in project
  • Fixed .xaml.cs code completion in new Xamarin.Forms .NET Standard project
  • Fixed default build action for new HTML file
  • Fixed SDK version not being parsed from Sdk attribute
  • Fixed null reference on opening .NET Core project with sdk version
  • Fixed editor errors when .NET Standard assembly referenced in Xamarin.iOS project

More information on all the new features and changes in Visual Studio for Mac 7.6 can be found in the release notes.

NuGet SDK resolver now used to find NuGet SDK packages

Visual Studio for Mac now has support for the NuGet SDK resolver. The NuGet SDK resolver will download and install SDKs for SDK style projects if these SDKs are missing.

<Project Sdk="My.Custom.Sdk/2.3.4">
  ...
</Project>

The SDK resolution is done in the background when the project is opened and there is currently no visual indication that this is happening.

The NuGet library assemblies are not available to the remote MSBuild host used by Visual Studio for Mac so the NuGet SDK resolver was previously failing to load. The NuGet SDK resolver supports a MSBUILD_NUGET_PATH environment variable which is now set by Visual Studio for Mac to point to the directory containing the NuGet assemblies that are included with the IDE.

Bug Fixes

Fixed synchronous operation cancelled message on stopping debugging

Stopping the .NET Core debugger would sometimes result in a dialog being displayed indicating that the debugger operation failed.

Debugger operation failed - Synchronous operation cancelled - dialog

Fixed debugger hanging when debugging unit tests

The .NET Core debugger would sometimes hang Visual Studio for Mac when debugging unit tests. The problem was that if the breakpoint was placed on an invalid line then the .NET Core debugger would send back the adjusted breakpoint location. Visual Studio for Mac would then send back an incorrect breakpoint line back to the .NET Core debugger, which again resulted in the debugger sending back a corrected line. This would repeat resulting in the IDE and debugger getting stuck in a loop.

Fixed command line arguments not used with a new project

Creating a new .NET Core console project, editing the project run configuration to use extra command line arguments, or to not use the external console, then building and running the project would result in the project run configuration not being used. No extra arguments would be passed to the console project, and the external console would still be used. This could be fixed by closing and re-opening the solution.

The problem was that when the project is re-evaluated, after it is created, its run configurations are cleared. The solution’s startup run configuration would still be using the original project run configuration that was no longer used. Changes made to the project run configuration then had no affect. Closing and re-opening the solution fixed this since the run configuration defined in the .csproj.user file is re-used when the project is re-evaluated on reloading so both the solution run configuration and the project run configuration refer to the same configuration. To fix this, on re-evaluating the project, if the solution’s run configuration refers to a project run configuration that has been removed then the solution’s startup configuration is refreshed.

Note that there is a similar problem with multiple solution run configurations that can occur which is not addressed by this fix.

Fixed hang when discovering unit tests

Opening a solution containing a .NET Core test project would sometimes result in the IDE hanging when discovering tests. On running kill -QUIT pid the IDE log would show a background thread and the UI thread both awaiting test discovery to complete:

var discoveredTests = await VsTestDiscoveryAdapter.Instance.DiscoverTestsAsync (Project);

VsTestProjectTestSuite/<OnCreateTests>d__12.MoveNext
in MonoDevelop.UnitTesting.VsTest/VsTestProjectTestSuite.cs:95

Allow loading of SDK style projects without a main PropertyGroup

On loading an SDK style project that did not have a main PropertyGroup Visual Studio for Mac would show the error message “Error while trying to load project: Object reference not set to an instance of an object”.

A project may define MSBuild properties in a Directory.Build.props file instead of having this in the main project file. It is then possible for the main project file to have no main property group.

Directory.Build.props:

<Project>
  <PropertyGroup>
    <OutputType>Exe</OutputType>
    <TargetFramework>netcoreapp2.1</TargetFramework>
  </PropertyGroup>
</Project>

MainProject.csproj:

<Project Sdk="Microsoft.NET.Sdk">
</Project>

Visual Studio for Mac now handles the missing main PropertyGroup.

Fixed TargetFramework not being updated in project

Changing a .NET Core project’s target framework to a different version in Project Options, then re-opening Project Options and changing the target framework version back again, would result in the target framework not being updated in the project. The problem was the original target framework the project had on opening was cached and the changing back to the same target framework version was being ignored resulting in the project file not being updated.

Fixed .xaml.cs code completion in new Xamarin.Forms .NET Standard project

Creating a new Xamarin.Forms .NET Standard project, then modifing the .xaml to add new named UI items, would result in no code completion in the .xaml.cs file for these new items until the solution was closed and re-opened. The problem was that the .xaml and .xaml.cs files were being removed from the file information held in memory when the project was re-evaluated. On re-evaluation, after the NuGet restore is first run for the project, the old MSBuild items for the .xaml and .xaml.cs file have the wrong metadata, so they need to be removed, whilst new MSBuild items with the updated metadata need to be added. The removal was done after adding the updated files and, since they had the same filename, the new updated files were being removed. The removal is now done before adding the updated files to avoid the files being removed incorrectly.

Fixed default build action for new HTML file

Adding a new .html file to the wwwroot folder of an ASP.NET Core project would add the file as a None item instead of a Content item. This would result in the .html file not being used when publishing the project. When ‘dotnet publish’ was used the publish directory would not contain the .html file.

ASP.NET Core projects have different build actions for files based on where they are added. A .html file in the root directory would be a None item by default, whilst a .html file in the wwwroot directory would be a Content item by default. To fix this the default build action for a file is determined by the file wildcard information available from the .NET Core SDK.

Fixed SDK version not being parsed from Sdk attribute

The Sdk attribute would have its forward slash / replaced with a backslash \ which meant Visual Studio for Mac was creating an SdkReference with the wrong name, for example:

Microsoft.NET.Sdk.Razor\2.1.0-preview2-final

Instead of having Microsoft.NET.Sdk.Razor as the name with the version being separate.

Fixed null reference on opening .NET Core project with SDK version

Opening a SDK style project that used a Sdk attribute with a version would show an error message “Error while trying to load project: Object reference not set to an instance of an object”. The problem was that an SdkResolver can return null from its Resolve method. These null results were added to a list and then an attempt was made to log the result warnings on a null result.

<Project Sdk="Microsoft.NET.Sdk.Razor/2.1.0-preview2-final">

Fixed editor errors when .NET Standard assembly referenced in Xamarin.iOS project

When a Xamarin.iOS project used an assembly that was compiled for .NET Standard, such as the assembly in the System.Collections.Immutable NuGet package, the netstandard assembly was not made available for code completion. This then resulted in the text editor showing errors even though the project could be compiled succesfully. The errors displayed were similar to:

  The type 'ValueType' is defined in an assembly that is not
  referenced. You must add a reference to assembly 'netstandard,
  Version=2.0.0.0, Culture=neutral, PublicKeytoken=cc7b1dffcd2ddd51'.

Now a check is made to determine if an assembly is referencing netstandard and if so the facade assemblies, which for Xamarin.iOS will include the netstandard.dll, are made available for code completion. Previously only a check was made for the project having an assembly referencing System.Runtime before including the facade assemblies.

NuGet Support in Visual Studio for Mac 7.6

Changes

  • Support no-op package restore on opening a solution
  • Added basic support for the NuGet SDK resolver
  • Fixed source code transformations not available in code completion
  • Fixed incorrect FSharp.Core NuGet package being restored
  • Fixed updating PackageReference removing metadata
  • Fixed build error after updating Xamarin.Forms PackageReference
  • Fixed build error after updating Xamarin.Forms NuGet package
  • Fixed editor errors when .NET Standard assembly referenced in Xamarin.iOS project

More information on all the new features and changes in Visual Studio for Mac 7.6 can be found in the release notes.

Support no-op package restore on opening a solution

On opening a solution a NuGet package restore was always run for projects that use PackageReferences. This resulted in the project.assets.json file being re-generated and the projects being re-evaluated. Now if the package references have not changed a no-op restore will occur. This makes the restore faster on opening a solution. It also prevents Visual Studio for Mac going online to fetch NuGet package information if a wildcard is used for a PackageReference or if the package version cannot be found. In the Package Console when a no-op restore occurs you will see the following messages:

Assets file has not changed. Skipping assets file writing.
No-Op restore. The cache will not be updated.

Allow NuGet SDK resolver to find NuGet SDK packages

Visual Studio for Mac now has basic support for the NuGet SDK resolver. The NuGet SDK resolver will download and install SDKs for SDK style projects if these SDKs are missing.

<Project Sdk="My.Custom.Sdk/2.3.4">
  ...
</Project>

The SDK resolution is done in the background when the project is opened and there is currently no visual indication that this is happening.

The NuGet library assemblies are not available to the remote MSBuild host used by Visual Studio for Mac so the NuGet SDK resolver was previously failing to load. The NuGet SDK resolver supports a MSBUILD_NUGET_PATH environment variable which is now set by Visual Studio for Mac to point to the directory containing the NuGet assemblies that are included with the IDE.

Bug Fixes

Source code transformations not available in code completion

Visual Studio for Mac now ensures that files generated by a NuGet package are available for code completion. One example NuGet package that generates files is the LibLog NuGet package.

The LibLog NuGet package has contentFiles that are processed by MSBuild and converted into .cs files. These .cs files are implicitly included in the project. These files are generated in the obj folder. For example:

obj/Debug/netstandard2.0/NuGet/SomeID/LibLog/5.0.0/ILog.cs

The types defined inside these generated files can be referenced by code in the project. Whilst the project would compile without any errors the text editor would show errors about the types from the generated files being undefined.

These generated files are not created or returned by running the CoreCompileDependsOn MSBuild target, which is currently used to find generated files. Now when the CoreCompileDependsOn target is evaluated, Visual Studio for Mac will also run NuGet specific MSBuild targets to ensure any NuGet package files are generated and made available for code completion.

Fixed incorrect FSharp.Core NuGet package restored

Installing the FSharp.Core 4.5.0 NuGet package into a F# .NET Core console project would result in version 4.3.4 of the FSharp.Core NuGet package being used and displayed in the Dependencies folder. FSharp.Core 4.3.4 is the NuGet package implicitly added by the F# .NET Core SDK. This was being used by the project instead of the PackageReference defined in the project. PackageReferences in the project will now override any implicitly added NuGet packages. This matches the behaviour of dotnet restore when run from the command line.

Fixed updating PackageReference removing metadata

On updating a NuGet PackageReference the old PackageReference was removed from the project file and then a new PackageReference was added. This resulted in custom MSBuild properties associated with the PackageReference being removed from the project file.

<PackageReference Include="NuGet.Versioning" Version="3.6.0">
  <PrivateAssets>all</PrivateAssets>
</PackageReference>  

Now on updating a NuGet package the version of the existing PackageReference element is updated so any custom MSBuild properties are not removed.

Fixed build error after updating Xamarin.Forms PackageReference

A build error could occur after updating projects that had a Xamarin.Forms PackageReference. One way to reproduce this was to have a .NET Standard project that used an old Xamarin.Forms version as a PackageReference, and another non .NET Core project, that references the .NET Standard project, which used a newer Xamarin.Forms NuGet package. On building an error would be displayed:

Error XF002: Xamarin.Forms tasks do not match targets

On updating the .NET Standard project to use the same Xamarin.Forms NuGet package version the build error would still occur until the solution was closed and re-opened. Now the remote MSBuild host is shutdown to ensure the correct Xamarin.Forms MSBuild targets and assemblies are used after the NuGet package is updated.

Fixed build error after updating Xamarin.Forms NuGet package

On updating the Xamarin.Forms NuGet package in a solution the build would sometimes fail with errors similar to:

Could not load file or assembly 'Xamarin.Forms.Xaml,
Version=2.0.0.0, Culture=neutral, PublicKeyToken=null' or one of
its dependencies.

Error XF002: Xamarin.Forms tasks do not match targets. Please
ensure that all projects reference the same version of
Xamarin.Forms, and if the error persists, please restart the IDE.

The problem was that the old MSBuild tasks and targets from the originally used Xamarin.Forms NuGet package were still being used. Now when an MSBuild import has changed in a project the remote MSBuild host is shutdown to ensure the correct MSBuild tasks are used.

Fixed editor errors when .NET Standard assembly referenced in Xamarin.iOS project

When a Xamarin.iOS project used an assembly that was compiled for .NET Standard, such as the assembly in the System.Collections.Immutable NuGet package, the netstandard assembly was not made available for code completion. This then resulted in the text editor showing errors even though the project could be compiled succesfully. The errors displayed were similar to:

  The type 'ValueType' is defined in an assembly that is not
  referenced. You must add a reference to assembly 'netstandard,
  Version=2.0.0.0, Culture=neutral, PublicKeytoken=cc7b1dffcd2ddd51'.

Now a check is made to determine if an assembly is referencing netstandard and if so the facade assemblies, which for Xamarin.iOS will include the netstandard.dll, are made available for code completion. Previously only a check was made for the project having an assembly referencing System.Runtime before including the facade assemblies.

.NET Core Support in Visual Studio for Mac 7.5

New Features

  • .NET Core 2.1 SDK support
    • .NET Core 2.1 SDK project templates
    • HTTPS development certificate support
    • .NET Core global tools added to PATH on startup
  • .NET Core location can now be configured
  • Xamarin.Forms project templates now use .NET Standard projects
  • Performance improvements when using projects with many files
  • .NET Core templating engine has been updated
  • Improved support for Xamarin.Forms
  • Item templates are now supported with the .NET Core templating engine

More information on all the new features and changes in Visual Studio for Mac 7.5 can be found in the release notes.

.NET Core 2.1 SDK support

Visual Studio for Mac 7.5 includes support for the .NET Core 2.1 SDK which is currently available as a release candidate. The following sections will look into the support provided by Visual Studio for Mac 7.5 for the .NET Core 2.1 SDK.

.NET Core 2.1 SDK project templates

If .NET Core 2.1.300 SDK is installed then the .NET Core 2.1 project templates will be available in the New Project dialog.

New Project dialog - .NET Core 2.1 target framework option

The .NET Core 2.1 project templates are not included with Visual Studio for Mac and will be searched for in the 2.1.300 SDK templates directory.

/usr/local/share/dotnet/sdk/2.1.300-rc1-008673/Templates/

The project templates for .NET Core 2.0 and 1.1 are currently still being shipped with Visual Studio for Mac.

HTTPS development certificate support

ASP.NET Core 2.1 projects use HTTPS by default. In order to be able to run ASP.NET Core 2.1 projects with HTTPS a development certificate needs to be installed. Visual Studio for Mac will detect if the development certificate is missing and offer to install it when you run an ASP.NET Core 2.1 project that uses HTTPS.

HTTPS development certificate not installed message

Visual Studio for Mac will use the dotnet dev-certs tool to check if the HTTPS development certificate is installed and trusted.

dotnet dev-certs https --trust --check

Installing the HTTPS certificate requires administrator privileges so you may be prompted for your username and password after clicking the Yes button. Currently the prompt for credentials shows mono-sgen64 wants to make changes. In the future this will show a custom message indicating that the credentials are required to install the HTTPS development certificate.

Mono sgen administrator dialog prompt

After entering your credentials the following command is run as administrator.

dotnet dev-certs https --trust

After the certificate is installed the ASP.NET Core 2.1 project will be opened in the default browser using HTTPS.

ASP.NET Core 2.1 project open in browser using HTTPS

Running dotnet dev-certs https —trust to install and trust the certificate needs to be done with administrator privileges with the user id 0. To do this Visual Studio for Mac does the following:

  1. Launches a separate custom console app.
  2. The console app uses the AuthorizationExecuteWithPrivileges Mac API provided by Xamarin.Mac to launch itself as again as administrator. It is not possible to run dotnet as administrator initially since it requires the user id to be set to 0, which is what happens when you use sudo dotnet, and this can only be done when running with administrator privileges. So the console app is launched again but this time with administrator privileges.
  3. The console app, now being run with administrator privileges, will use setuid to set the current user id to 0.
  4. The console app then runs dotnet dev-certs https —trust which will install and trust the HTTPS development certificate.

The dotnet dev-certs https —trust command will add two localhost certificates. You can see these by opening the Keychain Access application and searching for localhost.

localhost certificate created by dotnet dev-certs in Keychain Access application

If the HTTPS development certificate is found to be valid and trusted then this will be remembered for the current Visual Studio for Mac session and a check will not be run again during the current session.

.NET Core global tools added to path on startup

The .NET Core SDK 2.1 supports installing global tools. These tools are .NET Core console apps that are available as NuGet packages and can be installed and used from the command line. To be able to use these tools with the dotnet command line the ~/.dotnet/tools directory needs to be added to the PATH environment variable. The path to these global tools is now added to Visual Studio’s PATH environment variable when it starts.

Prompt to install .NET Core 2.1 SDK if not installed

If a .NET Core 2.1 project is opened and .NET Core 2.1.300 SDK is not installed then a dialog will be shown allowing the SDK to be downloaded. The project in the Solution window will show an error icon indicating that the .NET Core 2.1 SDK is not installed.

Launching a browser when running an ASP.NET Core 2.1 project

The .NET Core SDK 2.1 project templates for ASP.NET Core specify the https and http urls in the launchSettings.json file by using the applicationUrl property.

    "MyAspNetCore21Project": {
        "commandName": "Project",
        "launchBrowser": true,
        "applicationUrl": "https://localhost:5001;http://localhost:5000",
        "environmentVariables": {
            "ASPNETCORE_ENVIRONMENT": "Development"
        }
    }

With earlier .NET Core 2.1 preview SDKs this was defined in the ASPNETCORE_URLS environment variable. The full applicationUrl property was used unmodified when running the ASP.NET Core 2.1 project and resulted in an invalid url being used causing the AspNetCoreExecutionHandler to log a warning and not opening the browser. Now the first url in the applicationUrl is used if there are multiple urls.

Support ASPNETCORE_URLS when launching the browser

If the launchSettings.json does not define an applicationUrl then Visual Studio for Mac will fallback to checking the environment variable defined for ASPNETCORE_URLS in the launchSettings.json file and will use the first url found there. This url will be used to launch the browser when running the project.

An example launchSettings.json that was used in the .NET Core 2.1 preview SDKs is shown below.

"MyProject": {
  "commandName": "Project",
  "launchBrowser": true,
  "environmentVariables": {
    "ASPNETCORE_ENVIRONMENT": "Development",
    "ASPNETCORE_URLS": "https://localhost:5001;http://localhost:5000"
  }
}

Compared with the .NET Core SDK 2.0.

"MyProject": {
  "commandName": "Project",
  "launchBrowser": true,
  "environmentVariables": {
    "ASPNETCORE_ENVIRONMENT": "Development"
  },
  "applicationUrl": "http://localhost:5000/"
}

Allow .NET Core location to be configured

In Preferences there is now a Projects – SDK Locations – .NET Core section that can be used to configure the location of the .NET Core command line tool (dotnet).

.NET Core location configured in preferneces

This can be used to configure Visual Studio for Mac to use a .NET Core SDK that is not installed in the default location. After this is changed the MSBuild engine hosts are recycled and all .NET Core projects are re-evaluated to ensure the new locations of any MSBuild targets are used.

If the location is invalid, or no runtimes or SDKs can be found at the configured location, a Not found error will be displayed.

Invalid .NET Core location path specified in preferences

Xamarin.Forms Project Templates now include .NET Standard projects

The Xamarin.Forms project templates, Blank Forms App and Forms App, will now create a .NET Standard 2.0 project instead of a Portable Class Library (PCL) project if .NET Standard is selected in the New Project dialog.

New Project dialog - Blank Forms - .NET Standard option

The Xamarin.Forms Class Library project template now creates a .NET Standard 2.0 project instead of a Portable Class Library project.

New Project dialog - Xamarin.Forms Class Library project

Prevent .xaml.cs file from being renamed in a .NET Core project

The Xamarin.Forms NuGet package has an MSBuild .targets file that is imported after the project items are defined. This .targets file overrides the DependentUpon property for all .xaml.cs files. This means that renaming the .xaml.cs file to be different to the .xaml file is not supported. To prevent this the Rename menu is now disabled in the Solution window for .xaml.cs files if they depend on a .xaml file.

Exclude None build action for XAML files in .NET Core projects

Recent versions of Xamarin.Forms NuGet packages exclude all .xaml files from the default None file wildcard defined by the .NET Core SDK. This exclusion is done in a .targets file which is applied after the items in the project file have been added. This means that a .NET Standard project should not use None items for .xaml files since they will be removed. To avoid this problem the None build action is excluded from the list of build actions for .xaml files. This list of build actions is available when right clicking the file in the Solution window and in the Properties window when the file is selected.

Dependent files now renamed on renaming parent file in the Solution window

When a file is renamed in the Solution window the dependent files will also be renamed if they start with the same name as the parent file. This avoids problems with XAML files since a different name for the .xaml file and the associated .xaml.cs file is not supported.

Improve project load times for projects with many files

Opening a .NET Core project that contained many files that were not excluded, such as a .NET Core console project that has a node_modules directory, could take a long time to load.

Some performance improvements have been made to speed up the loading of .NET Core projects. For a .NET Core console project that had a node_modules directory containing around 17000 files the initial project load time which was taking around 70-80 seconds and now it takes around 20 seconds. Visual Studio 2017 on Windows takes around 15-20 seconds to load the same project before it is visible in the Solution Explorer window.

The performance improvements include:

  1. Adding a faster project item lookup used when finding an existing project item on loading the project.
  2. Updating the existing project items is now faster avoiding iterating over the existing items.
  3. Evaluating MSBuild items is now only done when evaluating properties. Previously this was done when evaluating project configurations and run configurations. This would result in files and directories being searched multiple times when looking wildcard matches on loading the project. Now the files and directories are searched once during the initial project load.

.NET Core templating engine updated

Updated the .NET Core templating to version 1.0.0-beta3-20171117-314. This new version of the .NET Core templating engine fixes the following problems:

  1. Templates that use files with @ character in their names being generated with the @ symbol encoded.
  2. Templates that use the Guid macro and did not specify a format would cause the template generation to fail. An exception was thrown since the format was not defined. Now if the format is not defined the default format is used.

Report template creation failures when using the .NET Core templating engine

To help diagnose problems with project and item templates that use the .NET Core templating engine more detailed information about the failure is now logged in the IDE log.

Support item templates with the new templating engine

Item templates that use the .NET Core templating engine can be defined through a new extension point.

<Extension path="/MonoDevelop/Ide/ItemTemplates">
        <Template
                id="Azure.Function.CSharp.BlobTrigger"
                _overrideName="Blob Trigger"
                path="Templates/Azure.Functions.Templates.nupkg" />
</Extension>

Item templates are not currently supported in the New File dialog however there is an API that can be used by extensions to create files from these templates. This is currently used when adding a new Azure Function to a project.

Bug Fixes

Missing child package dependencies in Solution window

After creating a new ASP.NET Core project sometimes the package dependencies shown in the Solution window under the SDK folder and the NuGet folder could not be expanded to view the child dependencies.

The problem was that if the call to get the package dependencies using MSBuild was cancelled this would result an empty list of depenencies being cached. Since no package dependencies were returned the Solution window would fallback to showing the package dependencies that were listed in the project and a default top level SDK package dependency.

MSBuild wildcards being expanded on saving a project

Saving a project with a file wildcard that had a Link with MSBuild item metadata, as shown below, would result in the wildcard being removed and replaced with MSBuild items for each file included by the wildcard.

<Compile Include="**\*.cs" Exclude="obj\**">
  <Link>%(RecursiveDir)%(Filename).cs</Link>
</Compile>

The problem was that the evaluated Link property value was being compared with the unevaluated value, which did not match, resulting in the wildcard being replaced with individual MSBuild items for each file. Now if the property value contains a % character a comparison is made against the evaluated value when checking if the project item has changed.

MSBuild items added for wildcards with link metadata on saving project

A project containing the following MSBuild file wildcards would have extra MSBuild items added when the project file was saved.

<ItemGroup>
  <Compile Include="..\**\*.cs">
    <Link>%(RecursiveDir)%(Filename)%(Extension)</Link>
  </Compile>
</ItemGroup>

On saving the project Compile update items would be added for each file included by the file wildcard.

<ItemGroup>
  <Compile Update="..\Test\Class1.cs">
    <Link>Class1.cs</Link>
  </Compile>
</ItemGroup>

This problem is similar to the previous problem where the evaluated Link value was being compared with the unevaluated value, which did not match, resulting MSBuild update items being added to the project when it was saved. Now if the property value contains a % character a comparison is made against the evaluated value when checking if the project item has changed.

TargetFramework changed on saving project

Adding a file to an SDK style project that targeted Tizen 4.0 would result in the TargetFramework changing from tizen40 to tizen4.0. Now the original framework identifier name is not modified and if the version of the framework changes then the version will be dotted or contain only numbers based on the format that was originally used in the project file.

ASP.NET Core file templates modifying project file

Adding a new .cshtml file from a file template to an ASP.NET Core project would modify the project file when it should not have been modified. The problem was the files were added as None items whilst .cshtml are Content items. The project file would contain the following after adding a new cshtml file from a template:

<ItemGroup>
  <Content Remove="Views\Index.cshtml" />
</ItemGroup>
<ItemGroup>
  <None Include="Views\Index.cshtml" />
</ItemGroup>

Another problem was that the Razor Page with view model file template specifies a DependentUpon property so this was added to the project file. This would result in the .cshtml and .cs files being nested whilst the other .cshtml and .cs files created with the initial ASP.NET Core project template were not nested. The project file would include the following:

<ItemGroup>
  <Compile Update="Views\Index.cshtml.cs">
    <DependentUpon>Index.cshtml</DependentUpon>
  </Compile>
</ItemGroup>

The .NET Core SDK does not indicate that .cshtml and .cs files are dependent on each other so they are not currently nested in the Solution window. New .cshtml files created from these updated file templates will now not be nested in Solution window.

XAML files not nested after editing project file in editor

Adding a new content page with xaml to a .NET Standard project, then excluding the files from the project, but not deleting it, then editing the project file and commenting out the MSBuild remove items, would then result in the xaml files not being nested in the Solution window. The problem was that the MSBuild update item for the .xaml.cs file, defined by the Xamarin.Forms default msbuild items, was being removed from the MSBuild project in memory. This MSBuild update item had the DependsOn property defined so this information was lost on reloading the project. Now a check is to made to ensure only update items that exist in the original project file are removed.

MSBuild item added for XAML file copied to a .NET Standard project

When copying a .xaml file from a Portable Class Library project to a .NET Standard project an MSBuild include item for the file would be added if the .xaml file did not have the default metadata properties defined by Xamarin.Forms. Now .NET Core projects opt-in to supporting items not being excluded if they are missing MSBuild item metadata which prevents an MSBuild include item added for the .xaml file.

Duplicate XAML file build error when copying file to a .NET Standard project

Copying a .xaml file from a Portable Class Library project to a .NET Standard project would result an MSBuild item for the .xaml file to the project causing it to not build due to a duplicate .xaml file.

Now when a xaml file is copied into a .NET Standard project, and it is missing properties that are included in by an update wildcard, an MSBuild item will not be added to the project.

MSBuild remove item not added for .xaml.cs file

With a .NET Core project, containing a single .xaml file and a dependent .xaml.cs file, removing but not deleting the .xaml file from the Solution window would not add an MSBuild remove item for the .xaml.cs file even though it was removed from the Solution window.

The problem was that the Xamarin.Forms NuGet package includes a Compile update item and only this was being considered when saving the project file. The default file wildcard, that includes all .cs files, provided by the .NET Core SDK was not considered. Only the last MSBuild item associated with the .xaml.cs file was being considered. If there was another .cs file in the project then the MSBuild remove item was added correctly. To avoid this all MSBuild items associated with a project item are now considered.

MSBuild remove item not removed on adding XAML file to project

When an .xaml file was removed but not deleted, and Xamarin.Forms 2.5 used, which has default MSBuild items defined, on adding the .xaml file back again to the project the EmbeddedResource remove item was not removed from the project.

The problem was that the .xaml file was being added as a None item since by default there is no build action specified for .xaml files.

Another problem was that the MSBuild remove items, defined by Xamarin.Forms that remove all .xaml files from the default None included by the .NET Core SDK, were being ignored since the file wildcards were not found.

Also an msbuild item is no longer added for an existing xaml file when it is added to the project. The Xamarin.Forms default msbuild items for .xaml files have extra metadata which were not being added to the file when it was added to the project from the file system.

Update item added on renaming xaml.cs file

When the .xaml and .xaml.cs file were renamed at the same time an MSBuild update item was added for the .xaml.cs file even though the Xamarin Forms NuGet package has a default MSBuild item that was the same as the generated MSBuild update item.

Argument null exception logged on opening .NET Core project

Opening a .NET Core project would sometimes log an unhandled ArgumentNullException. A file created event was sometimes raised before the project had finished loading and could result in a null set of items being used when checking if the new file should be added to the project. This is now handled. The files being created on project load are typically in the obj folder and would be ignored by the default file wildcards.

An unhandled exception has occured. Terminating Visual Studio? False
System.ArgumentNullException: Value cannot be null.
Parameter name: source
  at System.Linq.Enumerable.Where[TSource]
  in corefx/src/System.Linq/src/System/Linq/Where.cs:42
  at MonoDevelop.Projects.Project.OnFileCreatedExternally
in src/core/MonoDevelop.Core/MonoDevelop.Projects/Project.cs:4041

NuGet Support in Visual Studio for Mac 7.5

Changes

  • Support installing NuGet packages with item templates
  • Fixed generated NuGet package files not available for code completion
  • Fixed incorrect Android target framework used when the project has Package References
  • Fixed build errors after creating a new Android project with NuGet packages
  • Missing package dependencies in Solution window

More information on all the new features and changes in Visual Studio for Mac 7.5 can be found in the release notes.

Support installing NuGet packages with item templates

Initial support for creating new files from item templates that use the .NET Core templating engine has been added. This is currently used by the Azure Functions support in Visual Studio for Mac when a new Azure Function is added to the project. Currently the New File dialog does not have support for showing these templates but there is an API that can be used by extensions to create files from these templates.

The item templates can define post actions that indicate that a NuGet package is needed. These post actions are read and the NuGet package will be installed into the project by Visual Studio for Mac.

"postActions": [
  {
    "Description": "Adding Reference to Microsoft.Azure.WebJobs.Extensions.DocumentDB Nuget package",
    "ActionId": "B17581D1-C5C9-4489-8F0A-004BE667B814",
    "ContinueOnError": "true",
    "ManualInstructions": [],
    "args": {
      "referenceType": "package",
      "reference": "Microsoft.Azure.WebJobs.Extensions.DocumentDB",
      "version": "1.2.0",
      "projectFileExtensions": ".csproj"
    }
  }

Bug Fixes

Generated NuGet package files not available for code completion

On installing a NuGet package such as Refit, which extends the CoreCompileDependsOn to generate a C# file, the generated file would not be available for code completion until the solution was closed and re-opened again.

Below is a section of the refit.targets file used by the Refit NuGet package.

<PropertyGroup>
  <CoreCompileDependsOn>
    $(CoreCompileDependsOn);
    GenerateRefitStubs;
  </CoreCompileDependsOn>
</PropertyGroup>

<Target Name="GenerateRefitStubs" BeforeTargets="CoreCompile">

  <Error Condition="'$(MSBuildRuntimeType)' == 'Core' and '$(RefitMinCoreVersionRequired)' > '$(RefitNetCoreAppVersion)' "
       Text="Refit requires at least the .NET Core SDK v2.0 to run with 'dotnet build'"
       ContinueOnError="false"
       />

  <GenerateStubsTask SourceFiles="@(Compile)" BaseDirectory="$(MSBuildProjectDirectory)"   OutputFile="$(IntermediateOutputPath)\RefitStubs.g.cs" />

  <Message Text="Processed Refit Stubs" />      

  <ItemGroup Condition="Exists('$(IntermediateOutputPath)\RefitStubs.g.cs')">
    <Compile Include="$(IntermediateOutputPath)\RefitStubs.g.cs" />
  </ItemGroup>    
</Target>

The CoreCompileDependsOn property is re-defined so the GenerateRefitsStubs MSBuild target will be run. This creates a new RefitStubs.g.cs file which is included in the project by the Compile MSBuild item.

The problem was that the result of running the targets that are defined by the CoreCompileDependsOn property are cached by Visual Studio for Mac. When Refit is installed the cached result was still being returned so the generated C# file was not available for code completion. To fix this the project is now re-evaluated before getting the CoreCompileDependsOn property if an MSBuild import has been added or removed. Note that projects that use Package References were unaffected. Only projects that use a packages.config file were affected.

Incorrect Android target framework used when the project has Package References

Configuring an Android project so it uses the latest Android framework could result in the wrong target framework being used when building if the project used Package References. This would result in a build error similar to:

Error: Your project is not referencing the "MonoAndroid,Version=v7.1" framework. 
Add a reference to "MonoAndroid,Version=v7.1" in the "frameworks" section of your 
project.json, and then re-run NuGet restore

The problem was that the wrong target framework was being used in the project.assets.json. Running a NuGet restore was a workaround for the problem.

Now when the target framework version in project options is changed, and the project uses Package References, a NuGet restore is run after the project file is saved. This ensures the Package References work with the new target framework. This also re-generates the project.assets.json file so the build will use the correct references.

Another problem here was that configuring the Android to use the latest target framework would not result in the target framework being changed in the project model stored in memory. This could also result in the project.assets.json file being out of sync with the Android project’s target framework.

Build errors after creating a new Android project with NuGet packages

Creating a new Android project that installed NuGet packages as it was created would sometimes result in build errors that could be fixed by closing and re-opening the solution. An example build error is shown below.

Resources/values/styles.xml : error APT0000: 1: error: Error retrieving parent for item: No resource found that matches the given name 'Theme.AppCompat.Light.DarkActionBar'.
Resources/values/styles.xml : error APT0000: 2: error: Error: No resource found that matches the given   name: attr 'colorAccent'.
Resources/values/styles.xml : error APT0000: 1: error: Error: No resource found that matches the given name: attr 'colorPrimary'.
Resources/values/styles.xml : error APT0000: 1: error: Error: No resource found that matches the given name: attr 'colorPrimaryDark'.
Resources/values/styles.xml : error APT0000: 1: error: Error: No resource found that matches the given name: attr 'windowActionBar'.
Resources/values/styles.xml : error APT0000: 3: error: Error: No resource found that matches the given name: attr 'windowActionModeOverlay'.
Resources/values/styles.xml : error APT0000: 1: error: Error: No resource found that matches the given name: attr 'windowNoTitle'.
Resources/values/styles.xml : error APT0000: 3: error: Error retrieving parent for item: No resource found that matches the given name 'Theme.AppCompat.Light.Dialog'.
Resources/values/styles.xml : error APT0000: 3: error: Error: No resource found that matches the given name: attr 'colorAccent'.

The build errors varied but in each case the error was caused by a missing reference to an assembly from one of the Android Support NuGet packages installed when the project was created. The project file created would have the correct reference information but Visual Studio for Mac was building an old version of the project.

If the project was modified in memory when a build is requested this results in the unsaved project xml being given to the remote MSBuild host. In some cases this project xml was not being cleared and would result in an out of date project xml being used when building. This could occur if the MSBuild host did not have any projects loaded at the time when an attempt was made to unload the project from the host. Now the unsaved project xml is removed in all cases when the project is unloaded from the MSBuild host.

Missing package dependencies in Solution window

After creating a new ASP.NET Core project sometimes the package dependencies shown in the Solution window under the SDK folder and the NuGet folder could not be expanded to view the child dependencies.

The problem was that if the call to get the package dependencies using MSBuild was cancelled this would result an empty list of depenencies being cached. Since no package dependencies were returned the Solution window would fallback to showing the package dependencies that were listed in the project and a default top level SDK package dependency.

Language Server Protocol support in Visual Studio for Mac 7.4

A preview of support for the Language Server Protocol is now available for Visual Studio for Mac 7.4 as a separate extension.

Docker Language Server client being used in Visual Studio for Mac

A Language Server can provide support for programming language features such as:

  • Code completion
  • Find references
  • Go to definition
  • Quick fixes
  • Method signature help
  • Errors and warnings diagnostics
  • Documentation on hover
  • Document formatting
  • Rename refactoring

The Language Server Protocol provides a way for a client application, such as Visual Studio for Mac, to communicate with the Language Server in order to use the programming language features it supports.

Visual Studio Code supports the Language Server Protocol.

A preview of Language Server Protocol support in Visual Studio 2017 on Windows has also been announced.

Currently there is no support for debugging. Whilst there is a debugging protocol support for this is not currently available in Visual Studio for Mac.

The Language Server Protocol does not provide any support for compiling the code. This would need to be provided by the extension that implements the language client.

More detailed information about the Language Server Protocol can be found on the Language Server Protocol site.

The Creating a Language Client section below will take a more detailed look at how to implement a custom Language Server Client extension in Visual Studio for Mac.

Supports

  • MonoDevelop or Visual Studio Mac 7.4 or later.

Source Code

Installation

The Language Server Client extension is available to download from GitHub.

To install the extension open the Extensions Manager by selecting Extensions… from the main menu. Click the Install from file button. Select the .mpack file and then click the Open button.

The extension is also available in the Extensions Manager from the Visual Studio Extension Repository (Beta channel).

Creating a Language Client

The API provided by the Language Server Client extension follows the API defined by the Language Server Protocol extension used by Visual Studio on Windows as closely as possible.

More detailed documentation on the Language Server Client API provided by Visual Studio on Windows is available from the Microsoft docs site.

Prerequisites

The Language Server Client Extension for Visual Studio for Mac should be installed.

Also ensure you have the Addin Maker extension installed. This can be installed by selecting Extensions… from the main menu top open the Extensions Manager. Select the Gallery tab and use the text box at the top right to search for the Addin Maker extension.

Addin maker selected in Extensions Manager dialog

Click the Install button to install the Addin Maker extension.

The Addin Maker will be used to create the language client extension.

Creating an IDE Extension project

The starting point is to create an IDE Extension project. This project template is provided by the Addin Maker extension and is available from the New Project dialog, in the Other – IDE Extensions category.

IDE Extension project selected in New Project dialog

After creating the IDE Extensions project, expand the Dependencies folder to show the Extensions folder. Right click the Extensions folder and select Add Addin Reference.

IDE Extension project selected in New Project dialog

Find the MonoDevelop.LanguageServer.Client in the Add Extension Reference dialog. Select it to toggle its check box and then click the Add button to reference it.

Language Server Client extension in Add Extension Reference dialog

There are three parts to implementing a language client:

First we will take a look at enabling MEF support.

Enabling Managed Extensibility Framework Support

Registration of the language client with Visual Studio for Mac is done using the Managed Extensibility Framework (MEF) which is supported by Visual Studio for Mac.

In order to use MEF in your language client extension you need to indicate to Visual Studio for Mac that it should scan your extension for dependencies. This can be done in the extension’s .addin.xml file by adding the filename of your assembly.

1
2
3
<Extension path="/MonoDevelop/Ide/Composition">
  <Assembly file="MockLanguageExtension.dll" />
</Extension>

Content Type Definition

Your language client needs to indicate what files are supported. This is done by defining a content type definition.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
using System.ComponentModel.Composition;
using Microsoft.VisualStudio.LanguageServer.Client;
using Microsoft.VisualStudio.Utilities;

namespace MockLanguageExtension
{
  #pragma warning disable CS0649 // Field is never assigned to.

  public class FooContentDefinition
  {
      [Export]
      [Name("foo")]
      [BaseDefinition(CodeRemoteContentDefinition.CodeRemoteContentTypeName)]
      internal static ContentTypeDefinition FooContentTypeDefinition;

      [Export]
      [FileExtension(".foo")]
      [ContentType("foo")]
      internal static FileExtensionToContentTypeDefinition FooFileExtensionDefinition;
  }

  #pragma warning restore CS0649
}

The above content definition indicates that the .foo file extension is supported by the language client.

You can also define a filename, instead of a file extension, as supported by the language client by using the FileName attribute instead of the FileExtension attribute.

1
2
3
4
5
6
7
8
9
10
11
12
class DockerContentTypeDefinition
{
  [Export]
  [Name("docker")]
  [BaseDefinition(CodeRemoteContentDefinition.CodeRemoteContentTypeName)]
  internal static ContentTypeDefinition contentTypeDefinition;

  [Export]
  [FileName("Dockerfile")]
  [ContentType("docker")]
  internal static FileExtensionToContentTypeDefinition dockerFileDefinition;
}

You will need to add a reference to System.ComponentModel.Composition so the Export attribute can be used.

Implementing ILanguageClient

To integrate the Language Server with Visual Studio for Mac the ILanguageClient interface needs to be implemented.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
using System;
using System.Collections.Generic;
using System.ComponentModel.Composition;
using System.Diagnostics;
using System.IO;
using System.Threading;
using System.Threading.Tasks;
using Microsoft.VisualStudio.LanguageServer.Client;
using Microsoft.VisualStudio.Threading;
using Microsoft.VisualStudio.Utilities;

namespace MockLanguageExtension
{
  [ContentType("foo")]
  [Export(typeof(ILanguageClient))]
  public class FooLanguageClient : ILanguageClient
  {
      public IEnumerable<string> ConfigurationSections => null;

      public object InitializationOptions => null;

      public IEnumerable<string> FilesToWatch => null;

      public string Name => "Foo Language Extension";

      public event AsyncEventHandler<EventArgs> StartAsync;
      public event AsyncEventHandler<EventArgs> StopAsync;

      public async Task OnLoadedAsync()
      {
          await StartAsync?.InvokeAsync(this, EventArgs.Empty);
      }

      public Task<Connection> ActivateAsync(CancellationToken token)
      {
          var info = new ProcessStartInfo();
          var programPath = Path.Combine(Path.GetDirectoryName(GetType().Assembly.Location), "server", @"LanguageServer.UI.exe");
          info.FileName = "mono";
          info.Arguments = programPath;
          info.WorkingDirectory = Path.GetDirectoryName(programPath);
          info.UseShellExecute = false;
          info.RedirectStandardInput = true;
          info.RedirectStandardOutput = true;

          var process = new Process();
          process.StartInfo = info;

          Connection connection = null;

          if (process.Start())
          {
              connection = new Connection(process.StandardOutput.BaseStream, process.StandardInput.BaseStream);
          }

          return Task.FromResult(connection);
      }
  }
}

The class that implements the ILanguageClient interface needs to indicate it supports the content types that you have defined, and it also needs to indicate that it implements the ILanguageClient by using the Export attribute.

1
2
[ContentType("foo")]
[Export(typeof(ILanguageClient))]

The language client should return a unique description for the ILanguageClient.Name property.

The two methods that should be implemented are:

OnLoadedAsync is called when Visual Studio for Mac has loaded your extension. To activate your Language Server you need to call StartAsync. The simplest approach is to call StartAsync in the OnLoadedAsync method.

1
2
3
4
 public async Task OnLoadedAsync()
  {
      await StartAsync?.InvokeAsync(this, EventArgs.Empty);
  }

Calling StartAsync will cause Visual Studio for Mac to call the ILanguageClient’s ActivateAsync method. This is where you can start the Language Server.

The ActivateAsync method should return a Connection object with the streams that will be used to communicate with the Language Server. Standard input and output streams are supported as well as sockets.

1
var connection = new Connection(process.StandardOutput.BaseStream, process.StandardInput.BaseStream);

The first time you try to run and debug your language client extension you will see an error in the Application Output similar to:

1
2
3
WARNING: The add-in 'MockLanguageExtension,1.0' could not be updated because some of its 
dependencies are missing or not compatible:
  missing: MonoDevelop.LanguageServer.Client,0.1

The Addin Maker runs your language client extension using its own extension database. The MonoDevelop.LanguageServer.Client extension needs to be installed into this separate database in order to be able to run and debug your language client extension.

To do this run your language client extension project in Visual Studio for Mac and install the Language Server Client extension using the Extensions Manager in the instance of Visual Studio for Mac that is started. Then stop debugging and re-run your extension project again, and your language client should now be used when you open a supported file.

The content type registration and the ILanguageClient implementation is the minimum that is needed in order to integrate your Language Server with Visual Studio for Mac. Now let us take a look at other optional things that can be implemented.

Receiving Custom Messages

Your Language Server may support messages that are not part of the standard Language Server Protocol.

In order to support receiving custom messages the class that implements ILanguageClient should also implement the ILanguageClientCustomMessage interface. The CustomMessageTarget property should return an object that will receive the messages.

1
2
3
4
5
6
7
public object CustomMessageTarget => new CustomMessageTarget ();
public object MiddleLayer => null;

public Task AttachForCustomMessageAsync(JsonRpc rpc)
{
  return Task.CompletedTask;
}

An example CustomMessageTarget class is shown below.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
using Newtonsoft.Json.Linq;
using StreamJsonRpc;

namespace MockLanguageExtension
{
  public class CustomMessageTarget
  {
      [JsonRpcMethod("test/customNotification")]
      public void OnCustomNotification(JToken arg)
      {
          // Handle custom message from the Language Server.
      }
  }
}

Sending Custom Messages

To send custom messages to the Language Server the class that implements the ILanguageClient interface should also implement the ILanguageClientCustomMessage interface.

The AttachForCustomMessageAsync method should save the JsonRpc object passed and then you can use the JsonRpc object to send custom messages to the Language Server.

1
2
3
4
5
6
7
8
9
10
11
12
13
 JsonRpc rpc;

  public Task AttachForCustomMessageAsync(JsonRpc rpc)
  {
      this.rpc = rpc;
      return Task.CompletedTask;
  }

  public async Task SendMessageToServer()
  {
      string text = await rpc.InvokeWithParameterObjectAsync<string>("GetText");
      MessageService.ShowMessage("Text from language server:", text);
  }

Middle Layer

The ILanguageClientCustomMessage defines a MiddleLayer property. An object returned from the MiddleLayer property can be used to intercept messages sent to and received from the Language Server. The MiddleLayer object can implement the following interfaces:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
using System;
using System.Threading.Tasks;
using Microsoft.VisualStudio.LanguageServer.Client;
using Microsoft.VisualStudio.LanguageServer.Protocol;

namespace MockLanguageExtension
{
  class MiddleLayerProvider : ILanguageClientCompletionProvider
  {
      public Task<object> RequestCompletions(
          TextDocumentPositionParams param,
          Func<TextDocumentPositionParams, Task<object>> sendRequest)
      {
          return sendRequest(param);
      }

      public async Task<CompletionItem> ResolveCompletion(
          CompletionItem item,
          Func<CompletionItem, Task<CompletionItem>> sendRequest)
      {
          return await sendRequest(item);
      }
  }
}

Note that currently not all the Language Server messages can be intercepted.

The full source code to the sample Language Server Client Extension created whilst writing this blog post is available on GitHub

There are other examples included with the Language Server Client extension source code on GitHub, however these are not standalone and are compiled with the Language Server Client extension.

.NET Core Support in Visual Studio for Mac 7.4

Changes

  • Solution window detects file system changes outside Visual Studio for Mac
  • Projects with unknown target frameworks can now be loaded
    • MSBuild SDK Extras is now supported without requiring an extra extension to be installed
    • Tizen.NET projects are now supported
  • Fixed xUnit test messages not being displayed
  • ASP.NET Core minified files are no longer formatted
  • Support target framework defined in another MSBuild property
  • Show SDK information before dependencies are restored
  • Fixed failure to add new file when the default project namespace contains only numbers
  • Fixed remove item not added for .xaml.cs file
  • Fixed incorrect project updates when moving a file

More information on all the new features and changes in Visual Studio for Mac 7.4 can be found in the release notes.

Solution window detects file system changes

Files created in the project directory, or a subdirectory, outside Visual Studio for Mac are now added to the project and appear in the Solution window automatically.

File added and removed from command line - Solution window updated

Deleting project files and directories will remove the files from the Solution window. The Solution window will also update after a file or a directory is renamed outside Visual Studio for Mac.

Allow unknown target framework projects to be loaded

The target framework of an SDK style project is no longer restricted. Previously Visual Studio for Mac would fail to load an SDK style project unless its target framework was .NET Standard, .NET Core App or .NET Framework.

This allows Tizen projects to be loaded without the error message “Project does not support framework ‘Tizen,Version=v4.0’” being displayed. Tizen projects have a Tizen.NET package reference which imports an MSBuild .props file that defines the Tizen target framework.

The MSBuild.Sdk.Extras NuGet package is now supported so SDK style projects can use target frameworks that this NuGet package supports, such as Xamarin.iOS and MonoAndroid.

On building a project with an unknown target framework, that is not defined by any used NuGet package references, a build error that indicates the framework is not supported will occur:

The TargetFramework value 'test1.0' was not recognized.

NuGet restore will also fail for an unknown target framework with a message indicating the framework is invalid.

Bug Fixes

Fix xUnit test messages not displayed

xUnit tests support an ITestOutputHelper interface which can be passed to the constructor of the test. This has a WriteLine method which can be used to output messages whilst running the test. When this was used the text displayed in Visual Studio for Mac’s Test Results window was:

Microsoft.VisualStudio.TestPlatform.ObjectModel.TestResultMessage

Now the text from the message is shown in the Tests Results window.

Support target framework defined in another MSBuild property

An SDK style project that defined the element to be another MSBuild property would fail to restore.

In the example below the property TheFramework is defined in the Frameworks.props file.

<Project Sdk="Microsoft.NET.Sdk">
  <Import Project="Frameworks.props" />
  <PropertyGroup>
    <TargetFrameworks>$(TheFramework)</TargetFrameworks>
  </PropertyGroup>
</Project>

The unevaluated MSBuild property value was used and would result in the NuGet package restore failing.

Now the evaluated property value is used when restoring dependencies.

ASP.NET Core minified files and map files are no longer formatted

On creating a new ASP.NET Core project the minified files were being re-formatted and were no longer minified. Now the .min.css, .min.js and .map files are excluded from being re-formatted when a new ASP.NET Core project is created.

Fixed failure to add a new file when the default project namespace contains only numbers

If a project has a default namespace of ‘1’ then adding a new C# file from a template would throw a null reference exception. The problem was that the sanitized namespace for the project’s default namespace was null.

Show SDK information before dependencies are restored

When a new .NET Core project is created the Dependencies – SDK folder would show no items until the NuGet package restore completed. Now the SDK dependency is shown whilst the dependencies are being restored.

Fixed remove item not added for .xaml.cs file

When a new content page with xaml file was added and then removed, but not deleted, a remove item was not added for the .xaml.cs file.

Fixed incorrect project updates when moving a file

Moving a Resource file from one folder to another would not update the project file correctly. Either the project file would not be modified or the file would be removed.

One problem was that on moving a clone is taken of the original item and the associated MSBuild item was copied but was still referring back to the original location. Another problem was that an incorrect match was being made when looking for remove items resulting in the wrong files being removed from the project.

Fixed being unable to use NUnit in a .NET Core test project

The problem was that the NUnit test provider, which supports running NUnit tests for non .NET Core projects, was finding a PackageReference for NUnit, and then trying to load the tests for the .NET Core project and failing. To fix this the NUnit test provider now ignores .NET Core projects so the VS Test provider will load the tests for the project.

NuGet Support in Visual Studio for Mac 7.4

Changes

  • Support NuGet RestoreProjectStyle MSBuild Property
  • .NET Core xUnit tests not displayed if NuGet packages not cached
  • No tests displayed when project uses a NUnit PackageReference
  • NuGet MSBuild imports not removed when migrating to project.json

More information on all the new features and changes in Visual Studio for Mac 7.4 can be found in the release notes.

Support RestoreProjectStyle MSBuild property

If a project sets the RestoreProjectStyle property to be PackageReference then the project will be restored as though it has PackageReferences even if it does not have any.

<RestoreProjectStyle>PackageReference</RestoreProjectStyle>

This fixes runtime problems when a project references a .NET Standard project that has PackageReferences. Without the RestoreProjectStyle set the assemblies from the NuGet packages are not copied to the output directory and would have to be added to the main project.

Bug Fixes

.NET Core xUnit tests not displayed if NuGet packages are not in local NuGet cache

If the NuGet packages that contain the VS Test adapters were not available in the local machine’s NuGet package cache then the Unit Tests window would not show any tests after the NuGet packages were restored and the project was compiled.

Visual Studio for Mac would not initially find any test adapter dlls and would not attempt to discover any tests for the project after the NuGet packages were downloaded into the NuGet package cache.

Now after the NuGet package restore has completed the check for a VS Test adapter is now re-run.

No tests displayed when a project uses a NUnit PackageReference

The Unit Tests window would not show any unit tests when a non .NET Core project contained a NUnit PackageReference. Visual Studio for Mac was looking for a PackageReference that contained ‘nunit.framework’ and was not finding the NUnit NuGet package reference.

NuGet MSBuild imports not removed when migrating to project.json

When a Portable Class Library project was migrated to use a project.json file the MSBuild imports added by NuGet were not removed. These imports are added by NuGet into the generated ProjectName.nuget.props and ProjectName.nuget.targets files on restoring a project.json file. Leaving the import in the project file would result in the import being used twice. When a PCL project that used Xamarin.Forms was migrated to project.json the project would fail to compile with the error:

Error XF001: Xamarin.Forms targets have been imported multiple times.
Please check your project file and remove the duplicate import(s).

Now on migrating to project.json the MSBuild imports added by NuGet packages to the project are removed.

Fix unhandled exception when searching for packages

An unhandled exception was being logged if a package source returned an error or the package source url was invalid. This was because a task was not being observed when the package sources were being used.