summaryrefslogtreecommitdiff
path: root/Documentation
diff options
context:
space:
mode:
authorSwaroop Sridhar <Swaroop.Sridhar@microsoft.com>2019-03-27 14:03:25 -0700
committerGitHub <noreply@github.com>2019-03-27 14:03:25 -0700
commitc3e1bd5ccc482c9a7670762676bda95ebd34707d (patch)
tree4dfbe1b534001cbc653c0d9dfa7838a39f712070 /Documentation
parent6a48f05c77e80b604d71a9b84cc6b014306e849e (diff)
downloadcoreclr-c3e1bd5ccc482c9a7670762676bda95ebd34707d.tar.gz
coreclr-c3e1bd5ccc482c9a7670762676bda95ebd34707d.tar.bz2
coreclr-c3e1bd5ccc482c9a7670762676bda95ebd34707d.zip
Update DllMap doc (#22804)
* Update DllMap doc Update DllMap design doc: * To note the NativeLibrary APIs that can be used to implement DllMap * To point to a sample implementation of DllMap.
Diffstat (limited to 'Documentation')
-rw-r--r--Documentation/design-docs/dllmap.md286
1 files changed, 16 insertions, 270 deletions
diff --git a/Documentation/design-docs/dllmap.md b/Documentation/design-docs/dllmap.md
index ace8f05e7d..0833dab282 100644
--- a/Documentation/design-docs/dllmap.md
+++ b/Documentation/design-docs/dllmap.md
@@ -1,287 +1,33 @@
-# Dllmap design document
-This document is intended to describe a design of a Dllmap feature for .NET Core.
+# DllMap
+DllMap is a mechanism to influence native library load resolution via a name mapping. DllMap feature facilitates writing platform-agnostic library invocations (`pInvoke`) in managed code, while separating the platform-specific naming details to a separate configuration file. This document describes how DllMap can be realized in .Net Core.
-Author: Anna Aniol (@annaaniol)
+### Dllmap in Mono
-PR: https://github.com/dotnet/coreclr/pull/19826
+Mono implements [Dllmap](http://www.mono-project.com/docs/advanced/pinvoke/dllmap/) using an XML configuration for name mappings. For example:
-API proposal: https://github.com/dotnet/corefx/issues/32015
-
-## Background
-
-### .NET Core P/invoke mechanism
-There is a .NET directive ([DllImport](https://msdn.microsoft.com/en-us/library/system.runtime.interopservices.dllimportattribute(v=vs.110).aspx)) indicating that the attributed method is exposed by an unmanaged DLL as a static entry point. It enables to call a function exported from an unmanaged DLL inside a managed code. To make such a call, library name must be provided. Names of native libraries are OS-specific, so once the name is defined, the call can be executed correctly on one OS only.
-
-Right now, CoreCLR has no good way to handle the differences between platforms when it comes to p/invoking native libraries. Here is an example usage of DllImport:
-```c#
-// Use DllImport to import the Win32 MessageBox function.
-[DllImport("user32.dll", CharSet = CharSet.Unicode)]
-public static extern int MessageBox(IntPtr hWnd, String text, String caption, uint type);
-```
-This import works on Windows, but it doesn’t work on any other OS. If run e.g. on Linux, a DllNotFoundException will be thrown,
-which means that a DLL specified in a DLL import directive cannot be found.
-
-### Mono’s Dllmap
-
-Mono already provides a feature that addresses the problem of cross-platform p/invoke support. Mono’s [Dllmap](http://www.mono-project.com/docs/advanced/pinvoke/dllmap/)
-enables to configure p/invoke signatures at runtime. By providing an XML configuration file,
-user can define a custom mapping between OS-specific library names and method names.
-Thanks to that, even if a library defined in DllImport is incompatible with an OS that is currently running the application,
-a correct unmanaged method can be called (if it exists for this OS).
-
-In Mono Dllmap feature custom mapping can be tightly specified based on the OS name, CPU name and a wordsize.
-
-This simple Mono example maps references to the cygwin1.dll library to the libc.so.6 file:
```xml
<configuration>
- <dllmap dll="cygwin1.dll" target="libc.so.6"/>
+ <dllmap dll="MyLib.dll" target="YourLib.dll"/>
+ <dllmap os="windows" dll="libc.so.6" target="cygwin1.dll"/>
</configuration>
```
-Mono dllmap logic is implemented in [metadata/mono-config.c](https://github.com/mono/mono/blob/master/mono/metadata/mono-config.c)
-and [metadata/loader.c](https://github.com/mono/mono/blob/master/mono/metadata/loader.c) files.
-
-## Expectations
-
-### .NET Core Dllmap
-
-.NET Core Dllmap’s purpose is to deliver a cross-platform support for the p/invoke mechanism in .NET.
-With Dllmap user will be able to control interop methods by defining custom mapping between OS-specific dll names.
-
-Use of entrypoint mappings does not seem to be widespread in publicly searchable code.
-.NET Core Dllmap won't support entrypoint mappings as Mono does. We can come back to it if necessary.
-
-Target platforms for this feature are: Windows, Linux and OS X.
-
-There will be a diagnostic mechanism available to monitor dllmap related issues.
-
-### Interaction with Dllmap
-
-#### Mono users: Mono compatibility
-The Dllmap method is meant as a compatibility feature for Mono and provides users with a straightforward migration story from Mono to .NET Core applications having p/invokes
-for applications that *do not use entrypoint mappings*.
-The Mono-like dllmap behavior will consume a configuration file of [the same style](http://www.mono-project.com/docs/advanced/pinvoke/dllmap/) as Mono does.
-Users will be able to use their old Mono configuration files when specifying the mapping for .NET Core applications.
-Configuration files must be placed next to the assemblies that they describe.
-
-#### New users: flexibility
-New users, who plan to support p/invokes in their cross-platform applications, should implement their custom mapping policies that satisfies their needs.
-The runtime will use a specific callback on each dll load attempt.
-The user’s code can subscribe to these callbacks and define any mapping strategy.
-The default Mono-like mapping methods are provided for an easier migration from Mono.
-For newcomers, it’s highly recommended to use callbacks and implement their own handers. Details of the callback strategy are described in the Design section.
-
-### Usage example (XML configuration)
-
-Let’s say there is a customer developing a .NET application with p/invokes on Windows.
-The customer wants the application to run on both Windows and Linux without introducing any changes in the code.
-
-The application calls a function `MyFunction()` from an OS-specific library `libWindows.dll`.
-```c#
-[DllImport("libWindows.dll")]
-static extern uint MyFunction();
-```
-
-To make it work on Linux, that does not have `libWindows.dll`, user must define a mapping of the dll.
-To achieve this, the user puts an XML configuration file next to the dll that is about to be loaded. The file looks like this:
-```xml
-<configuration>
- <dllmap dll="libWindows.dll" target="libLinux.so.6" />
-</configuration>
-```
-
-With this file, all calls to `libWindows.dll` get automatically mapped to calls to `libLinux.so.6` on runtime.
-If only `libLinux.so.6` has a corresponding `MyFunction()` method, it gets called and the end user
-can’t see any difference in application’s behavior. Running the application cross-platform does not require any OS-specific changes in the code.
-All the mapping is defined in advance in the external configuration file.
-
-This is a very basic scenario and it can be extended to different operating systems and libraries.
-It assumes that user does not implement any custom actions (handlers) but uses the default Mono-like dllmap behavior.
-
-## Design
-### XML configuration file
-For a basic case, the mapping must be defined in an XML configuration file and placed next to the assembly that requires mapping of p/invokes.
-The file must be named AssemblyName.config where AssemblyName is a name of the executable for which the mapping is defined.
-
-XML parsing will be implemented in corefx.labs using XML parsers that .NET provides.
-
-### Library mapping
-In [dllimport.cpp](https://github.com/dotnet/coreclr/blob/master/src/vm/dllimport.cpp) file there is a method that loads the DLL and finds the procaddress for an N/Direct call.
-```c++
-VOID NDirect::NDirectLink(NDirectMethodDesc *pMD)
-{
- …
- HINSTANCE hmod = LoadLibraryModule( pMD, &errorTracker );
- …
- LPVOID pvTarget = NDirectGetEntryPoint(pMD, hmod);
- …
- pMD->SetNDirectTarget(pvTarget);
-}
-```
-`LoadLibraryModule` is responsible for loading a correct library and `NDirectGetEntryPoint ` is responsible for resolving a right entrypoint.
-
-There are several functions that get called in `LoadLibraryModule` to get an hmod of the unmanaged dll.
-If any of them returns a valid hmod, execution flow ends and the hmod gets returned.
-
-The proposed change extracts the logic of `LoadLibraryModule` and places it in a new function called `LoadLibraryModuleHierarchy`.
-`LoadLibraryModule` calls two functions:
-
-```c++
-hmod = LoadLibraryViaCallback(Assembly* pAssembly, AppDomain* pDomain, const wchar_t* wszLibName, BOOL searchAssemblyDirectory, DWORD dllImportSearchPathFlag);
-if(hmod == null)
-{
- hmod = LoadLibraryModuleHierarchy(Assembly *pAssembly, LPCWSTR wszLibName, BOOL searchAssemblyDirectory, DWORD dllImportSearchPathFlag);
-}
-```
-
-`LoadLibraryViaCallback` executs a callback for all assemblies except `System.Private.CoreLib`,
-which can’t be mapped at any time. The check to determine if the assembly is `System.Private.CoreLib` will happen on runtime in the unmanaged code.
-
-`LoadLibraryViaCallback` makes a call to managed code and managed code decides which dll to load (if mapping/custom behavior has been defined).
-Managed code calls `LoadLibraryModuleHierarchy` with updated parameters (e.g. with a mapped name) and passes a result back to unmanaged code.
-
-If there was no custom loading behavior defined for the assembly that triggered the callback, then LoadLibraryViaCallback returns a null pointer
-and LoadLibraryModuleHierarchy gets called with the original parameters from the DllImport directive.
-
-### Callbacks
-
-On each dll load attempt, the unmanaged code will make a call to a managed method(`LoadLibraryCallback`). On the managed side there is a map that maps
-an assembly to a specific callback that should be executed when `LoadLibraryCallback` gets called.
-
-Users can implement their own callback functions and register them for a specific assembly or for all project assemblies. Implementing own customized handlers is highly recommended.
-That gives a user full flexibility when using dllmap and doesn't limit defining the mapping to only XML-based style.
-Callbacks can be executed for all assemblies except `System.Private.CoreLib`.
-
-For those, who only want Mono compatibility, implementation of Mono-style callbacks will be placed in `corefx.labs`.
-
-Registering more than one callback per assembly will throw an exception.
-
-### Example resolution flow
-
-**User’s code**
-
-```c#
-using System.Runtime.InteropServices;
-
-// Implements a handler of AssemblyLoad event (raised for every assembly on its load)
-public static void AssemblyLoadCallbackHandler(object sender, AssemblyLoadEventArgs args)
-{
- Assembly assembly = args.LoadedAssembly;
- // Registers a speific callback for the given assembly
- NativeLibrary.RegisterNativeLibraryLoadCallback(assembly, SimpleCallbackHandler);
-}
-
-
-// Implements a custom callback function that does the mapping and calls
-// NativeLibrary.Load to load a library with updated parameters
-public static Func<LoadNativeLibraryArgs, NativeLibrary> SimpleCallbackHandler = SimpleCallbackHandlerLogic;
-
-public static NativeLibrary SimpleCallbackHandlerLogic(LoadNativeLibraryArgs args)
-{
- string libraryName = args.LibraryName;
- DllImportSearchPath dllImportSearchPath = args.DllImportSearchPath;
- Assembly assembly = args.CallingAssembly;
-
- if (libraryName == "TheNameToReplace")
- {
- libraryName = "TheCorrectName";
- NativeLibrary nativeLibrary = NativeLibrary.Load(libraryName, dllImportSearchPath, assembly);
- return nativeLibrary;
- }
- return new NativeLibrary("LibraryNotFound", IntPtr.Zero);
-}
-
-
-// Declares the actual interop function
-[DllImport("TheNameToReplace.dll", EntryPoint="MyFunction")]
-static extern int MyFunction();
-
-public static int Main()
-{
- // Registers a callback per each assembly of the current domain that gets loaded
- AppDomain.CurrentDomain.AssemblyLoad += AssemblyLoadCallbackHandler;
- // Executes the imported function
- // It will execute MyFunction() from TheCorrectName.dll
- MyFunction();
-}
-```
-
-**Runtime [unmanaged code]**
-- Calls `LoadLibraryCallback` that executes a `callback` function to check for mappings and load a dll if there was a mapping strategy defined
-
-**System.Runtime.InteropServices.LoadLibrary**
-- Is a public sealed class with `Name` and `Handle`
-- Exposes a `Load` method for loading a native library
-```c#
-public static NativeLibrary Load(string libraryName);
-public static NativeLibrary Load(string libraryName, DllImportSearchPath dllImportSearchPath, Assembly assembly);
-```
-- Defines a method to register a callback per assembly
-```c#
-public static void RegisterNativeLibraryLoadCallback(Assembly assembly, Func<LoadNativeLibraryArgs, NativeLibrary> callback)
-```
-
-**corefx.labs**
-- Implements Mono compatibile handler with XML parsing
-
-## Testing
-
-To verify if Dllmap’s behavior is correct, cross-platform tests will be run: [Mono tests](https://github.com/mono/mono/tree/0bcbe39b148bb498742fc68416f8293ccd350fb6/mcs/tools/mono-shlib-cop) and custom tests created on purpose of this feature.
-Custom tests must contain calls to native libraries. It doesn’t really matter what functions from which libraries get called, because the feature is about mapping things independently from method and library exact names. There are multiple dimensions that must be included in tests:
-
-**OS**. When it comes to the OS, there are three main target platforms for this feature: Windows, Linux and OS X. All the Linux based systems are so architecturally similar, so they are named just “Linux” in this document. Ubuntu 16.04LTS will be used for testing.
-Test cases:
-
-|Develop (initial dll) |Run (target dll)|
-|--|--|
-|Windows |Windows |
-|Windows |Linux |
-|Windows |OS X |
-|Linux | Windows|
-|Linux |OS X |
-|Linux |OS X |
-|OS X |Windows|
-|OS X |Linux |
-|OS X |OS X
-
-**System's architecture** – test cases:
+Mono also permits mapping of method names within libraries, but with the restriction that the original and mapped methods must have the same signature. This document does not deal with mapping method names or signatures.
-|Develop |Run |
-|--|--|
-|32-bit |32-bit|
-|32-bit|64-bit|
-|64-bit|32-bit |
-|64-bit| 32-bit|
+### Dllmap in .Net Core
-**Path mapping** – test cases:
+#### NativeLibrary APIs
-|Initial dll path |Target dll path|
-|--|--|
-|absolute |absolute|
-|absolute|relative|
-|relative|absolute |
-|relative| relative|
-
-**Dll naming** – test cases:
+.Net Core 3 provides a rich set of APIs to manage native libraries, as well as callbacks to influence native library resolution.
-|Initial dll name |Target dll nanme|
-|--|--
-|with extension (foo.dll)|with extension|
-|with extension|no extension|
-|no extension (foo)|with extension|
-|no extension| no extension|
-**Resistance to errors in the config file** - test cases:
-- correct config file
-- config file that can't be parsed &rightarrow;
-log a warning, ignore the mapping for the corresponding assembly &rightarrow; on some platforms (where mapping is not required) execute application, on some throw DllNotFoundException
-- config file pointing to a dll that can't be found &rightarrow; on the affected platforms throw a DllNotFoundException
+- [NativeLibrary APIs](https://docs.microsoft.com/en-us/dotnet/api/system.runtime.interopservices.nativelibrary?view=netcore-3.0): Perform operations on native libraries (such as `Load()`, `Free()`, get the address of an exported symbol, etc.) in a platform-independent way from managed code.
+- [DllImport Resolver callback](https://docs.microsoft.com/en-us/dotnet/api/system.runtime.interopservices.nativelibrary.setdllimportresolver?view=netcore-3.0): Gets a callback for first-chance native library resolution using custom logic.
+- [Native Library Resolve event](https://docs.microsoft.com/en-us/dotnet/api/system.runtime.loader.assemblyloadcontext.resolvingunmanageddll?view=netcore-3.0): Get an event for last-chance native library resolution using custom logic.
-All the above test cases will be covered.
+These APIs can be used to implement custom native library resolution logic, including Mono-style DllMap.
-### Related discussions
-[Lightweight and dynamic driving of P/Invoke](https://github.com/dotnet/coreclr/issues/19112)
+#### DllMap Sample
-[Handling p/invokes for different platforms and discussions about dllmap](https://github.com/dotnet/coreclr/issues/930)
+A sample implementation of DLLMap using the NativeLibrary APIs is here: [DllMap Sample](https://github.com/dotnet/samples/tree/master/core/extensions/DllMapDemo).
-[Add NativeLibrary class PR](https://github.com/dotnet/coreclr/pull/16409/commits/7ece113b5f58111ee934d923e1ea213ba50f4224)