Mellanox Technologies ===================== =============================================================================== Mellanox WinOF VPI for Windows Release Notes Revision 3.0.0, February 2012 ============================================================================== Table of Contents =============================================================================== 1. Overview 2. Mellanox WinOF VPI Package Contents 3. Supported Operating Systems and CPU Architectures 4. Supported HCA Adapter Cards and Firmware Versions 5. New Features and Changes From Previous Versions 6. Beta Features 7. Known Issues =============================================================================== 1. Overview =============================================================================== These are the release notes for Mellanox VPI version 3.0.0, InfiniBand and Ethernet drivers, part of the MLNX VPI release. The driver is intended for Mellanox ConnectX(R) based adapter cards that are identified on the PCI bus as one of the following PCI Device IDs (decimal): 25408, 25418, 25448, 25458, 26418, 26428, 26448, 26458 or 4099. This software package includes several software modules that can be used on a computer cluster configured as an InfiniBand subnet. Mellanox VPI is based on WinOF which was developed under Windows OpenFabrics, http://openfabrics.org. Mellanox VPI for Windows is presented as .exe packages, one for each supported operating systems. For further details, please see Section 3 below. =============================================================================== 2. Mellanox WinOf VPI Package Contents =============================================================================== The Mellanox WinOF VPI for Windows package contains the following components: - Core and ULPs: o IB HCA low-level drivers (mlx4) o IB Access Layer (IBAL) o Ethernet driver (ETH) o Upper Layer Protocols (ULPs): - IP over InfiniBand (IPoIB) - NetworkDirect (ND) - Utilities: o OpenSM (OSM): InfiniBand Subnet Manager (beta level) o Low level performance tools o vstat - get the card status o SdpConnect - SDP\WSD test - IB Diagnostics tools - SW Development Kit (SDK) - Documentation =============================================================================== 3. Supported Operating Systems =============================================================================== - Supported Operating Systems and Service Packs: o Windows 7 (x86, x64) o Windows Server 2008 (x86, x64) o Windows Server 2008 R2 (x64) =============================================================================== 4. Supported Network Adapter Cards and Firmware Versions =============================================================================== Mellanox WinOF VPI 3.0.0 supports the following Mellanox network adapter cards: - IB - ConnectX®-2 EN IB SDR/DDR/QDR (fw-25408 Rev 2.9.1000) - VPI / Ethernet - ConnectX® / ConnectX®-2 / ConnectX® EN / IB SDR/DDR/QDR (fw-25408 Rev 2.9.1000) - ConnectX®-3 FDR/SDR/QDR (fw-25408 Rev 2.10.0000 and higher) For official firmware versions please visit http://www.mellanox.com/content/pages.php?pg=firmware_download =============================================================================== 5. New Features and Changes From Previous Versions =============================================================================== 5.1 VPI Drivers New Features and Changes From Version 2.1.3 ----------------------------------------------------------- Ethernet Features -------------------- - Added RoCE support - Added support for 40GigE Ethernet - Added support for Hyper-V with Virtual Machine Queue (VMQ) - Added support for header data separation for Ethernet IPoIB Features -------------------- - IPoIB performance improvements - Added RSS Support for IPoIB - Modified the UI - Full IPv6 support for IPoIB including DHCP Management Features ---------------------- - Added support for OpenSM v3.3.11 (beta level) General Features ---------------------- - Added Auto Sensing support - Added ConnectX-3 support - Added FDR/FDR 10 support - Performance improvements for ConnectX-3 - Added support for more than 64 processors - Removed support for SDP/SRP/WSD - Changed the installation package to .exe instead of MSI - Removed the IBDiagnet tool from the Mellanox WinOF VPI v3.0.0 package 5.2 VPI Drivers New Features and Changes From Version 2.1.2 ----------------------------------------------------------- - Added support for Windows 7 (32 and 64 bits) - Added support for iSCSI boot - Mellanox drivers deletion (sys files) from system32\drivers directory upon uninstall - Added support for Altiris booting - Upgrade improvements when upgrading from 2.1.2 - Fixed a bug related to link status displaying. A link was displayed as disconnected although it was connected - Fixed a BlueScreen issue caused when the link was disconnected and the NIC configuration was IB and ETH - MLNX_WinOf_VPI v3.0.0 uses OpenSM v3.3.6 5.3 InfiniBand Drivers New Features and Changes From Version 2.1.2 ------------------------------------------------------------------------------- - Added support for software gateways - Increased the system memory allocation from 256GB to 8 TB - Added static IPv6 support - Added support for IPv6 neighbor discovery - Added support for receive methods such as: interrupts, polling and adaptive to improve network and/or system performance in certain configurations - Changed the default size of receive queue to 1024 and the max size to 2048 - Changed the minimum payload size to 600 bytes - Changed ibnetdiscover tool to display the machine name instead of the port description - Disabled WSD installation on windows 7 as it is not supported by the OS - Fixed a bug that caused driver starting failure - Fixed a bug in Linux related to windows interoperability 5.4 Ethernet Drivers New Features and Changes From Version 2.1.2 ------------------------------------------------------------------------------- - Added the “Fault Tolerance” failback option - Following is the new UI - Fixed a bug resulting in BlueScreen when the MCAT address was changed - Fixed a bug in MAC address setting that caused setting same MAC to multiple teams 5.5 InfiniBand Drivers New Features and Changes From Version 2.1.1 ------------------------------------------------------------------------------- - Using OpenSM 3.3.3 - Fixed OpenSM issues: - Memory leak - Command line parsing - Fixed memory leak in Network Direct provider when querying an adapter - Fixed BlueScreen (BS) issues caused when: - the driver was disabling - receiving illegal memory region address - the NIC interface contains multiple IPs - receiving DHCP discovery message - the unmap memory was not initialized - Fixed NMI BS issues that can happen on driver enabling or resetting - Removed firewall disabling during MLNX_WinOF_VPI installation - Added support to Repair and Upgrade while installing the package - Added InfiniBand tools such as ibroute.exe, ibtracert.exe, perfquery.exe, smpquery.exe, ibclearerrors.exe - Added ibv_* performance tools - Enabled IPoIB to work with Linux DHCP - ibal: Set timeout and retry values for RMPP messages - Improved scalability issues - Fixed wrong calculation of rate in ibstat tool - Added support for Dell GUIDs - Added missing options to read_bw and read_lat tools - Fixed issues that may have caused lost of interrupt - Removed inadequate event log - osmtest - created inventory file in case it does not exist when creating DB - Enabled sending mad message in DCP level - Perftests: Added a -d option to enable choosing the device to run on - Changed the setup settings of the installation process to not disable firewall on installation, by default - Fixed VPD read issues that disrupted the burned VPD 5.6 Ethernet Drivers New Features and Changes From Version 2.1.1 ------------------------------------------------------------------------------- - Added support to report the default link state when the link is connected to the ETH driver - Fixed a BlueScreen (BS) issue caused when the driver was disabling - Fixed issues that may have caused loss of interrupt - Fixed VPD read issues that disrupted the burned VPD - Fixed NMI BS issues that can happen on driver enabling or resetting - Removed inadequate event log - Removed firewall disabling during MLNX_WinOF_VPI installation - Added support to Repair and Upgrade while installing the package - Fixed RSS issues on Windows 2008 - Disabled header data split by default - Changed the number of RSS rings to 4 by default =============================================================================== 6. Beta Features =============================================================================== The following is a list of general limitations and known issues of the beta features included in this Mellanox WinOF VPI for Windows release. - OpenSM is currently at beta level. We do not recommend using it in deployment setups. If OpenSM is required in your setup, please use Mellanox Managed switch or download the OpenSM from http://openfabrics.org. - WinVerbs is currently at beta level. We recommend using ND over IBAL =============================================================================== 7. Known Issues =============================================================================== 7.1 InfiniBand Drivers Known Issues -------------------------------------------------------------------- The following is a list of general limitations and known issues of the various components included in this Mellanox WinOF VPI release. - IPoIB does not support: - MAC address change - QoS (packet priority) - Hyper-V - Load balancing and fail-over (LBFO) - Connected Mode - Setting multiple IP address on IPoIB interface on Window 2008 R2 is not functional due to Microsoft bug. - Memory Registration: Memory registration is limited to up to 20GB - In an interpobability environment that has both Linux and Windows OSs, the MTU value must be the same, otherwise packets larger than the minimum will not go through - Old InfiniBand application must be recompiled with latest SDK. - iSCSI boot over IPoIB is currently not functional. - When trying to configure and adapter card that has only one port, the following message is displayed and can be safely ignored: “An invalid registry PortType value was detected. The port will be initialized with default configuration” 7.2 Ethernet Drivers Known Issues ---------------------------------------------------------- The following is a list of general limitations and known issues of the various components included in this Mellanox WinOF VPI for Windows release. - VLAN creation: VLANs on the same machine cannot be assigned dynamic IPs (using DHCP) of the same subnet. - Replacing an adapter card may require reconfiguring LBFO bundles and/or VLANs - Changing the port type from ETH to IB is not supported if Vlan/LBFO is defined over the port. If you change, the following error is displayed "Upper VLANs have been detected. Please remove associated VLANs and repeat the operation." To change the port, remove the Vlan from the LBFO. - Hyper-V over LBFO is not supported. 7.3 RoCE Known Issues ---------------------------------------------------------- - RoCE does not support: - Routable RoCE - Traffic cannot go through the router - Multicast traffic - VLAN