Intel: AVX512, Python and AI

95 Pages·2012·7.28 MB·English

Intel: AVX512, Python and AI

Escola Supercomputador SDumont

Albino Aveleda
July 2017
AGENDA
•  Intel® Xeon® scalable processors (AVX-512)
•  Intel Python
•  Artificial Intelligence
Legal Disclaimers
Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific
computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you
in fully evaluating your contemplated purchases, including the performance of that product when combined with other products.
Relative performance is calculated by assigning a baseline value of 1.0 to one benchmark result, and then dividing the actual benchmark result for the baseline platform into each of the specific benchmark results of
each of the other platforms, and assigning them a relative performance number that correlates with the performance improvements reported.
Intel does not control or audit the design or implementation of third party benchmarks or Web sites referenced in this document. Intel encourages all of its customers to visit the referenced Web sites or others where
similar performance benchmarks are reported and confirm whether the referenced benchmarks are accurate and reflect performance of systems available for purchase.
Intel® Hyper-Threading Technology Available on select Intel® Xeon® processors. Requires an Intel® HT Technology-enabled system. Consult your PC manufacturer. Performance will vary depending on the specific
hardware and software used. For more information including details on which processors support HT Technology, visit http://www.intel.com/info/hyperthreading.
Intel® Turbo Boost Technology requires a Platform with a processor with Intel Turbo Boost Technology capability. Intel Turbo Boost Technology performance varies depending on hardware, software and overall
system configuration. Check with your platform manufacturer on whether your system delivers Intel Turbo Boost Technology. For more information, see http://www.intel.com/technology/turboboost
Intel processor numbers are not a measure of performance. Processor numbers differentiate features within each processor series, not across different processor sequences. See
http://www.intel.com/products/processor_number for details. Intel products are not intended for use in medical, life saving, life sustaining, critical control or safety systems, or in nuclear facility applications. All dates
and products specified are for planning purposes only and are subject to change without notice
Intel product plans in this presentation do not constitute Intel plan of record product roadmaps. Please contact your Intel representative to obtain Intel’s current plan of record product roadmaps. Product plans, dates,
and specifications are preliminary and subject to change without notice
Copyright © 2012-15 Intel Corporation. All rights reserved. Intel, the Intel logo, Xeon and Xeon logo , Xeon Phi and Xeon Phi logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the
United States and other countries. All dates and products specified are for planning purposes only and are subject to change without notice.
*Other names and brands may be claimed as the property of others.
3
Intel® Xeon® scalable processors
4
A Glimpse Inside the
Intel® Xeon® Scalable platform
Fabric Networking Accelerators SSDs Complementary
Intel® Omni-Path Intel® Ethernet Intel® QuickAssist Intel® Optane™ SSD Intel® FPGA
Architecture Intel® AVX-512 DC P4800X
INTEGRATED OPTIONS
Workload optimized frameworks & telemetry
(e.g. Caffe*, Intel® DAAL, Intel® MKL, DPDK, SNAP*, SPDK)
performance security Agility
Advancing virtually every aspect: Brand New core,
cache, on-die interconnects, memory controller & more
Intel® Advanced Vector Extensions 512 (Intel® AVX-512) Intel® Math Kernel Library (Intel® MKL) Data Plane Development Kit (DPDK)
Intel® Volume Management Device (Intel® VMD) Storage Performance Development Kit (SPDK) Intel® Resource Director Technology (Intel® RDT)
Intel® Data Analytics Acceleration Library (Intel® DAAL)

5
Breakthrough CPU Design: Intel® Mesh
Architecture

Mesh Architecture
ü  Maximizes performance
Ring Architecture
ü  Enables consistent, low latencies
ü  Optimized for data sharing and
memory access between all CPU
cores/threads for ideal memory
bandwidth and capacity
ü  Data flows scale efficiently for
2, 4 & 8+ socket configurations
ü  Designed for modern virtualized
and hybrid cloud implementations
2009-2017+
New in 2017
Designed for next-generation Data Centers
6
Intel® Xeon® Scalable processors for AI
Scalable performance for widest variety of AI & other datacenter workloads – including deep learning
Built-in ROI
Begin your AI journey today using
existing, familiar infrastructure
Potent performance
Train in days HOURS with up to 113X2 perf
vs. prior gen (2.2x excluding optimized SW1)

Production-ready
Most agile AI platform
Robust support for full range of
AI deployments
1,2Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems,
components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases,
including the performance of that product when combined with other products. For more complete information visit: http://www.intel.com/performance Source: Intel measured as of November 2016. Optimization Notice: Intel's compilers may or
may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include SSE2, SSE3, and SSSE3 instruction sets and other optimizations. Intel does not
guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors. Certain
optimizations not specific to Intel microarchitecture are reserved for Intel microprocessors. Please refer to the applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice.
Notice Revision #20110804. See slide 15 for configuration details.
7
The Intel® Xeon® Scalable Processors:

An Agile Solution Stack for Data Center Workloads Intel® Xeon® PLATINUM
PROCESSOR
Intel® Xeon® GOLD 81XX Series Platinum (2, 4, and 8
Socket)
PROCESSOR
+  Up to 28 Cores
+  2,4, or 8 socket configurations for
61XX Series Gold (2 and 4 Socket) best performance and scalability5
Intel® Xeon® SILVER +  Up to 22 Cores +  Topline memory channel
PROCESSOR +  Added 3rd UPI link for increased performance (1.5 TB memory
dataflow across cores bandwidth on select SKUs)
41XX Series Silver (2 Socket) +  Increased performance across +  3 UPI links option across 2S,4S,8S
Intel® Xeon® BRONZE +  Up to 12 cores memory channels6 for improved scalability and inter-core
PROCESSOR +  2S configuration with Improved +  Intel® AVX-512 with additional FMA data flow
+  Added Node Controller Support to
Memory channel performance
assist in scaled node management
+  Intel® Turbo Boost Technology
31XX Series Bronze (2 Socket)
for higher frequency capability 51XX Series Gold (2 and 4 Socket)
•  Up to 8 cores
+  Intel® HT Technology for hyper +  Up to 14 cores
•  2S configuration
threaded workloads +  Supports 2S and 4S configuration
•  Improved core interconnect (UPI)
for increased scalability
over past gen
+  Increased core interconnect speed to
•  48 PCIe 3.0 lanes
boost data flow in multi-processor
•  Intel® AVX-512 feature enabled
workloads The Best Performance,
•  Standard RAS features
+  Advanced RAS features
Scalability, Core options,
Efficient Performance at Low
Mainstream Performance, Fast and all Hardware-Enhanced
Entry Performance and Power. Provides more
Memory, More Interconnect Security features for the
security for price sensitive horsepower for single purpose
Engines, Advanced Reliability most robust capability
deployments workloads
Better performance, interconnectivity, scalability, and memory
Intel® Xeon® Scalable Processors for Technical Computing (HPC)
powerful and balanced performance integrated converged parallel
for diverse hpc workloads interconnect for programming environment for
compelling efficiency Intel® Xeon® scalable
Powerful performance
processors & Intel® Xeon Phi™
ü Up to 28 cores vs. 24 cores/22 cores (on Intel® Xeon® Integrated Intel® Omni-
processors
processor E7 v4 / Intel Xeon processor E5-2600 v4 families)
Path Architecture
ü Intel® AVX-512 delivers up to 2X FLOPs/clock-cycle peak designed for today’s HPC Highly integrated portfolio of
performance capability optimized for HPC, data analytics,
systems superior technologies and
and cryptography workloads1
ü New Intel® Mesh architecture with 3 Intel® Ultra Path ü Provides 100Gbps high- optimized software tools ensures
Interconnect lanes provides greater inter-CPU bandwidth bandwidth and low-latency code portability across IA solutions
for the most data-hungry, latency-sensitive applications fabric for HPC clusters
ü Intel AVX-512 enables converged
Significantly increased memory and I/O ü Reduces number of required programming environment for Intel Xeon
switches and lowers fabric
bandwidth Scalable Processor and Intel® Xeon Phi™
costs7, freeing up budget for up
Processor compute nodes
ü Up to 1.5x gen-to-gen memory bandwidth increase per to 24% more compute nodes8
CPU (6 memory channels) for extremely large compute- and ü Intel® Modern Code Developer Program
data-intensive workloads ü Denser 48-port switch chip enables the next decade of discovery
delivers a 33 percent increase9
ü More IO bandwidth with 48 PCIe 3.0 lanes vs. 40 lanes on over traditional InfiniBand switch, ü Intel® Parallel Studio XE 2017 upgrades
Intel Xeon processor E5-2600 v4 resulting in power, space and developer toolkit for HPC and technical
computing
ü Intel® Optane™ and Intel® 3D NAND solid state drives maintenance savings
deliver industry-leading combination of high throughput, low ü Intel® HPC Orchestrator simplifies
latency, high quality of service (QoS), and ultra high installation and ongoing maintenance of
endurance6 to break data access bottlenecks HPC system software stack
For footnotes and configurations, see slides 29-30.
9
Technologies & Features
Intel® xeon® Scalable processors
10