Get in Touch

Course Outline

Introduction to Cambricon and MLU Architecture

  • Overview of Cambricon’s AI chip portfolio.
  • MLU architecture and instruction pipeline.
  • Supported model types and use cases.

Installing the Development Toolchain

  • Installing BANGPy and Neuware SDK.
  • Setting up the environment for Python and C++.
  • Model compatibility and preprocessing.

Model Development with BANGPy

  • Tensor structure and shape management.
  • Computation graph construction.
  • Custom operation support within BANGPy.

Deploying with Neuware Runtime

  • Converting and loading models.
  • Execution and inference control.
  • Best practices for edge and data centre deployment.

Performance Optimization

  • Memory mapping and layer tuning.
  • Execution tracing and profiling.
  • Common bottlenecks and solutions.

Integrating MLU into Applications

  • Utilizing Neuware APIs for application integration.
  • Streaming and multi-model support.
  • Hybrid CPU-MLU inference scenarios.

End-to-End Project and Use Case

  • Lab: Deploying a vision or NLP model.
  • Edge inference with BANGPy integration.
  • Testing accuracy and throughput.

Summary and Next Steps

Requirements

  • A fundamental understanding of machine learning model structures.
  • Practical experience with Python and/or C++.
  • Familiarity with concepts regarding model deployment and acceleration.

Audience

  • Embedded AI developers.
  • ML engineers deploying solutions to edge or data centre environments.
  • Developers working with Chinese AI infrastructure.
 21 Hours

Testimonials (1)

Upcoming Courses

Related Categories