Get in Touch
 Duration 21 hours

Course Outline

Introduction to TinyML and Embedded AI

  • Attributes of TinyML model deployment
  • Limitations in microcontroller environments
  • Overview of embedded AI toolchains

Foundations of Model Optimisation

  • Comprehending computational bottlenecks
  • Identifying memory-intensive operations
  • Baseline performance profiling

Quantisation Techniques

  • Post-training quantisation strategies
  • Quantisation-aware training
  • Assessing the trade-off between accuracy and resources

Pruning and Compression

  • Structured and unstructured pruning methods
  • Weight sharing and model sparsity
  • Compression algorithms for lightweight inference

Hardware-Aware Optimisation

  • Deploying models on ARM Cortex-M systems
  • Optimising for DSP and accelerator extensions
  • Memory mapping and dataflow considerations

Benchmarking and Validation

  • Latency and throughput analysis
  • Power and energy consumption measurements
  • Accuracy and robustness testing

Deployment Workflows and Tools

  • Leveraging TensorFlow Lite Micro for embedded deployment
  • Integrating TinyML models with Edge Impulse pipelines
  • Testing and debugging on actual hardware

Advanced Optimisation Strategies

  • Neural architecture search for TinyML
  • Hybrid quantisation-pruning approaches
  • Model distillation for embedded inference

Summary and Next Steps

Requirements

  • A solid grasp of machine learning workflows
  • Hands-on experience with embedded systems or microcontroller development
  • Proficiency in Python programming

Target Audience

  • AI researchers
  • Embedded ML engineers
  • Professionals developing inference systems under resource constraints

Upcoming Courses

Related Categories