Does DeepNetworkDesigner support Transformer Layers?
12 visualizzazioni (ultimi 30 giorni)
Mostra commenti meno recenti
I want to add Transofmrer Layers while designing the network for deep learning using MATLAB DeepNetworkDesigner, but it doesn't show me such option. How can I add Transofmer Layers to the network designed using DeepNetworkDesigner?
0 Commenti
Risposte (2)
Matt J
il 14 Gen 2024
If the transformer layer is a custom layer that you have created for yourself, you would import it to deepNetworkDesigner from the workspace, as explained here,
0 Commenti
David Ho
il 18 Gen 2024
Hi Subhadip,
In R2023b, the following layers are supported in Deep Network Designer that are commonly used in transformers:
- selfAttentionLayer
- wordEmbeddingLayer (requires Text Analytics Toolbox)
- sinusoidalPositionEncodingLayer
- positionEmbeddingLayer
- embeddingConcatenationLayer
- indexing1dLayer
- patchEmbeddingLayer (requires Computer Vision Toolbox)
Best regards,
David
0 Commenti
Vedere anche
Categorie
Scopri di più su Image Data Workflows in Help Center e File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!