File:Process of a Single Attention Head in a Transformer Model.jpg
Jump to navigation
Jump to search
Size of this preview: 645 × 599 pixels. Other resolutions: 258 × 240 pixels | 517 × 480 pixels | 827 × 768 pixels | 1,102 × 1,024 pixels | 2,000 × 1,858 pixels.
Original file (2,000 × 1,858 pixels, file size: 298 KB, MIME type: image/jpeg)
Summary
| Description |
English: Visual representation of the self-attention mechanism within a single Transformer attention head, showing the transformation into Query, Key, and Value vectors and the weighted scoring process. |
| Date | |
| Source | Bioinformatics Advances, Volume 3, Issue 1, 2023, vbad001, https://doi.org/10.1093/bioadv/vbad001 |
| Author | Shuang Zhang, Rui Fan, Yuti Liu, Shuang Chen, Qiao Liu, Wanwen Zeng |
Licensing
This file is licensed under the Creative Commons Attribution 4.0 International license.
- You are free:
- to share – to copy, distribute and transmit the work
- to remix – to adapt the work
- Under the following conditions:
- attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
File history
Click on a date/time to view the file as it appeared at that time.
| Date/Time | Thumbnail | Dimensions | User | Comment | |
|---|---|---|---|---|---|
| current | 14:46, 30 November 2025 | | 2,000 × 1,858 (298 KB) | wikimediacommons>VV A-D-C-Y | Uploaded a work by Shuang Zhang, Rui Fan, Yuti Liu, Shuang Chen, Qiao Liu, Wanwen Zeng from Bioinformatics Advances, Volume 3, Issue 1, 2023, vbad001, https://doi.org/10.1093/bioadv/vbad001 with UploadWizard |
File usage
The following page uses this file:
