benchmark-kernel
Guide for benchmarking FlashInfer kernels with CUPTI timing
Explorez les skills IA publiés de flashinfer-ai et consultez leurs instructions source.
Skills indexés
7Étoiles des dépôts des skills indexés
15,370Forks du dépôt
2,197Moyenne des étoiles par skill indexé
2,196Les étoiles d’un dépôt peuvent se répéter entre ses skills.
Guide for benchmarking FlashInfer kernels with CUPTI timing
Tutorial for debugging CUDA crashes using API logging
Step-by-step tutorial for adding new CUDA kernels to FlashInfer
Track popular/new open-source LLMs and update docs/model_coverage.mdx with their kernel support status. Use when discovering new models to add to the coverage tracker, checking if a specific model is covered, o...
Clone SGLang, FlashInfer repositories from GitHub to tmp/. Use when setting up the project, preparing for kernel extraction, or when the user needs the source repositories.
Add pytest tests to validate reference implementations in flashinfer_trace against FlashInfer or SGLang ground truth. Use when validating kernel definitions, adding tests for new op_types, or verifying referenc...
Extract kernel schemas and definitions from SGLang model implementations with deduplication. Use when adding a new model, extracting GPU kernels (MLA, MoE, GQA, RMSNorm, GEMM), or generating Definition JSON fil...
Le classement utilise les étoiles du dépôt GitHub indexé. Plusieurs skills peuvent partager ce nombre : ce n’est ni un nombre d’installations ni une note de qualité.