Glossary

Edge computing involves processing data closer to its source (e.g., sensors, devices) instead of relying solely on centralized data centers.

vLLM is a flexible framework or implementation of a large language model that optimizes memory and computation for faster inference.

ResNet is a deep learning architecture designed to solve the problem of vanishing gradients in very deep networks by introducing skip connections.

Amazon SageMaker is a fully managed cloud service that simplifies the building, training, and deployment of machine learning models.