The lifecycle of a code AI completion
Demystifying code AI: Learn how Cody analyzes context, retrieves references, prompts models, and refines completions behind the scenes.
Quantization · Hugging Face
huggingface.coWe’re on a journey to advance and democratize artificial intelligence through open source and open science.
Let's talk about Siri
Last weekend I spent some serious time with Siri for the first time in a couple years. A lot has changed since I last took a look. Since iOS 15, all NLU processing is done locally on device. There's a local speech-to-text model, a local natural-language-understanding module, and a local text-to-speech model. All logic appears hard-coded and baked into the current iOS version.
Benchmarking GPT-Fast on a Volta Architecture GPU
Takeaways from benchmarking gpt-fast for local LLM inference on older hardware.