Phi-3-MLX – Language and Vision Models for Apple Silicon

Hacker News

Phi-3-MLX is an open-source framework that brings the latest Phi-3 models to Apple Silicon using the MLX framework. It supports both the Phi-3-Mini-128K language model (updated July 2, 2024) and the Phi-3-Vision multimodal model, enabling a wide range of AI applications. Key features: 1. Apple Silicon Optimization: Leverages MLX for efficient execution on Apple hardware. 2. Flexible Model Usage: - Phi-3-Mini-128K for language tasks - Phi-3-Vision for multimodal capabilities - Seamless switching between language-only and multimodal tasks 3. Advanced Generation Techniques: - Batched generation for multiple prompts - Constrained (beam search) decoding for structured outputs 4. Customization Options: - Model and cache quantization for resource optimization - (Q)LoRA fine-tuning for task-specific adaptation 5. Versatile Agent System: - Multi-turn conversations - Code generation and execution - External API integration (e.g., image generation, text-to-speech) 6. Extensible Toolchains: - In-context learning - Retrieval Augmented Generation (RAG) - Multi-agent interactions The framework's flexibility unlocks new potential for AI development on Apple Silicon. Some unique aspects include: - Easy switching between language-only and multimodal tasks - Custom toolchains for specialized workflows - Integration with external APIs for extended functionality Phi-3-MLX aims to provide a user-friendly interface for a wide range of AI tasks, from text generation to visual question answering and beyond. GitHub: https://github.com/JosefAlbers/Phi-3-Vision-MLX Documentation: https://josefalbers.github.io/Phi-3-Vision-MLX/ I would love to hear your thoughts on potential applications for this framework and any suggestions for additional features or integrations.

Visit product View on Hacker NewsJul 19, 2024

Share card

Actual performance

3points

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: agent, model, apple · Missing: mac, agents, macos

98%98% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Indie HackersFits the IH revenue-focused audience · Strong signals: supports · Missing: reddit linkedin, podcasting, created

81%81% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

AppSumoStrong fit for a featured deal · Strong signals: friendly, interface, efficient · Missing: plus, platform, intuitive

66%66% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Hacker NewsMay not resonate with HN audience · Strong signals: ide, io · Missing: https docs, excited, just released

46%46% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal

30%30% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

11%11% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

I made Android boot on Apple Silicon34%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I made Android boot on Apple Silicon

Hacker News3

MLX (Apple Silicon tensor library) bindings for Erlang57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

MLX (Apple Silicon tensor library) bindings for Erlang

Hacker News1

Compressing vision-language and unimodal Transformers via UPop55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Compressing vision-language and unimodal Transformers via UPop

Hacker News4

Silicon Feelings41%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Silicon Feelings

Hacker News30

ClassicTunes – a from-scratch remake of iTunes 7-10 for Apple Silicon43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

ClassicTunes – a from-scratch remake of iTunes 7-10 for Apple Silicon

Hacker News1

Sudoless asitop alternative – CLI perf monitor for Apple Silicon44%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Sudoless asitop alternative – CLI perf monitor for Apple Silicon

Hacker News2

Silicon Prices64%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Amazon Price Tracker for Apple Silicon Macs

Indie Hackers1e-commerce

Phi-4-multimodal and Phi-4-mini67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

The next generation of the Phi family from Microsoft

Product Hunt+128API

Compress vision-language and unimodal AI models by structured pruning53%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Compress vision-language and unimodal AI models by structured pruning

Hacker News7

Apple Silicon Games67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Game Compatibility and Game Performance for Apple

Indie Hackers1community

Browse all products Analyze your launch