AIM Weekly for 12 August 2024

12-August-2024

Tim Spann @PaaSDev Milvus - Towhee - Attu - Feder - GPTCache - VectorDB Bench

AIM Weekly (Towhee - Attu - Milvus (Tim-Tam))

https://github.com/milvus-io/milvus?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

https://www.youtube.com/@FLaNK-Stack

https://medium.com/@tspann/subscribe

https://ossinsight.io/analyze/tspannhw

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/unstructured-data-meetup-new-york/?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

This is Issue #150

Join us at the next meetup.

August 13, 2024 5:30 to 8:30 PM in NYC @ New York https://www.meetup.com/unstructured-data-meetup-new-york/

Tutorials

https://github.com/milvus-io/bootcamp/tree/master/bootcamp/tutorials/quickstart/apps/multimodal_rag_with_milvus

https://zilliz.com/blog/build-multimodal-product-recommender-demo-using-milvus-and-streamlit?utm_source=linkedin&utm_medium=social&utm_campaign=2024-08-06_social_linkedin-newsletter_milvus

https://www.twelvelabs.io/blog/twelve-labs-and-milvus

https://www.nvidia.com/en-us/on-demand/session/gtc24-dlit61739/?playlistId=playList-108242b0-35ac-4765-9796-d6961cb026c4?ncid=em-news-239328&mkt_tok=MTU2LU9GTi03NDIAAAGUyB2cf3s3US12jpJYD101M8sHYPIlHwcNRuSUIiuxx2ES3ksU3a-dTG2Q7ATVKM8W27NzEBOm66V4Yy405U5BAC4S-etGO8ZgS7d3JtrxWeWmfdwWcQ

https://towardsdatascience.com/explaining-vector-databases-in-3-levels-of-difficulty-fc392e48ab78

https://nvidia.github.io/GenerativeAIExamples/latest/api-catalog.html

https://rapids.ai/

https://github.com/theonemule/llm-workshop

Cool Tools from EvilSocket

All around LLM, Security and interesting networking stuff. Very applicable for your own security testing and edge stuff.

• https://github.com/evilsocket/cake

• https://github.com/evilsocket/nerve

• https://github.com/evilsocket/legba

• https://github.com/evilsocket/pwnagotchi

• https://github.com/bettercap/bettercap

• https://github.com/evilsocket/opensnitch

Articles

Milvus - The Unstructured Olympics of the Mind? AI? Data? https://medium.com/@tspann/milvus-the-unstructured-olympics-of-the-mind-ai-data-b08ee4ba8c33

From Edge to the Cloud and Back Again https://medium.com/@tspann/from-the-edge-to-the-cloud-and-back-again-01095e95a783

Simplifying Legal Research with RAG https://zilliz.com/blog/simplifying-legal-research-with-rag-milvus-ollama

12 Labs and Milvus for Video Search https://www.twelvelabs.io/blog/twelve-labs-and-milvus

Optimizing RAG with Rerankers https://medium.com/@zilliz_learn/optimizing-rag-with-rerankers-the-role-and-trade-offs-250bf4b3e09e

My Pick High Performance LLM Tech Stack https://www.linkedin.com/pulse/my-pick-high-performance-llm-tech-stack-tentenco-5my1e/?trackingId=1PU8S13sQJWp3%2BGSzkDFTA%3D%3D

Milvus Hybrid Index Demo https://docs.llamaindex.ai/en/stable/examples/vector_stores/MilvusHybridIndexDemo/

Audio https://milvus.io/docs/audio_similarity_search.md

Structured Outputs with Schema API https://openai.com/index/introducing-structured-outputs-in-the-api/

Advanced RAG with HYDE https://medium.com/@florian_algo/advanced-rag-06-exploring-query-rewriting-23997297f2d1

Real-Time 3D GenAI R&D https://blogs.nvidia.com/blog/real-time-3d-generative-ai-research-siggraph-2024/

NVIDIA Developer Examples for RAG with MILVUS https://nvidia.github.io/GenerativeAIExamples/latest/

Function Calling in Ollama https://python.plainenglish.io/function-calling-in-ollama-0-3-0-0360f3485712

Image Retrieval with IBM WatsonX and Milvus https://medium.com/ibm-data-ai/image-retrieval-with-ibm-watsonx-data-f4bdd1ec1824

Milvus on OpenShift https://milvus.io/docs/openshift.md

Transformers for Time Series Forecasting https://towardsdatascience.com/will-transformers-revolutionize-time-series-forecasting-1ac0eb61ecf3

Fine Tune OpenAIs GPT-40-Mini https://medium.com/pondhouse-data/fine-tune-openais-gpt-4o-mini-llm-ai-model-for-free-37c7222e95eb

OpenAI Fine Tuning https://platform.openai.com/docs/guides/fine-tuning

Developer GenAI Powered Visual AI Agents for the Edge https://developer.nvidia.com/blog/develop-generative-ai-powered-visual-ai-agents-for-the-edge/?

Robots Learning https://developer.nvidia.com/blog/fast-track-robot-learning-in-simulation-using-nvidia-isaac-lab

GenAI for Gifted Children https://phys.org/news/2024-08-generative-ai-gifted.html#google_vignette

Prompt Injection Attack Explained https://datavolo.io/2024/08/prompt-injection-attack-explained/

Unstructured / RAG https://unstructured.io/blog/unstructured-s-preprocessing-pipelines-enable-enhanced-rag-performance

Open Source AI https://about.fb.com/news/2024/07/open-source-ai-is-the-path-forward/

Dspy https://blog.isaacmiller.dev/posts/dspy

Chunking https://malaikannan.github.io//2024/08/05/Chunking/

Embeddings https://malaikannan.github.io//2024/07/31/Embeddings/

ONNX with Streaming https://datavolo.io/2024/07/onward-with-onnx/

Videos

Fun Unstructured Friday https://youtu.be/UyMUSXdH_lg

Quick Edge Demo https://www.loom.com/share/f779fbe49e674c9f8e42369546c61ca0

NYC Replacement Talk https://www.youtube.com/watch?v=AuWveijqcog

Live Fun Friday with Unstructed Data Preview https://www.youtube.com/watch?v=_jQB62uPsvc

High Speed Inference with LLAMA CPP and Vicuna https://pub.towardsai.net/high-speed-inference-with-llama-cpp-and-vicuna-on-cpu-136d28e7887b

Unstructured Data Processing at the Edge Webinar https://zilliz.com/event/unstructured-data-processing-from-cloud-to-edge

Unstructured Meetup SF https://www.youtube.com/watch?v=zQASWO7_FQg

Building an Agentic RAG locally with Milvus, Ollama and Llama Agents https://www.youtube.com/watch?v=ZO0dbk4tF_Q

Slides

https://www.slideshare.net/slideshow/milvus-vector-database-integrating-semantic-search-capabilities-with-net-and-azure/270900882

https://www.slideshare.net/slideshow/nycmeetup07-25-2024-unstructured-data-processing-from-cloud-to-edge/270502823

https://www.slideshare.net/slideshow/unstructured-data-processing-from-cloud-to-edge-webinar/270673415

Events

August 13, 2024: Unstructured Data Meetup NYC https://lu.ma/fddkhbr0

August 15, 2024: AI Camp NYC https://www.aicamp.ai/event/eventdetails/W2024081514

August 20, 2024: DotNet Conf Virtual AI https://focus.dotnetconf.net/

September 24, 2024: Unstructured Data Meetup NYC https://lu.ma/9o3la3gf

https://allevents.in/manhattan/unstructured-data-meetup-new-york/80001083991651?ref=smdl

October 23, 2024: Unstructured Data Meetup NYC https://lu.ma/naqu6xrd

October 27 - 29, Raleigh, NC - All Things Open https://2024.allthingsopen.org/speakers/timothy-spann

October 31 - Live stream from my Halloween decorations with three 12 foot skeletons

November 5-7, 10-12, 2024: CloudX. Online/Santa Clara. https://www.developerweek.com/cloudx/

November 19, 2024: XtremePython. Online. https://xtremepython.dev/2024/

November 21, 2024: Big Data Conference 2024 EU

https://events.pinetool.ai/3254/#sessions/108389?referrer%5Bpathname%5D=%2Fsessions&referrer%5Bsearch%5D=&referrer%5Btitle%5D=Sessions

November 21, 2024: Unstructured Data Meetup NYC https://lu.ma/cqxuproe

December 4, 2024: Grace Hopper Celebration - Open Source - Milvus https://ghc.anitab.org/open-source/

December 10, 2024: Unstructured Data Meetup NYC https://lu.ma/u2ijucyv

Code

• https://github.com/tspannhw/AIM-RPIAIKit-PoseEstimation

• https://github.com/tspannhw/AIM-RPIAIKit

• https://github.com/tspannhw/AIM-NYCStreetCams

• https://github.com/tspannhw/AIM-MotorVehicleCollisions

• https://github.com/tspannhw/AIM-Milvus-KB

• https://github.com/tspannhw/AIM-Milvus-DotNet

• https://github.com/tspannhw/AIM-JetsonAGXOrin

• https://github.com/milvus-io/milvus?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

Models

• https://github.com/aiola-lab/whisper-medusa

• https://huggingface.co/vectara/hallucination_evaluation_model

• https://huggingface.co/blog/gemma-july-update

• https://huggingface.co/LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct (English and Korean)

• https://github.com/LG-AI-EXAONE/EXAONE-3.0

• https://huggingface.co/collections/Qwen/qwen2-math-66b4c9e072eda65b5ec7534d

• https://github.com/camel-ai/crab

• https://huggingface.co/collections/OpenGVLab/internvl-20-667d3961ab5eb12c7ed1463e

• https://mmbench.opencompass.org.cn/leaderboard

• https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_5

Tools

• https://www.jetson-ai-lab.com/tutorial_llamaspeak.html

• https://github.com/Magic-Push/MagicPush

• https://github.com/philzook58/knuckledragger

• https://github.com/HelgeSverre/milvus

• https://github.com/langchain4j/langchain4j-examples/blob/main/milvus-example/src/main/java/MilvusEmbeddingStoreExample.java

• https://black.readthedocs.io/en/stable/getting_started.html

• https://hamel.dev/blog/posts/course

• https://github.com/jqnatividad/qsv

• https://github.com/Surya-KF/MediSaga-RAG-Chatbot-Application

• https://github.com/sarthakgarg07/StepsAI_Project_Final

• https://github.com/Aryamantiwari17/Text_Book-Generator

• https://blog.golioth.io/golioth-for-ai/

• https://www.clearskyinstitute.com/ham/HamClock/

• https://autoeditor.video/login

• https://github.com/useplunk/plunk

• https://allthingsopen.org/articles/build-a-local-ai-co-pilot

• https://github.com/danvega/hello-claude

• https://github.com/sgl-project/sglang

• https://nvidia.github.io/GenerativeAIExamples/latest/

• https://github.com/hacksider/Deep-Live-Cam

• https://github.com/NVIDIA/GenerativeAIExamples

• https://www.analyticsvidhya.com/blog/2022/02/a-comprehensive-guide-on-hyperparameter-tuning-and-its-techniques/

• https://pages.nist.gov/dioptra/index.html

• https://github.com/NVIDIA/GenerativeAIExamples/tree/1a33175a53afa9bb679a444365eeb974a397a29c/experimental/oran-chatbot-multimodal

• https://nvidia.github.io/GenerativeAIExamples/latest/api-catalog.html

• https://nvidia.github.io/GenerativeAIExamples/latest/multi-turn.html

• https://github.com/numaproj/numaflow/blob/main/docs/quick-start.md

• https://github.com/IntelLabs/RAGFoundry

• https://github.com/InternLM/MindSearch

• https://github.com/curvedinf/dir-assistant/

• https://github.com/karpathy/nano-llama31

• https://github.com/ruslanmv/Watsonx-Assistant-with-Milvus-as-Vector-Database

• https://github.com/penberg/limbo

• https://github.com/simonmysun/ell

• https://github.com/lovasoa/SQLpage

• https://jsonlines.org/

• https://rapids.ai/cuvs/

• https://github.com/IMJONEZZ/LLMs-in-Production

• https://github.com/NUS-HPC-AI-Lab/OpenDiT

• https://github.com/microsoft/MInference

• https://github.com/apple/ml-4m

• https://github.com/Metimol1/VisionCraft

• https://github.com/karpathy/build-nanogpt

• https://github.com/WerWolv/ImHex

• https://build.nvidia.com/nvidia/digital-humans-virtual-assistant?

• https://github.com/tryAGI/LangChain

• https://github.com/john-c-kane/lc-ollama-dotnet/blob/main/LC-SQLITE-Ollama-V1.ipynb

• https://github.com/heshengtao/comfyui_LLM_party

• https://github.com/comfyanonymous/ComfyUI

• https://github.com/2noise/ChatTTS

• https://github.com/mendableai/firecrawl

• https://github.com/Dicklesworthstone/llm_aided_ocr

• https://github.com/OpenDevin/OpenDevin

• https://github.com/TabbyML/tabby

• https://github.com/abgulati/hf-waitress

© 2020-2024 Tim Spann https://www.youtube.com/@FLaNK-Stack

🖥️ Videos:  [https://www.youtube.com/@MilvusVectorDatabase/videos](https://www.youtube.com/@MilvusVectorDatabase/videos)
X Twitter -   / milvusio  [https://x.com/milvusio](https://x.com/milvusio)
🔗 Linkedin:  / zilliz  [https://www.linkedin.com/company/zilliz/](https://www.linkedin.com/company/zilliz/)
😺 GitHub: [https://github.com/milvus-io/milvus](https://github.com/milvus-io/milvus)
🦾 Invitation to join discord:   / discord  [https://discord.com/invite/FjCMmaJng6](https://discord.com/invite/FjCMmaJng6)