Quarkus and LangChain4J - A Match Made in Heaven
airhacks.fm podcast with adam bien

Quarkus and LangChain4J - A Match Made in Heaven

Oct 20, 2024
1:02:45
E316
-(0)

About this episode

An airhacks.fm conversation with Georgios Andrianakis ( @geoand86 ) about: discussion on integrating langchain4j with quarkus for enterprise AI applications, similarities between LLM integration and microservice architecture, benefits of using Java and MicroProfile for AI development, explanation of AI services, chat memory, and tools in LangChain4J, importance of session management and fault tolerance in LLM applications, vector databases and embeddings for efficient information retrieval, RAG (Retrieve Augmented Generation) implementation in enterprise settings, Quarkus dev mode features for LLM experimentation, native image support with GraalVM, local inference possibilities with Java 21's Vector API and quantized models, challenges in prompt engineering and model selection, upcoming features in LangChain4J including Ollama tool support and improved result streaming, future developments in Java for AI and GPU support with Project Babylon , importance of enterprise-grade features like CI/CD, testing, and cloud deployment for LLM applications Georgios Andrianakis on twitter: @geoand86

Comments

Rate this episode

Episode Details

Author
adam-bien.com
Show Type
full
Audio Format
audio/mpeg

We use analytics

We use Umami, a privacy-friendly analytics tool, to understand how visitors use this site. No personal data is collected and no data leaves our EU servers. You can accept or decline below. Privacy Policy