Release 1.5.4 (#149)

* Pagination bug * Bug fix * chore: add docker cmd * Compatibility fixes for SDK version 2.0.0 (#69) * Pagination bug * Bug fix * Fix for schema changes * Render tool calling * Support for Langgraph, Qdrant & Groq (#73) * Pagination bug * Bug fix * Add langgraph support * QDrant support * Add Groq support * update README * update README * feat: optimise docker image for self host setup * adding api access to traces endpoint * clean up * refactor * feat: add clickhouse db create on app start (#79) * docs: add railway deploy, fix sdk badges (#81) * untrack .env * Revert "untrack .env" This reverts commit 4551d7e. * Playground and Prompt Management (#83) * Pagination bug * Bug fix * Playground - basic implementation * Playground - streaming and nonstreaming * Move playground inside project * API key flow * Api key * Playground refactor * Add chat hookup * anthropic streaming support * Bug fixes to openai playground * Anthropic bugfixes * Anthropic bugfix * Cohere first iteration * Cohere role fixes * Cohere api fix * Parallel running * Playground cost calculation non streaming * playground - streaming token calculation * latency and cost * Support for Groq * Add model name * Prompt management views * Remove current promptset flow * Prompt management API hooks * Prompt registry final * Playground bugfixes * Bug fix playground * Rearrange project nav * Fix playground * Fix prompts * Bugfixes * Minor fix * Prompt versioning bugfix * Bugfix * fix: clickhouse table find queries (#82) * Fix to surface multiple LLM requests inside LLM View (#84) * Pagination bug * Bug fix * Fix for surfacing multiple LLM requests in LLMView * Minor bugfixes (#86) * Pagination bug * Bug fix * Bugfixes * api to fetch promptset with prompt filters * bug fixes * fix invalid redirect * fix invalid status code * Project Switcher (#90) * Pagination bug * Bug fix * Project switcher * Feat: dataset download (#60) * API: download dataset * API: Download dataset * updated download-dataset api * Updated: download_dataset api * Updated download dataset API * Updated Download API: changed Response to Next Response, add a condition to ensure max page size is 500 * updated the download-dataset API: fixed the format and removed redundant lines of code * Updated download_daatset API: file name and removed 'id' param * Added the Download dataset button. * Merged developemnt into my branch * Updated button size * Fixes --------- Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com> * Update prompt registry with instructions to fetch prompts (#91) * Pagination bug * Bug fix * Update prompt registry * Minor bugfix (#94) * Pagination bug * Bug fix * Minor bugfix * chore: update github repo badges * optimizing token count function * Add GPT4-O Pricing and Playground (#98) * Pagination bug * Bug fix * Add GPT4-O support * Add GPT4-O support * Update cost * Dylan/s3en 2234 add perplexity support to playground (#89) * adding perplexity to playground types * adding ui stuff:' * adding perplexity chat api * fixing perplexity model dropdown --------- Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com> * api changes * add api access to get api and fix all bugs * bug fix * bug fix * updating descriptions to optional * prio python * cleanup and fixes * more bug fixes * more fixes * remove console log * updating trace_service functions * add migration * add format function, updating from day to hour * adding dropwdown menu * updating query key * updating query keys v2 * clean up * fix bug * Minor bugfix (#102) * Pagination bug * Bug fix * Minor bugfix * fixes * Bug fixes to Evaluations (#111) * Pagination bug * Bug fix * Bug fixes to evals v2 * Minor fix * upgrading tiktoken, adding omni to pricing (#110) Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com> * Update package * Dataset bugfix (#113) * Pagination bug * Bug fix * Dataset bugfix * Minor linking fix (#114) * Pagination bug * Bug fix * Dataset bugfix * Minor fix * api bug fix (#116) * fixing dropdown color (#117) * Support for Image inputs (#119) * Pagination bug * Bug fix * Support image inputs * Bug fix Spans with status_code = "ERROR" (#120) * Pagination bug * Bug fix * Support image inputs * Bug fixes * Dylan/s3en 2265 save prompt and model settings directly from playground (#99) * bug fixes, adding save prompt button in playground * adding save prompt dialog * adding create registry dialog * working registry selection * Adding new prompt to exist registry * storing * button padding fix * refactor, adding combobox * increasing dropdwon width --------- Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com> * adding image display * adding property filtering (#123) * optimizing cost function * optimizing per cost per hour function * removing console statements * updating queryKey for datasets * init advanced filter dialog * adding operator combobox * updating ui * adding attribute type * bug fixes * cleanup * remove console * updating queryKeys * adding missing table checks * adding more checks * chore: update clickhouse docker for user management * style: remove blank space * updating save prompt button * Redesign of Manual Evaluations (#134) * Pagination bug * Bug fix * Schema changes for evals * Fix APIs for evals * Minor bugfixes * Bugfix * Evaluation changes * Manual eval simplification * Minor fix * Manual evaluations UX changes * Chart title fix * Disable experiments * fix * Dylan/s3en 2318 add the ability to import a conversation from the traces to (#133) * adding import conversation button * init import conversation dialog * adding trace rows * fixing scroll bug * adding import prompt to playground * fixes * Minor * Bugfixes --------- Co-authored-by: Karthik Kalyanaraman <karthik@scale3labs.com> * storing * remove import for images * importing attribute stuff * fixing operations display * cleaning up advanced filters * cleanup * docs: update docker instructions * removing console, fixing button * add stars history (#139) * Dylan/s3en 2401 ability to filter by user for metrics and traces (#138) * adding user id combobox, api * fixing sql query * removing user filter on deselect{ * moving user combobox into filter dialog * adding filtering by user for token charts * bug fixes, more userId route, function updates * latency filtering * updating to alphanumeric * removing console, comment * updating default filter operation to and * adding clear all button, cleanup * Dylan/s3en 2350 aggregate metrics by models v2 (#141) * adding user id combobox, api * fixing sql query * removing user filter on deselect{ * moving user combobox into filter dialog * adding filtering by user for token charts * bug fixes, more userId route, function updates * latency filtering * updating to alphanumeric * removing console, comment * updating default filter operation to and * adding clear all button, cleanup * init commit model combobox * adding api, updating function, adding to metrics page * adding model to charts, apis, service * remove consoles * Automated Evaluations - Support for Inspect AI (#142) * Pagination bug * Bug fix * Experiments view * re-order * Comparison view * Experiment report * Experiments - hook up APIs * Experiments pagination * deduplicate paginated data * Fix loading and error states - experiments * Rename experiments and evaluations * Add loading spinner * Link evaluation * Link to evals * Fixes * Minor UI fixes * Bugfixes * DSPy support (#144) * Pagination bug * Bug fix * Bugfixes * DSPy support * Update README * Prompt registry and Playground integration (#146) * Pagination bug * Bug fix * Bugfixes * Playground enhancements * Fix * Playground improvment * Bug fix * Minor bug fixes (#148) * Pagination bug * Bug fix * Bugfixes * Bugfixes --------- Co-authored-by: Darshit Suratwala <darshit@scale3labs.com> Co-authored-by: darshit-s3 <119623510+darshit-s3@users.noreply.github.com> Co-authored-by: dylan <dylan@scale3labs.com> Co-authored-by: dylanzuber-scale3 <116033320+dylanzuber-scale3@users.noreply.github.com> Co-authored-by: Rohit Kadhe <rohit@scale3labs.com> Co-authored-by: Rohit Kadhe <113367036+rohit-kadhe@users.noreply.github.com> Co-authored-by: MayuriS24 <159064413+MayuriS24@users.noreply.github.com> Co-authored-by: yemiscale3 <111706151+yemiadej@users.noreply.github.com>
Scale3-Labs · Jun 20, 2024 · de693a1 · de693a1
1 parent bbb6a2b
commit de693a1
Show file tree

Hide file tree

Showing 6 changed files with 30 additions and 8 deletions.
diff --git a/app/(protected)/project/[project_id]/playground/page.tsx b/app/(protected)/project/[project_id]/playground/page.tsx
@@ -2,6 +2,7 @@
 
 import { AddLLMChat } from "@/components/playground/common";
 import LLMChat from "@/components/playground/llmchat";
+import HowTo from "@/components/shared/how-to";
 import {
   AnthropicModel,
   AnthropicSettings,
@@ -86,6 +87,7 @@ export default function Page() {
 
   return (
     <div className="px-12 py-6 flex flex-col gap-8">
+      <HowTo link="https://docs.langtrace.ai/features/playground" />
       <span className="text-sm font-semibold">
         Note: Dont forget to add your LLM provider API keys in the{" "}
         <Link href="/settings/keys" className="underline text-blue-400">

diff --git a/app/(protected)/project/[project_id]/prompts/[prompt_id]/page.tsx b/app/(protected)/project/[project_id]/prompts/[prompt_id]/page.tsx
@@ -1,5 +1,6 @@
 "use client";
 import CreatePromptDialog from "@/components/shared/create-prompt-dialog";
+import HowTo from "@/components/shared/how-to";
 import { PromptInstructions } from "@/components/shared/setup-instructions";
 import { Button } from "@/components/ui/button";
 import { Label } from "@/components/ui/label";
@@ -54,6 +55,7 @@ export default function Page() {
   if (!selectedPrompt)
     return (
       <div className="p-12 flex flex-col gap-2">
+        <HowTo link="https://docs.langtrace.ai/features/manage_prompts" />
         <Button
           className="w-fit"
           variant={"outline"}
@@ -82,6 +84,7 @@ export default function Page() {
   else
     return (
       <div className="px-12 py-12 flex flex-col gap-4">
+        <HowTo link="https://docs.langtrace.ai/features/manage_prompts" />
         <div className="flex gap-4 items-center">
           <Button
             className="w-fit"

diff --git a/app/(protected)/project/[project_id]/prompts/prompt-management.tsx b/app/(protected)/project/[project_id]/prompts/prompt-management.tsx
@@ -3,6 +3,7 @@
 import { CreatePromptset } from "@/components/project/dataset/create";
 import { EditPromptSet } from "@/components/project/dataset/edit";
 import CardLoading from "@/components/shared/card-skeleton";
+import HowTo from "@/components/shared/how-to";
 import {
   Card,
   CardDescription,
@@ -53,6 +54,7 @@ export default function PromptManagement({ email }: { email: string }) {
   } else {
     return (
       <div className="w-full py-12 px-12 flex flex-col gap-4">
+        <HowTo link="https://docs.langtrace.ai/features/manage_prompts" />
         <div className="w-fit">
           <CreatePromptset projectId={projectId} />
         </div>

diff --git a/components/playground/import-trace-conversation.tsx b/components/playground/import-trace-conversation.tsx
@@ -124,7 +124,7 @@ export default function ImportTraceConversation({
           Import Traced Conversation
         </Button>
       </DialogTrigger>
-      <DialogContent className="w-full max-w-6xl h-[600px] overflow-y-hidden">
+      <DialogContent className="w-full max-w-6xl h-[600px] overflow-y-scroll">
         <div className="flex flex-col gap-2">
           <Label htmlFor="name" className="text-left text-lg mb-4">
             Select a conversation to import

diff --git a/components/shared/how-to.tsx b/components/shared/how-to.tsx
@@ -0,0 +1,17 @@
+import { QuestionMarkCircledIcon } from "@radix-ui/react-icons";
+import Link from "next/link";
+import { Button } from "../ui/button";
+
+export default function HowTo({ link }: { link: string }) {
+  return (
+    <Link href={link} target="_blank">
+      <Button
+        className="absolute top-40 right-24 text-muted-foreground"
+        variant={"outline"}
+      >
+        How to use this
+        <QuestionMarkCircledIcon className="w-6 h-6 ml-2 text-muted-foreground" />
+      </Button>
+    </Link>
+  );
+}
diff --git a/components/shared/setup-instructions.tsx b/components/shared/setup-instructions.tsx
@@ -103,7 +103,6 @@ export function SetupInstructions({ project_id }: { project_id: string }) {
   );
 }
 
-
 export function PromptInstructions({ id }: { id: string }) {
   const [sdk, setSdk] = useState("python");
 
@@ -116,12 +115,11 @@ export function PromptInstructions({ id }: { id: string }) {
     <div className="flex flex-col gap-6 border rounded-md p-4">
       <div className="flex flex-row items-center gap-3">
         <Button
-          disabled={true}
           onClick={() => setSdk("python")}
           variant={sdk === "python" ? "default" : "ghost"}
           size={"sm"}
         >
-          Python (Coming Soon)
+          Python
         </Button>
         <Button
           onClick={() => setSdk("typescript")}
@@ -162,15 +160,15 @@ const prompt = Langtrace.getPromptFromRegistry('${id}')
             onClick={() => {
               copyToClipboard(
                 `
-from langtrace_python_sdk.utils import (get_prompt_from_registry)
+                from langtrace_python_sdk import get_prompt_from_registry
 
-prompt = get_prompt_from_registry('${id}')
+                prompt = get_prompt_from_registry('${id}')
 `
               );
             }}
           >
-            {`
-from langtrace_python_sdk.utils import (get_prompt_from_registry)
+            {`// Must precede any llm module imports
+from langtrace_python_sdk import get_prompt_from_registry
 
 prompt = get_prompt_from_registry('${id}')
 `}