Overview

Introducing "mAIstro" - an open-ended playground for Large Language Models, designed to ease development time and effort.

mAIstro is a practical tool that provides you with the following capabilities:

1. Choice of LLM: (BYOLLM Plans) Select your preferred LLM, and seamlessly integrate it with mAIstro.
2. Utilize NeuralSeek Template Language (NTL): Craft dynamic prompts using a combination of regular words and NTL markup to retrieve content from different sources.
3. User-Friendly Visual Editor: Create custom prompts with an easy-to-use point-and-click visual editor.
4. Utilize Other NeuralSeek Features: Extract, Protect, or Seek a query through the mAIstro platform.
5. Versatile Content Retrieval: Retrieve data from various sources, including KnowledgeBases, SQL Databases, websites, local files, or your own text.
6. Content Enhancement: Improve your data with features like summarization, stopword removal, keyword extraction, and PII removal to ensure your content is refined and valuable.
7. Guarded Prompts: mAIstro provides Prompt Injection Protection and Profanity Guardrails, preventing embarrassing moments with Language Generation.
8. Table Understanding: Conduct searches and generate answers with natural language queries against structured data.
9. Effortless Output: Easily view your generated content within the built-in editor or export it directly to a Word document, offering convenient control over your output.
10. Precision Semantic Scoring: Importantly, all these operations are assessed using our Semantic Scoring model. This allows insight into the content's scope tailored to your preferences.

Visual Editor

• The Visual Editor allows users to create expressions using movable, chain-linked, and customizable blocks that execute commands. It simplifies user interaction through drag-and-drop blocks, making it easy to navigate complex use cases with no code required.

NTL Editor

• The NTL Editor allows power users or developers to create expressions using NTL Markdown. This shows the raw NTL Markdown, allowing you to hand-edit or copy the whole template to share and debug.

mAIstro Inspector

• The mAIstro Inspector (the small bug icon near the top-right) allows users to drill down to the details of each step, exposing what was set, when it was set, and how it was processed.
• Expand steps individually to drill down into specific values, calculations, assignments, or generation.

Getting started with Visual Editor

Click to insert

All the elements on the left panel can be created in the editor by clicking them.

Click to edit

Selecting a card will highlight the node blue, and a dialog will appear on the right side to edit the configuration options for the selected node. Depending on the type of the node, there may be several options. See the NTL reference page for a description of all configurable options.

Deleting a node

You may delete a node by clicking the red Delete Node button at the bottom of the options panel.

Stacking elements

Adding nodes, by default, will connect the elements vertically. We call this Stacking, or building a Flow.

Stacked elements flow from top to bottom, meaning the output produced by the top element will become available as input to the bottom/next element.

Chaining elements

You can also connect elements horizontally. This is called Chaining.

Chaining is useful when you want to direct a node's output. In this example, the output of the LLM will be provided as input to the extract keywords element - chained together.

Example:

1. Click the element Extract Keywords to get stacked under Send To LLM.
2. Select the node, and drag it the right side of the element that you want to chain. You will see a blue dot indicating the chained connection.

3. Release the selection, chaining the nodes together.

   1. 

   2. 

   3. 

Evaluating

Clicking the evaluate button will run the expression, and generate output.

Saving as user template

You may frequently use the same expression over and over again. We offer the ability to save the template for re-use, and also be triggered via an API call.

Build an expression, and then click the Save button along the bottom of the editor. Enter the template name and (optional) description. Click Save in the dialog to save it as a user template.

Loading the template

Your saved template can be loaded into the editor, or called upon later from the API.

Click the Load button along the bottom of the editor, select User Templates, and click the checkbox to the template that you want to load. Click Load Template to load the saved template into the editor.