MailSense reads your Gmail, generates context-aware replies using Mistral AI, then scores every draft through a deterministic evaluation suite before saving it as a ready-to-send Gmail draft.
MailSense connects to Gmail via Composio OAuth and pulls your most recent unread threads automatically.
Pinecone vector search finds the top-3 most similar email pairs from your dataset to use as few-shot context.
Mistral AI drafts a professional reply using your active prompt template, few-shot examples, and tone policy.
11 metrics — BLEU, ROUGE, BERTScore, LLM Judge + 8 deterministic rules — score the draft. Fails trigger a self-correction loop.
Every reply is scored across lexical, semantic, and qualitative dimensions before it ever reaches your drafts folder.
Pure token-overlap measures to catch word-level drift.
Embedding-based similarity for deep meaning alignment.
Mistral grades qualitative dimensions no metric can see.
8 hard rules that every generated reply must pass — no exceptions. Violations trigger an automatic critique-and-rewrite loop.
When a draft scores below 0.80, MailSense generates a structured critique, rewrites the reply, and re-evaluates — up to 2 times — before giving up or passing.
OAuth & Thread Fetching
Securely connects to your Gmail via Composio OAuth, automatically pulls unread threads, and saves evaluated drafts back to your drafts folder.
Few-Shot Context Retrieval
Finds the top-3 most similar email pairs from your dataset using semantic search to provide relevant few-shot examples for generation.
Context-Aware Drafting
Generates professional email replies using your active prompt template, retrieved examples, and tone policy for consistent quality.
11-Metric Scoring Suite
Scores every draft across BLEU, ROUGE, BERTScore, LLM Judge, and 8 deterministic rules. Fails trigger automatic self-correction.
Every email response that flows through MailSense is evaluated, critiqued, and refined — completely autonomously.
Connect your Gmail, upload your dataset, and let MailSense generate, score, and save production-grade replies automatically.