AI Toolbox – User Tutorial

← Back to Toolbox

Welcome to the AI Toolbox

The AI Toolbox is Helen Keller's browser-based application that uses artificial intelligence to transcribe audio recordings and translate documents. It is built for M&E specialists and program staff who work with qualitative data β€” interviews, focus group discussions, and field reports β€” across Helen Keller's country programs and multiple languages.

The toolbox currently offers two services:

Service What It Does Status
Audio Analysis Transcribes audio files (KII, FGD, IDI) and optionally translates the resulting text. Stable
Document Translation Translates uploaded documents (PDF, DOCX, TXT) between supported languages. Beta
Prerequisites A modern web browser (Chrome or Edge recommended β€” both are available on Helen Keller laptops), a stable internet connection, and your audio or document file ready to upload. No installation or login is required β€” the tool runs entirely in your browser.

Interface Overview

When you first open the AI Toolbox, you will see the main screen with the following areas:

Full AI Toolbox interface in Audio Analysis mode showing header, mode switcher, Input Options card, and Process Log

Figure 1: Full AI Toolbox interface β€” Audio Analysis mode.

Key Areas

  1. Mode Switcher β€” Toggle between Audio Analysis and Document Translation (Beta) at the top.
  2. Input Options Card β€” Where you configure language, recording type, prompt, and upload your file. The AI model is automatically selected.
  3. Process Log & Result Card β€” The dark terminal-style log shows real-time status messages. Results appear in the text area below.
  4. Info Button (i) β€” The blue circle in the top-right of the Input Options card opens the Quick Start Guide.
Mode switcher bar with Audio Analysis active and Document Translation Beta inactive

Figure 2: Mode switcher β€” Audio Analysis active.

Audio  Service 1 β€” Audio Transcription & Translation

This is the primary service. Use it when you have an audio recording (interview, FGD, or IDI) and need a written transcript in the original language β€” with the option to translate it afterward.

💡
Two-Step Approach: Transcribe First, Translate Second Always transcribe first, review the output, and then translate. Do not ask the AI to transcribe and translate in a single prompt β€” the quality of both tasks suffers when combined.

1

Select Your Inputs

Fill in the three required dropdowns in the Input Options card:

  • Primary Language β€” The main language spoken in the audio (e.g., Nepali, Khmer, Bangla).
  • Type of Recording β€” Choose KII, FGD, or IDI. This affects the auto-generated prompt and the auto-selected AI model.
  • AI Model β€” Automatically selected based on recording type and mode. Manual override is disabled.
Input Options card with Primary Language, Type of Recording, and AI Model dropdowns filled in

Figure 3: Input dropdowns β€” Language, Recording Type, AI Model.

2

Review the Auto-Generated Prompt

Once you select a language and recording type, the User Prompt / Instructions text area auto-populates with a contextual prompt. This prompt tells the AI exactly how to transcribe β€” speaker labeling, timestamps, formatting rules, and quality notes.

You can edit this prompt to add context specific to your recording. For example:

  • Number of participants if known
  • Names of facilitators or interviewers
  • Project name or topic area
  • Any known audio quality issues
User Prompt text area auto-populated with a Nepali FGD transcription prompt

Figure 4: Auto-generated prompt for Nepali FGD.

💡
Pro Tip: Add participant names If you know the names of speakers, add them at the end of the prompt: "The interviewer is Priya and the respondent is Ramesh." The AI will use actual names instead of generic labels, making review much easier.
3

Upload Your Audio File

Drag and drop your audio file into the upload zone, or click to browse. The tool supports:

FormatExtensionNotes
MP3.mp3Most common format β€” recommended
WAV.wavUncompressed, larger file size
M4A.m4aApple/iPhone recordings
MP4.mp4Video files (audio track extracted)
WebM.webmBrowser-based recordings
OGG / Opus.ogg, .opusOpen-source formats
FLAC.flacLossless audio

Maximum file size: 500 MB. Files over 100 MB will display a warning but will still process.

File upload zone with file preview showing filename, size, format, and green File ready to process status

Figure 5: File preview after upload β€” validated and ready.

Large files > 100 MB For very large recordings, upload time depends on your internet speed. The progress bar will show real-time upload percentage. Keep the browser tab open until the upload completes.
4

Click "Transcribe"

Once all fields are valid, the Transcribe button activates. Click it to start processing. You will see:

  1. A progress bar showing file upload percentage.
  2. Status messages in the Process Log (dark area) β€” upload status, API calls, completion.
  3. A spinner on the button while processing.

Processing time depends on file size and the effective model selected by policy. A 30-minute FGD recording typically takes 2–5 minutes with Gemini Pro.

Progress bar showing file upload and PROCESSING button with spinner

Figure 6a: Upload progress bar and Processing button.

Process Log showing upload complete and Gemini API call in progress

Figure 6b: Process Log β€” file uploaded, calling Gemini API.

5

Review & Download the Transcription

After processing completes, the results area appears with:

  • Tab bar β€” Shows "πŸ“„ Original (Language)" tab.
  • Result text area β€” The full transcription with speaker labels, timestamps, and notes.
  • Action buttons:
    • Copy Text β€” Copies the transcription to your clipboard.
    • Download Docx File β€” Downloads the text as a .docx Word document.
Results area showing Nepali transcription with Original tab, Copy and Download buttons, and Translate controls

Figure 7: Transcription result β€” Original (Nepali) with action buttons and Translate controls.

💡
Always download your transcription before translating Save the original transcription to your computer first. This gives you a backup in case anything goes wrong during translation, and you'll have both versions for your records.
6

Translate the Transcription (Optional)

After transcription, a translation control bar appears below the results. To translate:

  1. Select your target language from the "Translate to:" dropdown.
  2. Click Translate.
  3. A new tab (e.g., "🌐 English") will appear next to the original tab.
  4. Switch between tabs to compare original and translated text.

You can translate to multiple languages β€” each translation creates a new tab. Previously completed translations are cached so you don't need to re-process them.

Results area with Original Nepali and English translation tabs, English tab active showing translated text

Figure 8: Translation result β€” English tab active with translated text.

Doc Beta  Service 2 β€” Standalone Document Translation

Use this service when you already have a text document (report, transcript, field notes) and need it translated from one language to another β€” without any audio processing.

Beta Feature Document Translation is currently in beta. It works well for plain text documents and DOCX files. Formatting preservation for complex layouts is limited.

1

Switch to Document Translation Mode

Click the "Document Translation Beta" button in the mode switcher bar at the top. The form fields will change to show document-specific options.

Document Translation mode active with language dropdowns set to Nepali to English and Gemini Pro model

Figure 9: Document Translation mode β€” source and target language selection.

2

Set Source & Target Languages

Select the current language of your document and the language you want it translated into:

  • Primary Language of Document β€” The language the document is currently written in.
  • Translate To β€” Your target language.

The system prevents you from selecting the same language for both, and automatically updates the prompt.

💡
Model behavior in Document Translation mode Document Translation runs on Gemini models only. The system defaults to Gemini Pro for translation accuracy.
3

Upload Your Document

The upload zone now accepts document formats instead of audio:

FormatExtensionNotes
Word Document.docxBest supported β€” formatting is partially preserved
PDF.pdfText extracted; images/charts are not translated
Plain Text.txtFull text translated; no formatting to preserve
Document upload zone with DOCX file preview showing filename, size, and ready status

Figure 10: DOCX file uploaded and validated for translation.

4

Click "Translate Document"

The submit button now reads "Translate Document". Click it to start. For DOCX files, you'll see a multi-step process in the log:

  1. Step 1: Reading and parsing the .docx file
  2. Step 2: Translating the extracted text via AI
  3. Step 3: Reconstructing the translated .docx file

A translated .docx file will automatically download when processing completes.

Process Log showing document parsing steps, paragraph extraction, and translation API call

Figure 11: Document translation Process Log β€” parsing, extracting, translating.

5

Review & Download

After translation completes:

  • The translated text appears in the results area under a "πŸ“„ Translated Document" tab.
  • A .docx file downloads automatically for DOCX uploads.
  • You can still use the Copy Text and Download Docx File buttons.

Note: The post-transcription translation controls (Translate to dropdown) do not appear in Document Translation mode since the translation is already performed.

AI Model Guide

The toolbox uses Gemini models only, with automatic model selection and policy-based overrides to balance quality, speed, and cost.

Model Best For Strengths Limitations
Gemini Pro FGDs, multi-speaker, long recordings, document translation Highest accuracy, best speaker identification, handles complex audio and large files Slightly slower than Flash
Gemini Flash KIIs, clean recordings, quick turnaround Fast processing, good for straightforward 1-on-1 interviews May struggle with multiple overlapping speakers
💡
When in doubt, use Gemini Pro It handles the widest range of scenarios. The system auto-selects models by recording type and may force Gemini Pro for high-thinking policy runs.

Supported Languages

The following languages are currently supported. This list may expand in the future.

Language Audio Transcription Document Translation (Source) Document Translation (Target)
Bangla
Englishβ€”
French
Hausa
Igbo
Khmer
Kiswahili
Nepali
Spanishβ€”
Tagalog
Wolof
Yoruba
English and Spanish are available for document translation but not as primary audio transcription languages β€” audio recordings in these languages can still be transcribed through prompt customization, but there is no dedicated language option in the dropdown yet.

Tips & Tricks for Best Results

🎤 Audio Recording Quality

📝 Prompt Customization

🔧 Model Selection Strategy

ScenarioRecommended ModelWhy
FGD with 6+ participants, noisy environmentGemini ProBest at differentiating multiple speakers and handling noise
Clean 1-on-1 KII, under 30 minGemini FlashFaster processing, sufficient quality for clear dual-speaker audio
Translating a 20-page DOCX reportGemini ProBetter context retention for long documents
Quick translation of a short text fileGemini FlashFaster, sufficient for short content

💾 Session Recovery

🚀 Workflow Best Practices

  1. Prepare your file first β€” ensure the audio format is supported and the file isn't corrupted before uploading.
  2. Review the auto-prompt β€” take 30 seconds to read and optionally customize it. Small additions dramatically improve output.
  3. Download before translating β€” save the original transcription first.
  4. Compare translations side-by-side β€” use the tabs to switch between original and translated text for spot-checking.
  5. For large batches, process one file at a time and save each result before starting the next.
💡
Power User Tip: Multiple translations You can translate a single transcription into multiple languages in one session. Each translation creates its own tab. This is useful when you need the same FGD transcript shared with Helen Keller teams in different country offices.

Known Limitations

We believe in transparency. Here are the current limitations of the AI Toolbox:

LimitationDetailsWorkaround
Policy-based model override For high-thinking runs, the system may force Gemini Pro to maintain compatibility and output quality. Review the Process Log to confirm the effective model used for each run.
Internet required The tool requires an active internet connection for AI processing. All computation happens in the cloud β€” nothing runs locally. Ensure a stable connection, especially for large file uploads. Avoid processing over mobile hotspots if possible.
Maximum output length AI models have a maximum output of ~8,192 tokens per request. Very long recordings may produce truncated results. For recordings over ~90 minutes, consider splitting the audio file before uploading.
Speaker identification accuracy The AI uses voice characteristics to identify speakers but is not 100% accurate, especially with similar-sounding voices. Review and correct speaker labels manually. Adding speaker names in the prompt helps significantly.
Document formatting (Beta) DOCX translation partially preserves formatting (paragraphs, text). Complex layouts (tables, images, headers/footers, charts) are not preserved. For complex documents, consider translating section by section or reformatting after translation.
PDF image-based content Scanned PDFs (images of text) cannot be processed β€” only PDFs with selectable/extractable text work. Use OCR software (e.g., Adobe Acrobat) to convert scanned PDFs to text-based PDFs first.
No offline mode The tool cannot function without internet. There is no queuing or offline processing. Plan your processing when you have reliable connectivity.
Browser compatibility The tool uses ES modules. Very old browsers (Internet Explorer, older mobile browsers) are not supported. Use the latest version of Chrome, Edge, Firefox, or Safari.
Single file per session You can only process one file at a time. There is no batch upload feature. Process files sequentially, downloading each result before starting the next.
AI accuracy is not 100% All AI-generated transcriptions and translations should be treated as drafts. Errors in transcription (especially with low-quality audio, heavy accents, or rare dialects) and translation (nuances, idioms) are expected. Always review and verify AI output against the source material before using it in reports or publications.
Important: Human review is essential The AI Toolbox is a productivity aid β€” not a replacement for human review. All transcriptions and translations must be reviewed by a qualified Helen Keller staff member before being used for analysis, reporting, or decision-making.

Troubleshooting

Common Issues

ProblemLikely CauseSolution
Buttons not responding JavaScript failed to load (CDN issue or network block) Hard refresh: Ctrl+Shift+R (Windows) or Cmd+Shift+R (Mac). Try a different browser or incognito mode.
"File too large" error File exceeds the 500 MB limit Compress the audio using a tool like Audacity (free) or convert to MP3 format.
Upload stalls or times out Slow or unstable internet connection Try again on a stronger connection. For files over 100 MB, wired connections are recommended.
Transcription is mostly "[inaudible]" Very poor audio quality Try Gemini Pro (more robust with noisy audio). Mention known audio issues in the prompt. Consider re-recording if possible.
Translation tab doesn't appear Translation API call failed Check the Process Log for error messages. Ensure the transcription completed successfully. Try again.
"Download Docx" button not working The document generation library failed to load from CDN Check your internet connection. Use "Copy Text" as a fallback and paste into Word or Google Docs.
Styles look broken Cached old CSS Hard refresh: Ctrl+Shift+R. Or clear browser cache for the site.

Frequently Asked Questions

Q: Is my data stored anywhere by the AI providers?

Audio files are uploaded to Google's servers for processing and are subject to Google's data handling policies. Files are uploaded temporarily for processing and are not permanently stored by the tool itself. Check Helen Keller's data governance policy before processing sensitive or personally identifiable recordings.

Q: Can I use this on my phone or tablet?

The interface is responsive and works on mobile devices, but for the best experience (especially with large files), use your Helen Keller laptop or desktop with Chrome or Edge.

Q: Can I process a recording in a language not listed?

The Gemini AI models support many languages beyond the ones in the dropdown. You can select the closest available language and manually edit the prompt to specify the actual language. Results may vary for less common languages. If your country office regularly needs a language not listed, email AI@hki.org and we can add it to the dropdown.

Q: How do I report a bug or request a feature?

Email AI@hki.org or reach out to Ekendra or Ric directly. Include the browser you used, the file type, and any error messages from the Process Log β€” a screenshot of the log helps a lot.

Q: What happens if I close the browser mid-processing?

The processing will be interrupted and you will lose the in-progress result. The tool cannot resume interrupted sessions. You will need to re-upload and re-process the file.

Q: Can I edit the transcription before downloading?

The result text area is currently read-only. To edit, download the .docx file and edit in Microsoft Word or Google Docs, or copy the text and paste it into your preferred editor.

Q: Why is Document Translation marked as "Beta"?

The feature works reliably for text-based translation but has limited formatting preservation. We are actively improving it. Complex document layouts (tables, charts, multi-column) may not translate cleanly.

Quick Reference Card

A summary you can print or screenshot for quick reference:

Audio Transcription Workflow
1.Select Language β†’ Recording Type β†’ AI Model
2.Review and customize the auto-generated prompt
3.Upload audio file (MP3 recommended, max 500 MB)
4.Click Transcribe and wait for processing
5.Review result β†’ Download .docx β†’ Then translate if needed
Document Translation Workflow
1.Switch to Document Translation mode
2.Set source language β†’ target language
3.Upload document (DOCX recommended)
4.Click Translate Document
5.Translated .docx auto-downloads + view in results area