fix: Resolve TypeScript and HTML errors

TypeScript Fixes:
- Fixed buildArrayResult type mismatch by converting data to tuples
- Removed unused @ts-expect-error directive
- Fixed SeriesResponse data type handling
- Fixed scalar calculation to use body.data objects directly
- Added proper type casting for dynamic metadata field access

HTML/JavaScript Fixes:
- Removed TypeScript type assertions from sidebar.html
- Changed (e.target as HTMLInputElement) to plain JS e.target.files
- Changed (event.target?.result as string) to String() conversion
- Now fully compatible with browser JavaScript environment

Template Features:
- exportTemplates() returns JSON data
- importTemplates() merges with existing templates
- Export/Import buttons in Templates tab UI

Author: darshild1024-cpu

README.md

@@ -1,14 +1,195 @@
-# DataSetIQ Sheets Add-on (`datasetiq-sheets-addon`)
+# DataSetIQ Google Sheets Add-on
 
-Google Sheets add-on that exposes DataSetIQ data through custom functions and a sidebar UI.
+**Professional Google Sheets add-on for economic and financial data from 15+ global sources.**
 
-## Features
-- Custom functions: `DSIQ` (spill array with headers, newest-first), `DSIQ_LATEST`, `DSIQ_VALUE` (on-or-before), `DSIQ_YOY`, `DSIQ_META`.
-- User key stored in `PropertiesService` (user-scoped). Shared files never leak keys.
-- Sidebar states for connect/disconnect, profile/quota display, and search via `/api/public/search`.
-- First-run authorize menu (`Extensions > DataSetIQ > Authorize`) to enable `UrlFetchApp`.
-- Single retry with exponential backoff for 429/5xx, respects `Retry-After` when provided.
-- Date normalization to UTC `YYYY-MM-DD` for cache/API parity.
+## 📊 Features
+
+### Custom Functions
+- **`DSIQ(seriesId, [freq], [start])`** – Full time-series array with headers (newest-first)
+- **`DSIQ_LATEST(seriesId)`** – Most recent value only
+- **`DSIQ_VALUE(seriesId, date)`** – Value on or before specified date
+- **`DSIQ_YOY(seriesId)`** – Year-over-year growth rate
+- **`DSIQ_META(seriesId, field)`** – Metadata (title, units, frequency, etc.)
+
+### Premium Features 🔓
+
+**Formula Builder Wizard** (🔧 Builder tab)
+- Step-by-step formula creation with guided inputs
+- Supports all DSIQ function types
+- Preview before inserting into cells
+
+**Templates System** (📁 Templates tab)
+- Scan current sheet for DSIQ formulas
+- Save formula collections as reusable templates
+- Load templates into new sheets instantly
+- Manage saved templates (view, load, delete)
+
+**Multi-Series Insert** (Search tab)
+- Select multiple series with checkboxes
+- Bulk insert with single click
+- Saves time on repetitive data pulls
+
+**Enhanced Sidebar UI** (🔍 Search tab)
+- Search across 15 data providers
+- Browse by source (FRED, BLS, IMF, OECD, etc.)
+- Favorites and Recent tracking
+- Live data preview with metadata
+- On-demand ingestion for metadata-only datasets
+
+### Data Sources (15 Providers)
+- **FRED** – Federal Reserve Economic Data
+- **BLS** – Bureau of Labor Statistics
+- **BEA** – Bureau of Economic Analysis
+- **Census** – US Census Bureau
+- **EIA** – Energy Information Administration
+- **IMF** – International Monetary Fund
+- **OECD** – Organisation for Economic Co-operation
+- **World Bank** – Global development data
+- **ECB** – European Central Bank
+- **Eurostat** – European statistics
+- **BOE** – Bank of England
+- **ONS** – UK Office for National Statistics
+- **StatCan** – Statistics Canada
+- **RBA** – Reserve Bank of Australia
+- **BOJ** – Bank of Japan
+
+## 🆓 Free vs 💎 Paid Plans
+
+| Feature | Free (No API Key) | Paid (Valid API Key) |
+|---------|------------------|----------------------|
+| **Custom Functions** | ✅ All functions | ✅ All functions |
+| **Observation Limit** | 100 most recent | 1,000 most recent |
+| **Search & Insert** | ✅ Basic search | ✅ Enhanced search |
+| **Data Preview** | ✅ Available | ✅ Available |
+| **Formula Builder** | ❌ Locked | ✅ Unlocked |
+| **Templates** | ❌ Locked | ✅ Unlocked |
+| **Multi-Insert** | ❌ Not available | ✅ Checkboxes visible |
+| **Favorites/Recent** | ✅ Available | ✅ Available |
+| **Browse by Source** | ✅ Available | ✅ Available |
+
+**Upgrade Message**: When data is truncated at 100 observations, users see:
+> ⚠️ Data limited to 100 most recent observations. Upgrade to a paid plan at datasetiq.com/pricing for up to 1,000 observations per series.
+
+## 🚀 Getting Started
+
+### Installation
+1. Install from Google Workspace Marketplace
+2. Open Google Sheets → Extensions → DataSetIQ → Open Sidebar
+3. First-time: Extensions → DataSetIQ → Authorize (grants network permissions)
+
+### Connecting Your Account
+1. Visit [datasetiq.com/dashboard/api-keys](https://datasetiq.com/dashboard/api-keys)
+2. Create an API key (free or paid plan)
+3. In sidebar, enter your API key and click "Connect Account"
+4. Status shows: ✅ Connected - Premium features unlocked
+
+### Using Custom Functions
+
+**Basic Usage:**
+```javascript
+=DSIQ("FRED-GDP")
+// Returns full GDP time-series with Date/Value headers
+
+=DSIQ_LATEST("BLS-CPI")
+// Returns latest CPI value
+
+=DSIQ_VALUE("IMF-NGDP", "2023-12-31")
+// Returns GDP value on or before Dec 31, 2023
+
+=DSIQ_YOY("FRED-UNRATE")
+// Returns year-over-year change in unemployment rate
+```
+
+**Advanced Options:**
+```javascript
+=DSIQ("FRED-GDP", "quarterly", "2020-01-01")
+// GDP data, quarterly frequency, from 2020 onwards
+
+=DSIQ_META("FRED-GDP", "title")
+// Returns metadata field (title, units, frequency, updated, source)
+```
+
+## 📖 User Guides
+
+### Formula Builder Wizard
+
+**Step 1: Choose Function**
+- Select from DSIQ, DSIQ_LATEST, DSIQ_VALUE, or DSIQ_YOY
+- Each function has different parameters
+
+**Step 2: Enter Series ID**
+- Enter the series identifier (e.g., "FRED-GDP")
+- Use Search tab to find series IDs
+
+**Step 3: Configure Options** (DSIQ and DSIQ_VALUE only)
+- **Frequency**: Optional (e.g., "quarterly", "monthly")
+- **Start Date**: Optional (e.g., "2020-01-01")
+
+**Step 4: Insert**
+- Click "Insert Formula" to place in active cell
+- Formula appears in cell and updates automatically
+
+### Templates Guide
+
+**Creating a Template:**
+1. Build your sheet with DSIQ formulas
+2. Click **🔧 Builder** tab → Navigate to Templates section
+3. Click "🔍 Scan Current Sheet"
+4. Review found formulas (count shown)
+5. Enter template name (e.g., "Q4 Report")
+6. Click "💾 Save Template"
+
+**Loading a Template:**
+1. Open new sheet
+2. Navigate to Templates tab
+3. Find saved template in list
+4. Click "📥 Load" button
+5. All formulas inserted at original cell positions
+
+**Managing Templates:**
+- **View**: See all saved templates with formula count
+- **Load**: Insert template into active sheet
+- **Delete**: Remove template (🗑️ button)
+
+### Multi-Series Insert
+
+**Selecting Series:**
+1. Search for series in Search tab
+2. Check boxes appear next to results (paid users only)
+3. Select multiple series by clicking checkboxes
+4. Counter updates: "Insert X Series" button appears
+
+**Bulk Insert:**
+1. Select active cell where you want first series
+2. Click "Insert X Series" button
+3. Series inserted vertically (one per row)
+4. Uses DSIQ_LATEST function by default
+
+## 🛠 Technical Details
+
+### Architecture
+- User API key stored in `PropertiesService` (user-scoped, never shared)
+- Sidebar UI communicates with `Code.gs` backend via `google.script.run`
+- Single retry with exponential backoff for 429/5xx errors
+- Respects `Retry-After` headers from API
+- Date normalization to UTC `YYYY-MM-DD` format
+
+### Privacy & Security
+- **No Key Leakage**: API keys stored per-user, never in spreadsheet
+- **Shared Files**: Each user must connect their own account
+- **Scopes**: Only requests necessary permissions (UrlFetchApp, Properties, Active Sheet)
+
+### Error Handling
+- **No API Key**: Sidebar shows "Connect your account" prompt
+- **Invalid Key**: "Invalid API Key. Please reconnect."
+- **Rate Limited**: "Rate limited. Please retry shortly."
+- **Free Limit**: "Free plan limit reached. Upgrade at datasetiq.com/pricing"
+- **Server Error**: "Server unavailable. Please retry."
+
+### Date Normalization
+- All dates normalized to UTC `YYYY-MM-DD` format
+- Handles MM/DD/YYYY, DD/MM/YYYY, ISO 8601, timestamps
+- Frequency and start date parameters also normalized
 
 ## Scripts
 - `npm run build` – bundle `src/Code.ts` to `Code.js` for `clasp push`.

sidebar.html

@@ -781,6 +781,52 @@ <h4 style="margin: 8px 0;">Step 3: Options (Optional)</h4>
           .deleteTemplate(id);
       }
 
+      function exportTemplatesFile() {
+        google.script.run
+          .withSuccessHandler((result) => {
+            const blob = new Blob([result.data], { type: 'application/json' });
+            const url = URL.createObjectURL(blob);
+            const a = document.createElement('a');
+            a.href = url;
+            a.download = `dsiq-templates-${Date.now()}.json`;
+            document.body.appendChild(a);
+            a.click();
+            document.body.removeChild(a);
+            URL.revokeObjectURL(url);
+            showStatus('✅ Templates exported to file');
+          })
+          .withFailureHandler(showError)
+          .exportTemplates();
+      }
+      
+      function showImportDialog() {
+        const input = document.createElement('input');
+        input.type = 'file';
+        input.accept = '.json';
+        input.onchange = (e) => {
+          const file = e.target.files ? e.target.files[0] : null;
+          if (!file) return;
+          
+          const reader = new FileReader();
+          reader.onload = (event) => {
+            const jsonData = event.target && event.target.result ? String(event.target.result) : '';
+            google.script.run
+              .withSuccessHandler((result) => {
+                if (result.ok) {
+                  showStatus(`✅ Imported ${result.count} templates`);
+                  loadTemplatesList();
+                } else {
+                  showStatus(`❌ ${result.error || 'Import failed'}`);
+                }
+              })
+              .withFailureHandler(showError)
+              .importTemplates(jsonData);
+          };
+          reader.readAsText(file);
+        };
+        input.click();
+      }
+      
       function toggleMultiSelect(seriesId) {
         const index = selectedForMultiInsert.indexOf(seriesId);
         if (index > -1) {
@@ -971,6 +1017,11 @@ <h3 style="margin: 8px 0 12px;">📁 Templates</h3>
 
           <hr style="border: none; border-top: 1px solid #e2e8f0; margin: 16px 0;" />
 
+          <div style="display: flex; gap: 8px; margin-bottom: 12px;">
+            <button onclick="exportTemplatesFile()" style="flex: 1; background: #6366f1; color: #fff; padding: 8px;">📤 Export</button>
+            <button onclick="showImportDialog()" style="flex: 1; background: #8b5cf6; color: #fff; padding: 8px;">📥 Import</button>
+          </div>
+          
           <h4 style="margin: 8px 0;">Saved Templates</h4>
           <div id="templates-list" class="muted">No templates saved yet.</div>
         </div>

src/Code.ts

@@ -124,7 +124,8 @@ function DSIQ(seriesId: string, frequency?: string | null, startDate?: any) {
     throw new Error(errorMessage);
   }
   const data = response?.data ?? [];
-  const result = buildArrayResult(data);
+  const tuples: [string, number][] = data.map(d => [d.date, d.value]);
+  const result = buildArrayResult(tuples);
 
   // Add upgrade message for free users if data is truncated at 100 observations
   const key = getApiKey();
@@ -175,11 +176,10 @@ function DSIQ_META(seriesId: string, field: string) {
   if (errorMessage) {
     throw new Error(errorMessage);
   }
-  const dataset = response?.dataset;
+  const dataset = response?.dataset as any;
   if (!dataset || !(normalizedField in dataset)) {
     throw new Error(`Metadata "${normalizedField}" not found.`);
   }
-  // @ts-expect-error dynamic access
   return dataset[normalizedField];
 }
 
@@ -519,21 +519,20 @@ function fetchSeries(
         // Metadata response
         transformedResponse = { dataset: body.dataset };
       } else if (body.data) {
-        // Data response - transform [{date, value}] to [[date, value]]
-        const dataArray = body.data.map((obs: any) => [obs.date, obs.value]);
+        // Data response - keep as objects for SeriesResponse type
         transformedResponse = { 
-          data: dataArray, 
+          data: body.data,
           seriesId: body.seriesId,
           status: body.status,
           message: body.message
         };
 
         // Handle scalar modes (latest, value, yoy)
-        if (mode === 'latest' && dataArray.length > 0) {
-          const latest = dataArray[dataArray.length - 1];
-          transformedResponse.scalar = latest[1];
-        } else if (mode === 'value' && dataArray.length > 0) {
-          transformedResponse.scalar = dataArray[0][1];
+        if (mode === 'latest' && body.data.length > 0) {
+          const latest = body.data[body.data.length - 1];
+          transformedResponse.scalar = latest.value;
+        } else if (mode === 'value' && body.data.length > 0) {
+          transformedResponse.scalar = body.data[0].value;
         }
       } else {
         transformedResponse = body;
@@ -803,6 +802,37 @@ function deleteTemplate(templateId: string) {
   return { ok: true };
 }
 
+/**
+ * Templates: Export to JSON string
+ */
+function exportTemplates(): { data: string } {
+  const templates = getTemplates();
+  return { data: JSON.stringify(templates, null, 2) };
+}
+
+/**
+ * Templates: Import from JSON string
+ */
+function importTemplates(jsonData: string): { ok: boolean; count?: number; error?: string } {
+  try {
+    const imported = JSON.parse(jsonData);
+    if (!Array.isArray(imported)) {
+      return { ok: false, error: 'Invalid template format' };
+    }
+    
+    const existing = getTemplates();
+    const combined = [...existing, ...imported];
+    PropertiesService.getUserProperties().setProperty(
+      TEMPLATES_PROP,
+      JSON.stringify(combined.slice(0, 50))
+    );
+    
+    return { ok: true, count: imported.length };
+  } catch (err) {
+    return { ok: false, error: 'Failed to parse JSON' };
+  }
+}
+
 /**
  * Multi-insert: Insert multiple series at once
  */
@@ -848,6 +878,8 @@ g.saveTemplate = saveTemplate;
 g.getTemplates = getTemplates;
 g.loadTemplate = loadTemplate;
 g.deleteTemplate = deleteTemplate;
+g.exportTemplates = exportTemplates;
+g.importTemplates = importTemplates;
 g.insertMultipleSeries = insertMultipleSeries;
 g.include = include;