Task Manager & Migration

Comprehensive task management system for organizing, scheduling, and monitoring export/import jobs. Create task hierarchies with folders, set up job dependencies, schedule automated execution, and track all running, pending, and completed operations in one centralized interface.

Three-Tab Interface

The Task Manager features a powerful three-tab interface for complete job lifecycle management.

Tasks Tab

Main workspace for creating and organizing export/import jobs with folder hierarchy.

• Task Folders - Organize tasks into folders (e.g., "Production Backups", "Development Migrations")
• Nested Tasks - Each task can contain multiple job items with different configurations
• Job Dependencies - Define parent-child relationships between jobs
• Quick Actions - Edit, run, duplicate, delete, and schedule tasks
• Filter & Search - Filter by schedule status, running status, or source/target type
• Ungrouped Tasks - Default location for tasks without folders

Monitor Tab (Execution Monitor)

Real-time monitoring of running, scheduled, and pending jobs with live status updates.

• Running Jobs - View currently executing tasks with progress bars and status
• Scheduled Jobs - Calendar and list view of upcoming scheduled executions
• Pending Jobs - Queue of jobs waiting to start (respecting dependencies)
• Live Updates - Real-time progress via SSE (Server-Sent Events)
• Quick Navigation - Jump to task configuration from monitor
• Pulsing Indicator - Green pulsing dot on Monitor tab when jobs are running

History Tab (Audit Log)

Complete execution history with detailed logs and audit trail for all job executions.

• Execution History - Chronological list of all completed, failed, and cancelled jobs
• Detailed Logs - Full execution logs with timestamps and error messages
• Filter by Status - View only successful, failed, or cancelled executions
• Filter by Task - View history for specific tasks
• Navigate to Task - Jump directly to task configuration from history entry
• Audit Compliance - Maintain compliance logs for regulatory requirements

Task Organization & Folders

Organize your migration jobs into logical folder hierarchies for better project management and team collaboration.

Creating Folder Structure

• Create Folders - Right-click on "Ungrouped Tasks" or existing folder → "New Folder"
• Nested Folders - Create subfolders within folders for multi-level organization
• Folder Paths - Use slash notation (e.g., "Production/Daily Backups/MongoDB")
• Move Tasks - Drag tasks between folders or use context menu → "Move to Folder"
• Expand/Collapse All - Quick controls to expand or collapse entire folder trees
• Folder Colors - Visual differentiation with folder icons and indentation

Task Naming & Organization

Element	Description	Example
Folder	Container for grouping related tasks	"Production/Daily Backups"
Task	Container for multiple job items	"MongoDB to MySQL Migration"
Job Item	Individual export/import configuration	"Export users collection to CSV"

Job Dependencies & Execution Order

Create complex workflows by defining parent-child relationships between jobs. Child jobs wait for parent jobs to complete before executing.

Setting Up Dependencies

1. Select a job item that should depend on other jobs (child job)
2. Click the "Set Parent Jobs" button or use context menu → "Job Dependencies"
3. In the Parent Selector modal, check the jobs that must complete first
4. Parent jobs from any task can be selected (not limited to same task)
5. Save the dependency configuration
6. Child job now shows parent job names with small badges

Dependency Behavior

• Sequential Execution - Child jobs wait until all parent jobs complete successfully
• Parallel Parents - Multiple parent jobs can run in parallel; child waits for all
• Cascading Dependencies - Job A → Job B → Job C creates execution chain
• Failure Handling - If parent fails, child job is skipped (not executed)
• Visual Indicators - Parent job names shown in small blue badges next to job name
• Cross-Task Dependencies - Jobs in different tasks can depend on each other

Common Dependency Patterns

Pattern 1: Sequential Migration
Export users → Export orders → Export products (each waits for previous)

Pattern 2: Parallel then Merge
Export users, Export products, Export orders → Generate report (waits for all three)

Pattern 3: Conditional Chain
Backup database → Transform data → Import to target → Verify integrity

Scheduling & Automation

Schedule tasks to run automatically using cron expressions or one-time execution timestamps.

Schedule Types

Type	Description	Example
Recurring (Cron)	Repeat on schedule using cron expression	0 2 * * * (Daily at 2 AM)
One-Time	Execute once at specific date/time	2026-01-15 14:30:00
Manual	No schedule, run only when manually triggered	N/A

Common Cron Patterns

0 0 * * *      # Every day at midnight
0 */6 * * *    # Every 6 hours
0 2 * * 0      # Every Sunday at 2 AM
0 3 1 * *      # First day of every month at 3 AM
*/15 * * * *   # Every 15 minutes

Schedule Management

• Edit Schedule - Click clock icon or context menu → "Edit Schedule"
• Clear Schedule - Remove scheduling to make task manual-only (requires confirmation)
• Next Run Time - Calculated automatically and displayed for each scheduled task
• Schedule Modal - Visual cron builder with presets and validation
• Filter Scheduled - View only scheduled, not-scheduled, or all tasks
• Monitor Scheduled - View upcoming executions in Monitor tab calendar view

SQL Migration Features

The Task Manager includes specialized features for SQL database migrations between MongoDB and relational databases.

SQL Export Capabilities

• MongoDB to SQL Script - Generate SQL INSERT statements from MongoDB collections
• Direct SQL Migration - Export MongoDB data directly to SQL database tables
• SQL Connection Management - Create and test SQL connections (MySQL, PostgreSQL, SQL Server, Oracle)
• Schema Generation - Automatically create SQL tables from MongoDB collection structure
• Type Mapping - Intelligent conversion between MongoDB and SQL data types
• Batch Size Control - Configure batch sizes for large-scale migrations

Supported SQL Databases

Database	Version Support	Features
MySQL	5.7+, 8.0+	Full support, JSON columns, SSL
PostgreSQL	10+, 12+, 14+	JSONB columns, array types, SSL
SQL Server	2016+, 2019+, 2022+	Windows/Linux, Azure SQL, SSL
Oracle	12c+, 19c+, 21c+	JSON columns, connection pooling

SQL Connection Health Check

The "Check Connections" feature scans all tasks and validates SQL/MongoDB connections.

• Bulk Validation - Test all connections across all tasks in one operation
• Missing Connection Detection - Identify tasks using deleted/renamed connections
• Auto-Replacement - Option to replace missing connections with alternatives
• Health Report - Summary of working, failed, and missing connections
• Connection Status Icons - Visual indicators (green checkmark, red X) for each connection

Context Menu Actions

Right-click on tasks, jobs, or folders to access powerful context menu actions.

Task-Level Actions

• Start Wizard - Add a new job item to this task
• Edit Name - Rename the task inline
• Run Task - Execute all job items in this task (respecting dependencies)
• Duplicate Task - Create a copy with "(n)" suffix and new IDs for all jobs
• Move to Folder - Relocate task to different folder
• Execution History - View audit log filtered to this task
• Delete Task - Remove task and all its job items (requires confirmation)

Job Item Actions

• Edit Job - Open job configuration modal (auto-connects required connections)
• Run Job Item - Execute this single job item immediately
• Job Dependencies - Open Parent Selector to set parent jobs
• Open Source in View - Open source collection/table in appropriate viewer
• Open Target in View - Open target collection/table in appropriate viewer
• Open in New Panel - Open source/target in split panel for comparison
• Delete Job - Remove this job item from task (requires confirmation)

Folder Actions

• New Folder - Create subfolder within this folder
• Add Task - Create new task in this folder
• Expand All - Recursively expand this folder and all subfolders/tasks
• Collapse All - Recursively collapse this folder and all subfolders/tasks
• Delete Folder - Remove folder (tasks move to parent or Ungrouped)

Filters & Search

Powerful filtering options to quickly find specific tasks in large collections.

Filter Options

Filter	Values	Purpose
Schedule Status	All / Scheduled / Not Scheduled	View only tasks with/without schedules
Running Status	All / Running / Not Running	View only active or idle tasks
Source/Target Type	All types, MongoDB, SQL, JSON, CSV, etc.	Filter by data source or target type
Search	Text search	Search task/job names
Folder Focus	Specific folder path	Show only tasks in selected folder

Search & Navigation

• Task Name Search - Type to filter tasks by name (case-insensitive)
• Folder Navigation - Click folder to focus on its contents
• Breadcrumb Trail - Shows current folder location and allows quick navigation
• Clear Filters - Reset all filters to show all tasks
• Filter Combinations - Multiple filters can be applied simultaneously
• Persist Filters - Filter state saved in activity (survives tab switches)

Pro Tips

1. Use folder paths like "Production/Database/Daily" to create multi-level organization. Tasks can be moved between folders via drag-drop or context menu.
2. When setting up dependencies, parent jobs from ANY task can be selected. This allows complex workflows across different project folders.
3. Watch the Monitor tab's pulsing green indicator to see when jobs are running. The indicator appears on the tab header itself.
4. Use "Duplicate Task" to create templates for similar migrations. Duplicated tasks get new IDs and "(n)" suffix, allowing quick reuse.
5. The "Open Source in View" action auto-detects whether to open Collection, Aggregation, or SQL Table viewer based on source type.
6. Run "Check Connections" periodically to validate all SQL and MongoDB connections across all tasks. It identifies missing connections early.
7. Schedule similar tasks at staggered times to avoid resource contention (e.g., 2 AM, 3 AM, 4 AM instead of all at 2 AM).
8. Use the History tab to review past failures. Click "Navigate to Task" to jump directly to the task configuration for fixes.

Related Features

• Tasks Management - Create individual export/import jobs with field mapping and transformations
• Collection Activity - View and query source/target collections before migration
• SQL Query Activity - Browse SQL tables and preview data before export
• Aggregation Pipeline - Build complex MongoDB aggregation queries as job sources
• Connection Manager - Manage MongoDB connections used in tasks