Task Manager

Schedule and manage background tasks for data exports, imports, synchronization jobs, and recurring database operations. The Task Manager lets you automate repetitive workflows and monitor job execution in real-time.

Task Types

The Task Manager supports various automation tasks for different data operations.

Export Tasks

Automatically export data from MongoDB collections to files.

Export Option	Description
JSON	Export to JSON format with optional pretty printing
CSV	Export to CSV with configurable delimiters and headers
BSON	Export in native MongoDB BSON format for backups
SQL	Export as SQL INSERT statements for migration

Import Tasks

Schedule automated data imports from files or external sources.

• File Import: Import from JSON, CSV, or BSON files
• Field Mapping: Map source fields to destination fields
• Data Transformation: Apply transformations during import
• Upsert Mode: Update existing documents or insert new ones

Scheduling

Configure when and how often tasks should run.

Schedule Options

Option	Description
One-Time	Run once at a specific date and time
Hourly	Run every hour at a specific minute
Daily	Run once per day at a specific time
Weekly	Run on specific days of the week
Monthly	Run on specific days of the month
Cron	Custom cron expression for advanced scheduling

Timezone Support

Tasks can be scheduled in any timezone. The Task Manager displays all times in your local timezone and handles daylight saving time automatically.

Task Monitoring

Monitor running tasks and view execution history.

Monitoring Features

• Real-Time Progress: Live progress bars and document counts
• Execution History: View past runs with start/end times and results
• Error Logs: Detailed error messages for failed tasks
• Statistics: Documents processed, skipped, and failed counts
• Duration Tracking: Execution time for performance analysis

Task Status

Status	Description
Scheduled	Task is waiting for its next scheduled run
Running	Task is currently executing
Completed	Task finished successfully
Failed	Task encountered an error
Paused	Task is temporarily disabled

Task Actions

Manage tasks with various control actions.

• Run Now: Execute the task immediately, regardless of schedule
• Pause: Temporarily stop scheduled runs
• Resume: Reactivate a paused task
• Edit: Modify task configuration
• Clone: Create a copy of the task with new settings
• Delete: Remove the task permanently
• View History: See all past executions

Notifications

Get notified about task execution results.

Notification Options

• On Success: Notify when task completes successfully
• On Failure: Notify when task encounters an error
• On Warning: Notify when task completes with warnings
• Email Notifications: Send results to email addresses
• In-App Notifications: Desktop notifications in VisuaLeaf

Data Transformations

Apply transformations to data during export, import, or sync operations.

Transformation Types

• Field Mapping: Rename or restructure fields
• Data Type Conversion: Convert between types (string to date, etc.)
• Filtering: Include/exclude documents based on conditions
• Custom JavaScript: Write custom transformation functions
• Aggregation Pipeline: Apply aggregation stages before export

Task Settings

Configure task behavior and performance options.

Setting	Description	Default
Batch Size	Number of documents to process per batch	1000
Retry Count	Number of retry attempts on failure	3
Timeout	Maximum execution time before timeout	30 minutes
Concurrent Tasks	Maximum tasks that can run simultaneously	2
Keep History	Number of execution records to retain	100

Pro Tips

1. Test First: Run tasks manually before scheduling to verify configuration.
2. Use Incremental Sync: For large datasets, incremental sync is much faster than full sync.
3. Schedule Off-Peak: Schedule heavy tasks during off-peak hours to reduce database load.
4. Monitor First Runs: Watch the first few scheduled runs to ensure they complete as expected.
5. Set Up Notifications: Enable failure notifications to catch issues quickly.
6. Use Transformations: Clean and transform data during migration to avoid manual post-processing.

Related Features

• Export Data - Manual export for one-time operations.
• Collection Compare - Compare collections before and after sync.
• Connection Manager - Set up connections for sync tasks.