← Back to Product Nexus
Data Nexus

Product Nexus · Data Nexus

Sources in. Destinations out. No glue code.

Data Nexus is ProBirds' data extraction and orchestration platform — reusable sources and destinations, scheduled tasks, dependency-based pipelines, and delta loads, without another one-off script to maintain.

01 · Sources & Destinations

Define a connection once. Reuse it everywhere.

  • Reusable source definitions for databases — MSSQL, Oracle, MySQL, PostgreSQL — files (CSV, JSON, XLSX, XLS, Parquet), and REST APIs.
  • Reusable destination definitions for local disk, FTP/SFTP, AWS S3, Azure Blob, Google Drive-style storage, and REST API endpoints.
  • Wildcard file patterns match recursively across subfolders — no per-file wiring.
Connected Source & Destination Types
MSSQL Oracle MySQL PostgreSQL CSV / JSON Parquet REST API AWS S3 Azure Blob SFTP
02 · Delta Extraction

Pull only what changed, not the whole table.

  • Extraction mode is full or delta — delta pulls only rows past a stored watermark.
  • An overlap window guards against records missed right at the boundary.
  • Delta can be reset per task whenever you need a clean full reload.
Orders — Delta Config
ModeDelta
Watermark Columnupdated_at
Last Watermark2026-08-14 09:00
Overlap Window120 sec
03 · Pipelines & Scheduling

Chain tasks into a pipeline, then forget about it.

  • Pipelines are a dependency graph of tasks, not just a list to run in order.
  • continue_on_error decides whether one failed step blocks everything downstream.
  • Cron scheduling covers everything from every 30 minutes to weekdays at 6pm.
Nightly Orders Pipeline
1
Extract Orders

MSSQL, delta mode

2
Extract Customers

PostgreSQL, full load

3
Merge & Load

Writes to warehouse table

4
Notify

Webhook on completion

04 · SAP Integration

SAP, without becoming a SAP integration project.

  • Native SAP source types extract directly, including delta pulls.
  • No direct access? Fall back to SAP OData / REST without touching SAP libraries.
  • Authorization is scoped per source, not shared across every task.
SAP Source vs OData Fallback
Direct SAP SourceOData / REST
RequiresSAP connection librariesJust an API endpoint
Delta supportNativeManual filters
Best forDirect SAP accessRestricted environments
05 · Monitoring & Webhooks

Every run logged, every failure visible.

  • A dashboard, results log, and event log cover every task and pipeline run.
  • Webhooks push results to your own endpoint the moment a run finishes.
  • Filters on the event log make finding one failed run in thousands fast.
Event Log
Orders ExtractSuccess
SAP Delta PullSuccess
FTP Batch LoadFailed
Customer SyncSuccess
Nightly PipelineSuccess
06 · Uptime & Health Checks

Know it's down before your users tell you.

  • Monitor servers, databases, websites, and connected equipment with HTTP, TCP, ping, database-ping, or SQL-query checks.
  • Every check records status — Up, Degraded, or Down — along with response time and consecutive failures.
  • Alerts fire the moment status changes, by webhook, Slack, or email, on both failure and recovery.
  • Check history can log straight to a database table, created automatically, for uptime reporting and trend analysis.
Production API — Health
StatusUP
Response Time142 ms
Uptime (7d)99.92%
Consecutive Failures0

Key Features

Everything an ETL script does, minus the script

  • ✓Reusable source & destination definitions
  • ✓Full or delta (incremental) extraction
  • ✓MSSQL procedures & Python scripts as tasks
  • ✓One-off runs or cron scheduling
  • ✓Dependency-based pipelines with continue-on-error
  • ✓Wildcard + recursive file batch processing
  • ✓Direct-to-database loading with dynamic table creation
  • ✓SAP source types plus OData/REST fallback
  • ✓Role-based access — Admin and Viewer
  • ✓Uptime and health checks for servers, databases, websites, and equipment

See Data Nexus on your own sources

We'll wire up one source and destination and show you a working pipeline in a day.

Talk to Us