INNORIX in Practice, Fleet-Scale Collection

Tomorrow morning's meetingneeds data from every site nationwide.

From now until 9 AM tomorrow,follow a company preparing data from across the country.

Scenario
A fictional business scenario of a company preparing data from sites nationwide by a set business deadline.

Today 19:3013 h 30 min until the meeting

MONDAY, 16:00
17 hours
Left until the meeting
COLLECTION SCOPE
120 sites
1,840 devices in scope
EXPECTED DATA
24.8 TB
Expected volume from all sites

BUSINESS SITES

Data readiness by site

Each square is one site.

  • Collected76
  • Collecting30
  • Awaiting data9
  • Awaiting reconnection5

MEETING PREPARATION

Tomorrow's 9 AM management meeting

Nationwide site data collection

76 / 120

  • Site operation recordsCollecting
  • Daily business resultsCollecting
  • Quality inspection resultsWaiting
  • Equipment status recordsCollecting

The meeting materials are prepared in the company's own business systems.

Collection stalls at a few sites while the rest carry on.

INNORIX in Practice

This afternoon16:00

Today 16:00

An unscheduled meeting is called.

At 4 PM, HQ leadership decided to review operations at every site nationwide the next morning.

This wasn't a meeting about one site's report.

Business records from production sites, logistics centers, standard sites and field facilities across the country all had to be reviewed together.

The staff member preparing the meeting passed the required data and deadline to the data operations team.

MONDAY, 16:00

Tomorrow 9 AM: nationwide site operations review

Meeting
TUE 09:00
Nationwide site operations review
Data-ready deadline
TUE 07:00
Leaves time to compile and review

REQUIRED DATA

Required dataScopeEst. size
Site operation records120 sites4.2 TB
Daily business results120 sites0.8 TB
Quality inspection results32 production sites11.6 TB
Equipment status and environment records1,840 devices8.2 TB

Total expected data24.8 TB

One meeting,but 120 places where the data has to be prepared.

Live contextNow

16:00Today

Until the meeting
17 h
Sites with data ready
0 / 120
Expected data
24.8 TB

Current task

Confirm required data and collection targets

Data-ready deadline

Tomorrow 07:00

Today 16:20

Every site needs different data.

Not every site the company runs does the same work.

Standard sites need daily business results and operation records; production sites need quality inspection results and production equipment records.

Logistics centers need inbound and outbound results and records from their logistics equipment.

24-hour facilities needed operational data up to a set reporting cutoff.

Using devices that were already connected, the data operations team sets up collection groups and file conditions for each site.

MONDAY, 16:20

What to collect depends on each site's work.

  • Standard sites

    64 sites, 320 devices

    Example files

    daily_sales.csv

    operation_summary.json

    business_record.zip

    Final data expected18:00

  • Production sites

    32 sites, 960 devices

    Example files

    production_result.csv

    inspection_result.zip

    machine_operation.log

    Final data expected20:00

  • Logistics centers

    16 sites, 400 devices

    Example files

    shipment_record.csv

    inventory_result.json

    warehouse_operation.log

    Final data expected22:00

  • 24-hour facilities

    8 sites, 160 devices

    Example files

    operation_24h.csv

    equipment_status.dat

    environment_record.zip

    Final data expectedNext day 05:30

Datasets

DatasetDevicesCollection condition
Business records320Closing files after 18:00
Production records960Once inspection and production files are ready
Logistics records400Closing files after 22:00
Overnight records160After the 05:30 summary
There's no need to collect the same files from every device at the same time.

Live contextNow

16:20Today

Until the meeting
16 h 40 min
Sites with data ready
0 / 120
Expected data
24.8 TB

Current task

Set up collection groups and file conditions per site

Data-ready deadline

Tomorrow 07:00

Today 16:40

Collection starts across all sites nationwide.

There was no need to wait for every site to finish the day.

Collection would start with the operation records and inspection results already generated, and pick up new files as they appeared, based on set conditions.

The goal: by the time the last site closes, most of the data is already at HQ.

MONDAY, 16:40

Collect whatever data is ready, starting now.

Collection runs

National business review
CollectionDevicesReceivedStatus
Business records32042 GBRunning
Production records960108 GBRunning
Logistics records40032 GBRunning
Overnight records16018 GBRunning

COLLECTION SCHEDULE

  • Collecting existing data
  • Collecting final files
Instead of waiting for all the data to be ready,the company starts pulling in data as it becomes ready.

Live contextNow

16:40Today

Until the meeting
16 h 20 min
Sites with data ready
0 / 120
Data collected so far
200 GB

Current task

Start collecting whatever data is ready

Data-ready deadline

Tomorrow 07:00

Today 18:00

Sites across the country close for the day, one by one.

At 6 PM, standard sites began closing for the day.

Business systems generated the day's final results files and operation records.

At some sites, those files had already reached the corporate storage.

But production sites and logistics centers were still at work, and 24-hour facilities kept generating data.

MONDAY, 18:00

Same time, different days at different sites

  • Standard site, Site-024

    Closed for the day

    • daily_sales.csvCollected
    • operation_summary.jsonCollected
    • business_record.zipCollected

    Day's required data collected

  • Production site, Site-078

    Open

    • inspection_1700.zipCollected
    • inspection_1800.zipCollecting
    • production_final.csvNot created

    Existing data collected, awaiting final file

  • Logistics center, Site-108

    Inbound/outbound in progress

    • shipment_1600.csvCollected
    • shipment_1800.csvCollecting
    • inventory_final.jsonNot created

    Final results expected at 22:00

  • 24-hour facility, Site-116

    Running continuously

    • operation_1700.logCollected
    • operation_1800.logCollecting
    • operation_24h.csvNot created

    Final summary cutoff tomorrow 05:30

Required data ready
42 / 120
Data collected so far
10.6 TB
Until the meeting
15 hours
Each site runs on its own hours,and data reaches the company in the order it is ready.

Live contextNow

18:00Today

Until the meeting
15 h
Sites with data ready
42 / 120
Data collected so far
10.6 TB

Current status

Standard sites' required data for the day collected

Remaining work

Collection in progress at production, logistics and 24-hour sites

NOT EVERYTHING GOES AS PLANNED, Today 19:30

Not every site has delivered its data.

At 7:30 PM, the data operations team checked collection status across all sites.

Data was arriving normally from most sites, but a few locations ran into unexpected problems.

One site lost its network connection; at another, some devices rebooted.

Some files had been generated on site but hadn't yet reached the company.

Tomorrow morning's meeting needs data from these sites, too.

MONDAY, 19:30

Data from 44 sites is not ready yet.

Collected
76
Collecting
30
Awaiting final files
9
Awaiting reconnection
5

Sites needing attention

SiteCollectedRemainingCurrent status
Site-01818.4 GB8.2 GBNetwork disconnected
Site-04124.6 GB12.8 GBDevice offline
Site-072612 GB184 GBConnection lost
Site-096280 GB96 GBDevice restarting
Site-114426 GB212 GBNetwork disconnected

COLLECTION POLICY

Network disconnected
Wait for reconnection, then resume transfer
Device reboot
Resume unfinished work once the device reconnects
Files not yet created
Collect later under the configured conditions
Devices connected normally
Keep collecting as planned
A problem at a few sitesdoesn't stop collection at the others.

Live contextNow

19:30Today

Until the meeting
13 h 30 min
Sites with data ready
76 / 120
Data collected so far
17.2 TB

Remaining work

30 sites collecting9 sites awaiting data5 sites awaiting reconnection

Today 22:00

Late-closing sites are still generating data.

At 10 PM, logistics centers across the country wrapped up the day's last inbound and outbound work.

Final inventory, shipment results and logistics equipment operation records were generated.

Since existing data had been collected since the afternoon, only the last files created after closing still needed to come in.

Production sites delivered the day's final inspection results the same way.

MONDAY, 22:00

As the day's last work ends, the final data is ready.

Today's logistics center data
4.32 TB
Already collected
4.08 TB
Left to collect
240 GB

Collected during business hoursFinal data

Latest collection activity

Logistics facilities
SourceFileCreatedStatus
Site-097shipment_final.csv22:01Collected
Site-099inventory_final.zip22:02Collecting
Site-103warehouse_final.log22:03Collected
Site-108outbound_summary.zip22:04Collecting
Site-112daily_operation.zip22:05Collecting
Sites ready
104 / 120
Data collected so far
21.9 TB
Rather than pulling everything at once after closing,only the last data to become ready is added.

Live contextNow

22:00Today

Until the meeting
11 h
Sites with data ready
104 / 120
Data collected so far
21.9 TB

Current status

Collecting final logistics center data

WHILE EVERYONE IS ASLEEP, Today 23:00

The HQ data operations lead heads home, too.

At 11 PM, the HQ data operations lead checked where things stood.

All required data had arrived from 109 of the 120 sites.

11 sites remained.

Devices at some sites were waiting to reconnect, and 24-hour facilities were waiting for their final summary files.

After checking the remaining collection work and the automatic run conditions, the lead went home.

MONDAY, 23:00

Before signing off, check the remaining work.

Collection summary

Collected
109 sites
Awaiting reconnection
3 sites
Awaiting final data
8 sites
Remaining workSitesExpected action
Interrupted transfers3Resume after reconnect
Overnight records8Collect through 05:30
Required file verification120Before 07:00

OVERNIGHT OPERATIONS

  • Resume transfers after reconnectConfigured
  • Collect files created overnightScheduled
  • Log results and errorsActive
  • Unfinished work alertsOperations team's alert channel
The data operations team's working hoursdon't have to match the hours the company's data is created.

Live contextNow

23:00Today

Until the meeting
10 h
Sites with data ready
109 / 120
Data collected so far
22.8 TB

Overnight work

3 sites awaiting reconnection8 sites awaiting final data

THE HOURS IN BETWEEN

Long after HQ has closed for the day,data keeps being generated across the country.

  1. Today23:00109 sites ready
  2. Midnight00:00Overnight collection in progress
  3. Next day02:10Site reconnected

OVERNIGHT COLLECTION ACTIVITY

  1. 23:32:04Site-118operation_2300.logCollected
  2. 00:02:18Site-115sensor_0000.csvCollected
  3. 00:42:30Site-072inspection_result.zipResumed
  4. 01:17:06Site-041operation_record.zipCollected
  5. 01:44:12Site-120equipment_status.datCollected
  6. 02:10:03Site-114Connection restoredResumed

6 h 50 min until the meeting

INNORIX in Practice

This afternoon16:00

Tomorrow 02:10

A disconnected site comes back online.

At 2:10 AM, devices at the last site, offline since the previous evening, came back on the network.

Some of its data had already reached the corporate storage before the outage.

On site were files whose transfer had not finished, plus new files created while the connection was down.

With the connection back, the unfinished transfers resumed and the required files created since then began to be collected.

TUESDAY, 02:10

Data starts arriving from the last site that was offline.

Site-114

Overnight operation facility

Connected
Collected before the outage
426 GB
Unfinished existing data
212 GB
Created during the outage
46 GB
Left to collect now
258 GB
TimeEventStatus
19:12Network connection lostInterrupted
02:10Device connection restoredConnected
02:11Interrupted transfer resumedRunning
02:12Newly generated files detectedRunning
02:28Outstanding files collectedCompleted

RECOVERY PROGRESS

Completed

684 GB / 684 GB

  • Collected before the outage426 GB
  • Existing data completed after recovery212 GB
  • Created during the outage46 GB
Even data from sites with a troubled collection environmentis making its way to the company.

Live contextNow

02:10Tomorrow

Until the meeting
6 h 50 min
Sites with data ready
115 / 120
Data collected so far
23.9 TB

Current status

Last offline site reconnectedResuming unfinished transfers and collecting new data

Tomorrow 05:30

The last operational data is generated.

At 5:30 AM, the reporting period for the meeting closed at the 24-hour sites as well.

Work on site didn't stop.

The on-site business systems wrote the business records and equipment status data for the review period out to files.

118 sites already had their data ready.

All that remained was for the final summary files from the last 2 sites to reach the company.

TUESDAY, 05:30

Data from the last two sites for the meeting

Sites collected
118 / 120
Data collected so far
24.5 TB
Until the meeting
3 h 30 min

Site-119128 GB

  • operation_24h.csvCreated, 05:30
  • equipment_final.zipCreated, 05:30

Collecting final records

Site-120172 GB

  • environment_final.zipCreated, 05:30
  • operation_summary.csvCreated, 05:30

Collecting final records

Work in the field carries on,while the data the meeting needs falls into place, one piece at a time.

Live contextNow

05:30Tomorrow

Until the meeting
3 h 30 min
Sites with data ready
118 / 120
Data collected so far
24.5 TB

Current status

Collecting final summary files from the last two sites

BEFORE THE MEETING, Tomorrow 06:20

Data from every site nationwide has arrived.

At 6:20 AM, collection of the last data needed for the meeting was complete.

Data collected since the previous afternoon, data generated overnight and data from devices that reconnected had all reached the corporate storage.

The question now isn't simply whether the transfers finished.

The company compares each site's required data list with the files that actually arrived, to confirm everything the meeting needs is ready.

TUESDAY, 06:20

Required data from all 120 sites nationwide is ready.

Sites with data ready
120 / 120
Devices in scope
1,840 devices
Total data collected
24.8 TB

Collection results

Collection groupSitesDevicesStatus
Business records64 / 64320Completed
Production records32 / 32960Completed
Logistics records16 / 16400Completed
Overnight records8 / 8160Completed

REQUIRED DATA VERIFICATION

Required site data
120 / 120
Requested data types
4 / 4
Required data still outstanding
0
Data-ready deadline
07:00
Actually ready
06:20

Result of checking the company's required data list against the actual file collection records.

Until the data deadline
40 min
Until the meeting
2 h 40 min
Data from every site is ready.Now the real business work can begin.

Live contextNow

06:20Tomorrow

Until the meeting
2 h 40 min
Sites with data ready
120 / 120
Final data collected
24.8 TB

Current status

Required data collected

Next task

Compile and review the meeting materials

Tomorrow 07:00

The data is ready, and the meeting materials are being built.

At 7 AM, data from every site was already in use where the company prepares its meeting materials.

HQ's business systems began compiling operating results by site, comparing quality inspection results, and summarizing equipment status and field operations.

The job of collecting files was done.

From here on, the work is turning the collected data into the information the company needs to make decisions.

TUESDAY, 07:00

The collected data goes to work for the business.

COLLECTED BUSINESS DATA

Collection completed

24.8 TB

  • /national-review/operation/4.2 TB
  • /national-review/business/0.8 TB
  • /national-review/inspection/11.6 TB
  • /national-review/equipment/8.2 TB

ENTERPRISE REPORTING SYSTEM

Preparing the nationwide site operations report

  • Compile business results by site87%

  • Organize production and quality inspection results68%

  • Compile logistics operations status94%

  • Summarize equipment status and exceptions76%

Example tasks in the company's own external aggregation and reporting system

Transferring files isn't the end goal;it is how the company gets to the work that matters.

Live contextNow

07:00Tomorrow

Until the meeting
2 h
Sites with data ready
120 / 120
Final data collected
24.8 TB

Current task

Preparing the nationwide site operations report

THE NEXT MORNING, Tomorrow 08:30

The meeting materials are ready.

At 8:30 AM, staff at HQ were going over the meeting materials.

Data from every site requested the previous afternoon was all in.

No one had to chase down which sites hadn't delivered yet or ask field staff to resend files.

The time left before the meeting went into reviewing the content, not preparing it.

TUESDAY, 08:30

30 minutes before the meeting, materials from every site are ready.

BUSINESS REVIEW REPORT

Nationwide site operations

For the Tuesday 9 AM management meeting

Ready for review

Operating results by site

Includes operational data from 120 sites

Production and quality

Includes inspection results from 32 production sites

  • Nationwide site operationsPrepared
  • Production and quality inspection resultsPrepared
  • Logistics facility resultsPrepared
  • Equipment status and operational issuesPrepared

Fictional meeting materials generated in the company's external reporting system.

The people preparing the meetingare reviewing the data instead of hunting for it.

Live contextNow

08:30Tomorrow

Until the meeting
30 min
Sites in the materials
120 / 120
Data in use
24.8 TB

Current task

Final review of the meeting materials

Tomorrow 09:00

The meeting begins.

At 9 AM, the meeting to review operations at every site nationwide began.

Attendees compared operating results by site and reviewed quality trends at production sites and activity at logistics centers.

Data from the devices that lost their connection the night before was in the materials, too.

So were the records from sites that worked through the night.

No one in the meeting talked about which sites' data hadn't arrived yet.

They talked about where the company stands now, and what it should do next.

Live contextNow

09:00Tomorrow

Scheduled
Meeting starts
Sites in the materials
120 / 120
Data in use
24.8 TB

Current task

Reviewing nationwide site operationsDeciding the company's next steps

TUESDAY, 09:00

The meeting begins.

Sites with data ready
120 / 120
Data collected for the meeting
24.8 TB
All data ready at
06:20

THE LAST 17 HOURS

How data was readied across all sites

Sites with required data collected, over time

Data from across the country was ready when it was needed,and the company's work began on schedule.

FROM DATA COLLECTION TO BUSINESS DECISIONS

When data is neededis decided by the business.

Sites differ in location and hours, devices in type and connectivity,but the company still needs their data together.

  1. MONDAY, 16:00

    The business sets the agenda.

    Tomorrow 09:00Nationwide site operations meetingData needed from 120 sites

    The work the company needs, and when it needs the data, are decided.

  2. OVERNIGHT

    Data comes in from across the country.

    Data that becomes ready at different times, in different environments, is collected continuously.

  3. TUESDAY, 09:00

    The business gets to work.

    120 / 120Data ready from every siteReady for business review

    With the data ready, the company starts assessing and deciding.

When the business is ready to start,its data must be ready, too.

THE TECHNOLOGY BEHIND THIS STORY

Fleet-Scale Collection

Collect the data your business needs from sites, industrial equipment, servers and field environments across the country.

Set different data and collection conditions for each site, and keep collecting continuously on a schedule or as new files are created.

Explore the product