Scene preview, MONDAYAn unscheduled meeting is called.
Operational data from 120 sites nationwide must be ready by tomorrow morning.
INNORIX in Practice
This afternoon16:00
Today 16:00
An unscheduled meeting is called.
At 4 PM, HQ leadership decided to review operations at every site nationwide the next morning.
This wasn't a meeting about one site's report.
Business records from production sites, logistics centers, standard sites and field facilities across the country all had to be reviewed together.
The staff member preparing the meeting passed the required data and deadline to the data operations team.
MONDAY, 16:00
Tomorrow 9 AM: nationwide site operations review
Meeting
TUE 09:00
Nationwide site operations review
Data-ready deadline
TUE 07:00
Leaves time to compile and review
REQUIRED DATA
Required data
Scope
Est. size
Site operation records
120 sites
4.2 TB
Daily business results
120 sites
0.8 TB
Quality inspection results
32 production sites
11.6 TB
Equipment status and environment records
1,840 devices
8.2 TB
Total expected data24.8 TB
One meeting,but 120 places where the data has to be prepared.
Live contextNow
16:00Today
Until the meeting
17 h
Sites with data ready
0 / 120
Expected data
24.8 TB
Current task
Confirm required data and collection targets
Data-ready deadline
Tomorrow 07:00
Today 16:20
Every site needs different data.
Not every site the company runs does the same work.
Standard sites need daily business results and operation records; production sites need quality inspection results and production equipment records.
Logistics centers need inbound and outbound results and records from their logistics equipment.
24-hour facilities needed operational data up to a set reporting cutoff.
Using devices that were already connected, the data operations team sets up collection groups and file conditions for each site.
MONDAY, 16:20
What to collect depends on each site's work.
Standard sites
64 sites, 320 devices
Example files
daily_sales.csv
operation_summary.json
business_record.zip
Final data expected18:00
Production sites
32 sites, 960 devices
Example files
production_result.csv
inspection_result.zip
machine_operation.log
Final data expected20:00
Logistics centers
16 sites, 400 devices
Example files
shipment_record.csv
inventory_result.json
warehouse_operation.log
Final data expected22:00
24-hour facilities
8 sites, 160 devices
Example files
operation_24h.csv
equipment_status.dat
environment_record.zip
Final data expectedNext day 05:30
Datasets
Dataset
Devices
Collection condition
Business records
320
Closing files after 18:00
Production records
960
Once inspection and production files are ready
Logistics records
400
Closing files after 22:00
Overnight records
160
After the 05:30 summary
There's no need to collect the same files from every device at the same time.
Live contextNow
16:20Today
Until the meeting
16 h 40 min
Sites with data ready
0 / 120
Expected data
24.8 TB
Current task
Set up collection groups and file conditions per site
Data-ready deadline
Tomorrow 07:00
Today 16:40
Collection starts across all sites nationwide.
There was no need to wait for every site to finish the day.
Collection would start with the operation records and inspection results already generated, and pick up new files as they appeared, based on set conditions.
The goal: by the time the last site closes, most of the data is already at HQ.
MONDAY, 16:40
Collect whatever data is ready, starting now.
Collection runs
National business review
Collection
Devices
Received
Status
Business records
320
42 GB
Running
Production records
960
108 GB
Running
Logistics records
400
32 GB
Running
Overnight records
160
18 GB
Running
COLLECTION SCHEDULE
16:4018:0020:0022:0002:0005:3007:00
Standard sites
Final
Production sites
Final
Logistics centers
Final
24-hour facilities
Final
Collecting existing data
Collecting final files
Instead of waiting for all the data to be ready,the company starts pulling in data as it becomes ready.
Live contextNow
16:40Today
Until the meeting
16 h 20 min
Sites with data ready
0 / 120
Data collected so far
200 GB
Current task
Start collecting whatever data is ready
Data-ready deadline
Tomorrow 07:00
Today 18:00
Sites across the country close for the day, one by one.
At 6 PM, standard sites began closing for the day.
Business systems generated the day's final results files and operation records.
At some sites, those files had already reached the corporate storage.
But production sites and logistics centers were still at work, and 24-hour facilities kept generating data.
MONDAY, 18:00
Same time, different days at different sites
Standard site, Site-024
Closed for the day
daily_sales.csvCollected
operation_summary.jsonCollected
business_record.zipCollected
Day's required data collected
Production site, Site-078
Open
inspection_1700.zipCollected
inspection_1800.zipCollecting
production_final.csvNot created
Existing data collected, awaiting final file
Logistics center, Site-108
Inbound/outbound in progress
shipment_1600.csvCollected
shipment_1800.csvCollecting
inventory_final.jsonNot created
Final results expected at 22:00
24-hour facility, Site-116
Running continuously
operation_1700.logCollected
operation_1800.logCollecting
operation_24h.csvNot created
Final summary cutoff tomorrow 05:30
Required data ready
42 / 120
Data collected so far
10.6 TB
Until the meeting
15 hours
Each site runs on its own hours,and data reaches the company in the order it is ready.
Live contextNow
18:00Today
Until the meeting
15 h
Sites with data ready
42 / 120
Data collected so far
10.6 TB
Current status
Standard sites' required data for the day collected
Remaining work
Collection in progress at production, logistics and 24-hour sites
NOT EVERYTHING GOES AS PLANNED, Today 19:30
Not every site has delivered its data.
At 7:30 PM, the data operations team checked collection status across all sites.
Data was arriving normally from most sites, but a few locations ran into unexpected problems.
One site lost its network connection; at another, some devices rebooted.
Some files had been generated on site but hadn't yet reached the company.
Tomorrow morning's meeting needs data from these sites, too.
MONDAY, 19:30
Data from 44 sites is not ready yet.
Collected
76
Collecting
30
Awaiting final files
9
Awaiting reconnection
5
Sites needing attention
Site
Collected
Remaining
Current status
Site-018
18.4 GB
8.2 GB
Network disconnected
Site-041
24.6 GB
12.8 GB
Device offline
Site-072
612 GB
184 GB
Connection lost
Site-096
280 GB
96 GB
Device restarting
Site-114
426 GB
212 GB
Network disconnected
COLLECTION POLICY
Network disconnected
Wait for reconnection, then resume transfer
Device reboot
Resume unfinished work once the device reconnects
Files not yet created
Collect later under the configured conditions
Devices connected normally
Keep collecting as planned
A problem at a few sitesdoesn't stop collection at the others.
At 10 PM, logistics centers across the country wrapped up the day's last inbound and outbound work.
Final inventory, shipment results and logistics equipment operation records were generated.
Since existing data had been collected since the afternoon, only the last files created after closing still needed to come in.
Production sites delivered the day's final inspection results the same way.
MONDAY, 22:00
As the day's last work ends, the final data is ready.
Today's logistics center data
4.32 TB
Already collected
4.08 TB
Left to collect
240 GB
Collected during business hoursFinal data
Latest collection activity
Logistics facilities
Source
File
Created
Status
Site-097
shipment_final.csv
22:01
Collected
Site-099
inventory_final.zip
22:02
Collecting
Site-103
warehouse_final.log
22:03
Collected
Site-108
outbound_summary.zip
22:04
Collecting
Site-112
daily_operation.zip
22:05
Collecting
Sites ready
104 / 120
Data collected so far
21.9 TB
Rather than pulling everything at once after closing,only the last data to become ready is added.
Live contextNow
22:00Today
Until the meeting
11 h
Sites with data ready
104 / 120
Data collected so far
21.9 TB
Current status
Collecting final logistics center data
WHILE EVERYONE IS ASLEEP, Today 23:00
The HQ data operations lead heads home, too.
At 11 PM, the HQ data operations lead checked where things stood.
All required data had arrived from 109 of the 120 sites.
11 sites remained.
Devices at some sites were waiting to reconnect, and 24-hour facilities were waiting for their final summary files.
After checking the remaining collection work and the automatic run conditions, the lead went home.
MONDAY, 23:00
Before signing off, check the remaining work.
Collection summary
Collected
109 sites
Awaiting reconnection
3 sites
Awaiting final data
8 sites
Remaining work
Sites
Expected action
Interrupted transfers
3
Resume after reconnect
Overnight records
8
Collect through 05:30
Required file verification
120
Before 07:00
OVERNIGHT OPERATIONS
Resume transfers after reconnectConfigured
Collect files created overnightScheduled
Log results and errorsActive
Unfinished work alertsOperations team's alert channel
The data operations team's working hoursdon't have to match the hours the company's data is created.
Live contextNow
23:00Today
Until the meeting
10 h
Sites with data ready
109 / 120
Data collected so far
22.8 TB
Overnight work
3 sites awaiting reconnection8 sites awaiting final data
THE HOURS IN BETWEEN
Long after HQ has closed for the day,data keeps being generated across the country.
Today23:00109 sites ready
Midnight00:00Overnight collection in progress
Next day02:10Site reconnected
OVERNIGHT COLLECTION ACTIVITY
23:32:04Site-118operation_2300.logCollected
00:02:18Site-115sensor_0000.csvCollected
00:42:30Site-072inspection_result.zipResumed
01:17:06Site-041operation_record.zipCollected
01:44:12Site-120equipment_status.datCollected
02:10:03Site-114Connection restoredResumed
6 h 50 min until the meeting
INNORIX in Practice
This afternoon16:00
Tomorrow 02:10
A disconnected site comes back online.
At 2:10 AM, devices at the last site, offline since the previous evening, came back on the network.
Some of its data had already reached the corporate storage before the outage.
On site were files whose transfer had not finished, plus new files created while the connection was down.
With the connection back, the unfinished transfers resumed and the required files created since then began to be collected.
TUESDAY, 02:10
Data starts arriving from the last site that was offline.
Site-114
Overnight operation facility
Connected
Collected before the outage
426 GB
Unfinished existing data
212 GB
Created during the outage
46 GB
Left to collect now
258 GB
Time
Event
Status
19:12
Network connection lost
Interrupted
02:10
Device connection restored
Connected
02:11
Interrupted transfer resumed
Running
02:12
Newly generated files detected
Running
02:28
Outstanding files collected
Completed
RECOVERY PROGRESS
Completed
684 GB / 684 GB
Collected before the outage426 GB
Existing data completed after recovery212 GB
Created during the outage46 GB
Even data from sites with a troubled collection environmentis making its way to the company.
Live contextNow
02:10Tomorrow
Until the meeting
6 h 50 min
Sites with data ready
115 / 120
Data collected so far
23.9 TB
Current status
Last offline site reconnectedResuming unfinished transfers and collecting new data
Tomorrow 05:30
The last operational data is generated.
At 5:30 AM, the reporting period for the meeting closed at the 24-hour sites as well.
Work on site didn't stop.
The on-site business systems wrote the business records and equipment status data for the review period out to files.
118 sites already had their data ready.
All that remained was for the final summary files from the last 2 sites to reach the company.
TUESDAY, 05:30
Data from the last two sites for the meeting
Sites collected
118 / 120
Data collected so far
24.5 TB
Until the meeting
3 h 30 min
Site-119128 GB
operation_24h.csvCreated, 05:30
equipment_final.zipCreated, 05:30
Collecting final records
Site-120172 GB
environment_final.zipCreated, 05:30
operation_summary.csvCreated, 05:30
Collecting final records
Work in the field carries on,while the data the meeting needs falls into place, one piece at a time.
Live contextNow
05:30Tomorrow
Until the meeting
3 h 30 min
Sites with data ready
118 / 120
Data collected so far
24.5 TB
Current status
Collecting final summary files from the last two sites
BEFORE THE MEETING, Tomorrow 06:20
Data from every site nationwide has arrived.
At 6:20 AM, collection of the last data needed for the meeting was complete.
Data collected since the previous afternoon, data generated overnight and data from devices that reconnected had all reached the corporate storage.
The question now isn't simply whether the transfers finished.
The company compares each site's required data list with the files that actually arrived, to confirm everything the meeting needs is ready.
TUESDAY, 06:20
Required data from all 120 sites nationwide is ready.
Sites with data ready
120 / 120
Devices in scope
1,840 devices
Total data collected
24.8 TB
Collection results
Collection group
Sites
Devices
Status
Business records
64 / 64
320
Completed
Production records
32 / 32
960
Completed
Logistics records
16 / 16
400
Completed
Overnight records
8 / 8
160
Completed
REQUIRED DATA VERIFICATION
Required site data
120 / 120
Requested data types
4 / 4
Required data still outstanding
0
Data-ready deadline
07:00
Actually ready
06:20
Result of checking the company's required data list against the actual file collection records.
Until the data deadline
40 min
Until the meeting
2 h 40 min
Data from every site is ready.Now the real business work can begin.
Live contextNow
06:20Tomorrow
Until the meeting
2 h 40 min
Sites with data ready
120 / 120
Final data collected
24.8 TB
Current status
Required data collected
Next task
Compile and review the meeting materials
Tomorrow 07:00
The data is ready, and the meeting materials are being built.
At 7 AM, data from every site was already in use where the company prepares its meeting materials.
HQ's business systems began compiling operating results by site, comparing quality inspection results, and summarizing equipment status and field operations.
The job of collecting files was done.
From here on, the work is turning the collected data into the information the company needs to make decisions.
TUESDAY, 07:00
The collected data goes to work for the business.
COLLECTED BUSINESS DATA
Collection completed
24.8 TB
/national-review/operation/4.2 TB
/national-review/business/0.8 TB
/national-review/inspection/11.6 TB
/national-review/equipment/8.2 TB
ENTERPRISE REPORTING SYSTEM
Preparing the nationwide site operations report
Compile business results by site87%
Organize production and quality inspection results68%
Compile logistics operations status94%
Summarize equipment status and exceptions76%
Example tasks in the company's own external aggregation and reporting system
Transferring files isn't the end goal;it is how the company gets to the work that matters.
Live contextNow
07:00Tomorrow
Until the meeting
2 h
Sites with data ready
120 / 120
Final data collected
24.8 TB
Current task
Preparing the nationwide site operations report
THE NEXT MORNING, Tomorrow 08:30
The meeting materials are ready.
At 8:30 AM, staff at HQ were going over the meeting materials.
Data from every site requested the previous afternoon was all in.
No one had to chase down which sites hadn't delivered yet or ask field staff to resend files.
The time left before the meeting went into reviewing the content, not preparing it.
TUESDAY, 08:30
30 minutes before the meeting, materials from every site are ready.
BUSINESS REVIEW REPORT
Nationwide site operations
For the Tuesday 9 AM management meeting
Ready for review
Operating results by site
Includes operational data from 120 sites
Production and quality
Includes inspection results from 32 production sites
Nationwide site operationsPrepared
Production and quality inspection resultsPrepared
Logistics facility resultsPrepared
Equipment status and operational issuesPrepared
Fictional meeting materials generated in the company's external reporting system.
The people preparing the meetingare reviewing the data instead of hunting for it.
Live contextNow
08:30Tomorrow
Until the meeting
30 min
Sites in the materials
120 / 120
Data in use
24.8 TB
Current task
Final review of the meeting materials
Tomorrow 09:00
The meeting begins.
At 9 AM, the meeting to review operations at every site nationwide began.
Attendees compared operating results by site and reviewed quality trends at production sites and activity at logistics centers.
Data from the devices that lost their connection the night before was in the materials, too.
So were the records from sites that worked through the night.
No one in the meeting talked about which sites' data hadn't arrived yet.
They talked about where the company stands now, and what it should do next.
Live contextNow
09:00Tomorrow
Scheduled
Meeting starts
Sites in the materials
120 / 120
Data in use
24.8 TB
Current task
Reviewing nationwide site operationsDeciding the company's next steps
TUESDAY, 09:00
The meeting begins.
Sites with data ready
120 / 120
Data collected for the meeting
24.8 TB
All data ready at
06:20
THE LAST 17 HOURS
How data was readied across all sites
0306090120Collection set up76 sites109 sites120 sites
16:0018:0022:0002:1005:3009:00
Data cutoff
Sites with required data collected, over time
Data from across the country was ready when it was needed,and the company's work began on schedule.
FROM DATA COLLECTION TO BUSINESS DECISIONS
When data is neededis decided by the business.
Sites differ in location and hours, devices in type and connectivity,but the company still needs their data together.
MONDAY, 16:00
The business sets the agenda.
Tomorrow 09:00Nationwide site operations meetingData needed from 120 sites
The work the company needs, and when it needs the data, are decided.
OVERNIGHT
Data comes in from across the country.
Data that becomes ready at different times, in different environments, is collected continuously.
TUESDAY, 09:00
The business gets to work.
120 / 120Data ready from every siteReady for business review
With the data ready, the company starts assessing and deciding.
When the business is ready to start,its data must be ready, too.
THE TECHNOLOGY BEHIND THIS STORY
Fleet-Scale Collection
Collect the data your business needs from sites, industrial equipment, servers and field environments across the country.
Set different data and collection conditions for each site, and keep collecting continuously on a schedule or as new files are created.