Data logger

Data logger Cube storing technical and sensor data

A data logger (also datalogger or data recorder) is an electronic device that records data over time or in relation to location either with a built in instrument or sensor or via external instruments and sensors. Increasingly, but not entirely, they are based on a digital processor (or computer). They generally are small, battery powered, portable, and equipped with a microprocessor, internal memory for data storage, and sensors. Some data loggers interface with a personal computer, and use software to activate the data logger and view and analyze the collected data, while others have a local interface device (keypad, LCD) and can be used as a stand-alone device.

Data loggers vary between general purpose types for a range of measurement applications to very specific devices for measuring in one environment or application type only. It is common for general purpose types to be programmable; however, many remain as static machines with only a limited number or no changeable parameters. Electronic data loggers have replaced chart recorders in many applications.

One of the primary benefits of using data loggers is the ability to automatically collect data on a 24-hour basis. Upon activation, data loggers are typically deployed and left unattended to measure and record information for the duration of the monitoring period. This allows for a comprehensive, accurate picture of the environmental conditions being monitored, such as air temperature and relative humidity.

The cost of data loggers has been declining over the years as technology improves and costs are reduced. Simple single channel data loggers cost as little as $25. More complicated loggers may costs hundreds or thousands of dollars.

Small data logger with integrated sensors measuring temperature, pressure, humidity, light and 3-axis acceleration

Data formats

Standardisation of protocols and data formats has been a problem but is now growing in the industry and XML, JSON, and YAML are increasingly being adopted for data exchange. The development of the Semantic Web and the Internet of Things is likely to accelerate this present trend.

Instrumentation protocols

Several protocols have been standardised including a smart protocol, SDI-12, that allows some instrumentation to be connected to a variety of data loggers. The use of this standard has not gained much acceptance outside the environmental industry. SDI-12 also supports multi drop instruments. Some datalogging companies are also now supporting the MODBUS standard. This has been used traditionally in the industrial control area, and there are many industrial instruments which support this communication standard. Another multi drop protocol which is now starting to become more widely used is based upon Canbus (ISO 11898). Some data loggers use a flexible scripting environment to adapt themselves to various non-standard protocols.

Data logging versus data acquisition

The terms data logging and data acquisition are often used interchangeably. However, in a historical context they are quite different. A data logger is a data acquisition system, but a data acquisition system is not necessarily a data logger.

• Data loggers typically have slower sample rates. A maximum sample rate of 1 Hz may be considered to be very fast for a data logger, yet very slow for a typical data acquisition system.
• Data loggers are implicitly stand-alone devices, while typical data acquisition system must remain tethered to a computer to acquire data. This stand-alone aspect of data loggers implies on-board memory that is used to store acquired data. Sometimes this memory is very large to accommodate many days, or even months, of unattended recording. This memory may be battery-backed static random access memory, flash memory or EEPROM. Earlier data loggers used magnetic tape, punched paper tape, or directly viewable records such as "strip chart recorders".
• Given the extended recording times of data loggers, they typically feature a mechanism to record the date and time in a timestamp to ensure that each recorded data value is associated with a date and time of acquisition in order to produce a sequence of events. As such, data loggers typically employ built-in real-time clocks whose published drift can be an important consideration when choosing between data loggers.
• Data loggers range from simple single-channel input to complex multi-channel instruments. Typically, the simpler the device the less programming flexibility. Some more sophisticated instruments allow for cross-channel computations and alarms based on predetermined conditions. The newest of data loggers can serve web pages, allowing numerous people to monitor a system remotely.
• The unattended and remote nature of many data logger applications implies the need in some applications to operate from a DC power source, such as a battery. Solar power may be used to supplement these power sources. These constraints have generally led to ensure that the devices they market are extremely power efficient relative to computers. In many cases they are required to operate in harsh environmental conditions where computers will not function reliably.
• 

  Portable Dataloggers may reach up to 20 channels with maximum 10ms (100Hz) sampling rate.
  This unattended nature also dictates that data loggers must be extremely reliable. Since they may operate for long periods nonstop with little or no human supervision, and may be installed in harsh or remote locations, it is imperative that so long as they have power, they will not fail to log data for any reason. Manufacturers go to great length to ensure that the devices can be depended on in these applications. As such dataloggers are almost completely immune to the problems that might affect a general-purpose computer in the same application, such as program crashes and the instability of some operating systems.

Applications

Data logger application for weather station at P2I LIPI

Applications of data logging include:

• Unattended weather station recording (such as wind speed / direction, temperature, relative humidity, solar radiation).
• Unattended hydrographic recording (such as water level, water depth, water flow, water pH, water conductivity).
• Unattended soil moisture level recording.
• Unattended gas pressure recording.
• Offshore buoys for recording a variety of environmental conditions.
• Road traffic counting.
• Measure temperatures (humidity, etc.) of perishables during shipments: Cold chain.^[1]
• Measure variations in light intensity.
• Process monitoring for maintenance and troubleshooting applications.
• Process monitoring to verify warranty conditions
• Wildlife research with pop-up archival tags
• Measure vibration and handling shock (drop height) environment of distribution packaging.^[2]
• Tank level monitoring.
• Deformation monitoring of any object with geodetic or geotechnical sensors controlled by an automatic deformation monitoring system.
• Environmental monitoring.
• Vehicle Testing (including crash testing)
• Motor Racing
• Monitoring of relay status in railway signalling.
• For science education enabling 'measurement', 'scientific investigation' and an appreciation of 'change'
• Record trend data at regular intervals in veterinary vital signs monitoring.
• Load profile recording for energy consumption management.
• Temperature, humidity and power use for heating and air conditioning efficiency studies.
• Water level monitoring for groundwater studies.
• Digital electronic bus sniffer for debug and validation

Examples

• Black-box (stimulus/response) loggers:
  • A flight data recorder (FDR), a piece of recording equipment used to collect specific aircraft performance data. The term may also be used, albeit less accurately, to describe the cockpit voice recorder (CVR), another type of data recording device found on board aircraft.
  • An event data recorder (EDR), a device installed by the manufacturer in some automobiles which collects and stores various data during the time-frame immediately before and after a crash.
  • A voyage data recorder (VDR), a data recording system designed to collect data from various sensors on board a ship.
  • A train event recorder, a device that records data about the operation of train controls and performance in response to those controls and other train control systems.
  • In automobiles, all diagnostic trouble codes (DTCs) are logged in engine control units (ECUs) so that at the time of service of a vehicle, a service engineer will read all the DTCs using Tech-2 or similar tools connected to the on-board diagnostics port, and will come to know problems occurred in the vehicle. Sometimes a small OBD data logger is plugged into the same port to continuously record vehicle data.
  • In embedded system and digital electronics design, specialized high-speed digital data logger help overcome the limitations of more traditional instruments such as the oscilloscope and the logic analyzer. The main advantage of a data logger is its ability to record very long traces, which proves very useful when trying to correct functional bugs that happen once in while.
  • In the racing industry, Data Loggers are used to record data such as braking points, lap/sector timing, and track maps, as well as any on-board vehicle sensors.
• Health data loggers:
  • The growing, preparation, storage and transportation of food. Data logger is generally used for data storage and these are small in size.
  • A Holter monitor is a portable device for continuously monitoring various electrical activity of the cardiovascular system for at least 24 hours.
  • An oDrive physical activity monitor^[3]
  • Electronic health record loggers.
• Other general data acquisition loggers:
  • An (scientific) experimental testing data acquisition tool.
  • Ultra Wideband Data Recorder, high-speed data recording up to 2 GigaSamples per second.
  • An open source data logger based on the Raspberry Pi computer ^[4]

Future directions

Data Loggers are changing more rapidly now than ever before. The original model of a stand alone data logger is changing to one of a device that collects data but also has access to wireless communications for alarming of events, automatic reporting of data and remote control. Data loggers are beginning to serve web pages for current readings, e-mail their alarms and FTP their daily results into databases or direct to the users. Very recently, there is a trend to move away from proprietary products with commercial software to open source software and hardware devices. The Raspberry Pi single-board computer is among others a popular platform hosting real-time Linux or preemptive-kernel Linux operating systems with many

• digital interfaces like I2C, SPI or UART enabling the direct interconnection of a digital sensor and a computer,
• and unlimited number of configurations to show measurements in real-time over the internet, process data, plot charts and diagrams...

There are more and more community-developed (open source) projects for data acquisition / data logging.^[5][6][7]

See also

• Black box
• Bus analyzer
• Computer data logging: logging APIs, server logs & syslog, web logging & web counters
• Continuous emissions monitoring system
• Runtime intelligence
• Sequence of events recorder
• SensorML
• Shock and vibration data logger
• Temperature data logger

References

1. Riva, Marco; Piergiovanni, Schiraldi, Luciano; Schiraldi, Alberto (January 2001). "Performances of time-temperature indicators in the study of temperature exposure of packaged fresh foods". Packaging Technology and Science 14 (1): 1–39. doi:10.1002/pts.521.
2. Singh, J; Singh, Burgess (2007). "Measurement, Analysis, and Comparison of the Parcel Shipping Shock and Drop Environment of the United States Postal Service with Commercial Carriers". JOTE 35 (3). doi:10.1520/JTE100787.
3. https://odrive.info
4. http://opendatalogger.com
5. http://real.mtak.hu/25714/1/28.pdf
6. http://opendatalogger.com
7. http://github.com/deguss/rpilogger