Difference between revisions of "DATA COLUMNS"

From Anitra Support
Jump to: navigation, search
 
(3 intermediate revisions by the same user not shown)
Line 2: Line 2:
  
 
The data model covered by Anitra is rather wide.  
 
The data model covered by Anitra is rather wide.  
It primarilly covers all the data colected by Anitra tags. As Anitra can also host imported data from other sources (including Movenbank data), there are many more columns for this purpose in the data model.  
+
It primarilly covers all the data colected by Anitra tags but as Anitra can also host imported data from other sources (including Movenbank data), there are many more columns for this purpose in the data model.  
  
Following table list the most important metrics with explanations and comments. The focus is on data generated by Anitra tags.
+
Wherever posible columns of general meaning are used to accomodate sematicaly similar data.
 +
 
 +
Still, note particular datasets carry only some of the metrics depending on their origin brand/tag (some columns areused by all the tags aut some are used only by some tags).
 +
 
 +
Following table list the most important metrics with explanations and comments.
  
 
{| class="wikitable"
 
{| class="wikitable"
! column name !! datatype !! description !! mandatory !! sample value
+
! column name !! datatype !! mandatory !! sample value !! description !! note
 
+
|-
 +
| '''device_code''' || text || yes|| 22155 || original tag code or serial number to identify data ||
 +
|-
 +
| '''timestamp''' || datetime || yes|| 2001-01-01 00:00:07.000 || UTC time stamp of data (e.g. GPS fix timestamp yyyy-mm-dd hh:mm:ss) ||
 +
|-
 +
| measurement_start || datetime || (yes) || 2001-01-01 00:00:01.000 ||  || used as a fallback for some imported datasets. <br>E.g. When original data distinguish between measurement start timestamp and GPS fix timestamp the GPS timestamp for records without fix can be empty (e.g. eOBS data structure). <br>measurement_start is transformed into timestamp column while importing data
 +
|-
 +
| '''latitude''' || decimal ||  || -11.123456 || decimal degrees, WGS84 reference system || imported values are rounded to 6 decimal points
 +
|-
 +
| '''longitude''' || decimal ||  || 5.123456789 || decimal degrees, WGS84 reference system || imported values are rounded to 6 decimal points
 +
|-
 +
| device_type || text || optional || dt_basic || identifies record type and origin of the data || to be used while importing data<br>'''dt_basic''' is used automatically when value not provided by user<br>other available values to be used to merge imported data with already existing  devices in Anitra:<br>'''dt_ecotone''' to append data to devices linked to Ecotone data integration<br>'''dt_ornitela''' to append data to devices linked to Ornitela data integration<br>'''dt_movebank_import''' to append data to devices plugged to Movebank data flow
 +
|-
 +
| acc_raw_x ||  ||  ||  || acceleration axis X raw ||
 +
|-
 +
| acc_raw_y ||  ||  ||  || acceleration axis Y raw ||
 +
|-
 +
| acc_raw_z ||  ||  ||  || acceleration axis Z raw ||
 +
|-
 +
| acceleration_x_ms2 ||  ||  ||  || acceleration axis X [ms2] ||
 +
|-
 +
| acceleration_y_ms2 ||  ||  ||  || acceleration axis Y [ms2] ||
 +
|-
 +
| acceleration_z_ms2 ||  ||  ||  || acceleration axis Z [ms2] ||
 +
|-
 +
| activity_count ||  ||  ||  || Activity || Ecotone data only
 +
|-
 +
| angular_velocity_x ||  ||  ||  || raw gyroscope data X (angular velocity) ||
 +
|-
 +
| angular_velocity_y ||  ||  ||  || raw gyroscope data X (angular velocity) ||
 +
|-
 +
| angular_velocity_z ||  ||  ||  || raw gyroscope data X (angular velocity) ||
 +
|-
 +
| baro_altitude_m ||  ||  ||  || Altitude [m] (barometer) || data transformed from Atm.pressure
 +
|-
 +
| baro_pressure_hpa' ||  ||  ||  || Atm. Pressure [hPa] (barometer) || uncalibrated
 +
|-
 +
| battery_percent ||  ||  ||  || battery level || transformed from battery voltage
 +
|-
 +
| battery_voltage_loaded_mv' ||  ||  ||  || Loaded Battery voltage [mV]<br>A detailed battery voltage while under workload || available for Anitra and oObs tags
 +
|-
 +
| battery_voltage_mv ||  ||  ||  || Battery voltage [mV] || masks temporary drops in battery due to batery load
 +
|-
 +
| cpu_temperature_c ||  ||  ||  || CPU Temperature || only for some tags (from Movebank)
 +
|-
 +
| gnss_altitude_elipsoid ||  ||  ||  || Altitude [m] (provided by GNSS module) || above elipsoid
 +
|-
 +
| gnss_altitude_msl ||  ||  ||  || Altitude msl [m] (provided by GNSS module) || above the mean see level
 +
|-
 +
| gnss_direction_deg' ||  ||  ||  || Direction [deg] (provided by GNSS module) || get stabilised while in the movememnt
 +
|-
 +
| gnss_fix_number ||  ||  ||  || number of GPS fixes taken to stabilise position || Anitra functionality, this behavior can be activated in configuration
 +
|-
 +
| gnss_fix_type ||  ||  ||  || Fix Quality (0=not fixed, 2=2D, 3=3D) || numeric values 0, 2, 3
 +
|-
 +
| gnss_gdop ||  ||  ||  || GDOP || provided for some Movebank records, alternatively calculation GDOP = mag(PDOP+TDOP)
 +
|-
 +
| gnss_hdop ||  ||  ||  || HDOP ||
 +
|-
 +
| gnss_pdop ||  ||  ||  || PDOP ||
 +
|-
 +
| gnss_satellite_count ||  ||  ||  || No of tracked satelites (NSAT)||
 +
|-
 +
| gnss_speed_kmh ||  ||  ||  || Ground Speed [km/h] (provided by GNSS module) || original value or transformed from other speed units (m/s or knots/s)
 +
|-
 +
| gnss_speed_ms ||  ||  ||  || Ground Speed [m/s] (provided by GNSS module) || original value or transformed from other speed units (km/h or knots/s)
 +
|-
 +
| gnss_time_to_fix ||  ||  ||  || Time to succesful 3D fix [sec] ||
 +
|-
 +
| gnss_time_to_fix_total ||  ||  ||  || total time of GNSS module activity || Anitra functionality, relevant when GPS drift suppressing functionality activated, also shows time spent by unsuccesful fixing attemtps.
 +
|-
 +
| gnss_vdop ||  ||  ||  || VDOP||
 +
|-
 +
| charging_current_ma ||  ||  ||  ||  || Ornitela data only
 +
|-
 +
| import_marked_outlier ||  ||  ||  || marks data labelled as outliers imported to Movebnak || for data from Movebank only
 +
|-
 +
| light ||  ||  ||  || Light [lx] || only available for some data from Movebank
 +
|-
 +
| mag_raw_x ||  ||  ||  || raw magnetometer data X || uncalibrated data
 +
|-
 +
| mag_raw_y ||  ||  ||  || raw magnetometer data X || uncalibrated data
 +
|-
 +
| mag_raw_z ||  ||  ||  || raw magnetometer data X || uncalibrated data
 +
|-
 +
| manually_marked_outlier ||  ||  ||  || a record manualy marked as outlier / wrong GPS || for data from Movebank, transformed to ANitra "wrong GPS" flag
 +
|-
 +
| measurement_duration ||  ||  ||  || time needed to create particular record || in most case same as TTF (time to fix),
 +
|-
 +
| mortality_onboard ||  ||  ||  || marks records taken while in mortality status || Flag produces by the anique Anitra onboard mortality detection functionality
 +
|-
 +
| mw_activity_count ||  ||  ||  || Activity indicator || only for some tags from Movebank
 +
|-
 +
| note ||  ||  ||  || Record note/comment || can be added manualy by a user or automaticaly
 +
|-
 +
| pitch ||  ||  ||  || Pitch [deg] || from calibrated accelerometer data
 +
|-
 +
| roll ||  ||  ||  || Roll [deg]|| from calibrated accelerometer data
 +
|-
 +
| solar_cell_percent ||  ||  ||  || Solar panel usage percentage || this metric reflects sunshine availability, values over 80% are good to activate battery solar charging efficiently.
 +
|-
 +
| temperature_c ||  ||  ||  || Temperature [°C] ||
 
|-
 
|-
| Example || Example || Example || Example || Example
+
| transmission_timestamp || || || || Data received timestamp (latest update) || Available only for some tags such as Anitra
 
|-
 
|-
| Example || Example || Example || Example || Example
+
| wrong_gps || || || || records with missing or wrong Latitude/Longitude information || flagged (1/true) when GPS position is wrong (automatic filtering or user maked outliers)
 
|-
 
|-
| Example || Example || Example || Example || Example
+
| wrong_time || || || || records with wrong time information (e.g. invalid date format or date in future) || flagged (1/true) when record time is wrong (automatic or user), damaged records = to be excluded from any analyses
 
|}
 
|}

Latest revision as of 12:14, 1 March 2024


The data model covered by Anitra is rather wide. It primarilly covers all the data colected by Anitra tags but as Anitra can also host imported data from other sources (including Movenbank data), there are many more columns for this purpose in the data model.

Wherever posible columns of general meaning are used to accomodate sematicaly similar data.

Still, note particular datasets carry only some of the metrics depending on their origin brand/tag (some columns areused by all the tags aut some are used only by some tags).

Following table list the most important metrics with explanations and comments.

column name datatype mandatory sample value description note
device_code text yes 22155 original tag code or serial number to identify data
timestamp datetime yes 2001-01-01 00:00:07.000 UTC time stamp of data (e.g. GPS fix timestamp yyyy-mm-dd hh:mm:ss)
measurement_start datetime (yes) 2001-01-01 00:00:01.000 used as a fallback for some imported datasets.
E.g. When original data distinguish between measurement start timestamp and GPS fix timestamp the GPS timestamp for records without fix can be empty (e.g. eOBS data structure).
measurement_start is transformed into timestamp column while importing data
latitude decimal -11.123456 decimal degrees, WGS84 reference system imported values are rounded to 6 decimal points
longitude decimal 5.123456789 decimal degrees, WGS84 reference system imported values are rounded to 6 decimal points
device_type text optional dt_basic identifies record type and origin of the data to be used while importing data
dt_basic is used automatically when value not provided by user
other available values to be used to merge imported data with already existing devices in Anitra:
dt_ecotone to append data to devices linked to Ecotone data integration
dt_ornitela to append data to devices linked to Ornitela data integration
dt_movebank_import to append data to devices plugged to Movebank data flow
acc_raw_x acceleration axis X raw
acc_raw_y acceleration axis Y raw
acc_raw_z acceleration axis Z raw
acceleration_x_ms2 acceleration axis X [ms2]
acceleration_y_ms2 acceleration axis Y [ms2]
acceleration_z_ms2 acceleration axis Z [ms2]
activity_count Activity Ecotone data only
angular_velocity_x raw gyroscope data X (angular velocity)
angular_velocity_y raw gyroscope data X (angular velocity)
angular_velocity_z raw gyroscope data X (angular velocity)
baro_altitude_m Altitude [m] (barometer) data transformed from Atm.pressure
baro_pressure_hpa' Atm. Pressure [hPa] (barometer) uncalibrated
battery_percent battery level transformed from battery voltage
battery_voltage_loaded_mv' Loaded Battery voltage [mV]
A detailed battery voltage while under workload
available for Anitra and oObs tags
battery_voltage_mv Battery voltage [mV] masks temporary drops in battery due to batery load
cpu_temperature_c CPU Temperature only for some tags (from Movebank)
gnss_altitude_elipsoid Altitude [m] (provided by GNSS module) above elipsoid
gnss_altitude_msl Altitude msl [m] (provided by GNSS module) above the mean see level
gnss_direction_deg' Direction [deg] (provided by GNSS module) get stabilised while in the movememnt
gnss_fix_number number of GPS fixes taken to stabilise position Anitra functionality, this behavior can be activated in configuration
gnss_fix_type Fix Quality (0=not fixed, 2=2D, 3=3D) numeric values 0, 2, 3
gnss_gdop GDOP provided for some Movebank records, alternatively calculation GDOP = mag(PDOP+TDOP)
gnss_hdop HDOP
gnss_pdop PDOP
gnss_satellite_count No of tracked satelites (NSAT)
gnss_speed_kmh Ground Speed [km/h] (provided by GNSS module) original value or transformed from other speed units (m/s or knots/s)
gnss_speed_ms Ground Speed [m/s] (provided by GNSS module) original value or transformed from other speed units (km/h or knots/s)
gnss_time_to_fix Time to succesful 3D fix [sec]
gnss_time_to_fix_total total time of GNSS module activity Anitra functionality, relevant when GPS drift suppressing functionality activated, also shows time spent by unsuccesful fixing attemtps.
gnss_vdop VDOP
charging_current_ma Ornitela data only
import_marked_outlier marks data labelled as outliers imported to Movebnak for data from Movebank only
light Light [lx] only available for some data from Movebank
mag_raw_x raw magnetometer data X uncalibrated data
mag_raw_y raw magnetometer data X uncalibrated data
mag_raw_z raw magnetometer data X uncalibrated data
manually_marked_outlier a record manualy marked as outlier / wrong GPS for data from Movebank, transformed to ANitra "wrong GPS" flag
measurement_duration time needed to create particular record in most case same as TTF (time to fix),
mortality_onboard marks records taken while in mortality status Flag produces by the anique Anitra onboard mortality detection functionality
mw_activity_count Activity indicator only for some tags from Movebank
note Record note/comment can be added manualy by a user or automaticaly
pitch Pitch [deg] from calibrated accelerometer data
roll Roll [deg] from calibrated accelerometer data
solar_cell_percent Solar panel usage percentage this metric reflects sunshine availability, values over 80% are good to activate battery solar charging efficiently.
temperature_c Temperature [°C]
transmission_timestamp Data received timestamp (latest update) Available only for some tags such as Anitra
wrong_gps records with missing or wrong Latitude/Longitude information flagged (1/true) when GPS position is wrong (automatic filtering or user maked outliers)
wrong_time records with wrong time information (e.g. invalid date format or date in future) flagged (1/true) when record time is wrong (automatic or user), damaged records = to be excluded from any analyses