Skip to content

Instantly share code, notes, and snippets.

@Tjoosten

Tjoosten/Describe

Last active August 21, 2017 18:07
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Tjoosten/a03557cb083449998e5d06fd2b17a8fa to your computer and use it in GitHub Desktop.
Save Tjoosten/a03557cb083449998e5d06fd2b17a8fa to your computer and use it in GitHub Desktop.
Download ZIP
PROBLEEM: Zoals beschreven in de describe file. plus ook data word in de verkeerde kolommen gezet.
Raw
Describe
| service_number | varchar(255) | YES | | NULL | |
| c | varchar(255) | YES | | NULL | |
| ptp | varchar(255) | YES | | NULL | |
| person_type_name | varchar(255) | YES | | NULL | |
| member_name | varchar(255) | YES | | NULL | |
| s | varchar(255) | YES | | NULL | |
| service_name | varchar(255) | YES | | NULL | |
| rank_rate | varchar(255) | YES | | NULL | |
| pg | varchar(255) | YES | | NULL | |
| occ | varchar(255) | YES | | NULL | |
| occupation_name | varchar(255) | YES | | NULL | |
| birth_date | varchar(255) | YES | | NULL | |
| gender | varchar(255) | YES | | NULL | |
| hor_city | varchar(255) | YES | | NULL | |
| hor_county | varchar(255) | YES | | NULL | |
| hor_ctry | varchar(255) | YES | | NULL | |
| hor_ST | varchar(255) | YES | | NULL | |
| state_prv_nm | varchar(255) | YES | | NULL | |
| marital_status | varchar(255) | YES | | NULL | |
| religion_name | varchar(255) | YES | | NULL | |
| L | varchar(255) | YES | | NULL | |
| race_name | varchar(255) | YES | | NULL | |
| ethnic_name | varchar(255) | YES | | NULL | |
| race_omb | varchar(255) | YES | | NULL | |
| ethnic_group_name | varchar(255) | YES | | NULL | |
| cas_circumstances | varchar(255) | YES | | NULL | |
| cas_city | varchar(255) | YES | | NULL | |
| cas_st | varchar(255) | YES | | NULL | |
| cas_ctry | varchar(255) | YES | | NULL | |
| cas_region_name | varchar(255) | YES | | NULL | |
| country_or_water_name | varchar(255) | YES | | NULL | |
| unit_name | varchar(255) | YES | | NULL | |
| d | varchar(255) | YES | | NULL | |
| process_dt | varchar(255) | YES | | NULL | |
| death_dt | varchar(255) | YES | | NULL | |
| year | varchar(255) | YES | | NULL | |
| wc | varchar(255) | YES | | NULL | |
| oitp | varchar(255) | YES | | NULL | |
| oi_name | varchar(255) | YES | | NULL | |
| oi_location | varchar(255) | YES | | NULL | |
| close_dt | varchar(255) | YES | | NULL | |
| aircraft | varchar(255) | YES | | NULL | |
| h | varchar(255) | YES | | NULL | |
| casualty_type_name | varchar(255) | YES | | NULL | |
| casualty_category | varchar(255) | YES | | NULL | |
| casualty_reason_name | varchar(255) | YES | | NULL | |
| csn | varchar(255) | YES | | NULL | |
| body | varchar(255) | YES | | NULL | |
| casualty_closure_name | varchar(255) | YES | | NULL | |
| wall | varchar(255) | YES | | NULL | |
| ops_inc_url | varchar(255) | YES | | NULL | |
| Incident_category | varchar(255) | YES | | NULL | |
| i_status_dt | varchar(255) | YES | | NULL | |
| i_csn | varchar(255) | YES | | NULL | |
| i_h | varchar(255) | YES | | NULL | |
| i_aircraft | varchar(255) | YES | | NULL | |
Raw
meh.sql
mysql> show warnings;
+---------+------+--------------------------------------------+
| Level | Code | Message |
+---------+------+--------------------------------------------+
| Warning | 1261 | Row 1 doesn't contain data for all columns |
| Warning | 1261 | Row 1 doesn't contain data for all columns |
| Warning | 1261 | Row 1 doesn't contain data for all columns |
| Warning | 1261 | Row 1 doesn't contain data for all columns |
| Warning | 1261 | Row 1 doesn't contain data for all columns |
| Warning | 1261 | Row 1 doesn't contain data for all columns |
| Warning | 1261 | Row 1 doesn't contain data for all columns |
| Warning | 1261 | Row 1 doesn't contain data for all columns |
| Warning | 1261 | Row 1 doesn't contain data for all columns |
| Warning | 1261 | Row 1 doesn't contain data for all columns |
| Warning | 1261 | Row 2 doesn't contain data for all columns |
| Warning | 1261 | Row 2 doesn't contain data for all columns |
| Warning | 1261 | Row 2 doesn't contain data for all columns |
| Warning | 1261 | Row 2 doesn't contain data for all columns |
| Warning | 1261 | Row 2 doesn't contain data for all columns |
| Warning | 1261 | Row 2 doesn't contain data for all columns |
| Warning | 1261 | Row 2 doesn't contain data for all columns |
| Warning | 1261 | Row 2 doesn't contain data for all columns |
| Warning | 1261 | Row 2 doesn't contain data for all columns |
| Warning | 1261 | Row 2 doesn't contain data for all columns |
| Warning | 1261 | Row 3 doesn't contain data for all columns |
| Warning | 1261 | Row 3 doesn't contain data for all columns |
| Warning | 1261 | Row 3 doesn't contain data for all columns |
| Warning | 1261 | Row 3 doesn't contain data for all columns |
| Warning | 1261 | Row 3 doesn't contain data for all columns |
| Warning | 1261 | Row 3 doesn't contain data for all columns |
| Warning | 1261 | Row 3 doesn't contain data for all columns |
| Warning | 1261 | Row 3 doesn't contain data for all columns |
| Warning | 1261 | Row 3 doesn't contain data for all columns |
| Warning | 1261 | Row 3 doesn't contain data for all columns |
| Warning | 1261 | Row 4 doesn't contain data for all columns |
| Warning | 1261 | Row 4 doesn't contain data for all columns |
| Warning | 1261 | Row 4 doesn't contain data for all columns |
| Warning | 1261 | Row 4 doesn't contain data for all columns |
| Warning | 1261 | Row 4 doesn't contain data for all columns |
| Warning | 1261 | Row 4 doesn't contain data for all columns |
| Warning | 1261 | Row 4 doesn't contain data for all columns |
| Warning | 1261 | Row 4 doesn't contain data for all columns |
| Warning | 1261 | Row 4 doesn't contain data for all columns |
| Warning | 1261 | Row 4 doesn't contain data for all columns |
| Warning | 1261 | Row 5 doesn't contain data for all columns |
| Warning | 1261 | Row 5 doesn't contain data for all columns |
| Warning | 1261 | Row 5 doesn't contain data for all columns |
| Warning | 1261 | Row 5 doesn't contain data for all columns |
| Warning | 1261 | Row 5 doesn't contain data for all columns |
| Warning | 1261 | Row 5 doesn't contain data for all columns |
| Warning | 1261 | Row 5 doesn't contain data for all columns |
| Warning | 1261 | Row 5 doesn't contain data for all columns |
| Warning | 1261 | Row 5 doesn't contain data for all columns |
| Warning | 1261 | Row 5 doesn't contain data for all columns |
| Warning | 1261 | Row 6 doesn't contain data for all columns |
| Warning | 1261 | Row 6 doesn't contain data for all columns |
| Warning | 1261 | Row 6 doesn't contain data for all columns |
| Warning | 1261 | Row 6 doesn't contain data for all columns |
| Warning | 1261 | Row 6 doesn't contain data for all columns |
| Warning | 1261 | Row 6 doesn't contain data for all columns |
| Warning | 1261 | Row 6 doesn't contain data for all columns |
| Warning | 1261 | Row 6 doesn't contain data for all columns |
| Warning | 1261 | Row 6 doesn't contain data for all columns |
| Warning | 1261 | Row 6 doesn't contain data for all columns |
| Warning | 1261 | Row 7 doesn't contain data for all columns |
| Warning | 1261 | Row 7 doesn't contain data for all columns |
| Warning | 1261 | Row 7 doesn't contain data for all columns |
| Warning | 1261 | Row 7 doesn't contain data for all columns |
+---------+------+--------------------------------------------+
64 rows in set (0.00 sec)
Raw
Probleem
Zoals beschreven in de describe file. plus ook data word in de verkeerde kolommen gezet.
Raw
schema.sql
CREATE DATABASE IF NOT EXISTS WAR_dataset;
USE WAR_dataset;
drop table if EXISTS dcas_2006_casualties;
CREATE TABLE IF NOT EXISTS dcas_2006_casualties (
service_number TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Service number',
c TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Member component code.',
ptp TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Person type name code',
person_type_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Person type name',
member_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Member name',
s TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Member service code',
service_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Member service name',
rank_rate TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Member rank of rate',
pg TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Member paygrade',
occ TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Memeber occupation code',
occupation_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Member occupation name',
birth_date TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Member birthdate',
gender TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Member gender',
hor_city TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Home of record city',
hor_county TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Home of record county',
hor_ctry TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Home of record country code.',
hor_ST TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Home of record state code',
state_prv_nm TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'State or province name',
marital_status TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Marital name',
religion_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Religion short name',
L TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'religion code',
race_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'race name',
ethnic_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Ethnic short name',
race_omb TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Race omb name',
ethnic_group_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Ethnic group name',
cas_circumstances TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Casualty circumstances',
cas_city TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Casualty city',
cas_st TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Casualty state or province code.',
cas_ctry TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Casualty county/over water code',
cas_region_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Casualty region name',
country_or_water_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Country/Over water code',
unit_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Member unit',
d TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'duty_code',
process_dt TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Process date',
death_dt TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Incident or death date',
year TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'year of death',
wc TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'War or Conflict code',
oitp TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Operation incident type code',
oi_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Operation/Incident name',
oi_location TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Location name',
close_dt TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Closure date',
aircraft TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Aircraft type',
h TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Hostile or non-hostile indicator',
casualty_type_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Casuality type name',
casualty_category TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Casuality category name',
casualty_reason_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Incident casuality reason name',
csn TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Casualty Cat. Short name',
body TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Remains recovered',
casualty_closure_name TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Casualty closure name',
wall TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Vietnam wall row and panel indicator',
ops_inc_url TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT '',
Incident_category TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Casualty category name',
i_status_dt TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Incident casualty category date',
i_csn TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'incident casualty cat. short name',
i_h TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Incident hostile or Incident non-hostile death',
i_aircraft TEXT COLLATE utf8mb4_unicode_ci DEFAULT NULL COMMENT 'Incident aircraft type'
) ENGINE = InnoDB DEFAULT CHARSET = utf8mb4 COLLATE = utf8mb4_unicode_ci;
--
-- Import the dataset to the MySQL Database table.
--
LOAD DATA LOCAL INFILE 'sources/PUF.DCAS2006.DAT' INTO TABLE dcas_2006_casualties FIELDS TERMINATED BY '|';
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment