Commits · f0f8731068bf2956bccb49f42e5d7459a2b0f954 · C3SL / transparencia

Apr 13, 2017
- Issue #45: Fix insert scripts for travel allowances and workers · df274240
  Cristian Weiland authored 7 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  df274240
Apr 12, 2017

Issue #41: Improve script to insert data · a530d8dd
Cristian Weiland authored 7 years ago
```
Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
```
a530d8dd

Issue #43: Rename indexes, use associative array in config files and improve grep · f3fc354d


- Rename indexes to group by year and month instead of university and add prefix
  to indicate data source (MEC or MS);
- Config files (config.sh) now use associative arrays instead of 2 arrays filter
  and university, which needed to be correlated, having the same length and using
  the same number index to relate data;
- Add flag -w in grep, which filters by matching a whole word instead of
  substring. For example: "PARA" does not match with "PARANA" anymore (which stops
  scripts from getting duplicated data for "UNIVERSIDADE FEDERAL DO PARANA");

Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>

f3fc354d

Issue #40: Rename indexes to group by year and month instead of university,... · 52c11c9f

Cristian Weiland authored 7 years ago

Issue #40: Rename indexes to group by year and month instead of university, add prefix (MEC or MS) and add scripts to insert data from ministry of health.

Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>

52c11c9f

Apr 11, 2017
- Rename indexes to group by year and month instead of university · 9707bd51
  Cristian Weiland authored 7 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  9707bd51
Apr 05, 2017
- Issue #38: Fix ministry name · 7bda7a2f
  Cristian Weiland authored 7 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  7bda7a2f
- Issue #38: Include scripts to insert data from health ministry · a19cac0a
  Cristian Weiland authored 7 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  a19cac0a
Mar 21, 2017
- Issue #32: Fix logstash config example typo that prevented logstash from inserting workers data · e4a1ee57
  Cristian Weiland authored 8 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  e4a1ee57
Mar 20, 2017
- Issue #25: Script also checks if variables in config file are set. · 40dcae90
  Cristian Weiland authored 8 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  40dcae90
- Issue #25: Improve documentation from scripts · 91c103f9
  Cristian Weiland authored 8 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  91c103f9
Mar 17, 2017
- Issue #25: Fix more bugs and allow to insert multiple universities · 0f634a06
  Cristian Weiland authored 8 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  0f634a06
Mar 16, 2017

Issue #25: Fix another scripts small bugs · c43721c2
Cristian Weiland authored 8 years ago
```
Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
```
c43721c2

Issue #25: Fix bug getting last day of month in script and add config file · 5f970c9e

Cristian Weiland authored 8 years ago


The config file has the following variables:
- Host: Host running ElasticSearch. Must not contain "http://".
- Index: The name of the index in which data will be inserted.
- Filter: The filter to get only part of Portal Transparencia's data.
Scripts were getting always the last day of the current month instead of the last day of the parameter's month.

Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>

5f970c9e

Mar 14, 2017
- Issue #20: Create master script to insert data and remove day parameter from insert_expenses.sh · 1d347d73
  Cristian Weiland authored 8 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  1d347d73
- Issue #19: Add scripts to insert travel allowance data · 5d2b38e9
  Cristian Weiland authored 8 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  5d2b38e9
Feb 16, 2017
- Issue #14: Improve scripts to download files and manage directories · e15b0620
  Cristian Weiland authored 8 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  e15b0620
Feb 14, 2017
- Improve directory tree, fix README and scripts and improve documentation · 25502f9c
  Cristian Weiland authored 8 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  25502f9c
Feb 10, 2017
- Add scripts to rename index and improve create config script. · e265745f
  Cristian Weiland authored 8 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  e265745f
Feb 07, 2017
- Add script to insert expenses · f8e05a81
  Cristian Weiland authored 8 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  f8e05a81
- Add scripts to help inserting data and fix bug inserting null values · d358ba26
  Cristian Weiland authored 8 years ago
  
  Signed-off-by: Cristian Weiland <cw14@inf.ufpr.br>
  d358ba26