paul-d-ray

Merge and aggregate datasets

From Roseeta Code Merge and aggregate datasets Task

Merge and aggregate two datasets as provided in .csv files into a new resulting dataset.
Use the appropriate methods and data structures depending on the programming language.
Use the most common libraries only when built-in functionality is not sufficient.
- Note Either load the data from the .csv files or create the required data structures hard-coded.

VisiData example done in Nushell

This will use the faa-wildlife-strikes.csv file from the VisiData demo. Calculate each species’ state-level percentages

Nushell Code to Join two data sets

let data = open faa-wildlife-strikes.csv
  | where SPECIES !~ 'Unknown' and STATE != ''

let state = $data

Filter on a Date Column

to filer on a date field do the following steps

make sure the import datetime is in the .visidatarc file.
format the date column with @ to let visidata know it is a date column.
be in the column, and do a filter z|
key in the command

    DATE_FIELD_NAME > datetime.date(YYYY,M,D)
    INCIDENT_DATE > datetime.date(2016,1,1)

Visidata Config File

In Windows, the config file goes in the user home folder

Create the C:\Users\USERNAM\.visidatarc file
- note the dot in front of the file name
add the following to the file

# for VisiData
import datetime

options.color_key_col = "green"

Purpose

Use FD to find a file and pipe it to Nushell's ls command to list information on the file.

Nushell Code

fd -H -I -i  -E 'Windows' -E 'Python' -E 'Steel*' -E '*ffice*' -E '*ire*' -E '*VS Code*' -E 'WindowsPowerShell' --glob  '*posh*.exe' 'c:\'  | lines | each {|file|  nuls -f  ($file |path dirname) | where name =~ ($file | path basename )  } | flatten

Nushell Code Explained

fd -H -I -i -E 'Windows' -E 'Python' -E 'Steel*' -E '*ffice*' -E '*ire*' -E '*VS Code*' -E 'WindowsPowerShell' --glob '*posh*.exe' 'c:\'

Using Nushell to get Local Weather

I saw on Hacker News for another programming lanuage. I wanted to get the forecast for my area using Nushell.

I used Grok to get the code for my location.

Nushell Code

http get https://api.weather.gov/gridpoints/FFC/32,107/forecast | from json |
  get properties.periods |

Purpose

I had a need to get words (four characters) that have a suffix from a list.

This was to help someone in the second grade with the words.

I used the unixdict.txt to get the words.

Nushell Code

First Monday of Each Month

I had a need to get the first Monday of each month of 2025.

This can be changed to get any other first day by changing the wday variable.
- su, mo, tu, we, th, fr, sa

Nushell Code

let wday = 'mo'
let year = 2025

Last Friday of Each Month

I had a need to get the last Friday of each month of 2025.

This can be changed to get any other last day by changing the wday variable.
- su, mo, tu, we, th, fr, sa

Nushell Code

let wday = 'fr'
let year = 2025
cal -m -t --week-start $wday --full-year $year |

	# config.nu
	#
	# Installed by:
	# version = "0.102.0"
	#
	# This file is used to override default Nushell settings, define
	# (or import) custom commands, or run any other startup tasks.
	# See https://www.nushell.sh/book/configuration.html
	#
	# This file is loaded after env.nu and before login.nu