Role: Principal Data Engineer specializing in Snowflake performance tuning
Objective: Generate Snowflake SQL queries that maximize partition pruning, minimize data scanning, and ensure deterministic results.
Role: Principal Data Engineer specializing in Snowflake performance tuning
Objective: Generate Snowflake SQL queries that maximize partition pruning, minimize data scanning, and ensure deterministic results.
| ### Keybase proof | |
| I hereby claim: | |
| * I am ronniejoshua on github. | |
| * I am ronniejoshua (https://keybase.io/ronniejoshua) on keybase. | |
| * I have a public key ASA5WWLiqt8-ayDMjpVHi3VzlvBG8Oo9XZq6lhQ5JEJGAQo | |
| To claim this, I am signing this object: |
| #!/usr/bin/env python3 | |
| # -*- coding: utf-8 -*- | |
| # Copyright 2021 Ronnie Joshua | |
| # Email: ron.juden@gmail.com | |
| # Linkedin: https://www.linkedin.com/in/ronnie-joshua/ | |
| # Vist: http://www.webanalyticsinfo.com/ | |
| # | |
| # Licensed under the Apache License, Version 2.0 (the "License"); | |
| # you may not use this file except in compliance with the License. |
| #!/usr/bin/env python3 | |
| # -*- coding: utf-8 -*- | |
| # Copyright 2021 Ronnie Joshua | |
| # Email: ron.juden@gmail.com | |
| # Linkedin: https://www.linkedin.com/in/ronnie-joshua/ | |
| # Vist: http://www.webanalyticsinfo.com/ | |
| # | |
| # Licensed under the Apache License, Version 2.0 (the "License"); | |
| # you may not use this file except in compliance with the License. |
| #!/usr/bin/env python3 | |
| # -*- coding: utf-8 -*- | |
| # Copyright 2021 Ronnie Joshua | |
| # | |
| # | |
| # Licensed under the Apache License, Version 2.0 (the "License"); | |
| # you may not use this file except in compliance with the License. | |
| # You may obtain a copy of the License at | |
| # |
| import requests | |
| import os | |
| def gcp_firewall_ip_whitelisting(): | |
| my_external_ip = requests.get("https://api.ipify.org").text | |
| print(f"My External IP Address: {my_external_ip}") | |
| known_ip_addresses = "" | |
| cmd_to_run = f"gcloud compute firewall-rules update nc-de-doc-sec --source-ranges {my_external_ip}, {known_ip_addresses}" | |
| os.system(cmd_to_run) |
| // https://codingcat.codes/2019/01/09/download-view-protected-pdf-google-drive-js-code/ | |
| // https://www.linkedin.com/in/ronnie-joshua/ | |
| // 1. Open the presentation | |
| // 2. Click three times on zoom to enlarge the presentation | |
| // 3. Scroll down slowly to the last page [Let the entire document load that's the idea] | |
| // 4. Then go to the developer console and run this script | |
| // 5. Check the results. if not okay then adjust width and length line of the code | |
| // Landscape PDF |
| #!/bin/bash | |
| GCLOUD="/Users/<your-username>/google-cloud-sdk/bin" | |
| ${GCLOUD}/gcloud compute firewall-rules update <gcp-firewall-rule-name> --project=<gcp-project-id> --source-ranges=$(curl ifconfig.me) | |
| external_ip=$(${GCLOUD}/gcloud compute instances describe <gcp-compute-engine> --zone=<gcp-ce-zone> --format='get(networkInterfaces[0].accessConfigs[0].natIP)') | |
| ssh naya@$external_ip -p 122 |
| import pandas as pd | |
| from data_extractor.nobel_api import nobel_api_laureates | |
| from data_extractor.jinfo_data import jewish_nobel_winners | |
| from data_extractor.utils import nobel_laureates_dataframe | |
| if __name__ == "__main__": | |
| # Extract data | |
| df_jew = pd.DataFrame(jewish_nobel_winners()) | |
| df_nobel = pd.DataFrame(nobel_api_laureates()) |
| from fuzzywuzzy import process | |
| import pandas as pd | |
| def fuzzy_merge(df_left, df_right, key_left, key_right, threshold=84, limit=1): | |
| """ | |
| df_1: the left table to join | |
| df_2: the right table to join | |
| key_left: the key column of the left table | |
| key_right: the key column of the right table |