Compare commits

...

12 Commits

  1. 15
      R/20180215.Rstudio-on-HPC.md
  2. 23
      R/20220621.Rstudio-cheatsheets.md
  3. 16
      README.md
  4. 17
      ansible/20220505.Ansible-major-updates.md
  5. 20
      carpentries/20220719.Carpentries-offline.md
  6. 22
      graphics/20220612.Image-processing-lessons.md
  7. 19
      security/20220202.TrustedCI-Framework-notes.md
  8. 0
      tensorflow/20220222.TensorFlow-profiling.md
  9. 20
      tensorflow/20220601.GPU-troubleshooting.md
  10. 21
      vm/20220405.run-Windows-in-VM-Linux.md

@ -1,9 +1,9 @@
R-related stuff
===============
RStudio on HPC
==============
Rstudio
-------
Rstudio on Turing
-----------------
[20180215]
To use R Studio on Turing:
@ -16,3 +16,10 @@ I also upgraded R to 3.4.3, it is built with ICC 18 with MKL as its
multi-threaded math libraries.
Rstudio on Wahab
----------------
Unless you need something out-of-ordinary, please use the Rstudio available
via [Open OnDemand interface](https://ondemand.wahab.hpc.odu.edu).

@ -0,0 +1,23 @@
Cheatsheets from RStudio
========================
RStudio offers a lot of cheatsheets for various tools, methods.
Check them out here:
https://www.rstudio.com/resources/cheatsheets/
Some notable ones (samples):
* "Data visualization with ggplot2 cheatsheet"
https://raw.githubusercontent.com/rstudio/cheatsheets/main/data-visualization.pdf
* "Data transformation with dplyr cheatsheet"
https://raw.githubusercontent.com/rstudio/cheatsheets/main/data-transformation.pdf
* "Base R cheatsheet" (contributed, Mhairi McNeill)
https://raw.githubusercontent.com/rstudio/cheatsheets/main/base-r.pdf
http://github.com/rstudio/cheatsheets/blob/main/base-r.pdf
* "Advanced R cheatsheet" (contributed, Arianne Colton and Sean Chen)
https://www.rstudio.com/wp-content/uploads/2016/02/advancedR.pdf

@ -8,12 +8,24 @@ and our
as a quick-and-dirty, programmer-friendly, collaborative space for
storing knowledge, pointers, etc. to non-sensitive information
about research computing in general.
The target audience of this KB is our own staff (primarily)
and the students who are working with us.
Once certain bit of topic has crystallized and matured,
we can edit and polish the KB article to become a wiki
Documents in this space is meant to be rather quick and dirty,
allowing us to capture information & knowledge and somewhat organize them,
without being bogged down with tedious polishing.
Once a certain bit of topic has crystallized and matured,
we can edit and polish the KB article to become a wiki article
or Q&A.
NOTE:
WP started this KB as a personal project in 2019, but would like to invite all
other RCS staff to work together to create a library of our collective
knowledge.
**WARNING**:
* This KB is intended to store public and internal knowledge base that is
*NOT* confidential.
* Do not store sensitive information on this KB *at all*!

@ -0,0 +1,17 @@
Notes on Ansible Major Updates
==============================
Major Changes Between Versions
------------------------------
Version 2.7 --> 2.8
https://docs.ansible.com/ansible/latest/porting_guides/porting_guide_2.8.html
Version 2.6 --> 2.7
https://docs.ansible.com/ansible/latest/porting_guides/porting_guide_2.7.html
Version 2.5 --> 2.6
https://docs.ansible.com/ansible/latest/porting_guides/porting_guide_2.6.html
Version 2.4 --> 2.5
https://docs.ansible.com/ansible/latest/porting_guides/porting_guide_2.5.html

@ -0,0 +1,20 @@
Software & Data Carpentry Workshops Without Internet
====================================================
Problem statement:
* How can we run SWC / DC workshops in areas where internet access is
unreliable *or* non-existent?
"Running Software/Data and Library Carpentries workshops offline"
https://medium.com/newcastle-university-research-software-engineering/running-software-data-and-library-carpentries-workshops-offline-a583adf087ca
2022-06-27 - Janetta Steyn - Newcastle University Research Software Engineering
* Use Raspberry Pi (RPi 4 or RPi 400 ideally) as a web server to connect to & interact with.
Project:
* https://github.com/carpentriesoffline/CarpentriesOffline.github.io

@ -0,0 +1,22 @@
Lessons on Image Processing
===========================
"Image Processing with Python"
https://datacarpentry.org/image-processing/
A Data Carpentry lesson.
About the lesson:
> "This lesson shows how to use Python and skimage to do basic image
processing."
> "With this lesson, we aim to provide a thorough grounding in the
fundamental concepts and skills of working with image data in
Python. Most of the examples used in this lesson focus on one
particular class of image processing technique, morphometrics, but
what you will learn can be used to solve a much wider range of
problems."

@ -0,0 +1,19 @@
TrustedCI Framework
===================
What is TrustedCI Framework?
----------------------------
Adoption of TrustedCI Framework by NSF
--------------------------------------
2022-02-02
In December, NSF published its newly-renamed Research Infrastructure Guide (RIG)
(f.k.a. Major Facilities Guide).
This publication included substantial updates to its cybersecurity content,
and increased alignment to the Trusted CI Framework.
Check out our blog post to learn more:
https://blog.trustedci.org/2022/02/nsf-publishes-new-research.html

@ -0,0 +1,20 @@
Troubleshooting TensorFlow / KERAS GPU Process
==============================================
Common issues:
* Model too big
(print the KERAS model---is the number of parameters doable with the GPU?)
* Batch size too large
* Memory not released from previous processing
(use `with tf.Session() as sess:` code block)

@ -0,0 +1,21 @@
Running Windows OS in VM under Linux
====================================
[20220405]
"Convert your Windows install into a VM on Linux"
https://opensource.com/article/21/1/virtualbox-windows-linux
2021-01-21 - David Both
> "Here's how I configured a VirtualBox VM to use a physical Windows
drive on my Linux workstation."
Major steps:
* Backup the existing install
* Configure virtualbox
* UNlock the Windows drive
* Reactivating Windows? -- buy $$$?
Loading…
Cancel
Save