Over time, my research has led me to pick up plenty of useful coding tricks. Quite often, I stumble upon powerful tools that are more frequently used by engineers, developers, and data scientists. I've documented all these learnings and now, I'm gradually turning them into blog posts. My hope is that by sharing these insights, you might find that mastering these tools becomes a less time-consuming task. Think of this blog as a way of passing the baton, from my research to your hands.
This blog is intended as a practical guide to highlight these tools. It could benefit fellow researchers in the field of economics, social sciences, or anyone interested in expanding their toolkit.
Your input makes a real difference — I warmly welcome any suggestions or feedback you might have. Don't hesitate to drop me an email. The methods and tips I've shared offer tested solutions that have proven successful in my experience, yet they represent but a handful of the vast array of strategies available. We're on a collective journey of continual learning and improvement — a journey I'm humbly a part of, just like you.
Lastly, a quick note, I try to keep my posts current. So, the date you see on each post reflects the most recent update. Keep exploring, and happy coding!
Overwiew Vim is a highly configurable text editor renowned for its efficiency and power. It’s built to enable efficient text editing, making it a popular choice for developers and system administrators.
In this post, I put the commands that I use the most, but I also recommend this interactive Vim tutorial
Open Vim To open vim, simply type the following in the command-line
vim <path/to/file> where <path/to/file> can be the path of any text-based file.
Regular expressions (regex) are powerful string matching tools that use pattern-matching techniques for complex searching and manipulating. They occur across many programming languages, but also dominate command-line text-processing tools such as sed and awk in Unix-like systems.
What are Regular Expressions? Regular expressions are a sequence of characters representing a search pattern. This pattern can be used within string searching algorithms to “find” or “find and …
You can submit scripts to run in Roar collab. Each script is called a job and you submit a job by providing a batch script to the SLURM scheduler. This script contains the resource specifications that your program needs to run.
Step 1: Create a job submit script. Below is an example of such file, called job_submit.sh.
#!/bin/bash #SBATCH --nodes=1 #SBATCH --cpus-per-task=4 #SBATCH --time=1:00:00 #SBATCH --mem=1GB #SBATCH --job-name=job_test #SBATCH --output=output_%j.log #SBATCH …
What are SSH keys SSH keys are a pair of cryptographic keys that enable secure, password-less remote access to servers and other systems.
Amplifying Workflow with SSH Authentication SSH authentication serves as a significant enhancer of your research workflow when working with High Performance Computing (HPC) resources. It paves the way for smooth file transfers between your local computer and the server straight from terminal, eradicating the need for repeated password input.
What is the Command Line? The command line, also known as a terminal or a shell, is a text-based interface that allows you to interact directly with your computer’s operating system. It enables you to instruct your computer explicitly what tasks to perform.
High Performance Computing (HPC) This direct contact becomes essential when working with high-performance computing (HPC) clusters, such as Roar Collab. Although Roar Collab operates on Red Hat Enterprise Linux 8 and may sometimes allow …
Overview Roar Collab is Penn State’s High-Performance Computing (HPC) Cluster. In this post, I will lay out the basic tools needed to use it.
Here, I assume:
You have already created an account and have access. Otherwise, follow the official documentation for instructions. Basic knowledge on Linux and using the comand line/bash shell. If not, check “Command Line Basics”. For the remainder of this tutorial, I will refer to Roar Collab as Rcollab.