Posts

Showing posts from May, 2019

nvidia-smi: Control Your GPUs

Most users know how to check the status of their CPUs, see how much system memory is free, or find out how much disk space is free. In contrast, keeping tabs on the health and status of GPUs has historically been more difficult. If you don’t know where to look, it can even be difficult to determine the type and capabilities of the GPUs in a system. Thankfully, NVIDIA’s latest hardware and software tools have made good improvements in this respect. The tool is NVIDIA’s System Management Interface ( nvidia-smi ). Depending on the generation of your card, various levels of information can be gathered. Additionally, GPU configuration options (such as ECC memory capability) may be enabled and disabled. As an aside, if you find that you’re having trouble getting your NVIDIA GPUs to run GPGPU code, nvidia-smi can be handy. For example, on some systems the proper NVIDIA devices in /dev are not created at boot. Running a simple nvidia-smi query as root will initialize all the c...

Github update - wrongly committed large file.

I added a large file to a git repository (102Mb), commited and push and got an error due to size limit limitations on github remote: error: GH001: Large files detected. You may want to try Git Large File Storage - https://git-lfs.github.com. remote: error: Trace: 7d51855d4f834a90c5a5a526e93d2668 remote: error: See http://git.io/iEPt8g for more information. remote: error: File coverage/sensitivity/simulated.bed is 102.00 MB; this exceeds GitHub's file size limit of 100.00 MB 1 2 3 4 remote : error : GH001 : Large files detected . You may want to try Git Large File Storage - https : / / git - lfs .github .com . remote : error : Trace : 7d51855d4f834a90c5a5a526e93d2668 remote : error : See http : / / git .io / iEPt8g for more information . remote : error : File coverage / sensitivity / simulated .bed is 102.00 MB ; this exceeds GitHub ' s file size limit of 100.00 MB Her...

How to download very large file from Google Drive?

Here are step-by-step instructions to download a file from Google Drive using the command line API if the file is shared privately and needs authentication. Get the file ID: Go to your Google Drive in your browser. Right-click (or control-click) the file you want to download and click “Get shareable link”. The link looks like this: https : //drive.google.com/open?id=XXXXX . Make note of the file ID “XXXXX”; you will be needing it below. Get an OAuth token: Go to OAuth 2.0 Playground In the “Select the Scope” box, scroll down, expand “Drive API v3”, and select https : //www.googleapis.com/auth/drive.readonly Click “Authorize APIs” and then “Exchange authorization code for tokens”. Copy the “Access token”; you will be needing it below. Download the file from the command line: If using OS X or Linux, open the “Terminal” program and enter the following command. curl - H "Authorization: Bearer YYYYY"   https : //www.googleapis.com/drive/v3/files/XXXXX?a...