Posts

Showing posts with the label Wikimania

downloading folders from google drive.

I wanted to download some course material on RL shared by the author via Google drive using the command line.  I got a bunch of stuff using wget a folder in google drive was a challenge. I looked it up in SO which gave me a hint but no solution. I installed gdown using pip and then used: gdown --folder --continue https://drive.google.com/drive/folders/1V9jAShWpccLvByv5S1DuOzo6GVvzd4LV if there are more than 50 files you need to use --remaining-ok and only get the first 50. In such a case its best to download using the folder using the UI and decompress locally. Decompressing from the command line created errors related to unicode but using the mac UI I decompressed without a glitch.
Post a Comment
Read more

Wikimania 2016

Image
Wikimania Goes Outdoors  (please never again) Thanks to the kind support of Wikimedia Israel, I attended Wikimania 2016 in the alpine village of  Esino Lario located in the Lombardy region of northen Italy. I was also able to attend the Hackathon event.  Compared to other Wikimedia conferences which I have attended this was a challenging event. The Wikimedia foundation has undergone a management crisis with the result of staff leaving in droves. For this Wikimania, the number of scholarships for staff has been restricted so attendance by staff developers was much less with many development teams not being represented.  This has had two outcomes one is that it is unclear what is being developed by WMF these days but the upside is that community projects and developers got more emphasis. The Kiwix Ecosystem Kiwix - the offline wikipedia reader Two such projects are Kiwix and the " community wishlist ". Kiwix is the brainc...
Post a Comment
Read more

Wikisym & Wikimania I 2013

Image
education (image credit: Sean MacEntee ) Thanks to a generous grant by MW.IL and WMF I was able to attend the 2013 Wikisym/Open Sim 2013 which took place at the Cyberport in Hong Kong.  I will not be going into details about all the conference session as I and others will be covering it in detail in Wikimedia's research newsletter syndicated in English  Wikipedia 's signpost as well as on meta.  Goals I came to wikisym 2013 to demo some new technology aimed at supporting educators and their students during formative assessments . Specifically I have developed a number of metrics to assess student activity on wiki.  Cyberport-cinema (Photo credit: Wikipedia ) I had written a draft of a paper covering the subject, but since I am more of a developer  than an educator, I was somewhat at a loss to complete the paper before wikisym. My plan was in essence to: Reach out and locate other researchers and p...
Post a Comment
Read more

Popular posts from this blog

downloading folders from google drive.

I wanted to download some course material on RL shared by the author via Google drive using the command line.  I got a bunch of stuff using wget a folder in google drive was a challenge. I looked it up in SO which gave me a hint but no solution. I installed gdown using pip and then used: gdown --folder --continue https://drive.google.com/drive/folders/1V9jAShWpccLvByv5S1DuOzo6GVvzd4LV if there are more than 50 files you need to use --remaining-ok and only get the first 50. In such a case its best to download using the folder using the UI and decompress locally. Decompressing from the command line created errors related to unicode but using the mac UI I decompressed without a glitch.
Read more

Random Thoughts on Linear Regressions

Regression Analysis TLDR Regression is the oldest and most powerful tool in a data scientist's toolbox. Under ideal conditions multiple linear regression would be the best and only tool a data scientist would want to use... In reality you would use a modern nonparametric variant or a different algorithm. Still, the main ideas I . discuss here  will pop up in many other models and algorithms. This post is my brain dump on regression - I'll update it as time allows to cover the many aspects of this technique.
Read more

SQL - Selection v.s. Projection

Selection and projection are two high level processes taking place when SQL queries are executed. Selection is choosing some records (rows) from a table and leaving others out. e.g. rows having name='oren'. Projection is the choosing some columns from each record and leaving others out. e.g. only name. So the select keyword performs projection while the where and keyword performs selection. Clearly the choice of using the keyword select for projection (choosing columns) rather than choosing rows, is an unfortunate flaw in the design of SQL, but this oversight is too well established to be fixed.
Read more