downloading folders from google drive.

I wanted to download some course material on RL shared by the author via Google drive using the command line.  I got a bunch of stuff using wget a folder in google drive was a challenge. I looked it up in SO which gave me a hint but no solution. I installed gdown using pip and then used: gdown --folder --continue https://drive.google.com/drive/folders/1V9jAShWpccLvByv5S1DuOzo6GVvzd4LV if there are more than 50 files you need to use --remaining-ok and only get the first 50. In such a case its best to download using the folder using the UI and decompress locally. Decompressing from the command line created errors related to unicode but using the mac UI I decompressed without a glitch.
Post a Comment

Data Science Glossary - P

Page view
is an instance of a page being loaded (or reloaded) in a browser.
Panel data
another name for longitudinal data collected, generally in the context of market research over time. (See also cohort analysis).
Persona
a market research technique used by web site or mobile app developers to model customer needs. Archetypes and segmentation are similar techniques which allow market researchers and ui/ux designers to explore clients based on typical representation or an idiosyncratic one.
PII
an acronym for Personally Identifying Information
Web property
is either a web site or an application
PCA
is an acronym for principal component analysis. It is a dimensionality reduction method in multivariate statistics that can be used to extract the principal components which are the  most important linearly uncorrelated dimensions of in a possibly linearly correlated dataset. PCA is often employed in exploratory data analysis and to create predictive models.
PCM
is an acronym for Pay per Click Model in advertising
Power
Statistical Power is the ability in Statical Inference of an experiment to detect the effect when an effect exists
Processing
is the component of the Google Analytics platform that organizes raw data into users and sessions, adds data from other sources, and applies configuration settings to transform the raw data into database tables for reporting.
Property
is a sub-component of a Google Analytics account that determines which data is organized and stored together. Any resource tagged with the same Property ID is collected and stored together. A single property can be used to track one website or mobile app, or be a roll-up of the data from multiple sites or mobile apps.
Propensity score matching
also called PSM, is a matching procedure technique, developed by Paul Rosenbaum and Donald Rubin in 1983 and used in econometrics to analyse experiments in which some subjects are given treatment whose effect is being measured. Ideally in these experiments the groups are randomised. However PSM can help to correct a bias that is often introduced when the groups is self selected as might happen in an observational study.  The matching procedure can be one of  (nearest neighbor, caliper matching, mahalanobis metric matching, stratification matching, difference-in-differences matching and exact matching) is used to select a subsample of the data point for which to test the hypothesis. An important issue with PSM is that since it makes the control more similar to the tested group it can increase bias in latent (unobserved) variables called confounders which will adversely affect the results of the analysis. 

Comments

Post a Comment

Popular posts from this blog

Moodle <=< Mediawiki SUL integration - first thoughts

Image
SUL is  Wikipedia's  Single User Login system The goal is to use it to authenticate moodle users there is one caveat - what happen if  the moodle user has no account. Moodle and MediaWiki account creation require different information. Since we'd like to use MediaWiki's standard which is highly permissive. It is necessary to change  moodle's requirements. Challenges Moodle does not explicitly define an object for setting registration requirements.  This needs to be accomplished by admins via edit a number of files manually.  errors will place the users in a limbo/blocked state... This is implemented differently on different version of moodle. This will break if the changes are overwritten by a system is upgrade. Directions Ideally Moodle should have a registration policy  object which allows the admin to define which fields are required and if they need to be unique . For example Moodle complains if different users share an email adr
Read more

downloading folders from google drive.

I wanted to download some course material on RL shared by the author via Google drive using the command line.  I got a bunch of stuff using wget a folder in google drive was a challenge. I looked it up in SO which gave me a hint but no solution. I installed gdown using pip and then used: gdown --folder --continue https://drive.google.com/drive/folders/1V9jAShWpccLvByv5S1DuOzo6GVvzd4LV if there are more than 50 files you need to use --remaining-ok and only get the first 50. In such a case its best to download using the folder using the UI and decompress locally. Decompressing from the command line created errors related to unicode but using the mac UI I decompressed without a glitch.
Read more

Insight into progressive web apps

Image
Some notes from a Meetup on PWAs in January 2016. I feel quite knowledgable on PWA but I wanted to learn more on implementing service worker. I ended up adding some research and collecting some great resources. However I ended up getting more detailed materials on the service worker based on google's developers docs. Also the resources have been expanded. https://www.meetup.com/The-Future-is-Javascript/events/246346861/ Service worker Service Workers Its just a simple JavaScript file that sits between you and the network – It runs in another thread – It has no access to DOM – It intercepts every network request (including cross domain) Entry point: self.caches (in service worker) or window.caches (on page)   Registering a Service Worker • Works with promises • Re-registration works fine In main.js navigator.serviceWorker.register('/sw.js').then(function(reg){ console.log('regsitered'); }.cat
Read more