Browse Source

add machine learning doc updates

master
Charles Reid 4 years ago
parent
commit
71ee0122cf
  1. 73
      MachineLearning.md
  2. 53
      TODOMachineLearning.md
  3. 165
      TODOSoftwareEngineering.md

73
MachineLearning.md

@ -11,7 +11,78 @@ Topics to review so you don't get weeded out.
### Machine Learning: The Full Topics List
A longer, fuller list of topics:
List of topics focusing on theoretical components:
* Supervised Learning
* VC Dimension
* PAC Learning
* Noise
* Regression
* Model Selection
* Dimensions
* Bayesian Decision Theory
* Classification
* Losses and Risks
* Discriminant Functions
* Utility Theory
* Association Rules
* Parametric Models
* Maximum Likelihood Estimation
* Building Estimators
* Bayes Estimator
* Parametric Classification
* Regression
* Tuning Model Complexity
* Model Selection
* Multivariate Methods
* Multivariate Data
* Parameter Estimation
* Missing Values
* Multivariate Normal
* Multivariate Classificaiton
* Tuning Complexity
* Discrete Features
* Multivariate Regression
* Dimensionality Reduction
* Subset Selection
* PCA
* Factor Analysis
* Multidimensional Scaling
* LDA
* Isomapl
* Local Linear Embedding
* Clustering
* Mixture Densities
* k-Means
* Expectation Maximization Algorithm
* Mixtures of Latent Variables
* Supervised Learning after Clustering
* Hierarchical Clustering
* Numbers of Clusters
* Nonparametric Methods
* Decision Trees
* Lienar iscrimination
* Miultilyaer Perceptrons
* Local Models
* Kernel Machines
* Bayesian Estimation
* Hidden Markov Models
* Graphical Models
* Combining Multiple Learners
* Reinforcement Learning
* Design and Analysis of Machine Learning Experiments
A long and full list of types of models under each sub-heading:
* Regression
* **Modeling relationship between variables, iteratively refined using an error measure.**

53
TODOMachineLearning.md

@ -1,12 +1,55 @@
## TODO Machine Learning
Have 1 repo, with a github pages.
### Notes on what goes where
Machine learning practice code goes in a cs/machine-learning repo.
* Code focused principally on concepts in machine learning,
* Code uses scikit-learn and other external libraries
* Fundamental algorithms go in the Python/respective language repo
Repo has a copy on Github, with an HTML landing page. Or, complements circe.
* HTML landing page with info about each topic.
* Notebook for each overarching topic.
* Split into multiple notebooks as needed.
* Example might be, notebook to compare ridge and lasso.
### TODO List
[ ] Bayes Decision Theory
- 05/25
- Books:
- Alpaydin Introduction to Machine Learning
- Wiki notes:
* Dimensionality Reduction
* Regression
* Regularization
* Classification
* Clustering
* Bayesian
* Decision Theory
* Decision Trees
* Association Rules
* Neural Networks
* Deep Learning
HTML landing page with info about each topic.
Notebook for each overarching topic,
split into multiple notebooks as needed.
For exmaple, a notebook to compare ridge and lasso.
- [ ] Regression: linear regression
- [ ] Regression: logistic regression

165
TODOSoftwareEngineering.md

@ -2,6 +2,10 @@
### TODO List
### Data Structures
---
[X] Algorithm complexity and big-oh notation
- 05/26, 05/27
- Books:
@ -16,6 +20,8 @@
- [https://charlesreid1.com:3000/cs/java/src/master/algorithm_complexity](https://charlesreid1.com:3000/cs/java/src/master/algorithm_complexity)
- [https://charlesreid1.com:3000/cs/python/src/master/algorithm_complexity](https://charlesreid1.com:3000/cs/python/src/master/algorithm_complexity)
---
[X] Arrays and Array-Based Sequences: Python
- 05/28, 05/29
- Books:
@ -27,6 +33,8 @@
- Code:
- [https://charlesreid1.com:3000/cs/python/src/master/arrays](https://charlesreid1.com:3000/cs/python/src/master/arrays)
---
[X] Stacks and Queues: Python
- 05/29
- Books:
@ -37,97 +45,134 @@
- Code:
- [https://charlesreid1.com:3000/cs/python/src/master/stacks-queues-deques/](https://charlesreid1.com:3000/cs/python/src/master/stacks-queues-deques/)
---
[ ] Linked lists: Python
[ ] Arrays and Array-Based Sequences: Java
[X] Arrays and Array-Based Sequences: Java
- 05/29, 05/30
- Books:
- Goodrich et al: Data Structures and Algorithms in Java
- Wiki notes:
- [https://charlesreid1.com/wiki/Arrays/Java](https://charlesreid1.com/wiki/Arrays/Java)
- [https://charlesreid1.com/wiki/Arrays](https://charlesreid1.com/wiki/Arrays)
- Review of arrays
- algorithmic complexity
- basic syntax, arrays utility class
- random arrays
- Python list class
- Code:
- [https://charlesreid1.com:3000/cs/java/src/master/arrays](https://charlesreid1.com:3000/cs/java/src/master/arrays)
---
[ ] Stacks and Queues: Java
[ ] Linked lists: Python
[ ] Linked lists: Java
[ ] Hash tables
[ ] Trees: binary search trees
[ ] Trees: heap trees
[ ] Trees: priority queues
[ ] Trees: balanced search trees
[ ] trees: red black trees
[ ] Trees: tree traversal
[ ] Graphs: directed and undirected
[ ] Graphs: graph <--> adjacency matrix/list
[ ] Graphs: BFS, DFS
### Algorithms
[ ] Algorithms: NP, NP-Complete, Approximation
[ ] Algorithms: Recursion
[ ] Search Algorithms
[ ] Search Algorithms: Sequential search
[ ] Search Algorithms: Binary search
[ ] Sort Algorithms
[ ] Algorithms: Selection sort
[ ] Algorithms: Merge sort
[ ] Algorithms: Quick sort
[ ] Algorithms: Heap sort
[ ] String algorithms
[ ] Algorithms: Substring search
[ ] Graph algorithms
[ ] Tree algorithms
[ ] Dynamic programming algorithms
[ ] Geometry algorithms
[ ] Algorithms: Convex hull
[ ] Algorithms: Computational geometry
### Object Oriented Programming
[ ] Object oriented programming
[ ] Object oriented design: basics
[ ] Object oriented design: inheritance diagrams
[ ] Object oriented design: polymorphism
[ ] Object oriented design: design patterns
[ ] Stacks and Queues: Java
### Mathematics
[ ] Bits and Bytes
[ ] Mathematics: Combinatorics
[ ] Mathematics: Probability
[ ] Mathematics: Linear Algebra (computational)
[ ] Mathematics: FFT
- [ ] Hash tables
- [ ] Trees: binary search trees
- [ ] Trees: heap trees
- [ ] Trees: priority queues
- [ ] Trees: balanced search trees
- [ ] trees: red black trees
- [ ] Trees: tree traversal
### Applied
- [ ] Graphs: directed and undirected
- [ ] Graphs: graph <--> adjacency matrix/list
- [ ] Graphs: BFS, DFS
[ ] Systems: Processing and Threads
[ ] Systems: Caching
[ ] Systems: Memory
[ ] Systems: System routines
[ ] Systems: Messaging systems
[ ] Systems: Serialization
[ ] Systems: Queue systems
- [ ] Algorithms: NP, NP-Complete, Approximation
- [ ] Search Algorithms: Sequential search
- [ ] Search Algorithms: Binary search
- [ ] Algorithms: Selection sort
- [ ] Algorithms: Merge sort
- [ ] Algorithms: Quick sort
- [ ] Algorithms: Heap sort
- [ ] Algorithms: String search methods
- [ ] Algorithms: Recursion
- [ ] Algorithms: Dynamic programming
- [ ] Algorithms: Convex hull
- [ ] Algorithms: Computational geometry
[ ] Scaling: Systems design
[ ] Scaling: Scalability
[ ] Scaling: Data handling
- [ ] Object oriented design: basics
- [ ] Object oriented design: inheritance diagrams
- [ ] Object oriented design: polymorphism
- [ ] Object oriented design: design patterns
- [ ] Bits and Bytes
- [ ] Mathematics: Combinatorics
- [ ] Mathematics: Probability
- [ ] Mathematics: Linear Algebra (computational)
- [ ] Mathematics: FFT
### Security
- [ ] Systems: Processing and Threads
- [ ] Systems: Caching
- [ ] Systems: Memory
- [ ] Systems: System routines
- [ ] Systems: Messaging systems
- [ ] Systems: Serialization
- [ ] Systems: Queue systems
[ ] Crypto Security: Information Theory
[ ] Crypto Security: Parity and Hamming Code
[ ] Crypto Security: Entropy
[ ] Crypto Security: Birthday/Hash Attacks
[ ] Crypto Security: Public Key Cryptography Math
- [ ] Scaling: Systems design
- [ ] Scaling: Scalability
- [ ] Scaling: Data handling
- [ ] Parallel programming: Basic concepts/algorithms
- [ ] Crypto Security: Information Theory
- [ ] Crypto Security: Parity and Hamming Code
- [ ] Crypto Security: Entropy
- [ ] Crypto Security: Birthday/Hash Attacks
- [ ] Crypto Security: Public Key Cryptography Math
### HPC/Supplemental
[ ] Supplemental: Unicode
[ ] Supplemental: Garbage Collection
[ ] Supplemental: Networking
[ ] Supplemental: Compilers
[ ] Supplemental: Compression
[ ] Supplemental: Endianness
- [ ] Supplemental: Unicode
- [ ] Supplemental: Garbage Collection
- [ ] Supplemental: Networking
- [ ] Supplemental: Compilers
- [ ] Supplemental: Compression
- [ ] Supplemental: Endianness
[ ] Parallel programming: Basic concepts/algorithms

Loading…
Cancel
Save