Feature Exploration/Learning

YouTube ... Quora ...Google search ...Google News ...Bing News

• Data Science ... Governance ... Preprocessing ... Exploration ... Interoperability ... Master Data Management (MDM) ... Bias and Variances ... Benchmarks ... Datasets
• Data Quality ...validity, accuracy, cleaning, completeness, consistency, encoding, padding, augmentation, labeling, auto-tagging, normalization, standardization, and imbalanced data
• Evaluating Machine Learning Models
• Artificial General Intelligence (AGI) to Singularity ... Curious Reasoning ... Emergence ... Moonshots ... Explainable AI ... Automated Learning
• Recursive Feature Elimination (RFE)
• Principal Component Analysis (PCA)
• Representation Learning
• Managed Vocabularies
• Excel ... Documents ... Database; Vector & Relational ... Graph ... LlamaIndex
• Analytics ... Visualization ... Graphical Tools ... Diagrams & Business Analysis ... Requirements ... Loop ... Bayes ... Network Pattern
• Development ... Notebooks ... AI Pair Programming ... Codeless, Generators, Drag n' Drop ... AIOps/MLOps ... AIaaS/MLaaS
• Feature selection | Wikipedia
• Notes on Feature Preprocessing: The What, the Why, and the How | Matthew Mayo - KDnuggets
• Feature Engineering and Selection: A Practical Approach for Predictive Models | Max Kuhn and Kjell Johnson
• Jon Tupitza's Famous Jupyter Notebooks:
  • Parametric Tests: Tests Designed for Normally-Distributed Data
    • Exploratory Data Analysis - Univariate
  • Non-Parametric Tests: Tests Designed for Data That's Not Normally-Distributed
    • Exploratory Data Analysis - Bivariate
  • Exploratory Data Analysis - Correlation
  • Feature Selection Techniques
• AI Governance / Algorithm Administration
• Tools:
  • What’s Your Project? | Qubole
  • From Messy Files To Automated Analytics | Trifacta
  • Accelerate discovery with a collaborative platform | Databricks
  • The Data Prep for AI Toolkit: Smarter ML Models Through Faster, More Accurate Data Prep | Paxata
  • The Age of The Badass Analyst | Alteryx

A feature is an individual measurable property or characteristic of a phenomenon being observed. The concept of a “feature” is related to that of an explanatory variable, which is used in statistical techniques such as linear regression. Feature vectors combine all of the features for a single row into a numerical vector. Part of the art of choosing features is to pick a minimum set of independent variables that explain the problem. If two variables are highly correlated, either they need to be combined into a single feature, or one should be dropped. Sometimes people perform principal component analysis to convert correlated variables into a set of linearly uncorrelated variables. Some of the transformations that people use to construct new features or reduce the dimensionality of feature vectors are simple. For example, subtract Year of Birth from Year of Death and you construct Age at Death, which is a prime independent variable for lifetime and mortality analysis. In other cases, feature construction may not be so obvious. Machine learning algorithms explained | Martin Heller - InfoWorld

Feature Examples

For example, if you were building a machine learning model to predict whether someone would like a particular movie, you might use features like the person's age, gender, and favorite genres of movies. You might also use features about the movie itself, such as the genre, director, and rating. Features are important because they allow machine learning models to learn about the world. By providing models with features, we can teach them to identify patterns and make predictions.

Here is an example of a feature in AI that a 7th grader might understand:

Imagine you are building a machine learning model to predict whether a student will pass or fail a math test. You might use the following features:

• The student's grades on previous math tests
• The student's attendance record in math class
• The student's homework completion rate
• The student's score on the math portion of the standardized test

Your machine learning model would learn to identify patterns in this data. For example, the model might learn that students who have high grades on previous math tests and good attendance are more likely to pass the test. The model could also learn that students who miss a lot of class or have incomplete homework are more likely to fail the test. Once your machine learning model is trained, you can use it to predict whether a new student is likely to pass or fail the math test. You can do this by providing the model with the student's features, such as their grades on previous math tests and their attendance record. The model will then use this information to make a prediction.

Feature Store

A feature store in AI is a system for managing and serving features to machine learning models. Features are measurable pieces of data that can be used to train and evaluate models. Feature stores provide a central repository for features, making them easier to discover, reuse, and manage. Feature stores are important because they can help to improve the quality, efficiency, and scalability of machine learning development and deployment. For example, feature stores can help to:

• Reduce the time and effort required to develop and maintain machine learning models
• Improve the performance and accuracy of machine learning models
• Make machine learning models more reproducible and scalable
• Ensure that machine learning models are using consistent and up-to-date data

• FEAST: is a feature store that is open-source and cloud-native. It is designed to be scalable and performant, and it can be deployed on a variety of cloud platforms. FEAST provides a number of features, including:

• A central repository for features, with support for versioning and lineage tracking
• A variety of data processing and transformation capabilities
• A low-latency serving API for online inference
• A batch API for offline training and batch predictions

• FeatureBase: is a commercial feature store that is offered by Google Cloud. It is designed to be easy to use and manage, and it provides a number of features, including:

• A central repository for features, with support for versioning and lineage tracking
• Automatic feature discovery and generation
• A low-latency serving API for online inference
• A batch API for offline training and batch predictions

• feathr: is a commercial feature store that is offered by Amazon Web Services (AWS). It is designed to be scalable and performant, and it provides a number of features, including:

• A central repository for features, with support for versioning and lineage tracking
• Automatic feature generation and transformation
• A low-latency serving API for online inference
• A batch API for offline training and batch predictions

How each fits:

• FEAST is a good choice for organizations that want a flexible and scalable feature store that they can deploy and manage on their own.
• FeatureBase is a good choice for organizations that want a feature store that is easy to use and manage, and that provides integration with Google Cloud Platform services.
• feathr is a good choice for organizations that want a feature store that is scalable and performant, and that provides integration with Amazon Web Services (AWS) services.

AI Explained: Feature Importance Fiddler Labs Learn more about feature importance, the different techniques, and the pros and cons of each. #ExplainableAI

Visualize your Data with Facets In this episode of AI Adventures, Yufeng explains how to use Facets, a project from Google Research, to visualize your dataset, find interesting relationships, and clean your data for machine learning. Learn more through our hands-on labs → https://goo.gle/38ZUlTD Associated Medium post "Visualize your data with Facets": https://goo.gl/7FDWwk Get Facets on GitHub: https://goo.gl/Xi8dTu Play with Facets in the browser: https://goo.gl/fFLCEV Watch more AI Adventures on the playlist: https://goo.gl/UC5usG Subscribe to get all the episodes as they come out: https://goo.gl/S0AS51 #AIAdventures

Stephen Elston - Data Visualization and Exploration with Python Visualization is an essential method in any data scientist’s toolbox and is a key data exploration method and is a powerful tool for presentation of results and understanding problems with analytics. Attendees are introduced to Python visualization packages, Matplotlib, Pandas, and Seaborn. The Jupyter notebook Visualization of complex real-world datasets presents a number of challenges to data scientists. By developing skills in data visualization, data scientists can confidently explore and understand the relationships in complex data sets. Using the Python matplotlib, pandas plotting and seaborn packages attendees will learn to: • Explore complex data sets with visualization, to develop understanding of the inherent relationships. • Create multiple views of data to highlight different aspects of the inherent relationships, with different graph types. • Use plot aesthetics to project multiple dimensions. • Apply conditioning or faceting methods to project multiple dimensions www.pydata.org

The Best Way to Visualize a Dataset Easily Siraj Raval In this video, we'll visualize a dataset of body metrics collected by giving people a fitness tracking device. We'll go over the steps necessary to preprocess the data, then use a technique called T-SNE to reduce the dimensionality of our data so we can visualize it.

Feature Selection

YouTube search... ...Google search

• Beginner's Guide to Feature Selection in Python | Sayak Paul ...Learn about the basics of feature selection and how to implement and investigate various feature selection techniques in Python
• Feature Selection For Machine Learning in Python | Jason Brownlee
• How to Perform Feature Selection with Categorical Data | Jason Brownlee

Pre-Modeling: Data Preprocessing and Feature Exploration in Python April Chen Data preprocessing and feature exploration are crucial steps in a modeling workflow. In this tutorial, I will demonstrate how to use Python libraries such as scikit-learn, statsmodels, and matplotlib to perform pre-modeling steps. Topics that will be covered include: missing values, variable types, outlier detection, multicollinearity, interaction terms, and visualizing variable distributions. Finally, I will show the impact of utilizing these techniques on model performance. Interactive Jupyter notebooks will be provided.

Recent Advances in Feature Selection: A Data Perspective part 1 Authors: Huan Liu, Department of Computer Science and Engineering, Arizona State University Jundong Li, School of Computing, Informatics and Decision Systems Engineering, Arizona State University Jiliang Tang, Department of Computer Science and Engineering, Michigan State University Feature selection, as a data preprocessing strategy, is imperative in preparing high-dimensional data for myriad of data mining and machine learning tasks. By selecting a subset of features of high quality, feature selection can help build simpler and more comprehensive models, improve data mining performance, and prepare clean and understandable data. The proliferation of big data in recent years has presented substantial challenges and opportunities for feature selection research. In this tutorial, we provide a comprehensive overview of recent advances in feature selection research from a data perspective. After we introduce some basic concepts, we review state-of-the-art feature selection algorithms and recent techniques of feature selection for structured, social, heterogeneous, and streaming data. In particular, we also discuss what the role of feature selection is in the context of deep learning and how feature selection is related to feature engineering. To facilitate and promote the research in this community, we present an open-source feature selection repository scikit-feature that consists of most of the popular feature selection algorithms. We conclude our discussion with some open problems and pressing issues in future research.

Alexandru Agachi - Introductory tutorial on data exploration and statistical models This tutorial will focus on analyzing a dataset and building statistical models from it. We will describe and visualize the data. We will then build and analyze statistical models, including linear and logistic regression, as well as chi-square tests of independence. We will then apply 4 machine learning techniques to the dataset: decision trees, random forests, lasso regression, and clustering. I would be happy to conduct an introductory level tutorial on exploring a dataset with the pandas/StatsModels/scikit-learn framework: 1. Descriptive statistics. Here we will describe each variable depending on its type, as well as the dataset overall. 2. Visualization for categorical and quantitative variables. We will learn effective visualization techniques for each type of variable in the dataset. 3. Statistical modeling for quantitative and categorical, explanatory and response variables: chi-square tests of independence, linear regression and logistic regression. We will learn to test hypotheses, and to interpret our models, their strengths, and their limitations. 4. I will then expand to the application of machine learning techniques, including decision trees, random forests, lasso regression, and clustering. Here we will explore the advantages and disadvantages of each of these techniques, as well as apply them to the dataset. This would be a very applied, introductory tutorial, to the statistical exploration of a dataset and the building of statistical models from it. I would be happy to send you the ipython notebook for this tutorial as well. www.pydata.org

Feature Selection in Machine learning| Variable selection| Dimension Reduction Feature selection is an important step in machine learning model building process. The performance of models depends in the following : Choice of algorithm Feature Selection

How do I select features for Machine Learning? Selecting the "best" features for your Machine Learning model will result in a better performing, easier to understand, and faster running model. But how do you know which features to select? In this video, I'll discuss 7 feature selection tactics used by the pros that you can apply to your own model. At the end, I'll give you my top 3 tips for effective feature selection.

Sparse Coding - Feature Extraction

Neural networks [8.1] : Sparse coding - definition Hugo Larochelle

Neural networks [8.8] : Sparse coding - feature extraction Hugo Larochelle