AIP-210 CertNexus Certified Artificial Intelligence Practitioner (CAIP) Question and Answers

Weighted class is a technique to rebalance a dataset by assigning different weights to each class, according to their frequency in the dataset. The weights are inversely proportional to the class frequency, meaning that rare classes have higher weights and common classes have lower weights. This helps to reduce the bias towards the majority class and improve the model performance on the minority class. References: 4. Data Validation - Building Machine Learning Pipelines, A guide to React design patterns - LogRocket Blog

Personas are fictional characters that represent the potential users or customers of an ML system. Personas can help understand the needs, goals, preferences, and behaviors of the target audience, as well as design and evaluate the system from their perspective. Some of the techniques that are used to build personas in the ML development lifecycle are:

• Population estimates: Population estimates are statistical methods that estimate the size, characteristics, and distribution of a population based on a sample or a census. Population estimates can help identify and quantify the potential market segments and user groups for an ML system, as well as their demographics, locations, and behaviors.
• Population triage: Population triage is a process of prioritizing and selecting the most relevant and representative personas for an ML system based on some criteria or metrics. Population triage can help focus on the key user needs and scenarios, as well as avoid creating too many or too few personas.

Word2vec is a word embedding method that finds characteristics of words in a very large number of documents. Word embedding is a technique that converts words into numerical vectors that represent their meaning, usage, or context. Word2vec learns a dense and continuous vector representation for each word based on its context in a large corpus of text. Word2vec can capture the semantic and syntactic similarity and relationships among words, such as synonyms, antonyms, analogies, or associations1.

Text vectorization is a technique that converts text into numerical vectors that can be used by machine learning models. Text vectorization can use different methods to represent text features, such as word frequency, word order, word meaning, or word context. Some of the common text vectorization methods are:

• TF-IDF: TF-IDF (term frequency-inverse document frequency) is a method that assigns a weight to each word based on its frequency in a document and its rarity across a collection of documents. TF-IDF can capture the importance and relevance of words for a given topic or domain, but it does not consider the order or meaning of words.
• Word2vec: Word2vec is a method that learns a vector representation for each word based on its context in a large corpus of text. Word2vec can capture the semantic and syntactic similarity and relationships among words, as well as preserve the order of words.

For an English-to-Spanish translation machine, using Word2vec would be appropriate and correctly defined, because in translation machines, we need to consider the order of the words, as well as their meaning and context.

Neural network models are suitable for classification problems with a large number of features, because they can learn complex and non-linear patterns from high-dimensional data. They can also handle image data, which is likely to be the input for the human face detection problem. Neural networks can also be trained using transfer learning, which can leverage pre-trained models on similar tasks and improve the accuracy and efficiency of the model. References: [Neural network - Wikipedia], [Transfer Learning - Machine Learning’s Next Frontier]

Emergent bias is a type of bias that arises when an AI model encounters new or different data or scenarios that were not present or accounted for during its training or development. Emergent bias can cause the model to make inaccurate or unfair predictions or decisions, as it may not be able to generalize well to new situations or adapt to changing conditions. One possible cause of emergent bias is seasonality, which means that some variables or patterns in the data may vary depending on the time of year. For example, if an AI model for merchandise sales prediction was trained in winter and applied in summer, it may produce biased results due to differences in customer behavior, demand, or preferences.

Lasso regression and ridge regression are both types of linear regression models that can handle high-dimensional and categorical data. They use regularization techniques to reduce the complexity of the model and avoid overfitting. Lasso regression uses L1 regularization, which adds a penalty term proportional to the absolute value of the coefficients to the loss function. This can shrink some coefficients to zero and perform feature selection. Ridge regression uses L2 regularization, which adds a penalty term proportional to the square of the coefficients to the loss function. This can shrink all coefficients towards zero and reduce multicollinearity. References: [Lasso (statistics) - Wikipedia], [Ridge regression - Wikipedia]

Missing values are a common problem in data analysis and machine learning, as they can affect the quality and reliability of the data and the model. There are various methods to deal with missing values, such as deleting, imputing, or ignoring them. One of the most common methods is imputing, which means replacing the missing values with some estimated values based on some criteria. For continuous variables, one of the simplest and most widely used imputation methods is to fill in the missing values with the mean (average) of the observed values for that variable in the entire dataset. This method can preserve the overall distribution and variance of the data, as well as avoid introducing bias or noise.

Lasso regression is a type of linear regression that adds a regularization term to the loss function to reduce overfitting and improve generalization. Lasso regression uses an L1 norm as the regularization term, which is the sum of the absolute values of the coefficients. Lasso regression can shrink some of the coefficients to zero, which effectively eliminates some of the features from the model. Lasso regression is preferable over ridge regression when there are many features with no association with the dependent variable, as it can perform feature selection and reduce the complexity and noise of the model.

Technical debt is a metaphor that describes the implied cost of additional work or rework caused by choosing an easy or quick solution over a better but more complex solution. Technical debt can accumulate in ML systems due to various factors, such as changing requirements, outdated code, poor documentation, or lack of testing. Some of the ways to decrease technical debt in ML systems are:

• Documentation readability: Documentation readability refers to how easy it is to understand and use the documentation of an ML system. Documentation readability can help reduce technical debt by providing clear and consistent information about the system’s design, functionality, performance, and maintenance. Documentation readability can also facilitate communication and collaboration among different stakeholders, such as developers, testers, users, and managers.
• Refactoring: Refactoring is the process of improving the structure and quality of code without changing its functionality. Refactoring can help reduce technical debt by eliminating code smells, such as duplication, complexity, or inconsistency. Refactoring can also enhance the readability, maintainability, and extensibility of code.

Data lineage is the process of tracking the origin, transformation, and usage of data throughout its lifecycle. It helps to ensure data quality, integrity, and provenance. Data lineage also supports the Privacy by Design methodology, which is a framework that aims to embed privacy principles into the design and operation of systems, processes, and products that involve personal data. By understanding, documenting, and displaying data lineage, an ML system can demonstrate how it collects, processes, stores, and deletes personal data in a transparent and accountable manner3 .

Entanglement in ML pipelines occurs when a change in one step affects other steps that depend on it. Changing the normalization function in the feature engineering step would affect the model training and evaluation steps, as they rely on the features generated by the feature engineering step. Therefore, this scenario is an example of entanglement in ML pipelines. The other scenarios are not examples of entanglement, as they do not affect other steps in the pipeline.

The final stage of the data management life cycle is data destruction, which is the process of securely deleting or erasing data that is no longer needed or relevant for the organization. Data destruction ensures that data is disposed of in compliance with any legal or regulatory requirements, as well as any internal policies or standards. Data destruction also protects the organization from potential data breaches, leaks, or thefts that could compromise its privacy and security. Data destruction can be performed using various methods, such as overwriting, degaussing, shredding, or incinerating

An activation function is a function that determines the output of a neuron in a neural network based on its input. An activation function can introduce non-linearity into a neural network, which allows it to model complex and non-linear relationships between inputs and outputs. Some of the common activation functions are:

• Sigmoid: A sigmoid function is a function that maps any real value to a value between 0 and 1. It has an S-shaped curve and is often used for binary classification or probability estimation.
• Hyperbolic tangent: A hyperbolic tangent function is a function that maps any real value to a value between -1 and 1. It has a similar shape to the sigmoid function but is symmetric around the origin. It is often used for regression or classification problems.
• ReLU: A ReLU (rectified linear unit) function is a function that maps any negative value to 0 and any positive value to itself. It has a piecewise linear shape and is often used for hidden layers in deep neural networks.

Additive is not an activation function, but rather a term that describes a property of some functions. Additive functions are functions that satisfy the condition f(x+y) = f(x) + f(y) for any x and y. Additive functions are linear functions, which means they have a constant slope and do not introduce non-linearity.

SVM models can use kernel functions to map the input data into higher-dimensional feature spaces, where linear separation is possible. This allows SVM models to handle non-linear problems effectively. References: CertNexus Certified Artificial Intelligence Practitioner, Support vector machine - Wikipedia

When concept drift is detected in the pipeline, it means that the model performance has degraded over time due to changes in the underlying data generating process. This requires retraining the model with new data that reflects the current situation and updating the model parameters accordingly. References: Use pipeline parameters to retrain models in the designer - Azure Machine Learning | Microsoft Learn, Retraining Model During Deployment: Continuous Training and Continuous Testing

Reinforcement learning is a type of machine learning that involves learning from trial and error based on rewards and penalties. Reinforcement learning can be used to develop models for dynamic pathing, which is the problem of finding an optimal path from one point to another in an uncertain and changing environment. Reinforcement learning can enable the model to adapt to new situations and learn from its own actions and feedback. For example, a self-driving car company can use reinforcement learning to train its model to navigate complex traffic scenarios and avoid collisions .

To calculate the minimum grade needed to achieve an 80% average, we can use the following formula:

minimum grade = (target average * number of tests - sum of grades) / (number of tests - 1)

Plugging in the given values, we get:

minimum grade = (80 * 7 - (76 + 81 + 78 + 87 + 75 + 72)) / (7 - 6)

minimum grade = (560 - 469) / 1

minimum grade = 91

Therefore, the student needs to score at least 91 on the last test to get an 80% average.

Semi-supervised learning is a type of machine learning that uses both labeled and unlabeled data to train a model. Semi-supervised learning can be useful when:

• Labeling data is challenging and expensive: Labeling data requires human intervention and domain expertise, which can be costly and time-consuming. Semi-supervised learning can leverage the large amount of unlabeled data that is easier and cheaper to obtain and use it to improve the model’s performance.
• There is a large amount of unlabeled data to be used for predictions: Unlabeled data can provide additional information and diversity to the model, which can help it learn more complex patterns and generalize better to new data. Semi-supervised learning can use various techniques, such as self-training, co-training, or generative models, to incorporate unlabeled data into the learning process.

Word embedding is a task in natural language processing (NLP) where words are converted into numerical vectors that represent their meaning, usage, or context. Word embedding can help reduce the dimensionality and sparsity of text data, as well as enable various operations and comparisons among words based on their vector representations. Some of the common methods for word embedding are:

• One-hot encoding: One-hot encoding is a method that assigns a unique binary vector to each word in a vocabulary. The vector has only one element with a value of 1 (the hot bit) and the rest with a value of 0. One-hot encoding can create distinct and orthogonal vectors for each word, but it does not capture any semantic or syntactic information about words.
• Word2vec: Word2vec is a method that learns a dense and continuous vector representation for each word based on its context in a large corpus of text. Word2vec can capture the semantic and syntactic similarity and relationships among words, such as synonyms, antonyms, analogies, or associations.
• GloVe: GloVe (Global Vectors for Word Representation) is a method that combines the advantages of count-based methods (such as TF-IDF) and predictive methods (such as Word2vec) to create word vectors. GloVe can leverage both global and local information from a large corpus of text to capture the co-occurrence patterns and probabilities of words.

Adversarial attacks are malicious attempts to fool or manipulate machine learning models by adding small perturbations to the input data that are imperceptible to humans but can cause significant changes in the model output. In general, models that perform their tasks more accurately are less robust against adversarial attacks, because they tend to have higher confidence in their predictions and are more sensitive to small changes in the input data. References: [Adversarial machine learning - Wikipedia], [Why Are Machine Learning Models Susceptible to Adversarial Attacks? | by Anirudh Jain | Towards Data Science]

Data privacy is the right of individuals to control how their personal data is collected, used, shared, and protected. It also involves complying with relevant laws and regulations that govern the handling of personal data. Data privacy is especially important when extracting business intelligence from primary data captured from the public, as it may contain sensitive or confidential information that could harm the individuals if misused or breached .

A type 1 error in statistical hypothesis testing is when the null hypothesis is true, but is rejected. This means that the test falsely concludes that there is a significant difference or effect when there is none. The probability of making a type 1 error is denoted by alpha, which is also known as the significance level of the test. A type 1 error can be reduced by choosing a smaller alpha value, but this may increase the chance of making a type 2 error, which is when the null hypothesis is false but fails to be rejected. References: [Type I and type II errors - Wikipedia], [Type I Error and Type II Error - Statistics How To]